Duckietown Challenges Home Challenges Submissions

Submission 1701

Submission1701
Competingyes
Challengeaido-LFP-full-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16644 sim-1of4: 16643 sim-2of4: 16674 sim-3of4: 16642
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16674sim-2of4successyes0:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203998040440715
deviation-center-line_median4.904463356399461


other stats
deviation-center-line_max4.904463356399461
deviation-center-line_mean4.904463356399461
deviation-center-line_min4.904463356399461
deviation-heading_max7.745124858723169
deviation-heading_mean7.745124858723169
deviation-heading_median7.745124858723169
deviation-heading_min7.745124858723169
distance-from-start_max1.2059816832534165
distance-from-start_mean1.2059816832534165
distance-from-start_median1.2059816832534165
distance-from-start_min1.2059816832534165
driven_any_max3.485084016236962
driven_any_mean3.485084016236962
driven_any_median3.485084016236962
driven_any_min3.485084016236962
driven_lanedir_consec_max1.4203998040440715
driven_lanedir_consec_mean1.4203998040440715
driven_lanedir_consec_min1.4203998040440715
driven_lanedir_max3.2905050472289954
driven_lanedir_mean3.2905050472289954
driven_lanedir_median3.2905050472289954
driven_lanedir_min3.2905050472289954
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16671sim-2of4timeoutyes----No reset possible
16664sim-2of4host-erroryes0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16660sim-2of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16657sim-2of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16651sim-2of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16645sim-2of4timeoutyes----No reset possible
16644sim-0of4successyes0:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.200000000000223
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.3557424143249113
deviation-center-line_median2.2764052687353016


other stats
deviation-center-line_max2.2764052687353016
deviation-center-line_mean2.2764052687353016
deviation-center-line_min2.2764052687353016
deviation-heading_max2.9201829757406066
deviation-heading_mean2.9201829757406066
deviation-heading_median2.9201829757406066
deviation-heading_min2.9201829757406066
distance-from-start_max1.1340032910142968
distance-from-start_mean1.1340032910142968
distance-from-start_median1.1340032910142968
distance-from-start_min1.1340032910142968
driven_any_max1.4165963270662665
driven_any_mean1.4165963270662665
driven_any_median1.4165963270662665
driven_any_min1.4165963270662665
driven_lanedir_consec_max1.3557424143249113
driven_lanedir_consec_mean1.3557424143249113
driven_lanedir_consec_min1.3557424143249113
driven_lanedir_max1.3557424143249113
driven_lanedir_mean1.3557424143249113
driven_lanedir_median1.3557424143249113
driven_lanedir_min1.3557424143249113
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean25.200000000000223
survival_time_min25.200000000000223
No reset possible
16643sim-1of4successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
16642sim-3of4successyes0:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.599999999999376
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.1822085786120473
deviation-center-line_median4.281969506383752


other stats
deviation-center-line_max4.281969506383752
deviation-center-line_mean4.281969506383752
deviation-center-line_min4.281969506383752
deviation-heading_max8.956926170181262
deviation-heading_mean8.956926170181262
deviation-heading_median8.956926170181262
deviation-heading_min8.956926170181262
distance-from-start_max1.84932503046977
distance-from-start_mean1.84932503046977
distance-from-start_median1.84932503046977
distance-from-start_min1.84932503046977
driven_any_max2.760582128240964
driven_any_mean2.760582128240964
driven_any_median2.760582128240964
driven_any_min2.760582128240964
driven_lanedir_consec_max2.1822085786120473
driven_lanedir_consec_mean2.1822085786120473
driven_lanedir_consec_min2.1822085786120473
driven_lanedir_max2.5502818256429407
driven_lanedir_mean2.5502818256429407
driven_lanedir_median2.5502818256429407
driven_lanedir_min2.5502818256429407
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed1
survival_time_max48.599999999999376
survival_time_mean48.599999999999376
survival_time_min48.599999999999376
No reset possible