Duckietown Challenges Home Challenges Submissions

Submission 1702

Submission1702
Competingyes
Challengeaido-LFV-full-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16686 sim-1of4: 16639 sim-2of4: 16637 sim-3of4: 16640
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16686sim-0of4successyes0:12:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0918531760676333
deviation-center-line_median5.910477685795049


other stats
deviation-center-line_max5.910477685795049
deviation-center-line_mean5.910477685795049
deviation-center-line_min5.910477685795049
deviation-heading_max8.289002671411088
deviation-heading_mean8.289002671411088
deviation-heading_median8.289002671411088
deviation-heading_min8.289002671411088
distance-from-start_max1.0313532441319608
distance-from-start_mean1.0313532441319608
distance-from-start_median1.0313532441319608
distance-from-start_min1.0313532441319608
driven_any_max3.4490819978293596
driven_any_mean3.4490819978293596
driven_any_median3.4490819978293596
driven_any_min3.4490819978293596
driven_lanedir_consec_max2.0918531760676333
driven_lanedir_consec_mean2.0918531760676333
driven_lanedir_consec_min2.0918531760676333
driven_lanedir_max3.2042238074943747
driven_lanedir_mean3.2042238074943747
driven_lanedir_median3.2042238074943747
driven_lanedir_min3.2042238074943747
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.4490819978293596, "survival_time": 59.99999999999873, "driven_lanedir": 3.2042238074943747, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.289002671411088, "distance-from-start": 1.0313532441319608, "deviation-center-line": 5.910477685795049, "driven_lanedir_consec": 2.0918531760676333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16677sim-0of4timeoutyes----No reset possible
16666sim-0of4timeoutyes----No reset possible
16663sim-0of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16655sim-0of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16654sim-0of4host-erroryes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16641sim-0of4timeoutyes----No reset possible
16640sim-3of4successyes0:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0916627020116696
deviation-center-line_median5.917247386091067


other stats
deviation-center-line_max5.917247386091067
deviation-center-line_mean5.917247386091067
deviation-center-line_min5.917247386091067
deviation-heading_max8.389432171221175
deviation-heading_mean8.389432171221175
deviation-heading_median8.389432171221175
deviation-heading_min8.389432171221175
distance-from-start_max1.030783298044124
distance-from-start_mean1.030783298044124
distance-from-start_median1.030783298044124
distance-from-start_min1.030783298044124
driven_any_max3.449081983725078
driven_any_mean3.449081983725078
driven_any_median3.449081983725078
driven_any_min3.449081983725078
driven_lanedir_consec_max2.0916627020116696
driven_lanedir_consec_mean2.0916627020116696
driven_lanedir_consec_min2.0916627020116696
driven_lanedir_max3.204014012014441
driven_lanedir_mean3.204014012014441
driven_lanedir_median3.204014012014441
driven_lanedir_min3.204014012014441
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.449081983725078, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014012014441, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432171221175, "distance-from-start": 1.030783298044124, "deviation-center-line": 5.917247386091067, "driven_lanedir_consec": 2.0916627020116696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16639sim-1of4successyes0:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.381630870892481
deviation-center-line_median6.662994790807998


other stats
deviation-center-line_max6.662994790807998
deviation-center-line_mean6.662994790807998
deviation-center-line_min6.662994790807998
deviation-heading_max5.427561246722322
deviation-heading_mean5.427561246722322
deviation-heading_median5.427561246722322
deviation-heading_min5.427561246722322
distance-from-start_max2.1860021307337045
distance-from-start_mean2.1860021307337045
distance-from-start_median2.1860021307337045
distance-from-start_min2.1860021307337045
driven_any_max3.509092323425108
driven_any_mean3.509092323425108
driven_any_median3.509092323425108
driven_any_min3.509092323425108
driven_lanedir_consec_max3.381630870892481
driven_lanedir_consec_mean3.381630870892481
driven_lanedir_consec_min3.381630870892481
driven_lanedir_max3.381630870892481
driven_lanedir_mean3.381630870892481
driven_lanedir_median3.381630870892481
driven_lanedir_min3.381630870892481
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"loop-000-ego0": {"driven_any": 3.509092323425108, "survival_time": 59.99999999999873, "driven_lanedir": 3.381630870892481, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.427561246722322, "distance-from-start": 2.1860021307337045, "deviation-center-line": 6.662994790807998, "driven_lanedir_consec": 3.381630870892481}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16637sim-2of4successyes0:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091626784820886
deviation-center-line_median5.917240573756968


other stats
deviation-center-line_max5.917240573756968
deviation-center-line_mean5.917240573756968
deviation-center-line_min5.917240573756968
deviation-heading_max8.389433025698892
deviation-heading_mean8.389433025698892
deviation-heading_median8.389433025698892
deviation-heading_min8.389433025698892
distance-from-start_max1.0307831250305386
distance-from-start_mean1.0307831250305386
distance-from-start_median1.0307831250305386
distance-from-start_min1.0307831250305386
driven_any_max3.4490819837243656
driven_any_mean3.4490819837243656
driven_any_median3.4490819837243656
driven_any_min3.4490819837243656
driven_lanedir_consec_max2.091626784820886
driven_lanedir_consec_mean2.091626784820886
driven_lanedir_consec_min2.091626784820886
driven_lanedir_max3.203992280226659
driven_lanedir_mean3.203992280226659
driven_lanedir_median3.203992280226659
driven_lanedir_min3.203992280226659
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible