Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 16669
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-0of4 host-error yes davinci-stage-02-6.2.51
2022-11-28 17:05:57+00:00 2022-11-28 17:05:58+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16667
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-0of3 host-error yes davinci-stage-02-6.2.51
2022-11-28 17:05:36+00:00 2022-11-28 17:05:37+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16660
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 host-error yes davinci-stage-02-6.2.51
2022-11-28 17:05:10+00:00 2022-11-28 17:05:11+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16659
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-2of3 host-error yes davinci-stage-02-6.2.51
2022-11-28 17:04:58+00:00 2022-11-28 17:04:58+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16654
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 host-error yes davinci-stage-02-6.2.51
2022-11-28 17:04:24+00:00 2022-11-28 17:04:25+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16646
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-0of4 timeout yes davinci-stage-02-6.2.51
2022-11-28 03:09:00+00:00 - - - - No reset possible 16639
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:57:13+00:00 2022-11-28 03:08:42+00:00 0:11:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.3499999999998664 driven_lanedir_consec_median 3.381630870892481 deviation-center-line_median 6.662994790807998
other stats deviation-center-line_max 6.662994790807998 deviation-center-line_mean 6.662994790807998 deviation-center-line_min 6.662994790807998 deviation-heading_max 5.427561246722322 deviation-heading_mean 5.427561246722322 deviation-heading_median 5.427561246722322 deviation-heading_min 5.427561246722322 distance-from-start_max 2.1860021307337045 distance-from-start_mean 2.1860021307337045 distance-from-start_median 2.1860021307337045 distance-from-start_min 2.1860021307337045 driven_any_max 3.509092323425108 driven_any_mean 3.509092323425108 driven_any_median 3.509092323425108 driven_any_min 3.509092323425108 driven_lanedir_consec_max 3.381630870892481 driven_lanedir_consec_mean 3.381630870892481 driven_lanedir_consec_min 3.381630870892481 driven_lanedir_max 3.381630870892481 driven_lanedir_mean 3.381630870892481 driven_lanedir_median 3.381630870892481 driven_lanedir_min 3.381630870892481 in-drivable-lane_max 2.3499999999998664 in-drivable-lane_mean 2.3499999999998664 in-drivable-lane_min 2.3499999999998664 per-episodes details {"loop-000-ego0": {"driven_any": 3.509092323425108, "survival_time": 59.99999999999873, "driven_lanedir": 3.381630870892481, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.427561246722322, "distance-from-start": 2.1860021307337045, "deviation-center-line": 6.662994790807998, "driven_lanedir_consec": 3.381630870892481}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16636
1703
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:54:27+00:00 2022-11-28 02:57:04+00:00 0:02:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16635
1703
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:52:21+00:00 2022-11-28 02:54:20+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16632
1704
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:43:34+00:00 2022-11-28 02:51:47+00:00 0:08:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.3499999999998806 driven_lanedir_consec_median 2.380620752906845 deviation-center-line_median 6.078324583568444
other stats deviation-center-line_max 6.569878400409913 deviation-center-line_mean 6.078324583568444 deviation-center-line_min 5.586770766726975 deviation-heading_max 8.265181027759835 deviation-heading_mean 7.317539588112885 deviation-heading_median 7.317539588112885 deviation-heading_min 6.369898148465933 distance-from-start_max 1.63164181697012 distance-from-start_mean 1.433389926870248 distance-from-start_median 1.433389926870248 distance-from-start_min 1.235138036770376 driven_any_max 3.486583615924898 driven_any_mean 3.479150650070676 driven_any_median 3.479150650070676 driven_any_min 3.471717684216453 driven_lanedir_consec_max 3.28796749924175 driven_lanedir_consec_mean 2.380620752906845 driven_lanedir_consec_min 1.4732740065719407 driven_lanedir_max 3.288000588512179 driven_lanedir_mean 3.287984043876964 driven_lanedir_median 3.287984043876964 driven_lanedir_min 3.28796749924175 in-drivable-lane_max 3.5999999999997954 in-drivable-lane_mean 3.3499999999998806 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.471717684216453, "survival_time": 59.99999999999873, "driven_lanedir": 3.28796749924175, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.369898148465933, "distance-from-start": 1.63164181697012, "deviation-center-line": 6.569878400409913, "driven_lanedir_consec": 3.28796749924175}, "loop2-000-ego1": {"driven_any": 3.486583615924898, "survival_time": 59.99999999999873, "driven_lanedir": 3.288000588512179, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181027759835, "distance-from-start": 1.235138036770376, "deviation-center-line": 5.586770766726975, "driven_lanedir_consec": 1.4732740065719407}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16627
1851
Andrea Daniele lx22-visservoing lx22-visservoing
sim success yes davinci-stage-02-6.2.51
2022-11-28 02:33:41+00:00 2022-11-28 02:43:18+00:00 0:09:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 0.0 deviation-center-line_median 0.8225235361321219 driven_lanedir_consec_median 6.210365877428675 survival_time_median 59.99999999999873
other stats deviation-center-line_max 0.946101532818657 deviation-center-line_mean 0.8225235361321219 deviation-center-line_min 0.6989455394455867 deviation-heading_max 5.2568622547369825 deviation-heading_mean 5.099791914834237 deviation-heading_median 5.099791914834237 deviation-heading_min 4.942721574931492 distance-from-start_max 1.5761171586244858 distance-from-start_mean 1.349664745259861 distance-from-start_median 1.349664745259861 distance-from-start_min 1.123212331895236 driven_any_max 6.2483350050366 driven_any_mean 6.245748072006569 driven_any_median 6.245748072006569 driven_any_min 6.2431611389765385 driven_lanedir_consec_max 6.21650692419253 driven_lanedir_consec_mean 6.210365877428675 driven_lanedir_consec_min 6.204224830664819 driven_lanedir_max 6.21650692419253 driven_lanedir_mean 6.210365877428675 driven_lanedir_median 6.210365877428675 driven_lanedir_min 6.204224830664819 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 6.2483350050366, "survival_time": 59.99999999999873, "driven_lanedir": 6.21650692419253, "in-drivable-lane": 0.0, "deviation-heading": 4.942721574931492, "distance-from-start": 1.123212331895236, "deviation-center-line": 0.6989455394455867, "driven_lanedir_consec": 6.21650692419253}, "LF-small-loop-001-ego0": {"driven_any": 6.2431611389765385, "survival_time": 59.99999999999873, "driven_lanedir": 6.204224830664819, "in-drivable-lane": 0.0, "deviation-heading": 5.2568622547369825, "distance-from-start": 1.5761171586244858, "deviation-center-line": 0.946101532818657, "driven_lanedir_consec": 6.204224830664819}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16622
1706
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:29:24+00:00 2022-11-28 02:33:24+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.14999999999957 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.6286605295435175 deviation-center-line_median 4.749421103903259
other stats deviation-center-line_max 4.749421103903259 deviation-center-line_mean 4.749421103903259 deviation-center-line_min 4.749421103903259 deviation-heading_max 3.0022009770680675 deviation-heading_mean 3.0022009770680675 deviation-heading_median 3.0022009770680675 deviation-heading_min 3.0022009770680675 distance-from-start_max 2.133910144488872 distance-from-start_mean 2.133910144488872 distance-from-start_median 2.133910144488872 distance-from-start_min 2.133910144488872 driven_any_max 2.6465975863112976 driven_any_mean 2.6465975863112976 driven_any_median 2.6465975863112976 driven_any_min 2.6465975863112976 driven_lanedir_consec_max 2.6286605295435175 driven_lanedir_consec_mean 2.6286605295435175 driven_lanedir_consec_min 2.6286605295435175 driven_lanedir_max 2.6286605295435175 driven_lanedir_mean 2.6286605295435175 driven_lanedir_median 2.6286605295435175 driven_lanedir_min 2.6286605295435175 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.6465975863112976, "survival_time": 45.14999999999957, "driven_lanedir": 2.6286605295435175, "in-drivable-lane": 0.0, "deviation-heading": 3.0022009770680675, "distance-from-start": 2.133910144488872, "deviation-center-line": 4.749421103903259, "driven_lanedir_consec": 2.6286605295435175}}simulation-passed 1 survival_time_max 45.14999999999957 survival_time_mean 45.14999999999957 survival_time_min 45.14999999999957
No reset possible 16621
1707
Bea Baselines 🐤minimal-agent-full aido-hello-sim-full-validation
sanity-check success yes davinci-stage-02-6.2.51
2022-11-28 02:27:23+00:00 2022-11-28 02:28:53+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.010100650259948551 deviation-center-line_median 0.006374430067497517
other stats deviation-center-line_max 0.006374430067497517 deviation-center-line_mean 0.006374430067497517 deviation-center-line_min 0.006374430067497517 deviation-heading_max 0.2614212407761817 deviation-heading_mean 0.2614212407761817 deviation-heading_median 0.2614212407761817 deviation-heading_min 0.2614212407761817 distance-from-start_max 0.011536496219628692 distance-from-start_mean 0.011536496219628692 distance-from-start_median 0.011536496219628692 distance-from-start_min 0.011536496219628692 driven_any_max 0.011538646402322758 driven_any_mean 0.011538646402322758 driven_any_median 0.011538646402322758 driven_any_min 0.011538646402322758 driven_lanedir_consec_max 0.010100650259948551 driven_lanedir_consec_mean 0.010100650259948551 driven_lanedir_consec_min 0.010100650259948551 driven_lanedir_max 0.010100650259948551 driven_lanedir_mean 0.010100650259948551 driven_lanedir_median 0.010100650259948551 driven_lanedir_min 0.010100650259948551 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.011538646402322758, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100650259948551, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628692, "deviation-center-line": 0.006374430067497517, "driven_lanedir_consec": 0.010100650259948551}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16616
1708
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:22:28+00:00 2022-11-28 02:26:56+00:00 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 1.3850760857666788 deviation-center-line_median 5.586765713943565
other stats deviation-center-line_max 5.586765713943565 deviation-center-line_mean 5.586765713943565 deviation-center-line_min 5.586765713943565 deviation-heading_max 8.627279155437556 deviation-heading_mean 8.627279155437556 deviation-heading_median 8.627279155437556 deviation-heading_min 8.627279155437556 distance-from-start_max 1.0494474660975028 distance-from-start_mean 1.0494474660975028 distance-from-start_median 1.0494474660975028 distance-from-start_min 1.0494474660975028 driven_any_max 3.449081931991406 driven_any_mean 3.449081931991406 driven_any_median 3.449081931991406 driven_any_min 3.449081931991406 driven_lanedir_consec_max 1.3850760857666788 driven_lanedir_consec_mean 1.3850760857666788 driven_lanedir_consec_min 1.3850760857666788 driven_lanedir_max 3.20200785319052 driven_lanedir_mean 3.20200785319052 driven_lanedir_median 3.20200785319052 driven_lanedir_min 3.20200785319052 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081931991406, "survival_time": 59.99999999999873, "driven_lanedir": 3.20200785319052, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279155437556, "distance-from-start": 1.0494474660975028, "deviation-center-line": 5.586765713943565, "driven_lanedir_consec": 1.3850760857666788}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16609
1710
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:12:14+00:00 2022-11-28 02:22:00+00:00 0:09:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.522558677891614 deviation-center-line_median 5.123208250925155
other stats deviation-center-line_max 7.953308842217784 deviation-center-line_mean 5.026103289778249 deviation-center-line_min 1.904687815044904 deviation-heading_max 7.817092400173712 deviation-heading_mean 5.15630723293663 deviation-heading_median 4.732874626105395 deviation-heading_min 3.3423872793620153 distance-from-start_max 2.224084223392078 distance-from-start_mean 1.372418883130667 distance-from-start_median 1.2029346346602598 distance-from-start_min 0.8597220398100703 driven_any_max 3.579587032303966 driven_any_mean 2.260716204012659 driven_any_median 1.9288422979916977 driven_any_min 1.605593187763276 driven_lanedir_consec_max 3.4576714425164017 driven_lanedir_consec_mean 1.8357601162686237 driven_lanedir_consec_min 0.8402516667748646 driven_lanedir_max 3.5592470379137566 driven_lanedir_mean 2.213681704953217 driven_lanedir_median 1.8578137794091545 driven_lanedir_min 1.5798522230808028 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.5125000000000073 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.6055966761902978, "survival_time": 59.99999999999873, "driven_lanedir": 1.5798522230808028, "in-drivable-lane": 0.0, "deviation-heading": 3.3423872793620153, "distance-from-start": 1.2287147051666274, "deviation-center-line": 7.953308842217784, "driven_lanedir_consec": 1.5798522230808028}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 2.252087919793097, "survival_time": 59.99999999999873, "driven_lanedir": 2.1195031205111157, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.702231952315873, "distance-from-start": 0.8597220398100703, "deviation-center-line": 6.865196295541358, "driven_lanedir_consec": 0.8402516667748646}, "udem-000-ego3": {"driven_any": 1.605593187763276, "survival_time": 59.99999999999873, "driven_lanedir": 1.5961244383071926, "in-drivable-lane": 0.0, "deviation-heading": 7.817092400173712, "distance-from-start": 1.1771545641538923, "deviation-center-line": 1.904687815044904, "driven_lanedir_consec": 1.465265132702425}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16605
1711
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:07:29+00:00 2022-11-28 02:11:50+00:00 0:04:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.85000000000009 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.8682838146430726 deviation-center-line_median 0.9280014701980372
other stats deviation-center-line_max 0.9280014701980372 deviation-center-line_mean 0.9280014701980372 deviation-center-line_min 0.9280014701980372 deviation-heading_max 2.313567244971171 deviation-heading_mean 2.313567244971171 deviation-heading_median 2.313567244971171 deviation-heading_min 2.313567244971171 distance-from-start_max 0.7827181653982369 distance-from-start_mean 0.7827181653982369 distance-from-start_median 0.7827181653982369 distance-from-start_min 0.7827181653982369 driven_any_max 0.888597530769245 driven_any_mean 0.888597530769245 driven_any_median 0.888597530769245 driven_any_min 0.888597530769245 driven_lanedir_consec_max 0.8682838146430726 driven_lanedir_consec_mean 0.8682838146430726 driven_lanedir_consec_min 0.8682838146430726 driven_lanedir_max 0.8682838146430726 driven_lanedir_mean 0.8682838146430726 driven_lanedir_median 0.8682838146430726 driven_lanedir_min 0.8682838146430726 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 0.888597530769245, "survival_time": 15.85000000000009, "driven_lanedir": 0.8682838146430726, "in-drivable-lane": 0.0, "deviation-heading": 2.313567244971171, "distance-from-start": 0.7827181653982369, "deviation-center-line": 0.9280014701980372, "driven_lanedir_consec": 0.8682838146430726}}simulation-passed 1 survival_time_max 15.85000000000009 survival_time_mean 15.85000000000009 survival_time_min 15.85000000000009
No reset possible 16598
1713
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 02:03:30+00:00 2022-11-28 02:07:21+00:00 0:03:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204028644018567 deviation-center-line_median 4.903598525098628
other stats deviation-center-line_max 4.903598525098628 deviation-center-line_mean 4.903598525098628 deviation-center-line_min 4.903598525098628 deviation-heading_max 7.744574599008731 deviation-heading_mean 7.744574599008731 deviation-heading_median 7.744574599008731 deviation-heading_min 7.744574599008731 distance-from-start_max 1.2060007868632094 distance-from-start_mean 1.2060007868632094 distance-from-start_median 1.2060007868632094 distance-from-start_min 1.2060007868632094 driven_any_max 3.485084017697367 driven_any_mean 3.485084017697367 driven_any_median 3.485084017697367 driven_any_min 3.485084017697367 driven_lanedir_consec_max 1.4204028644018567 driven_lanedir_consec_mean 1.4204028644018567 driven_lanedir_consec_min 1.4204028644018567 driven_lanedir_max 3.290525892781009 driven_lanedir_mean 3.290525892781009 driven_lanedir_median 3.290525892781009 driven_lanedir_min 3.290525892781009 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084017697367, "survival_time": 59.99999999999873, "driven_lanedir": 3.290525892781009, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574599008731, "distance-from-start": 1.2060007868632094, "deviation-center-line": 4.903598525098628, "driven_lanedir_consec": 1.4204028644018567}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16593
1714
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:58:44+00:00 2022-11-28 02:03:08+00:00 0:04:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.5026609949387937 deviation-center-line_median 4.00803286999595
other stats deviation-center-line_max 4.00803286999595 deviation-center-line_mean 4.00803286999595 deviation-center-line_min 4.00803286999595 deviation-heading_max 9.741722574045852 deviation-heading_mean 9.741722574045852 deviation-heading_median 9.741722574045852 deviation-heading_min 9.741722574045852 distance-from-start_max 3.051215295455992 distance-from-start_mean 3.051215295455992 distance-from-start_median 3.051215295455992 distance-from-start_min 3.051215295455992 driven_any_max 3.579590602174237 driven_any_mean 3.579590602174237 driven_any_median 3.579590602174237 driven_any_min 3.579590602174237 driven_lanedir_consec_max 3.5026609949387937 driven_lanedir_consec_mean 3.5026609949387937 driven_lanedir_consec_min 3.5026609949387937 driven_lanedir_max 3.5026609949387937 driven_lanedir_mean 3.5026609949387937 driven_lanedir_median 3.5026609949387937 driven_lanedir_min 3.5026609949387937 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.579590602174237, "survival_time": 59.99999999999873, "driven_lanedir": 3.5026609949387937, "in-drivable-lane": 0.0, "deviation-heading": 9.741722574045852, "distance-from-start": 3.051215295455992, "deviation-center-line": 4.00803286999595, "driven_lanedir_consec": 3.5026609949387937}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16587
1716
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:48:22+00:00 2022-11-28 01:58:37+00:00 0:10:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.04999999999999716 driven_lanedir_consec_median 3.105242381638413 deviation-center-line_median 4.2838554583648385
other stats deviation-center-line_max 6.480635029684861 deviation-center-line_mean 4.233458533023654 deviation-center-line_min 1.8854881856800791 deviation-heading_max 6.074433982916035 deviation-heading_mean 4.437287043141697 deviation-heading_median 4.190213879538641 deviation-heading_min 3.2942864305734707 distance-from-start_max 2.6219633070118125 distance-from-start_mean 2.3834433501492436 distance-from-start_median 2.3769915028957085 distance-from-start_min 2.157827087793745 driven_any_max 3.5765946322989515 driven_any_mean 3.229717557359504 driven_any_median 3.2158432856394445 driven_any_min 2.9105890258601756 driven_lanedir_consec_max 3.4606351955763963 driven_lanedir_consec_mean 3.0987684797264516 driven_lanedir_consec_min 2.723953960052584 driven_lanedir_max 3.5302995839808413 driven_lanedir_mean 3.1848735445261127 driven_lanedir_median 3.161506104690779 driven_lanedir_min 2.8861823847420505 in-drivable-lane_max 1.9499999999998892 in-drivable-lane_mean 0.5124999999999709 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.9105890258601756, "survival_time": 59.99999999999873, "driven_lanedir": 2.8861823847420505, "in-drivable-lane": 0.0, "deviation-heading": 6.074433982916035, "distance-from-start": 2.157827087793745, "deviation-center-line": 3.0576160910267776, "driven_lanedir_consec": 2.723953960052584}, "udem-000-ego1": {"driven_any": 3.521095053928605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4216564650122128, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2942864305734707, "distance-from-start": 2.6219633070118125, "deviation-center-line": 6.480635029684861, "driven_lanedir_consec": 3.4216564650122128}, "udem-000-ego2": {"driven_any": 2.9105915173502845, "survival_time": 59.99999999999873, "driven_lanedir": 2.9013557443693445, "in-drivable-lane": 0.0, "deviation-heading": 3.947864180395224, "distance-from-start": 2.395368409966694, "deviation-center-line": 1.8854881856800791, "driven_lanedir_consec": 2.7888282982646126}, "udem-000-ego3": {"driven_any": 3.5765946322989515, "survival_time": 59.99999999999873, "driven_lanedir": 3.5302995839808413, "in-drivable-lane": 0.09999999999999432, "deviation-heading": 4.432563578682058, "distance-from-start": 2.3586145958247235, "deviation-center-line": 5.5100948257029, "driven_lanedir_consec": 3.4606351955763963}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16584
1717
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:43:10+00:00 2022-11-28 01:47:54+00:00 0:04:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.100000000000193 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3040934355288318 deviation-center-line_median 1.289217129104995
other stats deviation-center-line_max 1.289217129104995 deviation-center-line_mean 1.289217129104995 deviation-center-line_min 1.289217129104995 deviation-heading_max 2.1907426992170524 deviation-heading_mean 2.1907426992170524 deviation-heading_median 2.1907426992170524 deviation-heading_min 2.1907426992170524 distance-from-start_max 1.2851043260193775 distance-from-start_mean 1.2851043260193775 distance-from-start_median 1.2851043260193775 distance-from-start_min 1.2851043260193775 driven_any_max 1.3235977943332726 driven_any_mean 1.3235977943332726 driven_any_median 1.3235977943332726 driven_any_min 1.3235977943332726 driven_lanedir_consec_max 1.3040934355288318 driven_lanedir_consec_mean 1.3040934355288318 driven_lanedir_consec_min 1.3040934355288318 driven_lanedir_max 1.3040934355288318 driven_lanedir_mean 1.3040934355288318 driven_lanedir_median 1.3040934355288318 driven_lanedir_min 1.3040934355288318 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 1.3235977943332726, "survival_time": 23.100000000000193, "driven_lanedir": 1.3040934355288318, "in-drivable-lane": 0.0, "deviation-heading": 2.1907426992170524, "distance-from-start": 1.2851043260193775, "deviation-center-line": 1.289217129104995, "driven_lanedir_consec": 1.3040934355288318}}simulation-passed 1 survival_time_max 23.100000000000193 survival_time_mean 23.100000000000193 survival_time_min 23.100000000000193
No reset possible 16577
1718
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:34:20+00:00 2022-11-28 01:42:48+00:00 0:08:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.174999999999917 driven_lanedir_consec_median 2.6226225453427174 deviation-center-line_median 5.3031846613240265
other stats deviation-center-line_max 5.816265976116539 deviation-center-line_mean 5.196634927837193 deviation-center-line_min 4.363904412584181 deviation-heading_max 13.510507170954757 deviation-heading_mean 10.821915690706016 deviation-heading_median 10.428621244524829 deviation-heading_min 8.919913102819658 distance-from-start_max 2.9580871089811698 distance-from-start_mean 2.332849013698153 distance-from-start_median 2.410604919303986 distance-from-start_min 1.55209910720347 driven_any_max 3.579590098610528 driven_any_mean 3.3933509000885236 driven_any_median 3.464904539716091 driven_any_min 3.064004422311384 driven_lanedir_consec_max 3.4992371353936753 driven_lanedir_consec_mean 2.597829668578795 driven_lanedir_consec_min 1.64683644823607 driven_lanedir_max 3.4992371353936753 driven_lanedir_mean 3.216224003341642 driven_lanedir_median 3.212923209015736 driven_lanedir_min 2.939812459941421 in-drivable-lane_max 4.299999999999949 in-drivable-lane_mean 2.162499999999946 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.579590098610528, "survival_time": 59.99999999999873, "driven_lanedir": 3.4992371353936753, "in-drivable-lane": 0.0, "deviation-heading": 8.919913102819658, "distance-from-start": 2.9580871089811698, "deviation-center-line": 4.363904412584181, "driven_lanedir_consec": 3.4992371353936753}, "zigzag-000-ego1": {"driven_any": 3.4790808241674496, "survival_time": 59.99999999999873, "driven_lanedir": 3.252574528929212, "in-drivable-lane": 3.3499999999998913, "deviation-heading": 10.055957232850009, "distance-from-start": 2.114012987076784, "deviation-center-line": 5.136572055912668, "driven_lanedir_consec": 2.305432630744014}, "zigzag-000-ego2": {"driven_any": 3.064004422311384, "survival_time": 59.99999999999873, "driven_lanedir": 2.939812459941421, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 13.510507170954757, "distance-from-start": 2.707196851531188, "deviation-center-line": 5.469797266735385, "driven_lanedir_consec": 2.939812459941421}, "zigzag-000-ego3": {"driven_any": 3.4507282552647327, "survival_time": 59.99999999999873, "driven_lanedir": 3.17327188910226, "in-drivable-lane": 4.299999999999949, "deviation-heading": 10.80128525619965, "distance-from-start": 1.55209910720347, "deviation-center-line": 5.816265976116539, "driven_lanedir_consec": 1.64683644823607}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16576
1719
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:31:41+00:00 2022-11-28 01:33:59+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.649999999999984 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.33188081358015475 deviation-center-line_median 0.20422121163305057
other stats deviation-center-line_max 0.20422121163305057 deviation-center-line_mean 0.20422121163305057 deviation-center-line_min 0.20422121163305057 deviation-heading_max 0.7151394802499836 deviation-heading_mean 0.7151394802499836 deviation-heading_median 0.7151394802499836 deviation-heading_min 0.7151394802499836 distance-from-start_max 0.33329338421304333 distance-from-start_mean 0.33329338421304333 distance-from-start_median 0.33329338421304333 distance-from-start_min 0.33329338421304333 driven_any_max 0.33659927688888963 driven_any_mean 0.33659927688888963 driven_any_median 0.33659927688888963 driven_any_min 0.33659927688888963 driven_lanedir_consec_max 0.33188081358015475 driven_lanedir_consec_mean 0.33188081358015475 driven_lanedir_consec_min 0.33188081358015475 driven_lanedir_max 0.33188081358015475 driven_lanedir_mean 0.33188081358015475 driven_lanedir_median 0.33188081358015475 driven_lanedir_min 0.33188081358015475 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.33659927688888963, "survival_time": 6.649999999999984, "driven_lanedir": 0.33188081358015475, "in-drivable-lane": 0.0, "deviation-heading": 0.7151394802499836, "distance-from-start": 0.33329338421304333, "deviation-center-line": 0.20422121163305057, "driven_lanedir_consec": 0.33188081358015475}}simulation-passed 1 survival_time_max 6.649999999999984 survival_time_mean 6.649999999999984 survival_time_min 6.649999999999984
No reset possible 16573
1719
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:26:04+00:00 2022-11-28 01:31:28+00:00 0:05:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.2655265789104 deviation-center-line_median 7.114511199103643
other stats deviation-center-line_max 7.114511199103643 deviation-center-line_mean 7.114511199103643 deviation-center-line_min 7.114511199103643 deviation-heading_max 5.702635580930089 deviation-heading_mean 5.702635580930089 deviation-heading_median 5.702635580930089 deviation-heading_min 5.702635580930089 distance-from-start_max 1.6303678440695035 distance-from-start_mean 1.6303678440695035 distance-from-start_median 1.6303678440695035 distance-from-start_min 1.6303678440695035 driven_any_max 3.466336917289666 driven_any_mean 3.466336917289666 driven_any_median 3.466336917289666 driven_any_min 3.466336917289666 driven_lanedir_consec_max 3.2655265789104 driven_lanedir_consec_mean 3.2655265789104 driven_lanedir_consec_min 3.2655265789104 driven_lanedir_max 3.2655265789104 driven_lanedir_mean 3.2655265789104 driven_lanedir_median 3.2655265789104 driven_lanedir_min 3.2655265789104 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16568
1721
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:22:29+00:00 2022-11-28 01:25:57+00:00 0:03:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.19999999999991 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 1.303336274368214 deviation-center-line_median 2.900740783049649
other stats deviation-center-line_max 2.900740783049649 deviation-center-line_mean 2.900740783049649 deviation-center-line_min 2.900740783049649 deviation-heading_max 5.3959193297072545 deviation-heading_mean 5.3959193297072545 deviation-heading_median 5.3959193297072545 deviation-heading_min 5.3959193297072545 distance-from-start_max 1.390965508634873 distance-from-start_mean 1.390965508634873 distance-from-start_median 1.390965508634873 distance-from-start_min 1.390965508634873 driven_any_max 2.2295876463781625 driven_any_mean 2.2295876463781625 driven_any_median 2.2295876463781625 driven_any_min 2.2295876463781625 driven_lanedir_consec_max 1.303336274368214 driven_lanedir_consec_mean 1.303336274368214 driven_lanedir_consec_min 1.303336274368214 driven_lanedir_max 2.097514770609055 driven_lanedir_mean 2.097514770609055 driven_lanedir_median 2.097514770609055 driven_lanedir_min 2.097514770609055 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 2.2295876463781625, "survival_time": 39.19999999999991, "driven_lanedir": 2.097514770609055, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.3959193297072545, "distance-from-start": 1.390965508634873, "deviation-center-line": 2.900740783049649, "driven_lanedir_consec": 1.303336274368214}}simulation-passed 1 survival_time_max 39.19999999999991 survival_time_mean 39.19999999999991 survival_time_min 39.19999999999991
No reset possible 16562
1723
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:18:56+00:00 2022-11-28 01:22:01+00:00 0:03:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.099999999999983 in-drivable-lane_median 5.649999999999983 driven_lanedir_consec_median 0.1397956002040246 deviation-center-line_median 0.09390664341773942
other stats deviation-center-line_max 0.09390664341773942 deviation-center-line_mean 0.09390664341773942 deviation-center-line_min 0.09390664341773942 deviation-heading_max 0.9654183287874442 deviation-heading_mean 0.9654183287874442 deviation-heading_median 0.9654183287874442 deviation-heading_min 0.9654183287874442 distance-from-start_max 1.0016247187181055 distance-from-start_mean 1.0016247187181055 distance-from-start_median 1.0016247187181055 distance-from-start_min 1.0016247187181055 driven_any_max 1.0016732136326914 driven_any_mean 1.0016732136326914 driven_any_median 1.0016732136326914 driven_any_min 1.0016732136326914 driven_lanedir_consec_max 0.1397956002040246 driven_lanedir_consec_mean 0.1397956002040246 driven_lanedir_consec_min 0.1397956002040246 driven_lanedir_max 0.1397956002040246 driven_lanedir_mean 0.1397956002040246 driven_lanedir_median 0.1397956002040246 driven_lanedir_min 0.1397956002040246 in-drivable-lane_max 5.649999999999983 in-drivable-lane_mean 5.649999999999983 in-drivable-lane_min 5.649999999999983 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}simulation-passed 1 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 16559
1724
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:16:48+00:00 2022-11-28 01:18:23+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16554
1725
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:14:52+00:00 2022-11-28 01:16:42+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2999999999999963 in-drivable-lane_median 1.5499999999999954 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.12567511082985364
other stats deviation-center-line_max 0.12567511082985364 deviation-center-line_mean 0.12567511082985364 deviation-center-line_min 0.12567511082985364 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.3731007861754618 distance-from-start_mean 0.3731007861754618 distance-from-start_median 0.3731007861754618 distance-from-start_min 0.3731007861754618 driven_any_max 0.37310743381811584 driven_any_mean 0.37310743381811584 driven_any_median 0.37310743381811584 driven_any_min 0.37310743381811584 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 1.5499999999999954 in-drivable-lane_mean 1.5499999999999954 in-drivable-lane_min 1.5499999999999954 per-episodes details {"4way-000-ego0": {"driven_any": 0.37310743381811584, "survival_time": 3.2999999999999963, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 1.5499999999999954, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3731007861754618, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 3.2999999999999963 survival_time_mean 3.2999999999999963 survival_time_min 3.2999999999999963
No reset possible 16550
1726
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:12:59+00:00 2022-11-28 01:14:38+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1969489134232345 survival_time_median 10.450000000000014 deviation-center-line_median 0.1253905781126274 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.1253905781126274 deviation-center-line_mean 0.1253905781126274 deviation-center-line_min 0.1253905781126274 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 1.5508236376562057 distance-from-start_mean 1.5508236376562057 distance-from-start_median 1.5508236376562057 distance-from-start_min 1.5508236376562057 driven_any_max 1.5511368313112754 driven_any_mean 1.5511368313112754 driven_any_median 1.5511368313112754 driven_any_min 1.5511368313112754 driven_lanedir_consec_max 0.1969489134232345 driven_lanedir_consec_mean 0.1969489134232345 driven_lanedir_consec_min 0.1969489134232345 driven_lanedir_max 0.1969489134232345 driven_lanedir_mean 0.1969489134232345 driven_lanedir_median 0.1969489134232345 driven_lanedir_min 0.1969489134232345 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"loop-000-ego0": {"driven_any": 1.5511368313112754, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969489134232345, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.5508236376562057, "deviation-center-line": 0.1253905781126274, "driven_lanedir_consec": 0.1969489134232345}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 16546
1727
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:10:59+00:00 2022-11-28 01:12:27+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16543
1728
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:07:08+00:00 2022-11-28 01:10:52+00:00 0:03:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.250000000000025 in-drivable-lane_median 8.775000000000027 driven_lanedir_consec_median 0.3301338553680937 deviation-center-line_median 0.20320237015909776
other stats deviation-center-line_max 0.27574141344199116 deviation-center-line_mean 0.2019553718705288 deviation-center-line_min 0.12567533372192854 deviation-heading_max 0.9488219555580462 deviation-heading_mean 0.8390918912315833 deviation-heading_median 0.8356408604491967 deviation-heading_min 0.7362638884698938 distance-from-start_max 1.6837476731392351 distance-from-start_mean 1.1946840199531843 distance-from-start_median 1.3150560032892975 distance-from-start_min 0.46487640009490705 driven_any_max 1.6838575324025415 driven_any_mean 1.194754885742435 driven_any_median 1.3151384084002675 driven_any_min 0.4648851937666637 driven_lanedir_consec_max 0.5392559894853717 driven_lanedir_consec_mean 0.3398044417698246 driven_lanedir_consec_min 0.15969406685773935 driven_lanedir_max 0.5392559894853717 driven_lanedir_mean 0.3398044417698246 driven_lanedir_median 0.3301338553680937 driven_lanedir_min 0.15969406685773935 in-drivable-lane_max 9.800000000000026 in-drivable-lane_mean 8.725000000000026 in-drivable-lane_min 7.55000000000003 per-episodes details {"autolab-000-ego0": {"driven_any": 0.4648851937666637, "survival_time": 11.250000000000025, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.46487640009490705, "deviation-center-line": 0.12567533372192854, "driven_lanedir_consec": 0.19955171937759708}, "autolab-000-ego1": {"driven_any": 1.463212954741934, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969406685773935, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.4631057991302578, "deviation-center-line": 0.1356249107782703, "driven_lanedir_consec": 0.15969406685773935}, "autolab-000-ego2": {"driven_any": 1.1670638620586014, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392559894853717, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722499510568, "distance-from-start": 1.1670062074483376, "deviation-center-line": 0.2707798295399252, "driven_lanedir_consec": 0.5392559894853717}, "autolab-000-ego3": {"driven_any": 1.6838575324025415, "survival_time": 11.250000000000025, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 8.05000000000003, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 11.250000000000025 survival_time_min 11.250000000000025
No reset possible 16539
1729
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 01:05:15+00:00 2022-11-28 01:06:57+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.499999999999992 in-drivable-lane_median 2.749999999999991 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.12567511082985364
other stats deviation-center-line_max 0.12567511082985364 deviation-center-line_mean 0.12567511082985364 deviation-center-line_min 0.12567511082985364 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.5733789333527137 distance-from-start_mean 0.5733789333527137 distance-from-start_median 0.5733789333527137 distance-from-start_min 0.5733789333527137 driven_any_max 0.5733903362648751 driven_any_mean 0.5733903362648751 driven_any_median 0.5733903362648751 driven_any_min 0.5733903362648751 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 2.749999999999991 in-drivable-lane_mean 2.749999999999991 in-drivable-lane_min 2.749999999999991 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5733903362648751, "survival_time": 4.499999999999992, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 2.749999999999991, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.5733789333527137, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 4.499999999999992 survival_time_mean 4.499999999999992 survival_time_min 4.499999999999992
No reset possible 16530
1734
Bea Baselines 🐤minimal-agent lx22-BV1
sim-3of5 success yes davinci-stage-02-6.2.51
2022-11-28 01:00:05+00:00 2022-11-28 01:05:00+00:00 0:04:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.437496092106819
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.437496092106819 distance-from-start_median 5.437496092106819 distance-from-start_min 5.437496092106819 driven_any_max 5.441098752040818 driven_any_mean 5.441098752040818 driven_any_median 5.441098752040818 driven_any_min 5.441098752040818 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 34.000000000000206 in-drivable-lane_mean 34.000000000000206 in-drivable-lane_median 34.000000000000206 in-drivable-lane_min 34.000000000000206 per-episodes details {"d50-ego0": {"driven_any": 5.441098752040818, "survival_time": 34.000000000000206, "driven_lanedir": 0.0, "in-drivable-lane": 34.000000000000206, "deviation-heading": 0.0, "distance-from-start": 5.437496092106819, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 34.000000000000206 survival_time_mean 34.000000000000206 survival_time_median 34.000000000000206 survival_time_min 34.000000000000206
No reset possible 16528
1734
Bea Baselines 🐤minimal-agent lx22-BV1
sim-1of5 success yes davinci-stage-02-6.2.51
2022-11-28 00:58:13+00:00 2022-11-28 00:59:50+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6233192523068
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6233192523068 distance-from-start_median 0.6233192523068 distance-from-start_min 0.6233192523068 driven_any_max 0.6233308988046636 driven_any_mean 0.6233308988046636 driven_any_median 0.6233308988046636 driven_any_min 0.6233308988046636 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 4.799999999999991 in-drivable-lane_mean 4.799999999999991 in-drivable-lane_median 4.799999999999991 in-drivable-lane_min 4.799999999999991 per-episodes details {"d45-ego0": {"driven_any": 0.6233308988046636, "survival_time": 4.799999999999991, "driven_lanedir": 0.0, "in-drivable-lane": 4.799999999999991, "deviation-heading": 0.0, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 4.799999999999991 survival_time_mean 4.799999999999991 survival_time_median 4.799999999999991 survival_time_min 4.799999999999991
No reset possible 16523
1741
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:55:24+00:00 2022-11-28 00:57:59+00:00 0:02:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.80000000000006 in-drivable-lane_median 10.700000000000069 driven_lanedir_consec_median 0.3090253186660683 deviation-center-line_median 0.26861536036719097
other stats deviation-center-line_max 0.26861536036719097 deviation-center-line_mean 0.26861536036719097 deviation-center-line_min 0.26861536036719097 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 2.1070810871296555 distance-from-start_mean 2.1070810871296555 distance-from-start_median 2.1070810871296555 distance-from-start_min 2.1070810871296555 driven_any_max 2.1073264492289447 driven_any_mean 2.1073264492289447 driven_any_median 2.1073264492289447 driven_any_min 2.1073264492289447 driven_lanedir_consec_max 0.3090253186660683 driven_lanedir_consec_mean 0.3090253186660683 driven_lanedir_consec_min 0.3090253186660683 driven_lanedir_max 0.3090253186660683 driven_lanedir_mean 0.3090253186660683 driven_lanedir_median 0.3090253186660683 driven_lanedir_min 0.3090253186660683 in-drivable-lane_max 10.700000000000069 in-drivable-lane_mean 10.700000000000069 in-drivable-lane_min 10.700000000000069 per-episodes details {"loop2-000-ego0": {"driven_any": 2.1073264492289447, "survival_time": 13.80000000000006, "driven_lanedir": 0.3090253186660683, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.1070810871296555, "deviation-center-line": 0.26861536036719097, "driven_lanedir_consec": 0.3090253186660683}}simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 13.80000000000006 survival_time_min 13.80000000000006
No reset possible 16519
1742
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:53:21+00:00 2022-11-28 00:54:52+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16514
1743
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:51:14+00:00 2022-11-28 00:53:03+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.149999999999993 in-drivable-lane_median 2.749999999999993 driven_lanedir_consec_median 0.13666480491623578 deviation-center-line_median 0.10783802485851966
other stats deviation-center-line_max 0.10783802485851966 deviation-center-line_mean 0.10783802485851966 deviation-center-line_min 0.10783802485851966 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.5146479428595191 distance-from-start_mean 0.5146479428595191 distance-from-start_median 0.5146479428595191 distance-from-start_min 0.5146479428595191 driven_any_max 0.5146585239872693 driven_any_mean 0.5146585239872693 driven_any_median 0.5146585239872693 driven_any_min 0.5146585239872693 driven_lanedir_consec_max 0.13666480491623578 driven_lanedir_consec_mean 0.13666480491623578 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.13666480491623578 driven_lanedir_mean 0.13666480491623578 driven_lanedir_median 0.13666480491623578 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 2.749999999999993 in-drivable-lane_mean 2.749999999999993 in-drivable-lane_min 2.749999999999993 per-episodes details {"4way-000-ego0": {"driven_any": 0.5146585239872693, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.5146479428595191, "deviation-center-line": 0.10783802485851966, "driven_lanedir_consec": 0.13666480491623578}}simulation-passed 1 survival_time_max 4.149999999999993 survival_time_mean 4.149999999999993 survival_time_min 4.149999999999993
No reset possible 16510
1744
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:49:09+00:00 2022-11-28 00:51:07+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.13666265914899656 survival_time_median 16.300000000000097 deviation-center-line_median 0.10783824785325348 in-drivable-lane_median 14.900000000000096
other stats deviation-center-line_max 0.10783824785325348 deviation-center-line_mean 0.10783824785325348 deviation-center-line_min 0.10783824785325348 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 2.521293261515461 distance-from-start_mean 2.521293261515461 distance-from-start_median 2.521293261515461 distance-from-start_min 2.521293261515461 driven_any_max 2.521966526425084 driven_any_mean 2.521966526425084 driven_any_median 2.521966526425084 driven_any_min 2.521966526425084 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 14.900000000000096 in-drivable-lane_mean 14.900000000000096 in-drivable-lane_min 14.900000000000096 per-episodes details {"autolab-000-ego0": {"driven_any": 2.521966526425084, "survival_time": 16.300000000000097, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.9508048428349388, "distance-from-start": 2.521293261515461, "deviation-center-line": 0.10783824785325348, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 16.300000000000097 survival_time_mean 16.300000000000097 survival_time_min 16.300000000000097
No reset possible 16504
1746
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:44:34+00:00 2022-11-28 00:48:46+00:00 0:04:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.200000000000069 in-drivable-lane_median 11.000000000000057 driven_lanedir_consec_median 0.3152938274760638 deviation-center-line_median 0.26684016190284265
other stats deviation-center-line_max 0.3356902421161755 deviation-center-line_mean 0.24640550413561532 deviation-center-line_min 0.11625145062060036 deviation-heading_max 2.486301423131022 deviation-heading_mean 1.563252755154394 deviation-heading_median 1.5495075837941936 deviation-heading_min 0.6676944298981667 distance-from-start_max 2.173942193160628 distance-from-start_mean 1.5951256386014727 distance-from-start_median 1.745851963918557 distance-from-start_min 0.7148564334081484 driven_any_max 2.174275713561512 driven_any_mean 1.595266942374297 driven_any_median 1.7459619017485188 driven_any_min 0.7148682524386378 driven_lanedir_consec_max 0.6842972359477595 driven_lanedir_consec_mean 0.3573150593764172 driven_lanedir_consec_min 0.11437534660578176 driven_lanedir_max 0.6842972359477595 driven_lanedir_mean 0.3573150593764172 driven_lanedir_median 0.3152938274760638 driven_lanedir_min 0.11437534660578176 in-drivable-lane_max 13.000000000000068 in-drivable-lane_mean 11.162500000000064 in-drivable-lane_min 9.650000000000077 per-episodes details {"loop-000-ego0": {"driven_any": 2.174275713561512, "survival_time": 14.200000000000069, "driven_lanedir": 0.3224767982503016, "in-drivable-lane": 11.050000000000042, "deviation-heading": 2.486301423131022, "distance-from-start": 2.173942193160628, "deviation-center-line": 0.27411484919814116, "driven_lanedir_consec": 0.3224767982503016}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 14.200000000000069, "driven_lanedir": 0.30811085670182603, "in-drivable-lane": 10.95000000000007, "deviation-heading": 2.339830246753357, "distance-from-start": 1.7251591376367597, "deviation-center-line": 0.3356902421161755, "driven_lanedir_consec": 0.30811085670182603}, "loop-000-ego2": {"driven_any": 1.766654784250807, "survival_time": 14.200000000000069, "driven_lanedir": 0.6842972359477595, "in-drivable-lane": 9.650000000000077, "deviation-heading": 0.6676944298981667, "distance-from-start": 1.7665447902003542, "deviation-center-line": 0.2595654746075442, "driven_lanedir_consec": 0.6842972359477595}, "loop-000-ego3": {"driven_any": 0.7148682524386378, "survival_time": 14.200000000000069, "driven_lanedir": 0.11437534660578176, "in-drivable-lane": 13.000000000000068, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.7148564334081484, "deviation-center-line": 0.11625145062060036, "driven_lanedir_consec": 0.11437534660578176}}simulation-passed 1 survival_time_max 14.200000000000069 survival_time_mean 14.200000000000069 survival_time_min 14.200000000000069
No reset possible 16498
1748
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:37:43+00:00 2022-11-28 00:44:07+00:00 0:06:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 34.1500000000002 in-drivable-lane_median 26.00000000000013 driven_lanedir_consec_median 0.22280089402067427 deviation-center-line_median 0.8311588777987078
other stats deviation-center-line_max 0.8311588777987078 deviation-center-line_mean 0.8311588777987078 deviation-center-line_min 0.8311588777987078 deviation-heading_max 7.726372769402024 deviation-heading_mean 7.726372769402024 deviation-heading_median 7.726372769402024 deviation-heading_min 7.726372769402024 distance-from-start_max 0.4595188992733995 distance-from-start_mean 0.4595188992733995 distance-from-start_median 0.4595188992733995 distance-from-start_min 0.4595188992733995 driven_any_max 4.472506714131231 driven_any_mean 4.472506714131231 driven_any_median 4.472506714131231 driven_any_min 4.472506714131231 driven_lanedir_consec_max 0.22280089402067427 driven_lanedir_consec_mean 0.22280089402067427 driven_lanedir_consec_min 0.22280089402067427 driven_lanedir_max 0.5298440176191865 driven_lanedir_mean 0.5298440176191865 driven_lanedir_median 0.5298440176191865 driven_lanedir_min 0.5298440176191865 in-drivable-lane_max 26.00000000000013 in-drivable-lane_mean 26.00000000000013 in-drivable-lane_min 26.00000000000013 per-episodes details {"loop2-000-ego0": {"driven_any": 4.472506714131231, "survival_time": 34.1500000000002, "driven_lanedir": 0.5298440176191865, "in-drivable-lane": 26.00000000000013, "deviation-heading": 7.726372769402024, "distance-from-start": 0.4595188992733995, "deviation-center-line": 0.8311588777987078, "driven_lanedir_consec": 0.22280089402067427}}simulation-passed 1 survival_time_max 34.1500000000002 survival_time_mean 34.1500000000002 survival_time_min 34.1500000000002
No reset possible 16494
1748
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:35:10+00:00 2022-11-28 00:37:29+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.6499999999999986 in-drivable-lane_median 1.6999999999999984 driven_lanedir_consec_median 0.06061692107146044 deviation-center-line_median 0.035546366339714315
other stats deviation-center-line_max 0.035546366339714315 deviation-center-line_mean 0.035546366339714315 deviation-center-line_min 0.035546366339714315 deviation-heading_max 0.7794523028059207 deviation-heading_mean 0.7794523028059207 deviation-heading_median 0.7794523028059207 deviation-heading_min 0.7794523028059207 distance-from-start_max 0.1831097530639172 distance-from-start_mean 0.1831097530639172 distance-from-start_median 0.1831097530639172 distance-from-start_min 0.1831097530639172 driven_any_max 0.286365142573381 driven_any_mean 0.286365142573381 driven_any_median 0.286365142573381 driven_any_min 0.286365142573381 driven_lanedir_consec_max 0.06061692107146044 driven_lanedir_consec_mean 0.06061692107146044 driven_lanedir_consec_min 0.06061692107146044 driven_lanedir_max 0.06061692107146044 driven_lanedir_mean 0.06061692107146044 driven_lanedir_median 0.06061692107146044 driven_lanedir_min 0.06061692107146044 in-drivable-lane_max 1.6999999999999984 in-drivable-lane_mean 1.6999999999999984 in-drivable-lane_min 1.6999999999999984 per-episodes details {"loop-000-ego0": {"driven_any": 0.286365142573381, "survival_time": 2.6499999999999986, "driven_lanedir": 0.06061692107146044, "in-drivable-lane": 1.6999999999999984, "deviation-heading": 0.7794523028059207, "distance-from-start": 0.1831097530639172, "deviation-center-line": 0.035546366339714315, "driven_lanedir_consec": 0.06061692107146044}}simulation-passed 1 survival_time_max 2.6499999999999986 survival_time_mean 2.6499999999999986 survival_time_min 2.6499999999999986
No reset possible 16492
1749
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:33:11+00:00 2022-11-28 00:34:43+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16485
1751
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-28 00:26:31+00:00 2022-11-28 00:32:57+00:00 0:06:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.679882087858096 survival_time_median 41.749999999999766 deviation-center-line_median 1.4753292967436873 in-drivable-lane_median 25.449999999999783
other stats deviation-center-line_max 1.4753292967436873 deviation-center-line_mean 1.4753292967436873 deviation-center-line_min 1.4753292967436873 deviation-heading_max 11.831043958061686 deviation-heading_mean 11.831043958061686 deviation-heading_median 11.831043958061686 deviation-heading_min 11.831043958061686 distance-from-start_max 0.8885829543378434 distance-from-start_mean 0.8885829543378434 distance-from-start_median 0.8885829543378434 distance-from-start_min 0.8885829543378434 driven_any_max 7.042361920463756 driven_any_mean 7.042361920463756 driven_any_median 7.042361920463756 driven_any_min 7.042361920463756 driven_lanedir_consec_max 1.679882087858096 driven_lanedir_consec_mean 1.679882087858096 driven_lanedir_consec_min 1.679882087858096 driven_lanedir_max 1.679882087858096 driven_lanedir_mean 1.679882087858096 driven_lanedir_median 1.679882087858096 driven_lanedir_min 1.679882087858096 in-drivable-lane_max 25.449999999999783 in-drivable-lane_mean 25.449999999999783 in-drivable-lane_min 25.449999999999783 per-episodes details {"autolab-000-ego0": {"driven_any": 7.042361920463756, "survival_time": 41.749999999999766, "driven_lanedir": 1.679882087858096, "in-drivable-lane": 25.449999999999783, "deviation-heading": 11.831043958061686, "distance-from-start": 0.8885829543378434, "deviation-center-line": 1.4753292967436873, "driven_lanedir_consec": 1.679882087858096}}simulation-passed 1 survival_time_max 41.749999999999766 survival_time_mean 41.749999999999766 survival_time_min 41.749999999999766
No reset possible 16476
1753
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 23:55:44+00:00 2022-11-28 00:26:23+00:00 0:30:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 43.42499999999911 driven_lanedir_consec_median 0.5329662773753729 deviation-center-line_median 1.289606294527613
other stats deviation-center-line_max 2.458618445772097 deviation-center-line_mean 1.309315092387905 deviation-center-line_min 0.1994293347242971 deviation-heading_max 23.15109788534859 deviation-heading_mean 13.621365393368052 deviation-heading_median 14.42748594530118 deviation-heading_min 2.4793917975212554 distance-from-start_max 0.908308966854482 distance-from-start_mean 0.4467080024359332 distance-from-start_median 0.3404434638976214 distance-from-start_min 0.1976361150940075 driven_any_max 11.587725061790676 driven_any_mean 4.673083235637529 driven_any_median 3.166278776056378 driven_any_min 0.7720503286466892 driven_lanedir_consec_max 0.5820263299321946 driven_lanedir_consec_mean 0.4758380001621667 driven_lanedir_consec_min 0.25539311596572656 driven_lanedir_max 1.1473964487700212 driven_lanedir_mean 0.6405209969434489 driven_lanedir_median 0.5796472115190238 driven_lanedir_min 0.25539311596572656 in-drivable-lane_max 56.999999999998735 in-drivable-lane_mean 43.59999999999908 in-drivable-lane_min 30.54999999999936 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7720503286466892, "survival_time": 59.99999999999873, "driven_lanedir": 0.25539311596572656, "in-drivable-lane": 56.999999999998735, "deviation-heading": 2.4793917975212554, "distance-from-start": 0.1976361150940075, "deviation-center-line": 0.1994293347242971, "driven_lanedir_consec": 0.25539311596572656}, "autolab-000-ego1": {"driven_any": 11.587725061790676, "survival_time": 59.99999999999873, "driven_lanedir": 0.6186309103397714, "in-drivable-lane": 51.649999999998855, "deviation-heading": 9.073121661940274, "distance-from-start": 0.908308966854482, "deviation-center-line": 0.8469322511130046, "driven_lanedir_consec": 0.5820263299321946}, "autolab-000-ego2": {"driven_any": 2.321392518792206, "survival_time": 59.99999999999873, "driven_lanedir": 0.5406635126982762, "in-drivable-lane": 30.54999999999936, "deviation-heading": 23.15109788534859, "distance-from-start": 0.38899122152804794, "deviation-center-line": 1.7322803379422216, "driven_lanedir_consec": 0.5406635126982762}, "autolab-000-ego3": {"driven_any": 4.01116503332055, "survival_time": 59.99999999999873, "driven_lanedir": 1.1473964487700212, "in-drivable-lane": 35.19999999999936, "deviation-heading": 19.781850228662083, "distance-from-start": 0.2918957062671949, "deviation-center-line": 2.458618445772097, "driven_lanedir_consec": 0.5252690420524697}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16469
1754
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 23:45:53+00:00 2022-11-27 23:55:30+00:00 0:09:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 46.14999999999894 driven_lanedir_consec_median 1.243069457422239 deviation-center-line_median 1.465662667089294
other stats deviation-center-line_max 1.465662667089294 deviation-center-line_mean 1.465662667089294 deviation-center-line_min 1.465662667089294 deviation-heading_max 12.163586639688951 deviation-heading_mean 12.163586639688951 deviation-heading_median 12.163586639688951 deviation-heading_min 12.163586639688951 distance-from-start_max 0.8753590915585961 distance-from-start_mean 0.8753590915585961 distance-from-start_median 0.8753590915585961 distance-from-start_min 0.8753590915585961 driven_any_max 10.45609379811832 driven_any_mean 10.45609379811832 driven_any_median 10.45609379811832 driven_any_min 10.45609379811832 driven_lanedir_consec_max 1.243069457422239 driven_lanedir_consec_mean 1.243069457422239 driven_lanedir_consec_min 1.243069457422239 driven_lanedir_max 1.2842498087854843 driven_lanedir_mean 1.2842498087854843 driven_lanedir_median 1.2842498087854843 driven_lanedir_min 1.2842498087854843 in-drivable-lane_max 46.14999999999894 in-drivable-lane_mean 46.14999999999894 in-drivable-lane_min 46.14999999999894 per-episodes details {"autolab-000-ego0": {"driven_any": 10.45609379811832, "survival_time": 59.99999999999873, "driven_lanedir": 1.2842498087854843, "in-drivable-lane": 46.14999999999894, "deviation-heading": 12.163586639688951, "distance-from-start": 0.8753590915585961, "deviation-center-line": 1.465662667089294, "driven_lanedir_consec": 1.243069457422239}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16464
1759
Bea Baselines 🐤template-pytorch lx22-BV1
sim-2of5 success yes davinci-stage-02-6.2.51
2022-11-27 23:37:13+00:00 2022-11-27 23:45:24+00:00 0:08:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.2180214813690262
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.2180214813690262 distance-from-start_median 1.2180214813690262 distance-from-start_min 1.2180214813690262 driven_any_max 6.408132981299596 driven_any_mean 6.408132981299596 driven_any_median 6.408132981299596 driven_any_min 6.408132981299596 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.408132981299596, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 1.2180214813690262, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16461
1759
Bea Baselines 🐤template-pytorch lx22-BV1
sim-1of5 success yes davinci-stage-02-6.2.51
2022-11-27 23:34:07+00:00 2022-11-27 23:36:58+00:00 0:02:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.44953264189054926
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.44953264189054926 distance-from-start_median 0.44953264189054926 distance-from-start_min 0.44953264189054926 driven_any_max 1.3467570291702908 driven_any_mean 1.3467570291702908 driven_any_median 1.3467570291702908 driven_any_min 1.3467570291702908 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.25000000000004 in-drivable-lane_mean 12.25000000000004 in-drivable-lane_median 12.25000000000004 in-drivable-lane_min 12.25000000000004 per-episodes details {"d45-ego0": {"driven_any": 1.3467570291702908, "survival_time": 12.25000000000004, "driven_lanedir": 0.0, "in-drivable-lane": 12.25000000000004, "deviation-heading": 0.0, "distance-from-start": 0.44953264189054926, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.25000000000004 survival_time_mean 12.25000000000004 survival_time_median 12.25000000000004 survival_time_min 12.25000000000004
No reset possible 16458
1766
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 23:28:40+00:00 2022-11-27 23:33:46+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.000000000000078 in-drivable-lane_median 8.200000000000054 driven_lanedir_consec_median 0.3016227202953985 deviation-center-line_median 0.3805156615223916
other stats deviation-center-line_max 0.3805156615223916 deviation-center-line_mean 0.3805156615223916 deviation-center-line_min 0.3805156615223916 deviation-heading_max 5.203122459151735 deviation-heading_mean 5.203122459151735 deviation-heading_median 5.203122459151735 deviation-heading_min 5.203122459151735 distance-from-start_max 0.17982392949089032 distance-from-start_mean 0.17982392949089032 distance-from-start_median 0.17982392949089032 distance-from-start_min 0.17982392949089032 driven_any_max 0.8461808462492147 driven_any_mean 0.8461808462492147 driven_any_median 0.8461808462492147 driven_any_min 0.8461808462492147 driven_lanedir_consec_max 0.3016227202953985 driven_lanedir_consec_mean 0.3016227202953985 driven_lanedir_consec_min 0.3016227202953985 driven_lanedir_max 0.3016227202953985 driven_lanedir_mean 0.3016227202953985 driven_lanedir_median 0.3016227202953985 driven_lanedir_min 0.3016227202953985 in-drivable-lane_max 8.200000000000054 in-drivable-lane_mean 8.200000000000054 in-drivable-lane_min 8.200000000000054 per-episodes details {"loop-000-ego0": {"driven_any": 0.8461808462492147, "survival_time": 15.000000000000078, "driven_lanedir": 0.3016227202953985, "in-drivable-lane": 8.200000000000054, "deviation-heading": 5.203122459151735, "distance-from-start": 0.17982392949089032, "deviation-center-line": 0.3805156615223916, "driven_lanedir_consec": 0.3016227202953985}}simulation-passed 1 survival_time_max 15.000000000000078 survival_time_mean 15.000000000000078 survival_time_min 15.000000000000078
No reset possible 16451
1767
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 23:25:54+00:00 2022-11-27 23:28:34+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.5499999999999954 in-drivable-lane_median 2.0499999999999945 driven_lanedir_consec_median 0.1354113925650342 deviation-center-line_median 0.048187352249186875
other stats deviation-center-line_max 0.048187352249186875 deviation-center-line_mean 0.048187352249186875 deviation-center-line_min 0.048187352249186875 deviation-heading_max 0.97253310283302 deviation-heading_mean 0.97253310283302 deviation-heading_median 0.97253310283302 deviation-heading_min 0.97253310283302 distance-from-start_max 0.15131158226915245 distance-from-start_mean 0.15131158226915245 distance-from-start_median 0.15131158226915245 distance-from-start_min 0.15131158226915245 driven_any_max 0.4047601837492544 driven_any_mean 0.4047601837492544 driven_any_median 0.4047601837492544 driven_any_min 0.4047601837492544 driven_lanedir_consec_max 0.1354113925650342 driven_lanedir_consec_mean 0.1354113925650342 driven_lanedir_consec_min 0.1354113925650342 driven_lanedir_max 0.1354113925650342 driven_lanedir_mean 0.1354113925650342 driven_lanedir_median 0.1354113925650342 driven_lanedir_min 0.1354113925650342 in-drivable-lane_max 2.0499999999999945 in-drivable-lane_mean 2.0499999999999945 in-drivable-lane_min 2.0499999999999945 per-episodes details {"4way-000-ego0": {"driven_any": 0.4047601837492544, "survival_time": 3.5499999999999954, "driven_lanedir": 0.1354113925650342, "in-drivable-lane": 2.0499999999999945, "deviation-heading": 0.97253310283302, "distance-from-start": 0.15131158226915245, "deviation-center-line": 0.048187352249186875, "driven_lanedir_consec": 0.1354113925650342}}simulation-passed 1 survival_time_max 3.5499999999999954 survival_time_mean 3.5499999999999954 survival_time_min 3.5499999999999954
No reset possible 16448
1768
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 23:23:46+00:00 2022-11-27 23:25:47+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16434
1771
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:52:23+00:00 2022-11-27 23:23:21+00:00 0:30:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 52.4499999999987 driven_lanedir_consec_median 0.6842354165610253 deviation-center-line_median 0.6623226574937954
other stats deviation-center-line_max 2.4782553540663956 deviation-center-line_mean 1.08967109897621 deviation-center-line_min 0.5557837268508531 deviation-heading_max 16.398648152756845 deviation-heading_mean 8.146230785254525 deviation-heading_median 5.780530067484655 deviation-heading_min 4.625214853291949 distance-from-start_max 1.181893793644939 distance-from-start_mean 0.7215631682047746 distance-from-start_median 0.6259909331251148 distance-from-start_min 0.45237701292393007 driven_any_max 11.760589265793776 driven_any_mean 8.430932011074608 driven_any_median 8.089389056979083 driven_any_min 5.784360664546489 driven_lanedir_consec_max 1.0365407881338131 driven_lanedir_consec_mean 0.6814267762652612 driven_lanedir_consec_min 0.32069548380518076 driven_lanedir_max 1.0412587662477932 driven_lanedir_mean 0.9179049045040844 driven_lanedir_median 0.920941001449056 driven_lanedir_min 0.7884788488704322 in-drivable-lane_max 53.299999999998676 in-drivable-lane_mean 49.94999999999884 in-drivable-lane_min 41.59999999999928 per-episodes details {"loop-000-ego0": {"driven_any": 5.784360664546489, "survival_time": 59.99999999999873, "driven_lanedir": 0.7884788488704322, "in-drivable-lane": 53.299999999998676, "deviation-heading": 5.488139061262694, "distance-from-start": 0.7453166748002049, "deviation-center-line": 0.5557837268508531, "driven_lanedir_consec": 0.5239066075310246}, "loop-000-ego1": {"driven_any": 5.897883645347082, "survival_time": 59.99999999999873, "driven_lanedir": 0.997317777307086, "in-drivable-lane": 41.59999999999928, "deviation-heading": 16.398648152756845, "distance-from-start": 0.5066651914500245, "deviation-center-line": 2.4782553540663956, "driven_lanedir_consec": 0.32069548380518076}, "loop-000-ego2": {"driven_any": 11.760589265793776, "survival_time": 59.99999999999873, "driven_lanedir": 1.0412587662477932, "in-drivable-lane": 51.799999999998704, "deviation-heading": 6.072921073706616, "distance-from-start": 1.181893793644939, "deviation-center-line": 0.721637250884025, "driven_lanedir_consec": 1.0365407881338131}, "loop-000-ego3": {"driven_any": 10.280894468611086, "survival_time": 59.99999999999873, "driven_lanedir": 0.844564225591026, "in-drivable-lane": 53.0999999999987, "deviation-heading": 4.625214853291949, "distance-from-start": 0.45237701292393007, "deviation-center-line": 0.6030080641035658, "driven_lanedir_consec": 0.844564225591026}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16433
1772
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:49:53+00:00 2022-11-27 22:52:15+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.199999999999982 in-drivable-lane_median 4.149999999999991 driven_lanedir_consec_median 0.2714350348907417 deviation-center-line_median 0.2346739915337434
other stats deviation-center-line_max 0.2346739915337434 deviation-center-line_mean 0.2346739915337434 deviation-center-line_min 0.2346739915337434 deviation-heading_max 2.8954822815285333 deviation-heading_mean 2.8954822815285333 deviation-heading_median 2.8954822815285333 deviation-heading_min 2.8954822815285333 distance-from-start_max 0.17007472259229903 distance-from-start_mean 0.17007472259229903 distance-from-start_median 0.17007472259229903 distance-from-start_min 0.17007472259229903 driven_any_max 0.7859786444996595 driven_any_mean 0.7859786444996595 driven_any_median 0.7859786444996595 driven_any_min 0.7859786444996595 driven_lanedir_consec_max 0.2714350348907417 driven_lanedir_consec_mean 0.2714350348907417 driven_lanedir_consec_min 0.2714350348907417 driven_lanedir_max 0.2714350348907417 driven_lanedir_mean 0.2714350348907417 driven_lanedir_median 0.2714350348907417 driven_lanedir_min 0.2714350348907417 in-drivable-lane_max 4.149999999999991 in-drivable-lane_mean 4.149999999999991 in-drivable-lane_min 4.149999999999991 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7859786444996595, "survival_time": 8.199999999999982, "driven_lanedir": 0.2714350348907417, "in-drivable-lane": 4.149999999999991, "deviation-heading": 2.8954822815285333, "distance-from-start": 0.17007472259229903, "deviation-center-line": 0.2346739915337434, "driven_lanedir_consec": 0.2714350348907417}}simulation-passed 1 survival_time_max 8.199999999999982 survival_time_mean 8.199999999999982 survival_time_min 8.199999999999982
No reset possible 16424
1774
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:38:08+00:00 2022-11-27 22:49:25+00:00 0:11:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.26764984149988424 deviation-center-line_median 0.7555295762526522
other stats deviation-center-line_max 0.7555295762526522 deviation-center-line_mean 0.7555295762526522 deviation-center-line_min 0.7555295762526522 deviation-heading_max 5.523299013646982 deviation-heading_mean 5.523299013646982 deviation-heading_median 5.523299013646982 deviation-heading_min 5.523299013646982 distance-from-start_max 1.044224797669204 distance-from-start_mean 1.044224797669204 distance-from-start_median 1.044224797669204 distance-from-start_min 1.044224797669204 driven_any_max 11.376062002465122 driven_any_mean 11.376062002465122 driven_any_median 11.376062002465122 driven_any_min 11.376062002465122 driven_lanedir_consec_max 0.26764984149988424 driven_lanedir_consec_mean 0.26764984149988424 driven_lanedir_consec_min 0.26764984149988424 driven_lanedir_max 0.24963678127672728 driven_lanedir_mean 0.24963678127672728 driven_lanedir_median 0.24963678127672728 driven_lanedir_min 0.24963678127672728 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"4way-000-ego0": {"driven_any": 11.376062002465122, "survival_time": 45.099999999999575, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299013646982, "distance-from-start": 1.044224797669204, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 16421
1775
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:36:03+00:00 2022-11-27 22:37:35+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16417
1775
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:33:21+00:00 2022-11-27 22:35:57+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.3901743521234762 deviation-center-line_median 0.17124897035562428
other stats deviation-center-line_max 0.17124897035562428 deviation-center-line_mean 0.17124897035562428 deviation-center-line_min 0.17124897035562428 deviation-heading_max 1.70314180472416 deviation-heading_mean 1.70314180472416 deviation-heading_median 1.70314180472416 deviation-heading_min 1.70314180472416 distance-from-start_max 0.4028556303039793 distance-from-start_mean 0.4028556303039793 distance-from-start_median 0.4028556303039793 distance-from-start_min 0.4028556303039793 driven_any_max 0.42407645028397256 driven_any_mean 0.42407645028397256 driven_any_median 0.42407645028397256 driven_any_min 0.42407645028397256 driven_lanedir_consec_max 0.3901743521234762 driven_lanedir_consec_mean 0.3901743521234762 driven_lanedir_consec_min 0.3901743521234762 driven_lanedir_max 0.3901743521234762 driven_lanedir_mean 0.3901743521234762 driven_lanedir_median 0.3901743521234762 driven_lanedir_min 0.3901743521234762 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.42407645028397256, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3901743521234762, "in-drivable-lane": 0.9, "deviation-heading": 1.70314180472416, "distance-from-start": 0.4028556303039793, "deviation-center-line": 0.17124897035562428, "driven_lanedir_consec": 0.3901743521234762}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 16415
1776
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:27:26+00:00 2022-11-27 22:33:16+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2701303550718044 survival_time_median 49.74999999999931 deviation-center-line_median 0.8041846674982114 in-drivable-lane_median 40.59999999999928
other stats deviation-center-line_max 0.8041846674982114 deviation-center-line_mean 0.8041846674982114 deviation-center-line_min 0.8041846674982114 deviation-heading_max 6.675380463416964 deviation-heading_mean 6.675380463416964 deviation-heading_median 6.675380463416964 deviation-heading_min 6.675380463416964 distance-from-start_max 1.137627771926658 distance-from-start_mean 1.137627771926658 distance-from-start_median 1.137627771926658 distance-from-start_min 1.137627771926658 driven_any_max 12.45015338279087 driven_any_mean 12.45015338279087 driven_any_median 12.45015338279087 driven_any_min 12.45015338279087 driven_lanedir_consec_max 0.2701303550718044 driven_lanedir_consec_mean 0.2701303550718044 driven_lanedir_consec_min 0.2701303550718044 driven_lanedir_max 0.2521152682910448 driven_lanedir_mean 0.2521152682910448 driven_lanedir_median 0.2521152682910448 driven_lanedir_min 0.2521152682910448 in-drivable-lane_max 40.59999999999928 in-drivable-lane_mean 40.59999999999928 in-drivable-lane_min 40.59999999999928 per-episodes details {"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 16414
1776
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:23:22+00:00 2022-11-27 22:27:05+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2676465159268615 survival_time_median 25.00000000000022 deviation-center-line_median 0.7555297758130887 in-drivable-lane_median 16.4500000000002
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.187140538312911 driven_any_mean 6.187140538312911 driven_any_median 6.187140538312911 driven_any_min 6.187140538312911 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.4500000000002 in-drivable-lane_mean 16.4500000000002 in-drivable-lane_min 16.4500000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.187140538312911, "survival_time": 25.00000000000022, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.4500000000002, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 25.00000000000022 survival_time_mean 25.00000000000022 survival_time_min 25.00000000000022
No reset possible 16406
1778
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:10:06+00:00 2022-11-27 22:23:16+00:00 0:13:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.250000000000306 in-drivable-lane_median 28.075000000000298 driven_lanedir_consec_median 0.1610207737330219 deviation-center-line_median 0.29879847452961933
other stats deviation-center-line_max 0.7438965564413397 deviation-center-line_mean 0.3444866849816528 deviation-center-line_min 0.03645323442603294 deviation-heading_max 5.151628362375439 deviation-heading_mean 3.250612996537796 deviation-heading_median 3.3709673175115276 deviation-heading_min 1.1088889887526905 distance-from-start_max 0.9340577697896384 distance-from-start_mean 0.6918300925811118 distance-from-start_median 0.6561491304294165 distance-from-start_min 0.5209643396759762 driven_any_max 7.865751162007197 driven_any_mean 4.149754186300885 driven_any_median 4.093549808670279 driven_any_min 0.5461659658557834 driven_lanedir_consec_max 0.34342719852355597 driven_lanedir_consec_mean 0.1843559383324774 driven_lanedir_consec_min 0.07195500734030984 driven_lanedir_max 0.34342719852355597 driven_lanedir_mean 0.17519082439080594 driven_lanedir_median 0.142690545849679 driven_lanedir_min 0.07195500734030984 in-drivable-lane_max 30.600000000000307 in-drivable-lane_mean 27.887500000000298 in-drivable-lane_min 24.80000000000028 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.557376740490916, "survival_time": 32.250000000000306, "driven_lanedir": 0.34342719852355597, "in-drivable-lane": 27.45000000000031, "deviation-heading": 4.085690366921237, "distance-from-start": 0.576509903181454, "deviation-center-line": 0.3481403947764579, "driven_lanedir_consec": 0.34342719852355597}, "zigzag-000-ego1": {"driven_any": 5.629722876849642, "survival_time": 32.250000000000306, "driven_lanedir": 0.19038935166124735, "in-drivable-lane": 24.80000000000028, "deviation-heading": 5.151628362375439, "distance-from-start": 0.7357883576773788, "deviation-center-line": 0.7438965564413397, "driven_lanedir_consec": 0.21133294232177}, "zigzag-000-ego2": {"driven_any": 7.865751162007197, "survival_time": 32.250000000000306, "driven_lanedir": 0.09499174003811064, "in-drivable-lane": 28.70000000000028, "deviation-heading": 2.6562442681018186, "distance-from-start": 0.9340577697896384, "deviation-center-line": 0.24945655428278077, "driven_lanedir_consec": 0.11070860514427378}, "zigzag-000-ego3": {"driven_any": 0.5461659658557834, "survival_time": 32.250000000000306, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 30.600000000000307, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}simulation-passed 1 survival_time_max 32.250000000000306 survival_time_mean 32.250000000000306 survival_time_min 32.250000000000306
No reset possible 16403
1779
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 22:06:22+00:00 2022-11-27 22:09:59+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.150000000000137 in-drivable-lane_median 10.600000000000112 driven_lanedir_consec_median 0.2737818968396458 deviation-center-line_median 0.7687309631535428
other stats deviation-center-line_max 0.7687309631535428 deviation-center-line_mean 0.7687309631535428 deviation-center-line_min 0.7687309631535428 deviation-heading_max 5.758343079064915 deviation-heading_mean 5.758343079064915 deviation-heading_median 5.758343079064915 deviation-heading_min 5.758343079064915 distance-from-start_max 0.6736010379604951 distance-from-start_mean 0.6736010379604951 distance-from-start_median 0.6736010379604951 distance-from-start_min 0.6736010379604951 driven_any_max 4.258760700432588 driven_any_mean 4.258760700432588 driven_any_median 4.258760700432588 driven_any_min 4.258760700432588 driven_lanedir_consec_max 0.2737818968396458 driven_lanedir_consec_mean 0.2737818968396458 driven_lanedir_consec_min 0.2737818968396458 driven_lanedir_max 0.25577241289552777 driven_lanedir_mean 0.25577241289552777 driven_lanedir_median 0.25577241289552777 driven_lanedir_min 0.25577241289552777 in-drivable-lane_max 10.600000000000112 in-drivable-lane_mean 10.600000000000112 in-drivable-lane_min 10.600000000000112 per-episodes details {"loop-000-ego0": {"driven_any": 4.258760700432588, "survival_time": 19.150000000000137, "driven_lanedir": 0.25577241289552777, "in-drivable-lane": 10.600000000000112, "deviation-heading": 5.758343079064915, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.7687309631535428, "driven_lanedir_consec": 0.2737818968396458}}simulation-passed 1 survival_time_max 19.150000000000137 survival_time_mean 19.150000000000137 survival_time_min 19.150000000000137
No reset possible 16399
1782
Bea Baselines 🐤template-random lx22-visservoing
sim success yes davinci-stage-02-6.2.51
2022-11-27 21:59:49+00:00 2022-11-27 22:06:12+00:00 0:06:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 23.174999999999663 deviation-center-line_median 1.1846435027267537 driven_lanedir_consec_median 0.4119359833831363 survival_time_median 35.84999999999938
other stats deviation-center-line_max 2.053692550333513 deviation-center-line_mean 1.1846435027267537 deviation-center-line_min 0.31559445511999407 deviation-heading_max 15.80459948077375 deviation-heading_mean 9.065579449172477 deviation-heading_median 9.065579449172477 deviation-heading_min 2.326559417571199 distance-from-start_max 1.4108418329398822 distance-from-start_mean 0.9784996704397644 distance-from-start_median 0.9784996704397644 distance-from-start_min 0.5461575079396466 driven_any_max 15.326310847370593 driven_any_mean 8.912150167222187 driven_any_median 8.912150167222187 driven_any_min 2.497989487073779 driven_lanedir_consec_max 0.6105561181479094 driven_lanedir_consec_mean 0.4119359833831363 driven_lanedir_consec_min 0.21331584861836328 driven_lanedir_max 0.5974394680482642 driven_lanedir_mean 0.40241777001121354 driven_lanedir_median 0.40241777001121354 driven_lanedir_min 0.20739607197416288 in-drivable-lane_max 38.19999999999931 in-drivable-lane_mean 23.174999999999663 in-drivable-lane_min 8.150000000000023 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 2.497989487073779, "survival_time": 11.700000000000031, "driven_lanedir": 0.20739607197416288, "in-drivable-lane": 8.150000000000023, "deviation-heading": 2.326559417571199, "distance-from-start": 0.5461575079396466, "deviation-center-line": 0.31559445511999407, "driven_lanedir_consec": 0.21331584861836328}, "LF-small-loop-001-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.5974394680482642, "in-drivable-lane": 38.19999999999931, "deviation-heading": 15.80459948077375, "distance-from-start": 1.4108418329398822, "deviation-center-line": 2.053692550333513, "driven_lanedir_consec": 0.6105561181479094}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 35.84999999999938 survival_time_min 11.700000000000031
No reset possible 16395
1784
Bea Baselines 🐤template-random lx22-BV1
sim-4of5 success yes davinci-stage-02-6.2.51
2022-11-27 21:56:37+00:00 2022-11-27 21:59:21+00:00 0:02:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5461575079396516
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5461575079396516 distance-from-start_median 0.5461575079396516 distance-from-start_min 0.5461575079396516 driven_any_max 2.35191748174678 driven_any_mean 2.35191748174678 driven_any_median 2.35191748174678 driven_any_min 2.35191748174678 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.450000000000028 in-drivable-lane_mean 11.450000000000028 in-drivable-lane_median 11.450000000000028 in-drivable-lane_min 11.450000000000028 per-episodes details {"d60-ego0": {"driven_any": 2.35191748174678, "survival_time": 11.450000000000028, "driven_lanedir": 0.0, "in-drivable-lane": 11.450000000000028, "deviation-heading": 0.0, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_median 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 16390
1791
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:49:10+00:00 2022-11-27 21:56:24+00:00 0:07:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.74999999999937 in-drivable-lane_median 34.749999999999275 driven_lanedir_consec_median 0.24555746228952957 deviation-center-line_median 1.3919847015555793
other stats deviation-center-line_max 1.3919847015555793 deviation-center-line_mean 1.3919847015555793 deviation-center-line_min 1.3919847015555793 deviation-heading_max 9.906601177812297 deviation-heading_mean 9.906601177812297 deviation-heading_median 9.906601177812297 deviation-heading_min 9.906601177812297 distance-from-start_max 1.1351054760255683 distance-from-start_mean 1.1351054760255683 distance-from-start_median 1.1351054760255683 distance-from-start_min 1.1351054760255683 driven_any_max 12.250926783811016 driven_any_mean 12.250926783811016 driven_any_median 12.250926783811016 driven_any_min 12.250926783811016 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.24555746228952957 driven_lanedir_consec_min 0.24555746228952957 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.2358197494342854 driven_lanedir_median 0.2358197494342854 driven_lanedir_min 0.2358197494342854 in-drivable-lane_max 34.749999999999275 in-drivable-lane_mean 34.749999999999275 in-drivable-lane_min 34.749999999999275 per-episodes details {"loop2-000-ego0": {"driven_any": 12.250926783811016, "survival_time": 48.74999999999937, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 34.749999999999275, "deviation-heading": 9.906601177812297, "distance-from-start": 1.1351054760255683, "deviation-center-line": 1.3919847015555793, "driven_lanedir_consec": 0.24555746228952957}}simulation-passed 1 survival_time_max 48.74999999999937 survival_time_mean 48.74999999999937 survival_time_min 48.74999999999937
No reset possible 16380
1849
Andrea Daniele lx22-visservoing lx22-visservoing
sim success yes davinci-stage-02-6.2.51
2022-11-27 21:38:52+00:00 2022-11-27 21:48:36+00:00 0:09:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 0.0 deviation-center-line_median 0.7365148409561499 driven_lanedir_consec_median 6.217038793971064 survival_time_median 59.99999999999873
other stats deviation-center-line_max 0.847908600231907 deviation-center-line_mean 0.7365148409561499 deviation-center-line_min 0.6251210816803929 deviation-heading_max 4.917535835381627 deviation-heading_mean 4.469179688703245 deviation-heading_median 4.469179688703245 deviation-heading_min 4.020823542024863 distance-from-start_max 1.575939865541797 distance-from-start_mean 1.3478147195477292 distance-from-start_median 1.3478147195477292 distance-from-start_min 1.1196895735536612 driven_any_max 6.24834304074401 driven_any_mean 6.245751884700575 driven_any_median 6.245751884700575 driven_any_min 6.2431607286571404 driven_lanedir_consec_max 6.22672890504532 driven_lanedir_consec_mean 6.217038793971064 driven_lanedir_consec_min 6.207348682896806 driven_lanedir_max 6.22672890504532 driven_lanedir_mean 6.217038793971064 driven_lanedir_median 6.217038793971064 driven_lanedir_min 6.207348682896806 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 6.24834304074401, "survival_time": 59.99999999999873, "driven_lanedir": 6.22672890504532, "in-drivable-lane": 0.0, "deviation-heading": 4.020823542024863, "distance-from-start": 1.1196895735536612, "deviation-center-line": 0.6251210816803929, "driven_lanedir_consec": 6.22672890504532}, "LF-small-loop-001-ego0": {"driven_any": 6.2431607286571404, "survival_time": 59.99999999999873, "driven_lanedir": 6.207348682896806, "in-drivable-lane": 0.0, "deviation-heading": 4.917535835381627, "distance-from-start": 1.575939865541797, "deviation-center-line": 0.847908600231907, "driven_lanedir_consec": 6.207348682896806}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16378
1794
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:36:09+00:00 2022-11-27 21:38:24+00:00 0:02:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.029483020207996535 survival_time_median 11.450000000000028 deviation-center-line_median 0.32684152243677644 in-drivable-lane_median 8.000000000000016
other stats deviation-center-line_max 0.32684152243677644 deviation-center-line_mean 0.32684152243677644 deviation-center-line_min 0.32684152243677644 deviation-heading_max 2.5488727326530465 deviation-heading_mean 2.5488727326530465 deviation-heading_median 2.5488727326530465 deviation-heading_min 2.5488727326530465 distance-from-start_max 0.5461575079396548 distance-from-start_mean 0.5461575079396548 distance-from-start_median 0.5461575079396548 distance-from-start_min 0.5461575079396548 driven_any_max 2.3519174817467863 driven_any_mean 2.3519174817467863 driven_any_median 2.3519174817467863 driven_any_min 2.3519174817467863 driven_lanedir_consec_max 0.029483020207996535 driven_lanedir_consec_mean 0.029483020207996535 driven_lanedir_consec_min 0.029483020207996535 driven_lanedir_max 0.03283067360874581 driven_lanedir_mean 0.03283067360874581 driven_lanedir_median 0.03283067360874581 driven_lanedir_min 0.03283067360874581 in-drivable-lane_max 8.000000000000016 in-drivable-lane_mean 8.000000000000016 in-drivable-lane_min 8.000000000000016 per-episodes details {"autolab-000-ego0": {"driven_any": 2.3519174817467863, "survival_time": 11.450000000000028, "driven_lanedir": 0.03283067360874581, "in-drivable-lane": 8.000000000000016, "deviation-heading": 2.5488727326530465, "distance-from-start": 0.5461575079396548, "deviation-center-line": 0.32684152243677644, "driven_lanedir_consec": 0.029483020207996535}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 16371
1795
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:22:12+00:00 2022-11-27 21:35:53+00:00 0:13:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.650000000000315 in-drivable-lane_median 25.07500000000031 driven_lanedir_consec_median 0.19631883983708276 deviation-center-line_median 0.5303169595499431
other stats deviation-center-line_max 0.6346587556337292 deviation-center-line_mean 0.4498294317662554 deviation-center-line_min 0.10402505233140616 deviation-heading_max 5.9042352469363495 deviation-heading_mean 3.531571794786276 deviation-heading_median 3.404936745672125 deviation-heading_min 1.4121784408645055 distance-from-start_max 0.8626308120701025 distance-from-start_mean 0.621002716979991 distance-from-start_median 0.6516762295571965 distance-from-start_min 0.318027596735469 driven_any_max 7.64129018112013 driven_any_mean 3.877106290822701 driven_any_median 3.7658309486532184 driven_any_min 0.335473084864234 driven_lanedir_consec_max 0.30624803336021755 driven_lanedir_consec_mean 0.18830365526398113 driven_lanedir_consec_min 0.05432890802154144 driven_lanedir_max 0.30624803336021755 driven_lanedir_mean 0.1907956986975728 driven_lanedir_median 0.19962933842245056 driven_lanedir_min 0.05767608458517248 in-drivable-lane_max 29.60000000000032 in-drivable-lane_mean 25.962500000000293 in-drivable-lane_min 24.100000000000243 per-episodes details {"udem-000-ego0": {"driven_any": 7.64129018112013, "survival_time": 31.650000000000315, "driven_lanedir": 0.05767608458517248, "in-drivable-lane": 24.100000000000243, "deviation-heading": 5.9042352469363495, "distance-from-start": 0.8626308120701025, "deviation-center-line": 0.6346587556337292, "driven_lanedir_consec": 0.05432890802154144}, "udem-000-ego1": {"driven_any": 3.4738391388470204, "survival_time": 31.650000000000315, "driven_lanedir": 0.26180184701004805, "in-drivable-lane": 24.50000000000032, "deviation-heading": 3.4753443866524747, "distance-from-start": 0.6297514211538991, "deviation-center-line": 0.5182786416817282, "driven_lanedir_consec": 0.2397963333994584}, "udem-000-ego2": {"driven_any": 4.057822758459417, "survival_time": 31.650000000000315, "driven_lanedir": 0.13745682983485308, "in-drivable-lane": 25.650000000000297, "deviation-heading": 3.3345291046917755, "distance-from-start": 0.6736010379604938, "deviation-center-line": 0.5423552774181579, "driven_lanedir_consec": 0.1528413462747071}, "udem-000-ego3": {"driven_any": 0.335473084864234, "survival_time": 31.650000000000315, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 29.60000000000032, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.318027596735469, "deviation-center-line": 0.10402505233140616, "driven_lanedir_consec": 0.30624803336021755}}simulation-passed 1 survival_time_max 31.650000000000315 survival_time_mean 31.650000000000315 survival_time_min 31.650000000000315
No reset possible 16363
1797
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:12:33+00:00 2022-11-27 21:21:41+00:00 0:09:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.34999999999917 driven_lanedir_consec_median 0.23799216289173675 deviation-center-line_median 2.122382603135255
other stats deviation-center-line_max 2.122382603135255 deviation-center-line_mean 2.122382603135255 deviation-center-line_min 2.122382603135255 deviation-heading_max 20.52214487263099 deviation-heading_mean 20.52214487263099 deviation-heading_median 20.52214487263099 deviation-heading_min 20.52214487263099 distance-from-start_max 1.4108418329398902 distance-from-start_mean 1.4108418329398902 distance-from-start_median 1.4108418329398902 distance-from-start_min 1.4108418329398902 driven_any_max 15.326310847370609 driven_any_mean 15.326310847370609 driven_any_median 15.326310847370609 driven_any_min 15.326310847370609 driven_lanedir_consec_max 0.23799216289173675 driven_lanedir_consec_mean 0.23799216289173675 driven_lanedir_consec_min 0.23799216289173675 driven_lanedir_max 0.2454177542370326 driven_lanedir_mean 0.2454177542370326 driven_lanedir_median 0.2454177542370326 driven_lanedir_min 0.2454177542370326 in-drivable-lane_max 36.34999999999917 in-drivable-lane_mean 36.34999999999917 in-drivable-lane_min 36.34999999999917 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16358
1799
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:09:24+00:00 2022-11-27 21:12:08+00:00 0:02:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.449999999999992 in-drivable-lane_median 3.399999999999992 driven_lanedir_consec_median 0.17403766373147 deviation-center-line_median 0.0640910905497618
other stats deviation-center-line_max 0.0640910905497618 deviation-center-line_mean 0.0640910905497618 deviation-center-line_min 0.0640910905497618 deviation-heading_max 0.6114931718356641 deviation-heading_mean 0.6114931718356641 deviation-heading_median 0.6114931718356641 deviation-heading_min 0.6114931718356641 distance-from-start_max 0.917256130418288 distance-from-start_mean 0.917256130418288 distance-from-start_median 0.917256130418288 distance-from-start_min 0.917256130418288 driven_any_max 0.9938727539159696 driven_any_mean 0.9938727539159696 driven_any_median 0.9938727539159696 driven_any_min 0.9938727539159696 driven_lanedir_consec_max 0.17403766373147 driven_lanedir_consec_mean 0.17403766373147 driven_lanedir_consec_min 0.17403766373147 driven_lanedir_max 0.17403766373147 driven_lanedir_mean 0.17403766373147 driven_lanedir_median 0.17403766373147 driven_lanedir_min 0.17403766373147 in-drivable-lane_max 3.399999999999992 in-drivable-lane_mean 3.399999999999992 in-drivable-lane_min 3.399999999999992 per-episodes details {"udem-000-ego0": {"driven_any": 0.9938727539159696, "survival_time": 4.449999999999992, "driven_lanedir": 0.17403766373147, "in-drivable-lane": 3.399999999999992, "deviation-heading": 0.6114931718356641, "distance-from-start": 0.917256130418288, "deviation-center-line": 0.0640910905497618, "driven_lanedir_consec": 0.17403766373147}}simulation-passed 1 survival_time_max 4.449999999999992 survival_time_mean 4.449999999999992 survival_time_min 4.449999999999992
No reset possible 16354
1800
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:07:16+00:00 2022-11-27 21:08:50+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16345
1802
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 21:02:56+00:00 2022-11-27 21:06:49+00:00 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.749999999999984 in-drivable-lane_median 5.474999999999984 driven_lanedir_consec_median 0.24222685195887603 deviation-center-line_median 0.07978806866033386
other stats deviation-center-line_max 0.2568268659170377 deviation-center-line_mean 0.12113114926300662 deviation-center-line_min 0.06812159381432109 deviation-heading_max 1.2927893688370895 deviation-heading_mean 0.7374595106980316 deviation-heading_median 0.6020455184641725 deviation-heading_min 0.45295763702669184 distance-from-start_max 1.7120425619369335 distance-from-start_mean 0.9530994453797346 distance-from-start_median 0.8544987092722509 distance-from-start_min 0.3913578010375031 driven_any_max 1.7185005321047406 driven_any_mean 0.9660740271356618 driven_any_median 0.8771505318593256 driven_any_min 0.391494512719256 driven_lanedir_consec_max 0.7732401434509224 driven_lanedir_consec_mean 0.3523027612587557 driven_lanedir_consec_min 0.1515171976663483 driven_lanedir_max 0.7732401434509224 driven_lanedir_mean 0.3523027612587557 driven_lanedir_median 0.24222685195887603 driven_lanedir_min 0.1515171976663483 in-drivable-lane_max 5.8999999999999835 in-drivable-lane_mean 5.087499999999984 in-drivable-lane_min 3.4999999999999876 per-episodes details {"4way-000-ego0": {"driven_any": 0.391494512719256, "survival_time": 6.749999999999984, "driven_lanedir": 0.18213075402093204, "in-drivable-lane": 5.699999999999984, "deviation-heading": 0.6161750824821208, "distance-from-start": 0.3913578010375031, "deviation-center-line": 0.06812159381432109, "driven_lanedir_consec": 0.18213075402093204}, "4way-000-ego1": {"driven_any": 0.5934835926606867, "survival_time": 6.749999999999984, "driven_lanedir": 0.1515171976663483, "in-drivable-lane": 5.8999999999999835, "deviation-heading": 0.45295763702669184, "distance-from-start": 0.5919630317071302, "deviation-center-line": 0.07267852851772624, "driven_lanedir_consec": 0.1515171976663483}, "4way-000-ego2": {"driven_any": 1.1608174710579644, "survival_time": 6.749999999999984, "driven_lanedir": 0.30232294989682007, "in-drivable-lane": 5.249999999999983, "deviation-heading": 0.5879159544462242, "distance-from-start": 1.1170343868373716, "deviation-center-line": 0.08689760880294149, "driven_lanedir_consec": 0.30232294989682007}, "4way-000-ego3": {"driven_any": 1.7185005321047406, "survival_time": 6.749999999999984, "driven_lanedir": 0.7732401434509224, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 1.2927893688370895, "distance-from-start": 1.7120425619369335, "deviation-center-line": 0.2568268659170377, "driven_lanedir_consec": 0.7732401434509224}}simulation-passed 1 survival_time_max 6.749999999999984 survival_time_mean 6.749999999999984 survival_time_min 6.749999999999984
No reset possible 16342
1803
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:58:34+00:00 2022-11-27 21:02:22+00:00 0:03:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.899999999999991 in-drivable-lane_median 7.69999999999999 driven_lanedir_consec_median 0.22924212443370068 deviation-center-line_median 0.07788550874769366
other stats deviation-center-line_max 0.13215115070811753 deviation-center-line_mean 0.08451398563882159 deviation-center-line_min 0.05013377435178154 deviation-heading_max 0.551118130560901 deviation-heading_mean 0.4867736483988059 deviation-heading_median 0.48699299239769767 deviation-heading_min 0.4219904782389271 distance-from-start_max 2.3781637640036313 distance-from-start_mean 1.2284337098999307 distance-from-start_median 1.0056167174930528 distance-from-start_min 0.5243376406099852 driven_any_max 2.505491639633309 driven_any_mean 1.2777864195054471 driven_any_median 1.0381294706542006 driven_any_min 0.5293950970800786 driven_lanedir_consec_max 0.4009917400579892 driven_lanedir_consec_mean 0.24854506749621855 driven_lanedir_consec_min 0.1347042810594838 driven_lanedir_max 0.4009917400579892 driven_lanedir_mean 0.24854506749621855 driven_lanedir_median 0.22924212443370068 driven_lanedir_min 0.1347042810594838 in-drivable-lane_max 7.999999999999991 in-drivable-lane_mean 7.649999999999992 in-drivable-lane_min 7.19999999999999 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6004862787041942, "survival_time": 8.899999999999991, "driven_lanedir": 0.22578775482650304, "in-drivable-lane": 7.749999999999991, "deviation-heading": 0.551118130560901, "distance-from-start": 0.5906060251174934, "deviation-center-line": 0.06486880874716822, "driven_lanedir_consec": 0.22578775482650304}, "zigzag-000-ego1": {"driven_any": 1.4757726626042071, "survival_time": 8.899999999999991, "driven_lanedir": 0.4009917400579892, "in-drivable-lane": 7.19999999999999, "deviation-heading": 0.4937168327455094, "distance-from-start": 1.4206274098686122, "deviation-center-line": 0.13215115070811753, "driven_lanedir_consec": 0.4009917400579892}, "zigzag-000-ego2": {"driven_any": 2.505491639633309, "survival_time": 8.899999999999991, "driven_lanedir": 0.23269649404089832, "in-drivable-lane": 7.649999999999991, "deviation-heading": 0.4219904782389271, "distance-from-start": 2.3781637640036313, "deviation-center-line": 0.09090220874821912, "driven_lanedir_consec": 0.23269649404089832}, "zigzag-000-ego3": {"driven_any": 0.5293950970800786, "survival_time": 8.899999999999991, "driven_lanedir": 0.1347042810594838, "in-drivable-lane": 7.999999999999991, "deviation-heading": 0.48026915204988585, "distance-from-start": 0.5243376406099852, "deviation-center-line": 0.05013377435178154, "driven_lanedir_consec": 0.1347042810594838}}simulation-passed 1 survival_time_max 8.899999999999991 survival_time_mean 8.899999999999991 survival_time_min 8.899999999999991
No reset possible 16334
1805
Bea Baselines 🐤template-ros lx22-modcon
sim success yes davinci-stage-02-6.2.51
2022-11-27 20:53:54+00:00 2022-11-27 20:58:07+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 5.300000000000024 deviation-center-line_median 0.6437686838483057 driven_lanedir_consec_median 2.1565604424041385 survival_time_median 12.7000000000001
other stats deviation-center-line_max 1.287537367696611 deviation-center-line_mean 0.6437686838483057 deviation-center-line_min 0.0 deviation-heading_max 2.714743042931883 deviation-heading_mean 1.3573715214659414 deviation-heading_median 1.3573715214659414 deviation-heading_min 0.0 distance-from-start_max 6.464519806941453 distance-from-start_mean 3.3954511194683046 distance-from-start_median 3.3954511194683046 distance-from-start_min 0.3263824319951555 driven_any_max 6.659308767521695 driven_any_mean 3.4951715200521 driven_any_median 3.4951715200521 driven_any_min 0.3310342725825046 driven_lanedir_consec_max 4.313120884808277 driven_lanedir_consec_mean 2.1565604424041385 driven_lanedir_consec_min 0.0 driven_lanedir_max 4.313120884808277 driven_lanedir_mean 2.1565604424041385 driven_lanedir_median 2.1565604424041385 driven_lanedir_min 0.0 in-drivable-lane_max 8.550000000000047 in-drivable-lane_mean 5.300000000000024 in-drivable-lane_min 2.0500000000000007 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 6.659308767521695, "survival_time": 23.350000000000197, "driven_lanedir": 4.313120884808277, "in-drivable-lane": 8.550000000000047, "deviation-heading": 2.714743042931883, "distance-from-start": 6.464519806941453, "deviation-center-line": 1.287537367696611, "driven_lanedir_consec": 4.313120884808277}, "LF-full-loop-001-ego0": {"driven_any": 0.3310342725825046, "survival_time": 2.0500000000000007, "driven_lanedir": 0.0, "in-drivable-lane": 2.0500000000000007, "deviation-heading": 0.0, "distance-from-start": 0.3263824319951555, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 23.350000000000197 survival_time_mean 12.7000000000001 survival_time_min 2.0500000000000007
No reset possible 16330
1809
Bea Baselines 🐤template-ros lx22-BV1
sim-2of5 success yes davinci-stage-02-6.2.51
2022-11-27 20:52:21+00:00 2022-11-27 20:53:48+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.33734867503017635
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.33734867503017635 distance-from-start_median 0.33734867503017635 distance-from-start_min 0.33734867503017635 driven_any_max 0.3387257855396695 driven_any_mean 0.3387257855396695 driven_any_median 0.3387257855396695 driven_any_min 0.3387257855396695 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.1000000000000005 in-drivable-lane_mean 2.1000000000000005 in-drivable-lane_median 2.1000000000000005 in-drivable-lane_min 2.1000000000000005 per-episodes details {"d40-ego0": {"driven_any": 0.3387257855396695, "survival_time": 2.1000000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 2.1000000000000005, "deviation-heading": 0.0, "distance-from-start": 0.33734867503017635, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.1000000000000005 survival_time_mean 2.1000000000000005 survival_time_median 2.1000000000000005 survival_time_min 2.1000000000000005
No reset possible 16324
1816
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:49:18+00:00 2022-11-27 20:51:58+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.549999999999992 in-drivable-lane_median 3.799999999999992 driven_lanedir_consec_median 0.09429094200306842 deviation-center-line_median 0.04521486003742643
other stats deviation-center-line_max 0.04521486003742643 deviation-center-line_mean 0.04521486003742643 deviation-center-line_min 0.04521486003742643 deviation-heading_max 0.5911728779811998 deviation-heading_mean 0.5911728779811998 deviation-heading_median 0.5911728779811998 deviation-heading_min 0.5911728779811998 distance-from-start_max 1.0205573372082508 distance-from-start_mean 1.0205573372082508 distance-from-start_median 1.0205573372082508 distance-from-start_min 1.0205573372082508 driven_any_max 1.0890816684976985 driven_any_mean 1.0890816684976985 driven_any_median 1.0890816684976985 driven_any_min 1.0890816684976985 driven_lanedir_consec_max 0.09429094200306842 driven_lanedir_consec_mean 0.09429094200306842 driven_lanedir_consec_min 0.09429094200306842 driven_lanedir_max 0.09429094200306842 driven_lanedir_mean 0.09429094200306842 driven_lanedir_median 0.09429094200306842 driven_lanedir_min 0.09429094200306842 in-drivable-lane_max 3.799999999999992 in-drivable-lane_mean 3.799999999999992 in-drivable-lane_min 3.799999999999992 per-episodes details {"loop-000-ego0": {"driven_any": 1.0890816684976985, "survival_time": 4.549999999999992, "driven_lanedir": 0.09429094200306842, "in-drivable-lane": 3.799999999999992, "deviation-heading": 0.5911728779811998, "distance-from-start": 1.0205573372082508, "deviation-center-line": 0.04521486003742643, "driven_lanedir_consec": 0.09429094200306842}}simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 4.549999999999992 survival_time_min 4.549999999999992
No reset possible 16316
1817
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:46:00+00:00 2022-11-27 20:48:52+00:00 0:02:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.999999999999987 in-drivable-lane_median 5.149999999999986 driven_lanedir_consec_median 0.10065858364266768 deviation-center-line_median 0.05266063230956128
other stats deviation-center-line_max 0.05266063230956128 deviation-center-line_mean 0.05266063230956128 deviation-center-line_min 0.05266063230956128 deviation-heading_max 0.6588911448694981 deviation-heading_mean 0.6588911448694981 deviation-heading_median 0.6588911448694981 deviation-heading_min 0.6588911448694981 distance-from-start_max 1.3852693831431144 distance-from-start_mean 1.3852693831431144 distance-from-start_median 1.3852693831431144 distance-from-start_min 1.3852693831431144 driven_any_max 1.436890683990904 driven_any_mean 1.436890683990904 driven_any_median 1.436890683990904 driven_any_min 1.436890683990904 driven_lanedir_consec_max 0.10065858364266768 driven_lanedir_consec_mean 0.10065858364266768 driven_lanedir_consec_min 0.10065858364266768 driven_lanedir_max 0.10065858364266768 driven_lanedir_mean 0.10065858364266768 driven_lanedir_median 0.10065858364266768 driven_lanedir_min 0.10065858364266768 in-drivable-lane_max 5.149999999999986 in-drivable-lane_mean 5.149999999999986 in-drivable-lane_min 5.149999999999986 per-episodes details {"udem-000-ego0": {"driven_any": 1.436890683990904, "survival_time": 5.999999999999987, "driven_lanedir": 0.10065858364266768, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.6588911448694981, "distance-from-start": 1.3852693831431144, "deviation-center-line": 0.05266063230956128, "driven_lanedir_consec": 0.10065858364266768}}simulation-passed 1 survival_time_max 5.999999999999987 survival_time_mean 5.999999999999987 survival_time_min 5.999999999999987
No reset possible 16312
1819
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:43:20+00:00 2022-11-27 20:45:28+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.136109252835098 survival_time_median 9.149999999999997 deviation-center-line_median 0.10250271197252855 in-drivable-lane_median 7.699999999999997
other stats deviation-center-line_max 0.10250271197252855 deviation-center-line_mean 0.10250271197252855 deviation-center-line_min 0.10250271197252855 deviation-heading_max 1.4616112216228294 deviation-heading_mean 1.4616112216228294 deviation-heading_median 1.4616112216228294 deviation-heading_min 1.4616112216228294 distance-from-start_max 2.3080653677427594 distance-from-start_mean 2.3080653677427594 distance-from-start_median 2.3080653677427594 distance-from-start_min 2.3080653677427594 driven_any_max 2.383950671445897 driven_any_mean 2.383950671445897 driven_any_median 2.383950671445897 driven_any_min 2.383950671445897 driven_lanedir_consec_max 0.136109252835098 driven_lanedir_consec_mean 0.136109252835098 driven_lanedir_consec_min 0.136109252835098 driven_lanedir_max 0.136109252835098 driven_lanedir_mean 0.136109252835098 driven_lanedir_median 0.136109252835098 driven_lanedir_min 0.136109252835098 in-drivable-lane_max 7.699999999999997 in-drivable-lane_mean 7.699999999999997 in-drivable-lane_min 7.699999999999997 per-episodes details {"loop-000-ego0": {"driven_any": 2.383950671445897, "survival_time": 9.149999999999997, "driven_lanedir": 0.136109252835098, "in-drivable-lane": 7.699999999999997, "deviation-heading": 1.4616112216228294, "distance-from-start": 2.3080653677427594, "deviation-center-line": 0.10250271197252855, "driven_lanedir_consec": 0.136109252835098}}simulation-passed 1 survival_time_max 9.149999999999997 survival_time_mean 9.149999999999997 survival_time_min 9.149999999999997
No reset possible 16307
1820
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:41:18+00:00 2022-11-27 20:42:46+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16302
1821
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:37:15+00:00 2022-11-27 20:41:12+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.55 in-drivable-lane_median 7.0500000000000025 driven_lanedir_consec_median 0.6122140378359874 deviation-center-line_median 0.22148535915248152
other stats deviation-center-line_max 0.32230531135657114 deviation-center-line_mean 0.20819754520821843 deviation-center-line_min 0.06751415117133963 deviation-heading_max 1.2183078762858224 deviation-heading_mean 0.8050865265275047 deviation-heading_median 0.7883353306406129 deviation-heading_min 0.4253675685429703 distance-from-start_max 2.478299956364108 distance-from-start_mean 1.2518139437837823 distance-from-start_median 0.910015488815888 distance-from-start_min 0.7089248411392455 driven_any_max 2.6591679178769385 driven_any_mean 1.3192282496069554 driven_any_median 0.9531212482406408 driven_any_min 0.7115025840696018 driven_lanedir_consec_max 0.8368842787091888 driven_lanedir_consec_mean 0.5436156988998173 driven_lanedir_consec_min 0.11315044121810568 driven_lanedir_max 0.8368842787091888 driven_lanedir_mean 0.5436156988998173 driven_lanedir_median 0.6122140378359874 driven_lanedir_min 0.11315044121810568 in-drivable-lane_max 8.8 in-drivable-lane_mean 7.275000000000002 in-drivable-lane_min 6.200000000000005 per-episodes details {"loop-000-ego0": {"driven_any": 1.185025413979852, "survival_time": 9.55, "driven_lanedir": 0.8368842787091888, "in-drivable-lane": 6.300000000000004, "deviation-heading": 1.2183078762858224, "distance-from-start": 1.1104443377063884, "deviation-center-line": 0.31792505278629324, "driven_lanedir_consec": 0.8368842787091888}, "loop-000-ego1": {"driven_any": 2.6591679178769385, "survival_time": 9.55, "driven_lanedir": 0.8301539496690402, "in-drivable-lane": 6.200000000000005, "deviation-heading": 1.0988016350729226, "distance-from-start": 2.478299956364108, "deviation-center-line": 0.32230531135657114, "driven_lanedir_consec": 0.8301539496690402}, "loop-000-ego2": {"driven_any": 0.7115025840696018, "survival_time": 9.55, "driven_lanedir": 0.39427412600293454, "in-drivable-lane": 7.8, "deviation-heading": 0.4253675685429703, "distance-from-start": 0.7095866399253874, "deviation-center-line": 0.1250456655186698, "driven_lanedir_consec": 0.39427412600293454}, "loop-000-ego3": {"driven_any": 0.7212170825014295, "survival_time": 9.55, "driven_lanedir": 0.11315044121810568, "in-drivable-lane": 8.8, "deviation-heading": 0.4778690262083032, "distance-from-start": 0.7089248411392455, "deviation-center-line": 0.06751415117133963, "driven_lanedir_consec": 0.11315044121810568}}simulation-passed 1 survival_time_max 9.55 survival_time_mean 9.55 survival_time_min 9.55
No reset possible 16297
1822
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:34:45+00:00 2022-11-27 20:36:46+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.400000000000013 in-drivable-lane_median 8.050000000000004 driven_lanedir_consec_median 0.3114301183526528 deviation-center-line_median 0.19544172648143468
other stats deviation-center-line_max 0.19544172648143468 deviation-center-line_mean 0.19544172648143468 deviation-center-line_min 0.19544172648143468 deviation-heading_max 2.369986081409165 deviation-heading_mean 2.369986081409165 deviation-heading_median 2.369986081409165 deviation-heading_min 2.369986081409165 distance-from-start_max 2.24877164254497 distance-from-start_mean 2.24877164254497 distance-from-start_median 2.24877164254497 distance-from-start_min 2.24877164254497 driven_any_max 2.7822952528425806 driven_any_mean 2.7822952528425806 driven_any_median 2.7822952528425806 driven_any_min 2.7822952528425806 driven_lanedir_consec_max 0.3114301183526528 driven_lanedir_consec_mean 0.3114301183526528 driven_lanedir_consec_min 0.3114301183526528 driven_lanedir_max 0.3114301183526528 driven_lanedir_mean 0.3114301183526528 driven_lanedir_median 0.3114301183526528 driven_lanedir_min 0.3114301183526528 in-drivable-lane_max 8.050000000000004 in-drivable-lane_mean 8.050000000000004 in-drivable-lane_min 8.050000000000004 per-episodes details {"autolab-000-ego0": {"driven_any": 2.7822952528425806, "survival_time": 10.400000000000013, "driven_lanedir": 0.3114301183526528, "in-drivable-lane": 8.050000000000004, "deviation-heading": 2.369986081409165, "distance-from-start": 2.24877164254497, "deviation-center-line": 0.19544172648143468, "driven_lanedir_consec": 0.3114301183526528}}simulation-passed 1 survival_time_max 10.400000000000013 survival_time_mean 10.400000000000013 survival_time_min 10.400000000000013
No reset possible 16292
1848
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-02-6.2.51
2022-11-27 20:29:09+00:00 2022-11-27 20:34:18+00:00 0:05:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 4.320194413930606
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 4.320194413930606 distance-from-start_median 4.320194413930606 distance-from-start_min 4.320194413930606 driven_any_max 4.907829339719668 driven_any_mean 4.907829339719668 driven_any_median 4.907829339719668 driven_any_min 4.907829339719668 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 33.60000000000023 in-drivable-lane_mean 33.60000000000023 in-drivable-lane_median 33.60000000000023 in-drivable-lane_min 33.60000000000023 per-episodes details {"d45-ego0": {"driven_any": 4.907829339719668, "survival_time": 33.60000000000023, "driven_lanedir": 0.0, "in-drivable-lane": 33.60000000000023, "deviation-heading": 0.0, "distance-from-start": 4.320194413930606, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 33.60000000000023 survival_time_mean 33.60000000000023 survival_time_median 33.60000000000023 survival_time_min 33.60000000000023
No reset possible 16283
1843
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-0of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:27:32+00:00 2022-11-27 20:29:00+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16278
1845
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:24:29+00:00 2022-11-27 20:26:22+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16274
1846
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-0of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:22:10+00:00 2022-11-27 20:24:04+00:00 0:01:54 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16266
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success yes davinci-stage-02-6.2.51
2022-11-27 20:18:09+00:00 2022-11-27 20:21:43+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.094303085750233
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.094303085750233 distance-from-start_median 5.094303085750233 distance-from-start_min 5.094303085750233 driven_any_max 5.70944127877577 driven_any_mean 5.70944127877577 driven_any_median 5.70944127877577 driven_any_min 5.70944127877577 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 16.900000000000105 in-drivable-lane_mean 16.900000000000105 in-drivable-lane_median 16.900000000000105 in-drivable-lane_min 16.900000000000105 per-episodes details {"d50-ego0": {"driven_any": 5.70944127877577, "survival_time": 16.900000000000105, "driven_lanedir": 0.0, "in-drivable-lane": 16.900000000000105, "deviation-heading": 0.0, "distance-from-start": 5.094303085750233, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 16.900000000000105 survival_time_mean 16.900000000000105 survival_time_median 16.900000000000105 survival_time_min 16.900000000000105
No reset possible 16259
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success yes davinci-stage-02-6.2.51
2022-11-27 20:15:54+00:00 2022-11-27 20:17:41+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.48816016817238
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.48816016817238 distance-from-start_median 0.48816016817238 distance-from-start_min 0.48816016817238 driven_any_max 0.4881601681723813 driven_any_mean 0.4881601681723813 driven_any_median 0.4881601681723813 driven_any_min 0.4881601681723813 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.2999999999999963 in-drivable-lane_mean 3.2999999999999963 in-drivable-lane_median 3.2999999999999963 in-drivable-lane_min 3.2999999999999963 per-episodes details {"d60-ego0": {"driven_any": 0.4881601681723813, "survival_time": 3.2999999999999963, "driven_lanedir": 0.0, "in-drivable-lane": 3.2999999999999963, "deviation-heading": 0.0, "distance-from-start": 0.48816016817238, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.2999999999999963 survival_time_mean 3.2999999999999963 survival_time_median 3.2999999999999963 survival_time_min 3.2999999999999963
No reset possible 16254
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 aborted no davinci-stage-02-6.2.51
2022-11-27 20:13:54+00:00 2022-11-27 20:15:01+00:00 0:01:07 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16250
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-3of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:11:52+00:00 2022-11-27 20:13:18+00:00 0:01:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16244
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:09:54+00:00 2022-11-27 20:11:27+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16239
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 20:08:11+00:00 2022-11-27 20:09:47+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16235
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-3of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:05:49+00:00 2022-11-27 20:07:36+00:00 0:01:47 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16230
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-2of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:04:35+00:00 2022-11-27 20:05:35+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16226
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-1of4 failed yes davinci-stage-02-6.2.51
2022-11-27 20:02:50+00:00 2022-11-27 20:04:28+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16220
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 19:56:17+00:00 2022-11-27 20:02:36+00:00 0:06:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.7991441641948205 survival_time_median 59.99999999999873 deviation-center-line_median 3.537941199236393 in-drivable-lane_median 21.94999999999955
other stats deviation-center-line_max 3.537941199236393 deviation-center-line_mean 3.537941199236393 deviation-center-line_min 3.537941199236393 deviation-heading_max 29.248872867220214 deviation-heading_mean 29.248872867220214 deviation-heading_median 29.248872867220214 deviation-heading_min 29.248872867220214 distance-from-start_max 0.17372903616197105 distance-from-start_mean 0.17372903616197105 distance-from-start_median 0.17372903616197105 distance-from-start_min 0.17372903616197105 driven_any_max 11.035417091440914 driven_any_mean 11.035417091440914 driven_any_median 11.035417091440914 driven_any_min 11.035417091440914 driven_lanedir_consec_max -2.7991441641948205 driven_lanedir_consec_mean -2.7991441641948205 driven_lanedir_consec_min -2.7991441641948205 driven_lanedir_max -2.7991441641948205 driven_lanedir_mean -2.7991441641948205 driven_lanedir_median -2.7991441641948205 driven_lanedir_min -2.7991441641948205 in-drivable-lane_max 21.94999999999955 in-drivable-lane_mean 21.94999999999955 in-drivable-lane_min 21.94999999999955 per-episodes details {"loop2-000-ego0": {"driven_any": 11.035417091440914, "survival_time": 59.99999999999873, "driven_lanedir": -2.7991441641948205, "in-drivable-lane": 21.94999999999955, "deviation-heading": 29.248872867220214, "distance-from-start": 0.17372903616197105, "deviation-center-line": 3.537941199236393, "driven_lanedir_consec": -2.7991441641948205}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16216
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-1of4 failed yes davinci-stage-02-6.2.51
2022-11-27 19:54:47+00:00 2022-11-27 19:55:44+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16208
1507
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-2of4 timeout yes davinci-stage-02-6.2.51
2022-11-27 19:52:10+00:00 2022-11-27 19:54:35+00:00 0:02:25 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16202
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-02-6.2.51
2022-11-27 07:04:57+00:00 2022-11-27 07:06:47+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.1845878312388505
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.1845878312388505 distance-from-start_median 1.1845878312388505 distance-from-start_min 1.1845878312388505 driven_any_max 1.5515230010770886 driven_any_mean 1.5515230010770886 driven_any_median 1.5515230010770886 driven_any_min 1.5515230010770886 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 5.349999999999989 in-drivable-lane_mean 5.349999999999989 in-drivable-lane_median 5.349999999999989 in-drivable-lane_min 5.349999999999989 per-episodes details {"d45-ego0": {"driven_any": 1.5515230010770886, "survival_time": 5.349999999999989, "driven_lanedir": 0.0, "in-drivable-lane": 5.349999999999989, "deviation-heading": 0.0, "distance-from-start": 1.1845878312388505, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 5.349999999999989 survival_time_mean 5.349999999999989 survival_time_median 5.349999999999989 survival_time_min 5.349999999999989
No reset possible 16199
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-02-6.2.51
2022-11-27 03:48:13+00:00 2022-11-27 03:56:11+00:00 0:07:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16192
1591
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-test
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:47:56+00:00 2022-11-27 00:50:28+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16188
1585
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-vali
step1-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:46:41+00:00 2022-11-27 00:47:22+00:00 0:00:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16183
1592
Andrea Daniele planning-exercise lx22-planning-dd-static-test
step1-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:42:05+00:00 2022-11-27 00:46:13+00:00 0:04:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16179
1586
Andrea Daniele planning-exercise lx22-planning-dd-static-vali
step1-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:37:02+00:00 2022-11-27 00:41:33+00:00 0:04:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16178
1594
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-test
step1-3of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:36:14+00:00 2022-11-27 00:36:43+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16175
1594
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-test
step1-1of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:35:26+00:00 2022-11-27 00:36:01+00:00 0:00:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16169
1586
Andrea Daniele planning-exercise lx22-planning-dd-static-vali
step1-2of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:30:40+00:00 2022-11-27 00:34:54+00:00 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16161
1589
Andrea Daniele planning-exercise lx22-planning-cc-static-vali
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-27 00:27:37+00:00 2022-11-27 00:30:18+00:00 0:02:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16156
1584
Andrea Censi exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-26 23:25:56+00:00 2022-11-26 23:37:19+00:00 0:11:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16145
1578
Andrea Censi planning-exercise lx22-planning-dd-empty-test
step1 success yes davinci-stage-02-6.2.51
2022-11-26 22:37:34+00:00 2022-11-26 22:54:27+00:00 0:16:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.9629629629629628 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16139
1570
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:33:57+00:00 2022-11-26 22:37:00+00:00 0:03:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16138
1570
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-1of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:32:33+00:00 2022-11-26 22:33:23+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16136
1571
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-1of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:27:37+00:00 2022-11-26 22:32:06+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16133
1579
Andrea Censi planning-exercise lx22-planning-cc-dynamic-test
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:24:33+00:00 2022-11-26 22:27:30+00:00 0:02:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16129
1580
Andrea Censi planning-exercise lx22-planning-cc-static-test
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:21:26+00:00 2022-11-26 22:24:06+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16121
1573
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-0of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:17:57+00:00 2022-11-26 22:20:52+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16116
1574
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-2of4 success yes davinci-stage-02-6.2.51
2022-11-26 22:14:45+00:00 2022-11-26 22:17:29+00:00 0:02:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16114
1558
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-3of4 failed yes davinci-stage-02-6.2.51
2022-11-26 21:00:33+00:00 2022-11-26 21:01:10+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16109
1558
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-2of4 failed yes davinci-stage-02-6.2.51
2022-11-26 20:59:41+00:00 2022-11-26 21:00:21+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16108
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-0of4 failed yes davinci-stage-02-6.2.51
2022-11-26 20:58:36+00:00 2022-11-26 20:59:13+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16100
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-3of4 failed yes davinci-stage-02-6.2.51
2022-11-26 20:57:42+00:00 2022-11-26 20:58:20+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16097
1562
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-3of4 failed yes davinci-stage-02-6.2.51
2022-11-26 20:54:08+00:00 2022-11-26 20:57:20+00:00 0:03:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16093
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-02-6.2.51
2022-11-26 19:42:01+00:00 2022-11-26 19:50:23+00:00 0:08:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16085
1556
Frank (Chude) Qian exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-26 19:18:05+00:00 2022-11-26 19:29:00+00:00 0:10:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16083
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 host-error no davinci-stage-02-6.2.51
2022-11-25 17:21:15+00:00 2022-11-25 17:22:54+00:00 0:01:39 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-02-6.2.51-job16083-226957, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-02-6.2.51-job16083-226957', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16077
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 16:29:48+00:00 2022-11-25 17:09:02+00:00 0:39:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 24.949999999999307 driven_lanedir_consec_median -3.6396913923954903 deviation-center-line_median 2.9517439957678575
other stats deviation-center-line_max 4.134635066791235 deviation-center-line_mean 2.8962612625710813 deviation-center-line_min 1.546921991957375 deviation-heading_max 26.834249274732283 deviation-heading_mean 23.040581609647496 deviation-heading_median 25.162114329415353 deviation-heading_min 15.003848505027 distance-from-start_max 0.17264406306666505 distance-from-start_mean 0.1680668842091607 distance-from-start_median 0.16741131183744318 distance-from-start_min 0.1648008500950914 driven_any_max 15.582773544296256 driven_any_mean 13.647423921154918 driven_any_median 13.658766756249538 driven_any_min 11.689388627824336 driven_lanedir_consec_max -1.9466336583487929 driven_lanedir_consec_mean -3.2499168692375653 driven_lanedir_consec_min -3.773651033810487 driven_lanedir_max -1.960505568404283 driven_lanedir_mean -5.074290490340701 driven_lanedir_median -5.406998047641883 driven_lanedir_min -7.522660297674752 in-drivable-lane_max 43.99999999999898 in-drivable-lane_mean 28.13749999999925 in-drivable-lane_min 18.649999999999388 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.064324267881002, "survival_time": 59.99999999999873, "driven_lanedir": -4.212178895598542, "in-drivable-lane": 27.39999999999928, "deviation-heading": 26.834249274732283, "distance-from-start": 0.16655978473215255, "deviation-center-line": 2.725939713647398, "driven_lanedir_consec": -3.773651033810487}, "zigzag-000-ego1": {"driven_any": 11.689388627824336, "survival_time": 59.99999999999873, "driven_lanedir": -1.960505568404283, "in-drivable-lane": 43.99999999999898, "deviation-heading": 15.003848505027, "distance-from-start": 0.1648008500950914, "deviation-center-line": 1.546921991957375, "driven_lanedir_consec": -1.9466336583487929}, "zigzag-000-ego2": {"driven_any": 15.582773544296256, "survival_time": 59.99999999999873, "driven_lanedir": -7.522660297674752, "in-drivable-lane": 18.649999999999388, "deviation-heading": 26.53572434369589, "distance-from-start": 0.17264406306666505, "deviation-center-line": 4.134635066791235, "driven_lanedir_consec": -3.741115679095421}, "zigzag-000-ego3": {"driven_any": 15.253209244618072, "survival_time": 59.99999999999873, "driven_lanedir": -6.601817199685225, "in-drivable-lane": 22.499999999999336, "deviation-heading": 23.788504315134812, "distance-from-start": 0.16826283894273378, "deviation-center-line": 3.177548277888317, "driven_lanedir_consec": -3.53826710569556}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16070
387
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 16:14:44+00:00 2022-11-25 16:29:34+00:00 0:14:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.749999999999368 driven_lanedir_consec_median -2.5419744601163754 deviation-center-line_median 3.648144229247465
other stats deviation-center-line_max 3.648144229247465 deviation-center-line_mean 3.648144229247465 deviation-center-line_min 3.648144229247465 deviation-heading_max 27.338482600464 deviation-heading_mean 27.338482600464 deviation-heading_median 27.338482600464 deviation-heading_min 27.338482600464 distance-from-start_max 0.2063875448211444 distance-from-start_mean 0.2063875448211444 distance-from-start_median 0.2063875448211444 distance-from-start_min 0.2063875448211444 driven_any_max 11.125902134024352 driven_any_mean 11.125902134024352 driven_any_median 11.125902134024352 driven_any_min 11.125902134024352 driven_lanedir_consec_max -2.5419744601163754 driven_lanedir_consec_mean -2.5419744601163754 driven_lanedir_consec_min -2.5419744601163754 driven_lanedir_max -2.5419744601163754 driven_lanedir_mean -2.5419744601163754 driven_lanedir_median -2.5419744601163754 driven_lanedir_min -2.5419744601163754 in-drivable-lane_max 23.749999999999368 in-drivable-lane_mean 23.749999999999368 in-drivable-lane_min 23.749999999999368 per-episodes details {"loop-000-ego0": {"driven_any": 11.125902134024352, "survival_time": 59.99999999999873, "driven_lanedir": -2.5419744601163754, "in-drivable-lane": 23.749999999999368, "deviation-heading": 27.338482600464, "distance-from-start": 0.2063875448211444, "deviation-center-line": 3.648144229247465, "driven_lanedir_consec": -2.5419744601163754}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16064
388
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 15:57:29+00:00 2022-11-25 16:14:11+00:00 0:16:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 19.649999999999583 driven_lanedir_consec_median -2.6516550357128423 deviation-center-line_median 3.9026913098498945
other stats deviation-center-line_max 3.9026913098498945 deviation-center-line_mean 3.9026913098498945 deviation-center-line_min 3.9026913098498945 deviation-heading_max 28.532337510239778 deviation-heading_mean 28.532337510239778 deviation-heading_median 28.532337510239778 deviation-heading_min 28.532337510239778 distance-from-start_max 0.22827403036925392 distance-from-start_mean 0.22827403036925392 distance-from-start_median 0.22827403036925392 distance-from-start_min 0.22827403036925392 driven_any_max 10.726973882876328 driven_any_mean 10.726973882876328 driven_any_median 10.726973882876328 driven_any_min 10.726973882876328 driven_lanedir_consec_max -2.6516550357128423 driven_lanedir_consec_mean -2.6516550357128423 driven_lanedir_consec_min -2.6516550357128423 driven_lanedir_max -2.707985610516482 driven_lanedir_mean -2.707985610516482 driven_lanedir_median -2.707985610516482 driven_lanedir_min -2.707985610516482 in-drivable-lane_max 19.649999999999583 in-drivable-lane_mean 19.649999999999583 in-drivable-lane_min 19.649999999999583 per-episodes details {"udem-000-ego0": {"driven_any": 10.726973882876328, "survival_time": 59.99999999999873, "driven_lanedir": -2.707985610516482, "in-drivable-lane": 19.649999999999583, "deviation-heading": 28.532337510239778, "distance-from-start": 0.22827403036925392, "deviation-center-line": 3.9026913098498945, "driven_lanedir_consec": -2.6516550357128423}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16062
389
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 15:55:03+00:00 2022-11-25 15:57:01+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16050
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 15:15:25+00:00 2022-11-25 15:54:25+00:00 0:39:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 20.74999999999948 driven_lanedir_consec_median -3.6614309980693447 deviation-center-line_median 4.128952964551994
other stats deviation-center-line_max 6.015050053522057 deviation-center-line_mean 4.069080012723249 deviation-center-line_min 2.0033640682669507 deviation-heading_max 35.30574063672681 deviation-heading_mean 28.43373301004823 deviation-heading_median 28.737391010114965 deviation-heading_min 20.954409383236168 distance-from-start_max 0.20159078192128585 distance-from-start_mean 0.16761762913949238 distance-from-start_median 0.16817908961645756 distance-from-start_min 0.1325215554037686 driven_any_max 15.075728775789964 driven_any_mean 12.884253068347356 driven_any_median 12.809522769159088 driven_any_min 10.842237959281285 driven_lanedir_consec_max -1.9881801653694096 driven_lanedir_consec_mean -3.5177713762637257 driven_lanedir_consec_min -4.760043343546806 driven_lanedir_max -1.9881801653694096 driven_lanedir_mean -5.53054396883506 driven_lanedir_median -5.676329473443166 driven_lanedir_min -8.781336763084497 in-drivable-lane_max 38.39999999999897 in-drivable-lane_mean 21.999999999999435 in-drivable-lane_min 8.09999999999981 per-episodes details {"udem-000-ego0": {"driven_any": 11.901897950154874, "survival_time": 59.99999999999873, "driven_lanedir": -3.192598418382432, "in-drivable-lane": 31.899999999999142, "deviation-heading": 24.561608705263588, "distance-from-start": 0.16274601084565937, "deviation-center-line": 2.6691469276232462, "driven_lanedir_consec": -3.034792234725286}, "udem-000-ego1": {"driven_any": 10.842237959281285, "survival_time": 59.99999999999873, "driven_lanedir": -1.9881801653694096, "in-drivable-lane": 38.39999999999897, "deviation-heading": 20.954409383236168, "distance-from-start": 0.1325215554037686, "deviation-center-line": 2.0033640682669507, "driven_lanedir_consec": -1.9881801653694096}, "udem-000-ego2": {"driven_any": 13.717147588163302, "survival_time": 59.99999999999873, "driven_lanedir": -8.160060528503902, "in-drivable-lane": 8.09999999999981, "deviation-heading": 35.30574063672681, "distance-from-start": 0.1736121683872557, "deviation-center-line": 6.015050053522057, "driven_lanedir_consec": -4.2880697614134045}, "udem-000-ego3": {"driven_any": 15.075728775789964, "survival_time": 59.99999999999873, "driven_lanedir": -8.781336763084497, "in-drivable-lane": 9.59999999999982, "deviation-heading": 32.91317331496634, "distance-from-start": 0.20159078192128585, "deviation-center-line": 5.588759001480742, "driven_lanedir_consec": -4.760043343546806}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16041
394
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 14:56:35+00:00 2022-11-25 15:15:06+00:00 0:18:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 37.94999999999898 driven_lanedir_consec_median -2.387767131315256 deviation-center-line_median 2.059965625687436
other stats deviation-center-line_max 2.059965625687436 deviation-center-line_mean 2.059965625687436 deviation-center-line_min 2.059965625687436 deviation-heading_max 21.41094557833256 deviation-heading_mean 21.41094557833256 deviation-heading_median 21.41094557833256 deviation-heading_min 21.41094557833256 distance-from-start_max 0.19191616959158497 distance-from-start_mean 0.19191616959158497 distance-from-start_median 0.19191616959158497 distance-from-start_min 0.19191616959158497 driven_any_max 10.652605370097504 driven_any_mean 10.652605370097504 driven_any_median 10.652605370097504 driven_any_min 10.652605370097504 driven_lanedir_consec_max -2.387767131315256 driven_lanedir_consec_mean -2.387767131315256 driven_lanedir_consec_min -2.387767131315256 driven_lanedir_max -2.387767131315256 driven_lanedir_mean -2.387767131315256 driven_lanedir_median -2.387767131315256 driven_lanedir_min -2.387767131315256 in-drivable-lane_max 37.94999999999898 in-drivable-lane_mean 37.94999999999898 in-drivable-lane_min 37.94999999999898 per-episodes details {"autolab-000-ego0": {"driven_any": 10.652605370097504, "survival_time": 59.99999999999873, "driven_lanedir": -2.387767131315256, "in-drivable-lane": 37.94999999999898, "deviation-heading": 21.41094557833256, "distance-from-start": 0.19191616959158497, "deviation-center-line": 2.059965625687436, "driven_lanedir_consec": -2.387767131315256}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16035
395
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 14:39:39+00:00 2022-11-25 14:56:03+00:00 0:16:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 34.74999999999879 driven_lanedir_consec_median -1.5768931404013948 deviation-center-line_median 2.703301958505339
other stats deviation-center-line_max 2.703301958505339 deviation-center-line_mean 2.703301958505339 deviation-center-line_min 2.703301958505339 deviation-heading_max 21.379545441067187 deviation-heading_mean 21.379545441067187 deviation-heading_median 21.379545441067187 deviation-heading_min 21.379545441067187 distance-from-start_max 0.16853658585444148 distance-from-start_mean 0.16853658585444148 distance-from-start_median 0.16853658585444148 distance-from-start_min 0.16853658585444148 driven_any_max 11.235669497176785 driven_any_mean 11.235669497176785 driven_any_median 11.235669497176785 driven_any_min 11.235669497176785 driven_lanedir_consec_max -1.5768931404013948 driven_lanedir_consec_mean -1.5768931404013948 driven_lanedir_consec_min -1.5768931404013948 driven_lanedir_max -1.5768931404013948 driven_lanedir_mean -1.5768931404013948 driven_lanedir_median -1.5768931404013948 driven_lanedir_min -1.5768931404013948 in-drivable-lane_max 34.74999999999879 in-drivable-lane_mean 34.74999999999879 in-drivable-lane_min 34.74999999999879 per-episodes details {"udem-000-ego0": {"driven_any": 11.235669497176785, "survival_time": 59.99999999999873, "driven_lanedir": -1.5768931404013948, "in-drivable-lane": 34.74999999999879, "deviation-heading": 21.379545441067187, "distance-from-start": 0.16853658585444148, "deviation-center-line": 2.703301958505339, "driven_lanedir_consec": -1.5768931404013948}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16029
396
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 14:35:14+00:00 2022-11-25 14:39:32+00:00 0:04:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.050000000000164 in-drivable-lane_median 6.0500000000000504 driven_lanedir_consec_median -0.9505939007486546 deviation-center-line_median 0.6126106569590904
other stats deviation-center-line_max 0.6126106569590904 deviation-center-line_mean 0.6126106569590904 deviation-center-line_min 0.6126106569590904 deviation-heading_max 11.603218285871414 deviation-heading_mean 11.603218285871414 deviation-heading_median 11.603218285871414 deviation-heading_min 11.603218285871414 distance-from-start_max 0.15480578944010187 distance-from-start_mean 0.15480578944010187 distance-from-start_median 0.15480578944010187 distance-from-start_min 0.15480578944010187 driven_any_max 3.885900023117041 driven_any_mean 3.885900023117041 driven_any_median 3.885900023117041 driven_any_min 3.885900023117041 driven_lanedir_consec_max -0.9505939007486546 driven_lanedir_consec_mean -0.9505939007486546 driven_lanedir_consec_min -0.9505939007486546 driven_lanedir_max -0.9458366187818664 driven_lanedir_mean -0.9458366187818664 driven_lanedir_median -0.9458366187818664 driven_lanedir_min -0.9458366187818664 in-drivable-lane_max 6.0500000000000504 in-drivable-lane_mean 6.0500000000000504 in-drivable-lane_min 6.0500000000000504 per-episodes details {"4way-000-ego0": {"driven_any": 3.885900023117041, "survival_time": 21.050000000000164, "driven_lanedir": -0.9458366187818664, "in-drivable-lane": 6.0500000000000504, "deviation-heading": 11.603218285871414, "distance-from-start": 0.15480578944010187, "deviation-center-line": 0.6126106569590904, "driven_lanedir_consec": -0.9505939007486546}}simulation-passed 1 survival_time_max 21.050000000000164 survival_time_mean 21.050000000000164 survival_time_min 21.050000000000164
No reset possible 16025
514
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-validation
sim-2of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:33:37+00:00 2022-11-25 14:35:01+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16017
516
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-validation
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:31:54+00:00 2022-11-25 14:33:30+00:00 0:01:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16012
517
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:29:46+00:00 2022-11-25 14:31:22+00:00 0:01:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16008
518
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:28:12+00:00 2022-11-25 14:29:39+00:00 0:01:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16003
520
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 14:26:32+00:00 2022-11-25 14:27:48+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15999
520
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:25:04+00:00 2022-11-25 14:26:19+00:00 0:01:15 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15995
521
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-testing
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:23:38+00:00 2022-11-25 14:24:52+00:00 0:01:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15991
522
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-testing
sim-3of4 failed no davinci-stage-02-6.2.51
2022-11-25 14:22:29+00:00 2022-11-25 14:23:23+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15969
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 14:04:31+00:00 2022-11-25 14:22:06+00:00 0:17:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 54.44999999999904 in-drivable-lane_median 2.400000000000023 driven_lanedir_consec_median 5.800337105469268 deviation-center-line_median 3.507796233619681
other stats deviation-center-line_max 5.2304040041648685 deviation-center-line_mean 3.752530139453179 deviation-center-line_min 2.764124086408485 deviation-heading_max 16.718628787367727 deviation-heading_mean 14.560959036592635 deviation-heading_median 15.640724647151911 deviation-heading_min 10.243758064698998 distance-from-start_max 2.8034438215787567 distance-from-start_mean 2.52948879241017 distance-from-start_median 2.7016892985376373 distance-from-start_min 1.9111327509866485 driven_any_max 9.378734880918012 driven_any_mean 6.974038654134349 driven_any_median 6.7756885717747215 driven_any_min 4.966042592069941 driven_lanedir_consec_max 8.595990061551971 driven_lanedir_consec_mean 6.004636143094288 driven_lanedir_consec_min 3.8218802998866455 driven_lanedir_max 8.595990061551971 driven_lanedir_mean 6.004636143094288 driven_lanedir_median 5.800337105469268 driven_lanedir_min 3.8218802998866455 in-drivable-lane_max 4.899999999999894 in-drivable-lane_mean 2.424999999999985 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 9.378734880918012, "survival_time": 54.44999999999904, "driven_lanedir": 8.595990061551971, "in-drivable-lane": 0.8499999999999908, "deviation-heading": 15.286913929916604, "distance-from-start": 2.7781208795498538, "deviation-center-line": 2.764124086408485, "driven_lanedir_consec": 8.595990061551971}, "loop-000-ego1": {"driven_any": 4.966042592069941, "survival_time": 54.44999999999904, "driven_lanedir": 3.8218802998866455, "in-drivable-lane": 3.950000000000056, "deviation-heading": 10.243758064698998, "distance-from-start": 2.8034438215787567, "deviation-center-line": 4.243939304279579, "driven_lanedir_consec": 3.8218802998866455}, "loop-000-ego2": {"driven_any": 8.42266436065629, "survival_time": 54.44999999999904, "driven_lanedir": 6.637324877650634, "in-drivable-lane": 4.899999999999894, "deviation-heading": 15.994535364387222, "distance-from-start": 2.6252577175254204, "deviation-center-line": 2.7716531629597823, "driven_lanedir_consec": 6.637324877650634}, "loop-000-ego3": {"driven_any": 5.128712782893153, "survival_time": 54.44999999999904, "driven_lanedir": 4.963349333287901, "in-drivable-lane": 0.0, "deviation-heading": 16.718628787367727, "distance-from-start": 1.9111327509866485, "deviation-center-line": 5.2304040041648685, "driven_lanedir_consec": 4.963349333287901}}simulation-passed 1 survival_time_max 54.44999999999904 survival_time_mean 54.44999999999904 survival_time_min 54.44999999999904
No reset possible 15963
530
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 13:56:55+00:00 2022-11-25 14:04:22+00:00 0:07:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 10.135078140514093 deviation-center-line_median 2.814551031011964
other stats deviation-center-line_max 2.814551031011964 deviation-center-line_mean 2.814551031011964 deviation-center-line_min 2.814551031011964 deviation-heading_max 12.80493460738892 deviation-heading_mean 12.80493460738892 deviation-heading_median 12.80493460738892 deviation-heading_min 12.80493460738892 distance-from-start_max 1.1207219776159152 distance-from-start_mean 1.1207219776159152 distance-from-start_median 1.1207219776159152 distance-from-start_min 1.1207219776159152 driven_any_max 10.469607107690056 driven_any_mean 10.469607107690056 driven_any_median 10.469607107690056 driven_any_min 10.469607107690056 driven_lanedir_consec_max 10.135078140514093 driven_lanedir_consec_mean 10.135078140514093 driven_lanedir_consec_min 10.135078140514093 driven_lanedir_max 10.135078140514093 driven_lanedir_mean 10.135078140514093 driven_lanedir_median 10.135078140514093 driven_lanedir_min 10.135078140514093 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 10.469607107690056, "survival_time": 59.99999999999873, "driven_lanedir": 10.135078140514093, "in-drivable-lane": 0.0, "deviation-heading": 12.80493460738892, "distance-from-start": 1.1207219776159152, "deviation-center-line": 2.814551031011964, "driven_lanedir_consec": 10.135078140514093}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15960
531
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 13:55:00+00:00 2022-11-25 13:56:29+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15955
532
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 13:48:32+00:00 2022-11-25 13:54:30+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 41.69999999999977 in-drivable-lane_median 0.0 driven_lanedir_consec_median 6.888510330605288 deviation-center-line_median 2.1549496417071614
other stats deviation-center-line_max 2.1549496417071614 deviation-center-line_mean 2.1549496417071614 deviation-center-line_min 2.1549496417071614 deviation-heading_max 10.68794799755172 deviation-heading_mean 10.68794799755172 deviation-heading_median 10.68794799755172 deviation-heading_min 10.68794799755172 distance-from-start_max 1.0395413409080425 distance-from-start_mean 1.0395413409080425 distance-from-start_median 1.0395413409080425 distance-from-start_min 1.0395413409080425 driven_any_max 7.163646250411587 driven_any_mean 7.163646250411587 driven_any_median 7.163646250411587 driven_any_min 7.163646250411587 driven_lanedir_consec_max 6.888510330605288 driven_lanedir_consec_mean 6.888510330605288 driven_lanedir_consec_min 6.888510330605288 driven_lanedir_max 6.888510330605288 driven_lanedir_mean 6.888510330605288 driven_lanedir_median 6.888510330605288 driven_lanedir_min 6.888510330605288 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 7.163646250411587, "survival_time": 41.69999999999977, "driven_lanedir": 6.888510330605288, "in-drivable-lane": 0.0, "deviation-heading": 10.68794799755172, "distance-from-start": 1.0395413409080425, "deviation-center-line": 2.1549496417071614, "driven_lanedir_consec": 6.888510330605288}}simulation-passed 1 survival_time_max 41.69999999999977 survival_time_mean 41.69999999999977 survival_time_min 41.69999999999977
No reset possible 15951
533
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 13:41:52+00:00 2022-11-25 13:48:03+00:00 0:06:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 9.1181512062982 survival_time_median 59.99999999999873 deviation-center-line_median 3.0859157123264116 in-drivable-lane_median 3.2999999999999226
other stats deviation-center-line_max 3.0859157123264116 deviation-center-line_mean 3.0859157123264116 deviation-center-line_min 3.0859157123264116 deviation-heading_max 18.317284523935797 deviation-heading_mean 18.317284523935797 deviation-heading_median 18.317284523935797 deviation-heading_min 18.317284523935797 distance-from-start_max 2.7798866923097 distance-from-start_mean 2.7798866923097 distance-from-start_median 2.7798866923097 distance-from-start_min 2.7798866923097 driven_any_max 10.645659095132268 driven_any_mean 10.645659095132268 driven_any_median 10.645659095132268 driven_any_min 10.645659095132268 driven_lanedir_consec_max 9.1181512062982 driven_lanedir_consec_mean 9.1181512062982 driven_lanedir_consec_min 9.1181512062982 driven_lanedir_max 9.1181512062982 driven_lanedir_mean 9.1181512062982 driven_lanedir_median 9.1181512062982 driven_lanedir_min 9.1181512062982 in-drivable-lane_max 3.2999999999999226 in-drivable-lane_mean 3.2999999999999226 in-drivable-lane_min 3.2999999999999226 per-episodes details {"loop-000-ego0": {"driven_any": 10.645659095132268, "survival_time": 59.99999999999873, "driven_lanedir": 9.1181512062982, "in-drivable-lane": 3.2999999999999226, "deviation-heading": 18.317284523935797, "distance-from-start": 2.7798866923097, "deviation-center-line": 3.0859157123264116, "driven_lanedir_consec": 9.1181512062982}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15949
534
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 13:39:48+00:00 2022-11-25 13:41:22+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15942
535
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 13:30:46+00:00 2022-11-25 13:39:41+00:00 0:08:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5499999999999687 driven_lanedir_consec_median 10.45430208574406 deviation-center-line_median 3.406053200148164
other stats deviation-center-line_max 3.4844304481263224 deviation-center-line_mean 3.406053200148164 deviation-center-line_min 3.327675952170005 deviation-heading_max 13.697567399669824 deviation-heading_mean 13.516018218828528 deviation-heading_median 13.516018218828528 deviation-heading_min 13.334469037987231 distance-from-start_max 1.0622120188702575 distance-from-start_mean 1.0510367610936304 distance-from-start_median 1.0510367610936304 distance-from-start_min 1.039861503317003 driven_any_max 11.033575666325012 driven_any_mean 10.995956999445951 driven_any_median 10.995956999445951 driven_any_min 10.958338332566894 driven_lanedir_consec_max 10.504817521554472 driven_lanedir_consec_mean 10.45430208574406 driven_lanedir_consec_min 10.403786649933645 driven_lanedir_max 10.504817521554472 driven_lanedir_mean 10.45430208574406 driven_lanedir_median 10.45430208574406 driven_lanedir_min 10.403786649933645 in-drivable-lane_max 0.5999999999999659 in-drivable-lane_mean 0.5499999999999687 in-drivable-lane_min 0.4999999999999716 per-episodes details {"loop2-000-ego0": {"driven_any": 10.958338332566894, "survival_time": 59.99999999999873, "driven_lanedir": 10.403786649933645, "in-drivable-lane": 0.5999999999999659, "deviation-heading": 13.697567399669824, "distance-from-start": 1.0622120188702575, "deviation-center-line": 3.327675952170005, "driven_lanedir_consec": 10.403786649933645}, "loop2-000-ego1": {"driven_any": 11.033575666325012, "survival_time": 59.99999999999873, "driven_lanedir": 10.504817521554472, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 13.334469037987231, "distance-from-start": 1.039861503317003, "deviation-center-line": 3.4844304481263224, "driven_lanedir_consec": 10.504817521554472}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15939
536
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 13:27:53+00:00 2022-11-25 13:30:40+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.35000000000013 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3576621758864222 deviation-center-line_median 0.917912584375106
other stats deviation-center-line_max 0.917912584375106 deviation-center-line_mean 0.917912584375106 deviation-center-line_min 0.917912584375106 deviation-heading_max 4.611603459799668 deviation-heading_mean 4.611603459799668 deviation-heading_median 4.611603459799668 deviation-heading_min 4.611603459799668 distance-from-start_max 2.1156647967718136 distance-from-start_mean 2.1156647967718136 distance-from-start_median 2.1156647967718136 distance-from-start_min 2.1156647967718136 driven_any_max 2.471674019933819 driven_any_mean 2.471674019933819 driven_any_median 2.471674019933819 driven_any_min 2.471674019933819 driven_lanedir_consec_max 2.3576621758864222 driven_lanedir_consec_mean 2.3576621758864222 driven_lanedir_consec_min 2.3576621758864222 driven_lanedir_max 2.3576621758864222 driven_lanedir_mean 2.3576621758864222 driven_lanedir_median 2.3576621758864222 driven_lanedir_min 2.3576621758864222 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.471674019933819, "survival_time": 18.35000000000013, "driven_lanedir": 2.3576621758864222, "in-drivable-lane": 0.0, "deviation-heading": 4.611603459799668, "distance-from-start": 2.1156647967718136, "deviation-center-line": 0.917912584375106, "driven_lanedir_consec": 2.3576621758864222}}simulation-passed 1 survival_time_max 18.35000000000013 survival_time_mean 18.35000000000013 survival_time_min 18.35000000000013
No reset possible 15932
538
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 13:17:44+00:00 2022-11-25 13:27:25+00:00 0:09:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.09999999999992 in-drivable-lane_median 0.4500000000000064 driven_lanedir_consec_median 5.66451059079427 deviation-center-line_median 1.7499439742909602
other stats deviation-center-line_max 1.7499439742909602 deviation-center-line_mean 1.7499439742909602 deviation-center-line_min 1.7499439742909602 deviation-heading_max 8.569601101541478 deviation-heading_mean 8.569601101541478 deviation-heading_median 8.569601101541478 deviation-heading_min 8.569601101541478 distance-from-start_max 3.4421122230394596 distance-from-start_mean 3.4421122230394596 distance-from-start_median 3.4421122230394596 distance-from-start_min 3.4421122230394596 driven_any_max 6.274689363857833 driven_any_mean 6.274689363857833 driven_any_median 6.274689363857833 driven_any_min 6.274689363857833 driven_lanedir_consec_max 5.66451059079427 driven_lanedir_consec_mean 5.66451059079427 driven_lanedir_consec_min 5.66451059079427 driven_lanedir_max 5.878598961929994 driven_lanedir_mean 5.878598961929994 driven_lanedir_median 5.878598961929994 driven_lanedir_min 5.878598961929994 in-drivable-lane_max 0.4500000000000064 in-drivable-lane_mean 0.4500000000000064 in-drivable-lane_min 0.4500000000000064 per-episodes details {"udem-000-ego0": {"driven_any": 6.274689363857833, "survival_time": 39.09999999999992, "driven_lanedir": 5.878598961929994, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 8.569601101541478, "distance-from-start": 3.4421122230394596, "deviation-center-line": 1.7499439742909602, "driven_lanedir_consec": 5.66451059079427}}simulation-passed 1 survival_time_max 39.09999999999992 survival_time_mean 39.09999999999992 survival_time_min 39.09999999999992
No reset possible 15930
539
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 13:15:21+00:00 2022-11-25 13:17:38+00:00 0:02:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15928
539
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 13:13:21+00:00 2022-11-25 13:15:12+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15927
539
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 13:11:04+00:00 2022-11-25 13:13:06+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.899999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4802681996247242 deviation-center-line_median 0.26730939682991545
other stats deviation-center-line_max 0.26730939682991545 deviation-center-line_mean 0.26730939682991545 deviation-center-line_min 0.26730939682991545 deviation-heading_max 1.3566435059655964 deviation-heading_mean 1.3566435059655964 deviation-heading_median 1.3566435059655964 deviation-heading_min 1.3566435059655964 distance-from-start_max 0.4862739059347084 distance-from-start_mean 0.4862739059347084 distance-from-start_median 0.4862739059347084 distance-from-start_min 0.4862739059347084 driven_any_max 0.5064461261268792 driven_any_mean 0.5064461261268792 driven_any_median 0.5064461261268792 driven_any_min 0.5064461261268792 driven_lanedir_consec_max 0.4802681996247242 driven_lanedir_consec_mean 0.4802681996247242 driven_lanedir_consec_min 0.4802681996247242 driven_lanedir_max 0.4802681996247242 driven_lanedir_mean 0.4802681996247242 driven_lanedir_median 0.4802681996247242 driven_lanedir_min 0.4802681996247242 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.5064461261268792, "survival_time": 3.899999999999994, "driven_lanedir": 0.4802681996247242, "in-drivable-lane": 0.0, "deviation-heading": 1.3566435059655964, "distance-from-start": 0.4862739059347084, "deviation-center-line": 0.26730939682991545, "driven_lanedir_consec": 0.4802681996247242}}simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 3.899999999999994 survival_time_min 3.899999999999994
No reset possible 15922
541
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 13:04:02+00:00 2022-11-25 13:10:44+00:00 0:06:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.478853596778437 survival_time_median 59.99999999999873 deviation-center-line_median 3.6066114593486063 in-drivable-lane_median 0.0
other stats deviation-center-line_max 3.6066114593486063 deviation-center-line_mean 3.6066114593486063 deviation-center-line_min 3.6066114593486063 deviation-heading_max 13.758888706270358 deviation-heading_mean 13.758888706270358 deviation-heading_median 13.758888706270358 deviation-heading_min 13.758888706270358 distance-from-start_max 2.8994252539243472 distance-from-start_mean 2.8994252539243472 distance-from-start_median 2.8994252539243472 distance-from-start_min 2.8994252539243472 driven_any_max 8.838180739317117 driven_any_mean 8.838180739317117 driven_any_median 8.838180739317117 driven_any_min 8.838180739317117 driven_lanedir_consec_max 8.478853596778437 driven_lanedir_consec_mean 8.478853596778437 driven_lanedir_consec_min 8.478853596778437 driven_lanedir_max 8.478853596778437 driven_lanedir_mean 8.478853596778437 driven_lanedir_median 8.478853596778437 driven_lanedir_min 8.478853596778437 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 8.838180739317117, "survival_time": 59.99999999999873, "driven_lanedir": 8.478853596778437, "in-drivable-lane": 0.0, "deviation-heading": 13.758888706270358, "distance-from-start": 2.8994252539243472, "deviation-center-line": 3.6066114593486063, "driven_lanedir_consec": 8.478853596778437}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15917
544
Bea Baselines 🐤baseline-dagger-pytorch aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.51
2022-11-25 13:02:36+00:00 2022-11-25 13:03:43+00:00 0:01:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.03656562121906837 deviation-center-line_median 0.005203487375794533
other stats deviation-center-line_max 0.005203487375794533 deviation-center-line_mean 0.005203487375794533 deviation-center-line_min 0.005203487375794533 deviation-heading_max 0.24533170461013784 deviation-heading_mean 0.24533170461013784 deviation-heading_median 0.24533170461013784 deviation-heading_min 0.24533170461013784 distance-from-start_max 0.0402345664437677 distance-from-start_mean 0.0402345664437677 distance-from-start_median 0.0402345664437677 distance-from-start_min 0.0402345664437677 driven_any_max 0.0403143925884205 driven_any_mean 0.0403143925884205 driven_any_median 0.0403143925884205 driven_any_min 0.0403143925884205 driven_lanedir_consec_max 0.03656562121906837 driven_lanedir_consec_mean 0.03656562121906837 driven_lanedir_consec_min 0.03656562121906837 driven_lanedir_max 0.03656562121906837 driven_lanedir_mean 0.03656562121906837 driven_lanedir_median 0.03656562121906837 driven_lanedir_min 0.03656562121906837 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.0403143925884205, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03656562121906837, "in-drivable-lane": 0.0, "deviation-heading": 0.24533170461013784, "distance-from-start": 0.0402345664437677, "deviation-center-line": 0.005203487375794533, "driven_lanedir_consec": 0.03656562121906837}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15912
766
Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4b aido-hello-sim-validation
sanity-check failed no davinci-stage-02-6.2.51
2022-11-25 13:01:17+00:00 2022-11-25 13:02:10+00:00 0:00:53 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15907
797
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3d aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.51
2022-11-25 13:00:01+00:00 2022-11-25 13:01:10+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0490536994967361 deviation-center-line_median 0.006321476908534512
other stats deviation-center-line_max 0.006321476908534512 deviation-center-line_mean 0.006321476908534512 deviation-center-line_min 0.006321476908534512 deviation-heading_max 0.2616883477673184 deviation-heading_mean 0.2616883477673184 deviation-heading_median 0.2616883477673184 deviation-heading_min 0.2616883477673184 distance-from-start_max 0.05595530097041457 distance-from-start_mean 0.05595530097041457 distance-from-start_median 0.05595530097041457 distance-from-start_min 0.05595530097041457 driven_any_max 0.055966246191170424 driven_any_mean 0.055966246191170424 driven_any_median 0.055966246191170424 driven_any_min 0.055966246191170424 driven_lanedir_consec_max 0.0490536994967361 driven_lanedir_consec_mean 0.0490536994967361 driven_lanedir_consec_min 0.0490536994967361 driven_lanedir_max 0.0490536994967361 driven_lanedir_mean 0.0490536994967361 driven_lanedir_median 0.0490536994967361 driven_lanedir_min 0.0490536994967361 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.055966246191170424, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0490536994967361, "in-drivable-lane": 0.0, "deviation-heading": 0.2616883477673184, "distance-from-start": 0.05595530097041457, "deviation-center-line": 0.006321476908534512, "driven_lanedir_consec": 0.0490536994967361}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15904
804
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2 aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.51
2022-11-25 12:58:23+00:00 2022-11-25 12:59:34+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.04646170431488961 deviation-center-line_median 0.005526509379572738
other stats deviation-center-line_max 0.005526509379572738 deviation-center-line_mean 0.005526509379572738 deviation-center-line_min 0.005526509379572738 deviation-heading_max 0.2419209947305405 deviation-heading_mean 0.2419209947305405 deviation-heading_median 0.2419209947305405 deviation-heading_min 0.2419209947305405 distance-from-start_max 0.050431827193006776 distance-from-start_mean 0.050431827193006776 distance-from-start_median 0.050431827193006776 distance-from-start_min 0.050431827193006776 driven_any_max 0.05053888858930475 driven_any_mean 0.05053888858930475 driven_any_median 0.05053888858930475 driven_any_min 0.05053888858930475 driven_lanedir_consec_max 0.04646170431488961 driven_lanedir_consec_mean 0.04646170431488961 driven_lanedir_consec_min 0.04646170431488961 driven_lanedir_max 0.04646170431488961 driven_lanedir_mean 0.04646170431488961 driven_lanedir_median 0.04646170431488961 driven_lanedir_min 0.04646170431488961 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.05053888858930475, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04646170431488961, "in-drivable-lane": 0.0, "deviation-heading": 0.2419209947305405, "distance-from-start": 0.050431827193006776, "deviation-center-line": 0.005526509379572738, "driven_lanedir_consec": 0.04646170431488961}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15899
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 12:53:33+00:00 2022-11-25 12:58:06+00:00 0:04:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.675696836821229 deviation-center-line_median 0.19635223125533263
other stats deviation-center-line_max 0.19635223125533263 deviation-center-line_mean 0.19635223125533263 deviation-center-line_min 0.19635223125533263 deviation-heading_max 1.81505389113436 deviation-heading_mean 1.81505389113436 deviation-heading_median 1.81505389113436 deviation-heading_min 1.81505389113436 distance-from-start_max 3.5639702148835872 distance-from-start_mean 3.5639702148835872 distance-from-start_median 3.5639702148835872 distance-from-start_min 3.5639702148835872 driven_any_max 5.684198905858687 driven_any_mean 5.684198905858687 driven_any_median 5.684198905858687 driven_any_min 5.684198905858687 driven_lanedir_consec_max 5.675696836821229 driven_lanedir_consec_mean 5.675696836821229 driven_lanedir_consec_min 5.675696836821229 driven_lanedir_max 5.675696836821229 driven_lanedir_mean 5.675696836821229 driven_lanedir_median 5.675696836821229 driven_lanedir_min 5.675696836821229 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.684198905858687, "survival_time": 59.99999999999873, "driven_lanedir": 5.675696836821229, "in-drivable-lane": 0.0, "deviation-heading": 1.81505389113436, "distance-from-start": 3.5639702148835872, "deviation-center-line": 0.19635223125533263, "driven_lanedir_consec": 5.675696836821229}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15898
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 12:51:48+00:00 2022-11-25 12:53:26+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15895
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 12:46:09+00:00 2022-11-25 12:51:20+00:00 0:05:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.161183222767684 deviation-center-line_median 0.16237308678117102
other stats deviation-center-line_max 0.16237308678117102 deviation-center-line_mean 0.16237308678117102 deviation-center-line_min 0.16237308678117102 deviation-heading_max 1.6697144680274827 deviation-heading_mean 1.6697144680274827 deviation-heading_median 1.6697144680274827 deviation-heading_min 1.6697144680274827 distance-from-start_max 2.3375328751443054 distance-from-start_mean 2.3375328751443054 distance-from-start_median 2.3375328751443054 distance-from-start_min 2.3375328751443054 driven_any_max 5.867610759158524 driven_any_mean 5.867610759158524 driven_any_median 5.867610759158524 driven_any_min 5.867610759158524 driven_lanedir_consec_max 5.161183222767684 driven_lanedir_consec_mean 5.161183222767684 driven_lanedir_consec_min 5.161183222767684 driven_lanedir_max 5.859601719805226 driven_lanedir_mean 5.859601719805226 driven_lanedir_median 5.859601719805226 driven_lanedir_min 5.859601719805226 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.867610759158524, "survival_time": 59.99999999999873, "driven_lanedir": 5.859601719805226, "in-drivable-lane": 0.0, "deviation-heading": 1.6697144680274827, "distance-from-start": 2.3375328751443054, "deviation-center-line": 0.16237308678117102, "driven_lanedir_consec": 5.161183222767684}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15890
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 12:35:23+00:00 2022-11-25 12:45:48+00:00 0:10:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 6.0817422473064955 deviation-center-line_median 0.25576965235048754
other stats deviation-center-line_max 0.25576965235048754 deviation-center-line_mean 0.25576965235048754 deviation-center-line_min 0.25576965235048754 deviation-heading_max 1.94582432309865 deviation-heading_mean 1.94582432309865 deviation-heading_median 1.94582432309865 deviation-heading_min 1.94582432309865 distance-from-start_max 2.49941447398169 distance-from-start_mean 2.49941447398169 distance-from-start_median 2.49941447398169 distance-from-start_min 2.49941447398169 driven_any_max 6.0939946438635975 driven_any_mean 6.0939946438635975 driven_any_median 6.0939946438635975 driven_any_min 6.0939946438635975 driven_lanedir_consec_max 6.0817422473064955 driven_lanedir_consec_mean 6.0817422473064955 driven_lanedir_consec_min 6.0817422473064955 driven_lanedir_max 6.081742517685205 driven_lanedir_mean 6.081742517685205 driven_lanedir_median 6.081742517685205 driven_lanedir_min 6.081742517685205 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 6.0939946438635975, "survival_time": 59.99999999999873, "driven_lanedir": 6.081742517685205, "in-drivable-lane": 0.0, "deviation-heading": 1.94582432309865, "distance-from-start": 2.49941447398169, "deviation-center-line": 0.25576965235048754, "driven_lanedir_consec": 6.0817422473064955}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15886
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
468 error yes davinci-stage-02-6.2.51
2022-11-25 12:33:36+00:00 2022-11-25 12:35:03+00:00 0:01:27 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f593dfb2e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f593dfb2e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15881
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 12:29:57+00:00 2022-11-25 12:33:14+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.050000000000264 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.292618548158817 deviation-center-line_median 0.19323515838271432
other stats deviation-center-line_max 0.19323515838271432 deviation-center-line_mean 0.19323515838271432 deviation-center-line_min 0.19323515838271432 deviation-heading_max 1.8288145404727405 deviation-heading_mean 1.8288145404727405 deviation-heading_median 1.8288145404727405 deviation-heading_min 1.8288145404727405 distance-from-start_max 1.9904020045641833 distance-from-start_mean 1.9904020045641833 distance-from-start_median 1.9904020045641833 distance-from-start_min 1.9904020045641833 driven_any_max 2.3014771077635525 driven_any_mean 2.3014771077635525 driven_any_median 2.3014771077635525 driven_any_min 2.3014771077635525 driven_lanedir_consec_max 2.292618548158817 driven_lanedir_consec_mean 2.292618548158817 driven_lanedir_consec_min 2.292618548158817 driven_lanedir_max 2.292618548158817 driven_lanedir_mean 2.292618548158817 driven_lanedir_median 2.292618548158817 driven_lanedir_min 2.292618548158817 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.3014771077635525, "survival_time": 28.050000000000264, "driven_lanedir": 2.292618548158817, "in-drivable-lane": 0.0, "deviation-heading": 1.8288145404727405, "distance-from-start": 1.9904020045641833, "deviation-center-line": 0.19323515838271432, "driven_lanedir_consec": 2.292618548158817}}simulation-passed 1 survival_time_max 28.050000000000264 survival_time_mean 28.050000000000264 survival_time_min 28.050000000000264
No reset possible 15876
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 12:25:33+00:00 2022-11-25 12:29:23+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.667494145070765 deviation-center-line_median 0.2625618403675503
other stats deviation-center-line_max 0.2625618403675503 deviation-center-line_mean 0.2625618403675503 deviation-center-line_min 0.2625618403675503 deviation-heading_max 2.4450188093470064 deviation-heading_mean 2.4450188093470064 deviation-heading_median 2.4450188093470064 deviation-heading_min 2.4450188093470064 distance-from-start_max 1.5213034236679508 distance-from-start_mean 1.5213034236679508 distance-from-start_median 1.5213034236679508 distance-from-start_min 1.5213034236679508 driven_any_max 5.681963014330128 driven_any_mean 5.681963014330128 driven_any_median 5.681963014330128 driven_any_min 5.681963014330128 driven_lanedir_consec_max 5.667494145070765 driven_lanedir_consec_mean 5.667494145070765 driven_lanedir_consec_min 5.667494145070765 driven_lanedir_max 5.667494145070765 driven_lanedir_mean 5.667494145070765 driven_lanedir_median 5.667494145070765 driven_lanedir_min 5.667494145070765 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.681963014330128, "survival_time": 59.99999999999873, "driven_lanedir": 5.667494145070765, "in-drivable-lane": 0.0, "deviation-heading": 2.4450188093470064, "distance-from-start": 1.5213034236679508, "deviation-center-line": 0.2625618403675503, "driven_lanedir_consec": 5.667494145070765}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15874
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 12:23:47+00:00 2022-11-25 12:25:26+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15869
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 12:11:34+00:00 2022-11-25 12:23:40+00:00 0:12:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.2917560752452353 deviation-center-line_median 0.27463897897422074
other stats deviation-center-line_max 0.8490104989255264 deviation-center-line_mean 0.4053497700508593 deviation-center-line_min 0.2231106233294694 deviation-heading_max 4.652112626803104 deviation-heading_mean 3.392972578929611 deviation-heading_median 3.4870395918569868 deviation-heading_min 1.9456985052013656 distance-from-start_max 2.3851954040258585 distance-from-start_mean 1.4217930471518925 distance-from-start_median 1.6509883922908557 distance-from-start_min 2.220446049250313e-16 driven_any_max 5.630152749474803 driven_any_mean 2.559119045837817 driven_any_median 2.3031617169380976 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 5.099440922602875 driven_lanedir_consec_mean 2.4207382682733365 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.620526100398644 driven_lanedir_mean 2.5510097184456804 driven_lanedir_median 2.291756386692038 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.930809165198691, "survival_time": 59.99999999999873, "driven_lanedir": 2.9200356041068973, "in-drivable-lane": 0.0, "deviation-heading": 3.5129636830313307, "distance-from-start": 2.3851954040258585, "deviation-center-line": 0.2707652624623321, "driven_lanedir_consec": 2.9200349812132913}, "4way-000-ego1": {"driven_any": 5.630152749474803, "survival_time": 59.99999999999873, "driven_lanedir": 5.620526100398644, "in-drivable-lane": 0.0, "deviation-heading": 1.9456985052013656, "distance-from-start": 2.067364738250145, "deviation-center-line": 0.2785126954861093, "driven_lanedir_consec": 5.099440922602875}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.2231106233294694, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 1.6755142686775044, "survival_time": 59.99999999999873, "driven_lanedir": 1.6634771692771788, "in-drivable-lane": 0.0, "deviation-heading": 3.461115500682643, "distance-from-start": 1.2346120463315662, "deviation-center-line": 0.8490104989255264, "driven_lanedir_consec": 1.6634771692771788}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15864
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 12:00:42+00:00 2022-11-25 12:11:20+00:00 0:10:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.40652749865251103
other stats deviation-center-line_max 0.40652749865251103 deviation-center-line_mean 0.40652749865251103 deviation-center-line_min 0.40652749865251103 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.40652749865251103, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15860
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 11:55:21+00:00 2022-11-25 12:00:16+00:00 0:04:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.007019068997936 deviation-center-line_median 0.38011035127619336
other stats deviation-center-line_max 0.4837985399042229 deviation-center-line_mean 0.38011035127619336 deviation-center-line_min 0.2764221626481639 deviation-heading_max 3.0253232596119735 deviation-heading_mean 2.714016045259945 deviation-heading_median 2.714016045259945 deviation-heading_min 2.4027088309079163 distance-from-start_max 1.521674143069448 distance-from-start_mean 1.2769944684334753 distance-from-start_median 1.2769944684334753 distance-from-start_min 1.0323147937975024 driven_any_max 5.08623281214027 driven_any_mean 5.021228797880976 driven_any_median 5.021228797880976 driven_any_min 4.956224783621684 driven_lanedir_consec_max 5.0705723110226515 driven_lanedir_consec_mean 5.007019068997936 driven_lanedir_consec_min 4.94346582697322 driven_lanedir_max 5.0705723110226515 driven_lanedir_mean 5.007019068997936 driven_lanedir_median 5.007019068997936 driven_lanedir_min 4.94346582697322 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 4.956224783621684, "survival_time": 59.99999999999873, "driven_lanedir": 4.94346582697322, "in-drivable-lane": 0.0, "deviation-heading": 2.4027088309079163, "distance-from-start": 1.521674143069448, "deviation-center-line": 0.2764221626481639, "driven_lanedir_consec": 4.94346582697322}, "loop2-000-ego1": {"driven_any": 5.08623281214027, "survival_time": 59.99999999999873, "driven_lanedir": 5.0705723110226515, "in-drivable-lane": 0.0, "deviation-heading": 3.0253232596119735, "distance-from-start": 1.0323147937975024, "deviation-center-line": 0.4837985399042229, "driven_lanedir_consec": 5.0705723110226515}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15854
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 11:45:17+00:00 2022-11-25 11:54:52+00:00 0:09:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.268486692511211 deviation-center-line_median 0.2677582178916847
other stats deviation-center-line_max 0.2677582178916847 deviation-center-line_mean 0.2677582178916847 deviation-center-line_min 0.2677582178916847 deviation-heading_max 2.3862148122965765 deviation-heading_mean 2.3862148122965765 deviation-heading_median 2.3862148122965765 deviation-heading_min 2.3862148122965765 distance-from-start_max 3.215326192663788 distance-from-start_mean 3.215326192663788 distance-from-start_median 3.215326192663788 distance-from-start_min 3.215326192663788 driven_any_max 5.282829526436911 driven_any_mean 5.282829526436911 driven_any_median 5.282829526436911 driven_any_min 5.282829526436911 driven_lanedir_consec_max 5.268486692511211 driven_lanedir_consec_mean 5.268486692511211 driven_lanedir_consec_min 5.268486692511211 driven_lanedir_max 5.268486692511211 driven_lanedir_mean 5.268486692511211 driven_lanedir_median 5.268486692511211 driven_lanedir_min 5.268486692511211 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.282829526436911, "survival_time": 59.99999999999873, "driven_lanedir": 5.268486692511211, "in-drivable-lane": 0.0, "deviation-heading": 2.3862148122965765, "distance-from-start": 3.215326192663788, "deviation-center-line": 0.2677582178916847, "driven_lanedir_consec": 5.268486692511211}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15848
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 11:43:18+00:00 2022-11-25 11:44:55+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.499999999999986 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7152019553352842 deviation-center-line_median 0.09388648296550528
other stats deviation-center-line_max 0.09388648296550528 deviation-center-line_mean 0.09388648296550528 deviation-center-line_min 0.09388648296550528 deviation-heading_max 0.944239660915932 deviation-heading_mean 0.944239660915932 deviation-heading_median 0.944239660915932 deviation-heading_min 0.944239660915932 distance-from-start_max 0.7152240362894687 distance-from-start_mean 0.7152240362894687 distance-from-start_median 0.7152240362894687 distance-from-start_min 0.7152240362894687 driven_any_max 0.7257895926659109 driven_any_mean 0.7257895926659109 driven_any_median 0.7257895926659109 driven_any_min 0.7257895926659109 driven_lanedir_consec_max 0.7152019553352842 driven_lanedir_consec_mean 0.7152019553352842 driven_lanedir_consec_min 0.7152019553352842 driven_lanedir_max 0.7152019553352842 driven_lanedir_mean 0.7152019553352842 driven_lanedir_median 0.7152019553352842 driven_lanedir_min 0.7152019553352842 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.7257895926659109, "survival_time": 8.499999999999986, "driven_lanedir": 0.7152019553352842, "in-drivable-lane": 0.0, "deviation-heading": 0.944239660915932, "distance-from-start": 0.7152240362894687, "deviation-center-line": 0.09388648296550528, "driven_lanedir_consec": 0.7152019553352842}}simulation-passed 1 survival_time_max 8.499999999999986 survival_time_mean 8.499999999999986 survival_time_min 8.499999999999986
No reset possible 15845
1324
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-2of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:41:51+00:00 2022-11-25 11:43:04+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15839
1325
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:40:27+00:00 2022-11-25 11:41:42+00:00 0:01:15 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15833
1326
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:39:08+00:00 2022-11-25 11:40:21+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15830
1327
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:38:03+00:00 2022-11-25 11:39:01+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15826
1329
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-3of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:36:39+00:00 2022-11-25 11:37:52+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15821
1330
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 11:35:21+00:00 2022-11-25 11:36:20+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15816
1333
Bea Baselines 🐤baseline-RPL-ros lx22-visservoing
sim failed yes davinci-stage-02-6.2.51
2022-11-25 11:34:11+00:00 2022-11-25 11:35:09+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15810
1335
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-0of5 failed no davinci-stage-02-6.2.51
2022-11-25 11:32:58+00:00 2022-11-25 11:33:56+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15780
1349
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 11:15:33+00:00 2022-11-25 11:32:39+00:00 0:17:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 27.84999999999866 driven_lanedir_consec_median 2.4954637320704456 deviation-center-line_median 2.818150519702741
other stats deviation-center-line_max 2.818150519702741 deviation-center-line_mean 2.818150519702741 deviation-center-line_min 2.818150519702741 deviation-heading_max 14.628758926617095 deviation-heading_mean 14.628758926617095 deviation-heading_median 14.628758926617095 deviation-heading_min 14.628758926617095 distance-from-start_max 2.839216353763523 distance-from-start_mean 2.839216353763523 distance-from-start_median 2.839216353763523 distance-from-start_min 2.839216353763523 driven_any_max 7.913093558813808 driven_any_mean 7.913093558813808 driven_any_median 7.913093558813808 driven_any_min 7.913093558813808 driven_lanedir_consec_max 2.4954637320704456 driven_lanedir_consec_mean 2.4954637320704456 driven_lanedir_consec_min 2.4954637320704456 driven_lanedir_max 3.554939980978652 driven_lanedir_mean 3.554939980978652 driven_lanedir_median 3.554939980978652 driven_lanedir_min 3.554939980978652 in-drivable-lane_max 27.84999999999866 in-drivable-lane_mean 27.84999999999866 in-drivable-lane_min 27.84999999999866 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.913093558813808, "survival_time": 59.99999999999873, "driven_lanedir": 3.554939980978652, "in-drivable-lane": 27.84999999999866, "deviation-heading": 14.628758926617095, "distance-from-start": 2.839216353763523, "deviation-center-line": 2.818150519702741, "driven_lanedir_consec": 2.4954637320704456}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15776
1350
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 11:10:55+00:00 2022-11-25 11:15:06+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.000000000000009 in-drivable-lane_median 0.849999999999997 driven_lanedir_consec_median 1.0101154198333844 deviation-center-line_median 0.789713699050619
other stats deviation-center-line_max 0.789713699050619 deviation-center-line_mean 0.789713699050619 deviation-center-line_min 0.789713699050619 deviation-heading_max 2.354289980202088 deviation-heading_mean 2.354289980202088 deviation-heading_median 2.354289980202088 deviation-heading_min 2.354289980202088 distance-from-start_max 0.8308294003759809 distance-from-start_mean 0.8308294003759809 distance-from-start_median 0.8308294003759809 distance-from-start_min 0.8308294003759809 driven_any_max 1.182924584363306 driven_any_mean 1.182924584363306 driven_any_median 1.182924584363306 driven_any_min 1.182924584363306 driven_lanedir_consec_max 1.0101154198333844 driven_lanedir_consec_mean 1.0101154198333844 driven_lanedir_consec_min 1.0101154198333844 driven_lanedir_max 1.0101154198333844 driven_lanedir_mean 1.0101154198333844 driven_lanedir_median 1.0101154198333844 driven_lanedir_min 1.0101154198333844 in-drivable-lane_max 0.849999999999997 in-drivable-lane_mean 0.849999999999997 in-drivable-lane_min 0.849999999999997 per-episodes details {"4way-000-ego0": {"driven_any": 1.182924584363306, "survival_time": 10.000000000000009, "driven_lanedir": 1.0101154198333844, "in-drivable-lane": 0.849999999999997, "deviation-heading": 2.354289980202088, "distance-from-start": 0.8308294003759809, "deviation-center-line": 0.789713699050619, "driven_lanedir_consec": 1.0101154198333844}}simulation-passed 1 survival_time_max 10.000000000000009 survival_time_mean 10.000000000000009 survival_time_min 10.000000000000009
No reset possible 15773
1350
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 11:09:02+00:00 2022-11-25 11:10:35+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15769
1351
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 11:06:41+00:00 2022-11-25 11:08:48+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15765
1352
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 11:00:39+00:00 2022-11-25 11:06:26+00:00 0:05:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.721784936544122 survival_time_median 59.99999999999873 deviation-center-line_median 3.0385275702817913 in-drivable-lane_median 16.249999999999485
other stats deviation-center-line_max 3.0385275702817913 deviation-center-line_mean 3.0385275702817913 deviation-center-line_min 3.0385275702817913 deviation-heading_max 7.316617179234069 deviation-heading_mean 7.316617179234069 deviation-heading_median 7.316617179234069 deviation-heading_min 7.316617179234069 distance-from-start_max 3.89164645819219 distance-from-start_mean 3.89164645819219 distance-from-start_median 3.89164645819219 distance-from-start_min 3.89164645819219 driven_any_max 7.907771712903017 driven_any_mean 7.907771712903017 driven_any_median 7.907771712903017 driven_any_min 7.907771712903017 driven_lanedir_consec_max 4.721784936544122 driven_lanedir_consec_mean 4.721784936544122 driven_lanedir_consec_min 4.721784936544122 driven_lanedir_max 5.568845547719974 driven_lanedir_mean 5.568845547719974 driven_lanedir_median 5.568845547719974 driven_lanedir_min 5.568845547719974 in-drivable-lane_max 16.249999999999485 in-drivable-lane_mean 16.249999999999485 in-drivable-lane_min 16.249999999999485 per-episodes details {"autolab-000-ego0": {"driven_any": 7.907771712903017, "survival_time": 59.99999999999873, "driven_lanedir": 5.568845547719974, "in-drivable-lane": 16.249999999999485, "deviation-heading": 7.316617179234069, "distance-from-start": 3.89164645819219, "deviation-center-line": 3.0385275702817913, "driven_lanedir_consec": 4.721784936544122}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15764
1353
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 10:58:09+00:00 2022-11-25 11:00:10+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15759
1354
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 10:50:59+00:00 2022-11-25 10:57:48+00:00 0:06:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.100000000000051 in-drivable-lane_median 3.050000000000034 driven_lanedir_consec_median 0.5792092270951195 deviation-center-line_median 0.6023142702111045
other stats deviation-center-line_max 1.7143724597003014 deviation-center-line_mean 0.839094336655967 deviation-center-line_min 0.43737634650135754 deviation-heading_max 4.1584581248153984 deviation-heading_mean 3.1312356097824425 deviation-heading_median 2.932098046662525 deviation-heading_min 2.502288220989322 distance-from-start_max 0.74024558733511 distance-from-start_mean 0.6176583723640984 distance-from-start_median 0.6093204585164813 distance-from-start_min 0.5117469850883208 driven_any_max 1.5944012484126513 driven_any_mean 1.0865910998367212 driven_any_median 1.050085222175318 driven_any_min 0.6517927065835979 driven_lanedir_consec_max 0.6198911029970716 driven_lanedir_consec_mean 0.5319210498654339 driven_lanedir_consec_min 0.34937464227442483 driven_lanedir_max 0.7085205403327421 driven_lanedir_mean 0.6217075243800132 driven_lanedir_median 0.6019017514906754 driven_lanedir_min 0.5745060542059597 in-drivable-lane_max 7.200000000000064 in-drivable-lane_mean 3.325000000000033 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6518394218276203, "survival_time": 13.100000000000051, "driven_lanedir": 0.5745060542059597, "in-drivable-lane": 0.0, "deviation-heading": 4.1584581248153984, "distance-from-start": 0.5117469850883208, "deviation-center-line": 1.7143724597003014, "driven_lanedir_consec": 0.5745060542059597}, "zigzag-000-ego1": {"driven_any": 1.5944012484126513, "survival_time": 13.100000000000051, "driven_lanedir": 0.7085205403327421, "in-drivable-lane": 6.100000000000068, "deviation-heading": 3.2763487187740603, "distance-from-start": 0.74024558733511, "deviation-center-line": 0.4595975118809117, "driven_lanedir_consec": 0.34937464227442483}, "zigzag-000-ego2": {"driven_any": 1.4483310225230157, "survival_time": 13.100000000000051, "driven_lanedir": 0.6198911029970716, "in-drivable-lane": 7.200000000000064, "deviation-heading": 2.502288220989322, "distance-from-start": 0.648032468072554, "deviation-center-line": 0.43737634650135754, "driven_lanedir_consec": 0.6198911029970716}, "zigzag-000-ego3": {"driven_any": 0.6517927065835979, "survival_time": 13.100000000000051, "driven_lanedir": 0.5839123999842791, "in-drivable-lane": 0.0, "deviation-heading": 2.5878473745509893, "distance-from-start": 0.5706084489604086, "deviation-center-line": 0.7450310285412973, "driven_lanedir_consec": 0.5839123999842791}}simulation-passed 1 survival_time_max 13.100000000000051 survival_time_mean 13.100000000000051 survival_time_min 13.100000000000051
No reset possible 15755
1355
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 10:44:45+00:00 2022-11-25 10:50:49+00:00 0:06:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.34999999999956 in-drivable-lane_median 2.050000000000029 driven_lanedir_consec_median 5.472875324684281 deviation-center-line_median 3.5042236741265302
other stats deviation-center-line_max 3.5042236741265302 deviation-center-line_mean 3.5042236741265302 deviation-center-line_min 3.5042236741265302 deviation-heading_max 6.383667126366989 deviation-heading_mean 6.383667126366989 deviation-heading_median 6.383667126366989 deviation-heading_min 6.383667126366989 distance-from-start_max 2.5174144240900462 distance-from-start_mean 2.5174144240900462 distance-from-start_median 2.5174144240900462 distance-from-start_min 2.5174144240900462 driven_any_max 5.869871413600447 driven_any_mean 5.869871413600447 driven_any_median 5.869871413600447 driven_any_min 5.869871413600447 driven_lanedir_consec_max 5.472875324684281 driven_lanedir_consec_mean 5.472875324684281 driven_lanedir_consec_min 5.472875324684281 driven_lanedir_max 5.472875324684281 driven_lanedir_mean 5.472875324684281 driven_lanedir_median 5.472875324684281 driven_lanedir_min 5.472875324684281 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 2.050000000000029 in-drivable-lane_min 2.050000000000029 per-episodes details {"loop-000-ego0": {"driven_any": 5.869871413600447, "survival_time": 45.34999999999956, "driven_lanedir": 5.472875324684281, "in-drivable-lane": 2.050000000000029, "deviation-heading": 6.383667126366989, "distance-from-start": 2.5174144240900462, "deviation-center-line": 3.5042236741265302, "driven_lanedir_consec": 5.472875324684281}}simulation-passed 1 survival_time_max 45.34999999999956 survival_time_mean 45.34999999999956 survival_time_min 45.34999999999956
No reset possible 15750
1358
Bea Baselines 🐤baseline-duckietown-ml lx22-visservoing
sim success yes davinci-stage-02-6.2.51
2022-11-25 10:33:58+00:00 2022-11-25 10:44:09+00:00 0:10:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 24.874999999999385 deviation-center-line_median 4.659572797926462 driven_lanedir_consec_median 4.527304508402093 survival_time_median 59.99999999999873
other stats deviation-center-line_max 4.670802326660425 deviation-center-line_mean 4.659572797926462 deviation-center-line_min 4.648343269192498 deviation-heading_max 4.81550650371684 deviation-heading_mean 4.3191259863809215 deviation-heading_median 4.3191259863809215 deviation-heading_min 3.8227454690450022 distance-from-start_max 1.484207681512612 distance-from-start_mean 1.2559127058597537 distance-from-start_median 1.2559127058597537 distance-from-start_min 1.027617730206895 driven_any_max 7.92090663562652 driven_any_mean 7.914404694964345 driven_any_median 7.914404694964345 driven_any_min 7.90790275430217 driven_lanedir_consec_max 4.695931518932486 driven_lanedir_consec_mean 4.527304508402093 driven_lanedir_consec_min 4.3586774978717 driven_lanedir_max 4.695931518932486 driven_lanedir_mean 4.527304508402093 driven_lanedir_median 4.527304508402093 driven_lanedir_min 4.3586774978717 in-drivable-lane_max 26.24999999999944 in-drivable-lane_mean 24.874999999999385 in-drivable-lane_min 23.499999999999332 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 7.92090663562652, "survival_time": 59.99999999999873, "driven_lanedir": 4.3586774978717, "in-drivable-lane": 26.24999999999944, "deviation-heading": 3.8227454690450022, "distance-from-start": 1.027617730206895, "deviation-center-line": 4.670802326660425, "driven_lanedir_consec": 4.3586774978717}, "LF-small-loop-001-ego0": {"driven_any": 7.90790275430217, "survival_time": 59.99999999999873, "driven_lanedir": 4.695931518932486, "in-drivable-lane": 23.499999999999332, "deviation-heading": 4.81550650371684, "distance-from-start": 1.484207681512612, "deviation-center-line": 4.648343269192498, "driven_lanedir_consec": 4.695931518932486}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15747
1360
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-2of5 success no davinci-stage-02-6.2.51
2022-11-25 10:31:14+00:00 2022-11-25 10:33:35+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.2940073599529205
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.2940073599529205 distance-from-start_median 1.2940073599529205 distance-from-start_min 1.2940073599529205 driven_any_max 1.3091415615654065 driven_any_mean 1.3091415615654065 driven_any_median 1.3091415615654065 driven_any_min 1.3091415615654065 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.00000000000002 in-drivable-lane_mean 11.00000000000002 in-drivable-lane_median 11.00000000000002 in-drivable-lane_min 11.00000000000002 per-episodes details {"d40-ego0": {"driven_any": 1.3091415615654065, "survival_time": 11.00000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 11.00000000000002, "deviation-heading": 0.0, "distance-from-start": 1.2940073599529205, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.00000000000002 survival_time_mean 11.00000000000002 survival_time_median 11.00000000000002 survival_time_min 11.00000000000002
No reset possible 15743
1360
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-1of5 success no davinci-stage-02-6.2.51
2022-11-25 10:29:04+00:00 2022-11-25 10:31:08+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5086838075729326
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5086838075729326 distance-from-start_median 0.5086838075729326 distance-from-start_min 0.5086838075729326 driven_any_max 0.658519057402809 driven_any_mean 0.658519057402809 driven_any_median 0.658519057402809 driven_any_min 0.658519057402809 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 6.099999999999986 in-drivable-lane_mean 6.099999999999986 in-drivable-lane_median 6.099999999999986 in-drivable-lane_min 6.099999999999986 per-episodes details {"d45-ego0": {"driven_any": 0.658519057402809, "survival_time": 6.099999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 6.099999999999986, "deviation-heading": 0.0, "distance-from-start": 0.5086838075729326, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 6.099999999999986 survival_time_mean 6.099999999999986 survival_time_median 6.099999999999986 survival_time_min 6.099999999999986
No reset possible 15736
1368
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 10:16:23+00:00 2022-11-25 10:28:51+00:00 0:12:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.04999999999941 in-drivable-lane_median 8.649999999999732 driven_lanedir_consec_median 3.0321164322887073 deviation-center-line_median 2.6411869357453877
other stats deviation-center-line_max 2.6411869357453877 deviation-center-line_mean 2.6411869357453877 deviation-center-line_min 2.6411869357453877 deviation-heading_max 14.36851446277574 deviation-heading_mean 14.36851446277574 deviation-heading_median 14.36851446277574 deviation-heading_min 14.36851446277574 distance-from-start_max 1.297760058017327 distance-from-start_mean 1.297760058017327 distance-from-start_median 1.297760058017327 distance-from-start_min 1.297760058017327 driven_any_max 6.234182135551709 driven_any_mean 6.234182135551709 driven_any_median 6.234182135551709 driven_any_min 6.234182135551709 driven_lanedir_consec_max 3.0321164322887073 driven_lanedir_consec_mean 3.0321164322887073 driven_lanedir_consec_min 3.0321164322887073 driven_lanedir_max 4.513540639667145 driven_lanedir_mean 4.513540639667145 driven_lanedir_median 4.513540639667145 driven_lanedir_min 4.513540639667145 in-drivable-lane_max 8.649999999999732 in-drivable-lane_mean 8.649999999999732 in-drivable-lane_min 8.649999999999732 per-episodes details {"udem-000-ego0": {"driven_any": 6.234182135551709, "survival_time": 48.04999999999941, "driven_lanedir": 4.513540639667145, "in-drivable-lane": 8.649999999999732, "deviation-heading": 14.36851446277574, "distance-from-start": 1.297760058017327, "deviation-center-line": 2.6411869357453877, "driven_lanedir_consec": 3.0321164322887073}}simulation-passed 1 survival_time_max 48.04999999999941 survival_time_mean 48.04999999999941 survival_time_min 48.04999999999941
No reset possible 15734
1370
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 10:11:33+00:00 2022-11-25 10:16:16+00:00 0:04:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.12347102686018 survival_time_median 47.44999999999944 deviation-center-line_median 1.8772282206100404 in-drivable-lane_median 30.34999999999932
other stats deviation-center-line_max 1.8772282206100404 deviation-center-line_mean 1.8772282206100404 deviation-center-line_min 1.8772282206100404 deviation-heading_max 4.140174141049068 deviation-heading_mean 4.140174141049068 deviation-heading_median 4.140174141049068 deviation-heading_min 4.140174141049068 distance-from-start_max 2.073292086756247 distance-from-start_mean 2.073292086756247 distance-from-start_median 2.073292086756247 distance-from-start_min 2.073292086756247 driven_any_max 6.148614814011898 driven_any_mean 6.148614814011898 driven_any_median 6.148614814011898 driven_any_min 6.148614814011898 driven_lanedir_consec_max 2.12347102686018 driven_lanedir_consec_mean 2.12347102686018 driven_lanedir_consec_min 2.12347102686018 driven_lanedir_max 2.12347102686018 driven_lanedir_mean 2.12347102686018 driven_lanedir_median 2.12347102686018 driven_lanedir_min 2.12347102686018 in-drivable-lane_max 30.34999999999932 in-drivable-lane_mean 30.34999999999932 in-drivable-lane_min 30.34999999999932 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.148614814011898, "survival_time": 47.44999999999944, "driven_lanedir": 2.12347102686018, "in-drivable-lane": 30.34999999999932, "deviation-heading": 4.140174141049068, "distance-from-start": 2.073292086756247, "deviation-center-line": 1.8772282206100404, "driven_lanedir_consec": 2.12347102686018}}simulation-passed 1 survival_time_max 47.44999999999944 survival_time_mean 47.44999999999944 survival_time_min 47.44999999999944
No reset possible 15724
1372
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:52:49+00:00 2022-11-25 10:11:13+00:00 0:18:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.299999999999891 driven_lanedir_consec_median 0.8931440043564197 deviation-center-line_median 4.607630039147656
other stats deviation-center-line_max 7.119977999000723 deviation-center-line_mean 4.159971273327921 deviation-center-line_min 0.3046470160156492 deviation-heading_max 22.88097174024547 deviation-heading_mean 12.452826365478677 deviation-heading_median 12.544190395891867 deviation-heading_min 1.841952929885487 distance-from-start_max 3.6234230616057057 distance-from-start_mean 1.593158546304068 distance-from-start_median 1.1073570308466372 distance-from-start_min 0.5344970619172926 driven_any_max 7.914054448866035 driven_any_mean 2.887246373091889 driven_any_median 1.275855156144071 driven_any_min 1.0832207312133806 driven_lanedir_consec_max 3.935273016811651 driven_lanedir_consec_mean 1.5640166437838086 driven_lanedir_consec_min 0.5345055496107425 driven_lanedir_max 6.406235743110327 driven_lanedir_mean 2.181757325358477 driven_lanedir_median 0.8931440043564197 driven_lanedir_min 0.5345055496107425 in-drivable-lane_max 54.999999999998735 in-drivable-lane_mean 16.22499999999963 in-drivable-lane_min 1.2999999999999954 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.2758573055104896, "survival_time": 59.99999999999873, "driven_lanedir": 0.9401792214378276, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 7.322400383296982, "distance-from-start": 1.1214012705603302, "deviation-center-line": 7.119977999000723, "driven_lanedir_consec": 0.9401792214378276}, "zigzag-000-ego1": {"driven_any": 1.2758530067776523, "survival_time": 59.99999999999873, "driven_lanedir": 0.8461087872750117, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 22.88097174024547, "distance-from-start": 1.093312791132944, "deviation-center-line": 5.500815774277301, "driven_lanedir_consec": 0.8461087872750117}, "zigzag-000-ego2": {"driven_any": 1.0832207312133806, "survival_time": 59.99999999999873, "driven_lanedir": 0.5345055496107425, "in-drivable-lane": 54.999999999998735, "deviation-heading": 1.841952929885487, "distance-from-start": 0.5344970619172926, "deviation-center-line": 0.3046470160156492, "driven_lanedir_consec": 0.5345055496107425}, "zigzag-000-ego3": {"driven_any": 7.914054448866035, "survival_time": 59.99999999999873, "driven_lanedir": 6.406235743110327, "in-drivable-lane": 6.44999999999979, "deviation-heading": 17.76598040848675, "distance-from-start": 3.6234230616057057, "deviation-center-line": 3.714444304018011, "driven_lanedir_consec": 3.935273016811651}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15722
1373
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:48:49+00:00 2022-11-25 09:52:22+00:00 0:03:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.400000000000222 in-drivable-lane_median 2.6500000000000217 driven_lanedir_consec_median 2.8026755426713663 deviation-center-line_median 1.6443990433995823
other stats deviation-center-line_max 1.6443990433995823 deviation-center-line_mean 1.6443990433995823 deviation-center-line_min 1.6443990433995823 deviation-heading_max 4.128115891548599 deviation-heading_mean 4.128115891548599 deviation-heading_median 4.128115891548599 deviation-heading_min 4.128115891548599 distance-from-start_max 2.276373235423173 distance-from-start_mean 2.276373235423173 distance-from-start_median 2.276373235423173 distance-from-start_min 2.276373235423173 driven_any_max 3.2210405535047095 driven_any_mean 3.2210405535047095 driven_any_median 3.2210405535047095 driven_any_min 3.2210405535047095 driven_lanedir_consec_max 2.8026755426713663 driven_lanedir_consec_mean 2.8026755426713663 driven_lanedir_consec_min 2.8026755426713663 driven_lanedir_max 2.8026755426713663 driven_lanedir_mean 2.8026755426713663 driven_lanedir_median 2.8026755426713663 driven_lanedir_min 2.8026755426713663 in-drivable-lane_max 2.6500000000000217 in-drivable-lane_mean 2.6500000000000217 in-drivable-lane_min 2.6500000000000217 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.2210405535047095, "survival_time": 25.400000000000222, "driven_lanedir": 2.8026755426713663, "in-drivable-lane": 2.6500000000000217, "deviation-heading": 4.128115891548599, "distance-from-start": 2.276373235423173, "deviation-center-line": 1.6443990433995823, "driven_lanedir_consec": 2.8026755426713663}}simulation-passed 1 survival_time_max 25.400000000000222 survival_time_mean 25.400000000000222 survival_time_min 25.400000000000222
No reset possible 15720
1373
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 09:46:43+00:00 2022-11-25 09:48:22+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.4999999999999885 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5492946526712845 deviation-center-line_median 0.24494571440773188
other stats deviation-center-line_max 0.24494571440773188 deviation-center-line_mean 0.24494571440773188 deviation-center-line_min 0.24494571440773188 deviation-heading_max 1.535453797923149 deviation-heading_mean 1.535453797923149 deviation-heading_median 1.535453797923149 deviation-heading_min 1.535453797923149 distance-from-start_max 0.5397404071143779 distance-from-start_mean 0.5397404071143779 distance-from-start_median 0.5397404071143779 distance-from-start_min 0.5397404071143779 driven_any_max 0.5788754709283455 driven_any_mean 0.5788754709283455 driven_any_median 0.5788754709283455 driven_any_min 0.5788754709283455 driven_lanedir_consec_max 0.5492946526712845 driven_lanedir_consec_mean 0.5492946526712845 driven_lanedir_consec_min 0.5492946526712845 driven_lanedir_max 0.5492946526712845 driven_lanedir_mean 0.5492946526712845 driven_lanedir_median 0.5492946526712845 driven_lanedir_min 0.5492946526712845 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.5788754709283455, "survival_time": 5.4999999999999885, "driven_lanedir": 0.5492946526712845, "in-drivable-lane": 0.0, "deviation-heading": 1.535453797923149, "distance-from-start": 0.5397404071143779, "deviation-center-line": 0.24494571440773188, "driven_lanedir_consec": 0.5492946526712845}}simulation-passed 1 survival_time_max 5.4999999999999885 survival_time_mean 5.4999999999999885 survival_time_min 5.4999999999999885
No reset possible 15718
1374
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 09:43:19+00:00 2022-11-25 09:46:36+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.499999999999985 in-drivable-lane_median 0.9499999999999966 driven_lanedir_consec_median 0.6411480467016211 deviation-center-line_median 0.17979717785931687
other stats deviation-center-line_max 0.17979717785931687 deviation-center-line_mean 0.17979717785931687 deviation-center-line_min 0.17979717785931687 deviation-heading_max 1.4150878917497738 deviation-heading_mean 1.4150878917497738 deviation-heading_median 1.4150878917497738 deviation-heading_min 1.4150878917497738 distance-from-start_max 0.5664683709117986 distance-from-start_mean 0.5664683709117986 distance-from-start_median 0.5664683709117986 distance-from-start_min 0.5664683709117986 driven_any_max 0.7182568013008965 driven_any_mean 0.7182568013008965 driven_any_median 0.7182568013008965 driven_any_min 0.7182568013008965 driven_lanedir_consec_max 0.6411480467016211 driven_lanedir_consec_mean 0.6411480467016211 driven_lanedir_consec_min 0.6411480467016211 driven_lanedir_max 0.6411480467016211 driven_lanedir_mean 0.6411480467016211 driven_lanedir_median 0.6411480467016211 driven_lanedir_min 0.6411480467016211 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.9499999999999966 in-drivable-lane_min 0.9499999999999966 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7182568013008965, "survival_time": 6.499999999999985, "driven_lanedir": 0.6411480467016211, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.4150878917497738, "distance-from-start": 0.5664683709117986, "deviation-center-line": 0.17979717785931687, "driven_lanedir_consec": 0.6411480467016211}}simulation-passed 1 survival_time_max 6.499999999999985 survival_time_mean 6.499999999999985 survival_time_min 6.499999999999985
No reset possible 15714
1375
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:41:15+00:00 2022-11-25 09:42:46+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15711
1375
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 09:39:20+00:00 2022-11-25 09:41:10+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15708
1376
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:37:21+00:00 2022-11-25 09:39:09+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15706
1377
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 09:32:25+00:00 2022-11-25 09:36:50+00:00 0:04:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.353223699510511 survival_time_median 33.55000000000023 deviation-center-line_median 0.9228691439354 in-drivable-lane_median 15.000000000000089
other stats deviation-center-line_max 0.9228691439354 deviation-center-line_mean 0.9228691439354 deviation-center-line_min 0.9228691439354 deviation-heading_max 5.151910544825146 deviation-heading_mean 5.151910544825146 deviation-heading_median 5.151910544825146 deviation-heading_min 5.151910544825146 distance-from-start_max 1.382192463117652 distance-from-start_mean 1.382192463117652 distance-from-start_median 1.382192463117652 distance-from-start_min 1.382192463117652 driven_any_max 4.302998006261677 driven_any_mean 4.302998006261677 driven_any_median 4.302998006261677 driven_any_min 4.302998006261677 driven_lanedir_consec_max 1.353223699510511 driven_lanedir_consec_mean 1.353223699510511 driven_lanedir_consec_min 1.353223699510511 driven_lanedir_max 2.205523081902223 driven_lanedir_mean 2.205523081902223 driven_lanedir_median 2.205523081902223 driven_lanedir_min 2.205523081902223 in-drivable-lane_max 15.000000000000089 in-drivable-lane_mean 15.000000000000089 in-drivable-lane_min 15.000000000000089 per-episodes details {"loop-000-ego0": {"driven_any": 4.302998006261677, "survival_time": 33.55000000000023, "driven_lanedir": 2.205523081902223, "in-drivable-lane": 15.000000000000089, "deviation-heading": 5.151910544825146, "distance-from-start": 1.382192463117652, "deviation-center-line": 0.9228691439354, "driven_lanedir_consec": 1.353223699510511}}simulation-passed 1 survival_time_max 33.55000000000023 survival_time_mean 33.55000000000023 survival_time_min 33.55000000000023
No reset possible 15704
1377
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:26:05+00:00 2022-11-25 09:31:52+00:00 0:05:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 6.119827759644096 survival_time_median 59.99999999999873 deviation-center-line_median 3.7430784724350623 in-drivable-lane_median 11.049999999999772
other stats deviation-center-line_max 3.7430784724350623 deviation-center-line_mean 3.7430784724350623 deviation-center-line_min 3.7430784724350623 deviation-heading_max 11.01765254167092 deviation-heading_mean 11.01765254167092 deviation-heading_median 11.01765254167092 deviation-heading_min 11.01765254167092 distance-from-start_max 4.048749282771819 distance-from-start_mean 4.048749282771819 distance-from-start_median 4.048749282771819 distance-from-start_min 4.048749282771819 driven_any_max 7.9077741539891 driven_any_mean 7.9077741539891 driven_any_median 7.9077741539891 driven_any_min 7.9077741539891 driven_lanedir_consec_max 6.119827759644096 driven_lanedir_consec_mean 6.119827759644096 driven_lanedir_consec_min 6.119827759644096 driven_lanedir_max 6.119827759644096 driven_lanedir_mean 6.119827759644096 driven_lanedir_median 6.119827759644096 driven_lanedir_min 6.119827759644096 in-drivable-lane_max 11.049999999999772 in-drivable-lane_mean 11.049999999999772 in-drivable-lane_min 11.049999999999772 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.9077741539891, "survival_time": 59.99999999999873, "driven_lanedir": 6.119827759644096, "in-drivable-lane": 11.049999999999772, "deviation-heading": 11.01765254167092, "distance-from-start": 4.048749282771819, "deviation-center-line": 3.7430784724350623, "driven_lanedir_consec": 6.119827759644096}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15696
1379
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 09:15:00+00:00 2022-11-25 09:25:46+00:00 0:10:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.000000000000263 in-drivable-lane_median 5.450000000000049 driven_lanedir_consec_median 1.9356088658662385 deviation-center-line_median 1.550851216658414
other stats deviation-center-line_max 1.7486442852783095 deviation-center-line_mean 1.246132592921514 deviation-center-line_min 0.13418365309091762 deviation-heading_max 11.649485391979685 deviation-heading_mean 6.554034410970646 deviation-heading_median 6.806915415474352 deviation-heading_min 0.952821420954192 distance-from-start_max 2.014476642790586 distance-from-start_mean 1.40487590394007 distance-from-start_median 1.702789361488481 distance-from-start_min 0.1994482499927325 driven_any_max 3.57274302750026 driven_any_mean 2.5503667786729745 driven_any_median 3.214120313101035 driven_any_min 0.20048346098956712 driven_lanedir_consec_max 2.8919056355501054 driven_lanedir_consec_mean 1.7193917782005697 driven_lanedir_consec_min 0.11444374551969672 driven_lanedir_max 2.8919056355501054 driven_lanedir_mean 1.847637426345793 driven_lanedir_median 2.192100162156686 driven_lanedir_min 0.11444374551969672 in-drivable-lane_max 26.500000000000263 in-drivable-lane_mean 10.162500000000096 in-drivable-lane_min 3.250000000000026 per-episodes details {"loop-000-ego0": {"driven_any": 3.2141549931618405, "survival_time": 28.000000000000263, "driven_lanedir": 2.37522732095179, "in-drivable-lane": 3.250000000000026, "deviation-heading": 11.649485391979685, "distance-from-start": 2.014476642790586, "deviation-center-line": 1.7486442852783095, "driven_lanedir_consec": 1.862244728370896}, "loop-000-ego1": {"driven_any": 0.20048346098956712, "survival_time": 28.000000000000263, "driven_lanedir": 0.11444374551969672, "in-drivable-lane": 26.500000000000263, "deviation-heading": 0.952821420954192, "distance-from-start": 0.1994482499927325, "deviation-center-line": 0.13418365309091762, "driven_lanedir_consec": 0.11444374551969672}, "loop-000-ego2": {"driven_any": 3.57274302750026, "survival_time": 28.000000000000263, "driven_lanedir": 2.8919056355501054, "in-drivable-lane": 3.599999999999995, "deviation-heading": 7.075587388234443, "distance-from-start": 1.4829438369768444, "deviation-center-line": 1.373878542439245, "driven_lanedir_consec": 2.8919056355501054}, "loop-000-ego3": {"driven_any": 3.21408563304023, "survival_time": 28.000000000000263, "driven_lanedir": 2.0089730033615805, "in-drivable-lane": 7.300000000000104, "deviation-heading": 6.5382434427142595, "distance-from-start": 1.9226348860001177, "deviation-center-line": 1.7278238908775827, "driven_lanedir_consec": 2.0089730033615805}}simulation-passed 1 survival_time_max 28.000000000000263 survival_time_mean 28.000000000000263 survival_time_min 28.000000000000263
No reset possible 15693
1380
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 09:09:12+00:00 2022-11-25 09:14:52+00:00 0:05:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 38.19999999999997 in-drivable-lane_median 1.7500000000000249 driven_lanedir_consec_median 4.567761963430359 deviation-center-line_median 3.321123507358312
other stats deviation-center-line_max 3.321123507358312 deviation-center-line_mean 3.321123507358312 deviation-center-line_min 3.321123507358312 deviation-heading_max 6.556647811138298 deviation-heading_mean 6.556647811138298 deviation-heading_median 6.556647811138298 deviation-heading_min 6.556647811138298 distance-from-start_max 2.11658454670624 distance-from-start_mean 2.11658454670624 distance-from-start_median 2.11658454670624 distance-from-start_min 2.11658454670624 driven_any_max 4.920545830465709 driven_any_mean 4.920545830465709 driven_any_median 4.920545830465709 driven_any_min 4.920545830465709 driven_lanedir_consec_max 4.567761963430359 driven_lanedir_consec_mean 4.567761963430359 driven_lanedir_consec_min 4.567761963430359 driven_lanedir_max 4.567761963430359 driven_lanedir_mean 4.567761963430359 driven_lanedir_median 4.567761963430359 driven_lanedir_min 4.567761963430359 in-drivable-lane_max 1.7500000000000249 in-drivable-lane_mean 1.7500000000000249 in-drivable-lane_min 1.7500000000000249 per-episodes details {"loop-000-ego0": {"driven_any": 4.920545830465709, "survival_time": 38.19999999999997, "driven_lanedir": 4.567761963430359, "in-drivable-lane": 1.7500000000000249, "deviation-heading": 6.556647811138298, "distance-from-start": 2.11658454670624, "deviation-center-line": 3.321123507358312, "driven_lanedir_consec": 4.567761963430359}}simulation-passed 1 survival_time_max 38.19999999999997 survival_time_mean 38.19999999999997 survival_time_min 38.19999999999997
No reset possible 15692
1380
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 09:04:56+00:00 2022-11-25 09:08:50+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 26.950000000000248 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.333430460221142 deviation-center-line_median 2.0500395949542094
other stats deviation-center-line_max 2.0500395949542094 deviation-center-line_mean 2.0500395949542094 deviation-center-line_min 2.0500395949542094 deviation-heading_max 5.1136322997682875 deviation-heading_mean 5.1136322997682875 deviation-heading_median 5.1136322997682875 deviation-heading_min 5.1136322997682875 distance-from-start_max 2.5123676460471933 distance-from-start_mean 2.5123676460471933 distance-from-start_median 2.5123676460471933 distance-from-start_min 2.5123676460471933 driven_any_max 3.426817593505425 driven_any_mean 3.426817593505425 driven_any_median 3.426817593505425 driven_any_min 3.426817593505425 driven_lanedir_consec_max 3.333430460221142 driven_lanedir_consec_mean 3.333430460221142 driven_lanedir_consec_min 3.333430460221142 driven_lanedir_max 3.333430460221142 driven_lanedir_mean 3.333430460221142 driven_lanedir_median 3.333430460221142 driven_lanedir_min 3.333430460221142 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.426817593505425, "survival_time": 26.950000000000248, "driven_lanedir": 3.333430460221142, "in-drivable-lane": 0.0, "deviation-heading": 5.1136322997682875, "distance-from-start": 2.5123676460471933, "deviation-center-line": 2.0500395949542094, "driven_lanedir_consec": 3.333430460221142}}simulation-passed 1 survival_time_max 26.950000000000248 survival_time_mean 26.950000000000248 survival_time_min 26.950000000000248
No reset possible 15686
1385
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-3of5 success no davinci-stage-02-6.2.51
2022-11-25 08:55:46+00:00 2022-11-25 09:04:27+00:00 0:08:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15683
1385
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-25 08:52:58+00:00 2022-11-25 08:55:32+00:00 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.2303438465644148
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.2303438465644148 distance-from-start_median 1.2303438465644148 distance-from-start_min 1.2303438465644148 driven_any_max 1.3755229837339482 driven_any_mean 1.3755229837339482 driven_any_median 1.3755229837339482 driven_any_min 1.3755229837339482 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.450000000000028 in-drivable-lane_mean 11.450000000000028 in-drivable-lane_median 11.450000000000028 in-drivable-lane_min 11.450000000000028 per-episodes details {"d60-ego0": {"driven_any": 1.3755229837339482, "survival_time": 11.450000000000028, "driven_lanedir": 0.0, "in-drivable-lane": 11.450000000000028, "deviation-heading": 0.0, "distance-from-start": 1.2303438465644148, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_median 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 15676
1393
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 08:42:58+00:00 2022-11-25 08:52:23+00:00 0:09:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.24999999999968 in-drivable-lane_median 2.300000000000008 driven_lanedir_consec_median 3.9003330633320097 deviation-center-line_median 2.029615796554507
other stats deviation-center-line_max 2.029615796554507 deviation-center-line_mean 2.029615796554507 deviation-center-line_min 2.029615796554507 deviation-heading_max 8.334688233672178 deviation-heading_mean 8.334688233672178 deviation-heading_median 8.334688233672178 deviation-heading_min 8.334688233672178 distance-from-start_max 3.3078194555964253 distance-from-start_mean 3.3078194555964253 distance-from-start_median 3.3078194555964253 distance-from-start_min 3.3078194555964253 driven_any_max 5.59754728591906 driven_any_mean 5.59754728591906 driven_any_median 5.59754728591906 driven_any_min 5.59754728591906 driven_lanedir_consec_max 3.9003330633320097 driven_lanedir_consec_mean 3.9003330633320097 driven_lanedir_consec_min 3.9003330633320097 driven_lanedir_max 5.046254580425187 driven_lanedir_mean 5.046254580425187 driven_lanedir_median 5.046254580425187 driven_lanedir_min 5.046254580425187 in-drivable-lane_max 2.300000000000008 in-drivable-lane_mean 2.300000000000008 in-drivable-lane_min 2.300000000000008 per-episodes details {"udem-000-ego0": {"driven_any": 5.59754728591906, "survival_time": 43.24999999999968, "driven_lanedir": 5.046254580425187, "in-drivable-lane": 2.300000000000008, "deviation-heading": 8.334688233672178, "distance-from-start": 3.3078194555964253, "deviation-center-line": 2.029615796554507, "driven_lanedir_consec": 3.9003330633320097}}simulation-passed 1 survival_time_max 43.24999999999968 survival_time_mean 43.24999999999968 survival_time_min 43.24999999999968
No reset possible 15670
1394
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 08:34:52+00:00 2022-11-25 08:42:23+00:00 0:07:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.799999999999887 driven_lanedir_consec_median 4.454044806132165 deviation-center-line_median 4.108154418027153
other stats deviation-center-line_max 4.108154418027153 deviation-center-line_mean 4.108154418027153 deviation-center-line_min 4.108154418027153 deviation-heading_max 13.45581185440864 deviation-heading_mean 13.45581185440864 deviation-heading_median 13.45581185440864 deviation-heading_min 13.45581185440864 distance-from-start_max 1.9641179214132851 distance-from-start_mean 1.9641179214132851 distance-from-start_median 1.9641179214132851 distance-from-start_min 1.9641179214132851 driven_any_max 7.907289585583798 driven_any_mean 7.907289585583798 driven_any_median 7.907289585583798 driven_any_min 7.907289585583798 driven_lanedir_consec_max 4.454044806132165 driven_lanedir_consec_mean 4.454044806132165 driven_lanedir_consec_min 4.454044806132165 driven_lanedir_max 7.095827127078207 driven_lanedir_mean 7.095827127078207 driven_lanedir_median 7.095827127078207 driven_lanedir_min 7.095827127078207 in-drivable-lane_max 2.799999999999887 in-drivable-lane_mean 2.799999999999887 in-drivable-lane_min 2.799999999999887 per-episodes details {"4way-000-ego0": {"driven_any": 7.907289585583798, "survival_time": 59.99999999999873, "driven_lanedir": 7.095827127078207, "in-drivable-lane": 2.799999999999887, "deviation-heading": 13.45581185440864, "distance-from-start": 1.9641179214132851, "deviation-center-line": 4.108154418027153, "driven_lanedir_consec": 4.454044806132165}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15657
1397
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 08:13:15+00:00 2022-11-25 08:34:45+00:00 0:21:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.4250000000000265 driven_lanedir_consec_median 1.269857385774377 deviation-center-line_median 5.343388786837334
other stats deviation-center-line_max 6.658221601086534 deviation-center-line_mean 4.714730193726601 deviation-center-line_min 1.5139216001452034 deviation-heading_max 55.58477578933253 deviation-heading_mean 32.11280018798316 deviation-heading_median 30.756785753047797 deviation-heading_min 11.35285345650452 distance-from-start_max 2.152244291972848 distance-from-start_mean 1.393949436135462 distance-from-start_median 1.218985522005545 distance-from-start_min 0.9855824085579092 driven_any_max 7.913699588180642 driven_any_mean 3.730060017380079 driven_any_median 2.7226964222697148 driven_any_min 1.561147636800246 driven_lanedir_consec_max 4.077171120970986 driven_lanedir_consec_mean 1.8396497012710484 driven_lanedir_consec_min 0.7417129125644539 driven_lanedir_max 6.231166938952461 driven_lanedir_mean 2.53343127858215 driven_lanedir_median 1.5694605927428689 driven_lanedir_min 0.7636369898904021 in-drivable-lane_max 38.84999999999856 in-drivable-lane_mean 13.199999999999656 in-drivable-lane_min 3.1000000000000068 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.561147636800246, "survival_time": 59.99999999999873, "driven_lanedir": 0.7636369898904021, "in-drivable-lane": 4.250000000000023, "deviation-heading": 55.58477578933253, "distance-from-start": 0.9855824085579092, "deviation-center-line": 6.606106679681102, "driven_lanedir_consec": 0.7417129125644539}, "zigzag-000-ego1": {"driven_any": 1.5611588918422838, "survival_time": 59.99999999999873, "driven_lanedir": 0.932971711455752, "in-drivable-lane": 3.1000000000000068, "deviation-heading": 42.03377943560804, "distance-from-start": 1.26682324643138, "deviation-center-line": 6.658221601086534, "driven_lanedir_consec": 0.932971711455752}, "zigzag-000-ego2": {"driven_any": 7.913699588180642, "survival_time": 59.99999999999873, "driven_lanedir": 6.231166938952461, "in-drivable-lane": 6.60000000000003, "deviation-heading": 19.479792070487555, "distance-from-start": 2.152244291972848, "deviation-center-line": 4.080670893993566, "driven_lanedir_consec": 4.077171120970986}, "zigzag-000-ego3": {"driven_any": 3.8842339526971457, "survival_time": 59.99999999999873, "driven_lanedir": 2.2059494740299854, "in-drivable-lane": 38.84999999999856, "deviation-heading": 11.35285345650452, "distance-from-start": 1.1711477975797102, "deviation-center-line": 1.5139216001452034, "driven_lanedir_consec": 1.6067430600930015}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15655
1398
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 08:10:58+00:00 2022-11-25 08:12:50+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.799999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.6001087965408689 deviation-center-line_median 0.2239504175653612
other stats deviation-center-line_max 0.2239504175653612 deviation-center-line_mean 0.2239504175653612 deviation-center-line_min 0.2239504175653612 deviation-heading_max 1.3835867538915907 deviation-heading_mean 1.3835867538915907 deviation-heading_median 1.3835867538915907 deviation-heading_min 1.3835867538915907 distance-from-start_max 0.5755062455898677 distance-from-start_mean 0.5755062455898677 distance-from-start_median 0.5755062455898677 distance-from-start_min 0.5755062455898677 driven_any_max 0.6187074517187078 driven_any_mean 0.6187074517187078 driven_any_median 0.6187074517187078 driven_any_min 0.6187074517187078 driven_lanedir_consec_max 0.6001087965408689 driven_lanedir_consec_mean 0.6001087965408689 driven_lanedir_consec_min 0.6001087965408689 driven_lanedir_max 0.6001087965408689 driven_lanedir_mean 0.6001087965408689 driven_lanedir_median 0.6001087965408689 driven_lanedir_min 0.6001087965408689 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.6187074517187078, "survival_time": 5.799999999999987, "driven_lanedir": 0.6001087965408689, "in-drivable-lane": 0.0, "deviation-heading": 1.3835867538915907, "distance-from-start": 0.5755062455898677, "deviation-center-line": 0.2239504175653612, "driven_lanedir_consec": 0.6001087965408689}}simulation-passed 1 survival_time_max 5.799999999999987 survival_time_mean 5.799999999999987 survival_time_min 5.799999999999987
No reset possible 15653
1399
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 08:08:27+00:00 2022-11-25 08:10:40+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15650
1399
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 08:06:29+00:00 2022-11-25 08:08:06+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15648
1400
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 08:03:54+00:00 2022-11-25 08:06:01+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.09999999999998 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.41885674395418215 deviation-center-line_median 0.2592734099538108
other stats deviation-center-line_max 0.2592734099538108 deviation-center-line_mean 0.2592734099538108 deviation-center-line_min 0.2592734099538108 deviation-heading_max 0.7151194489559713 deviation-heading_mean 0.7151194489559713 deviation-heading_median 0.7151194489559713 deviation-heading_min 0.7151194489559713 distance-from-start_max 0.4199960454985642 distance-from-start_mean 0.4199960454985642 distance-from-start_median 0.4199960454985642 distance-from-start_min 0.4199960454985642 driven_any_max 0.42359927688869903 driven_any_mean 0.42359927688869903 driven_any_median 0.42359927688869903 driven_any_min 0.42359927688869903 driven_lanedir_consec_max 0.41885674395418215 driven_lanedir_consec_mean 0.41885674395418215 driven_lanedir_consec_min 0.41885674395418215 driven_lanedir_max 0.41885674395418215 driven_lanedir_mean 0.41885674395418215 driven_lanedir_median 0.41885674395418215 driven_lanedir_min 0.41885674395418215 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}simulation-passed 1 survival_time_max 8.09999999999998 survival_time_mean 8.09999999999998 survival_time_min 8.09999999999998
No reset possible 15646
1400
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 07:59:55+00:00 2022-11-25 08:03:25+00:00 0:03:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.200000000000223 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.3557424143249113 deviation-center-line_median 2.2764052687353016
other stats deviation-center-line_max 2.2764052687353016 deviation-center-line_mean 2.2764052687353016 deviation-center-line_min 2.2764052687353016 deviation-heading_max 2.9201829757406066 deviation-heading_mean 2.9201829757406066 deviation-heading_median 2.9201829757406066 deviation-heading_min 2.9201829757406066 distance-from-start_max 1.1340032910142968 distance-from-start_mean 1.1340032910142968 distance-from-start_median 1.1340032910142968 distance-from-start_min 1.1340032910142968 driven_any_max 1.4165963270662665 driven_any_mean 1.4165963270662665 driven_any_median 1.4165963270662665 driven_any_min 1.4165963270662665 driven_lanedir_consec_max 1.3557424143249113 driven_lanedir_consec_mean 1.3557424143249113 driven_lanedir_consec_min 1.3557424143249113 driven_lanedir_max 1.3557424143249113 driven_lanedir_mean 1.3557424143249113 driven_lanedir_median 1.3557424143249113 driven_lanedir_min 1.3557424143249113 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}simulation-passed 1 survival_time_max 25.200000000000223 survival_time_mean 25.200000000000223 survival_time_min 25.200000000000223
No reset possible 15642
1401
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 07:53:15+00:00 2022-11-25 07:59:35+00:00 0:06:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.2653509128575537 deviation-center-line_median 7.121053917268459
other stats deviation-center-line_max 7.121053917268459 deviation-center-line_mean 7.121053917268459 deviation-center-line_min 7.121053917268459 deviation-heading_max 5.705613996279617 deviation-heading_mean 5.705613996279617 deviation-heading_median 5.705613996279617 deviation-heading_min 5.705613996279617 distance-from-start_max 1.6305272704555316 distance-from-start_mean 1.6305272704555316 distance-from-start_median 1.6305272704555316 distance-from-start_min 1.6305272704555316 driven_any_max 3.4663369114033205 driven_any_mean 3.4663369114033205 driven_any_median 3.4663369114033205 driven_any_min 3.4663369114033205 driven_lanedir_consec_max 3.2653509128575537 driven_lanedir_consec_mean 3.2653509128575537 driven_lanedir_consec_min 3.2653509128575537 driven_lanedir_max 3.2653509128575537 driven_lanedir_mean 3.2653509128575537 driven_lanedir_median 3.2653509128575537 driven_lanedir_min 3.2653509128575537 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4663369114033205, "survival_time": 59.99999999999873, "driven_lanedir": 3.2653509128575537, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.705613996279617, "distance-from-start": 1.6305272704555316, "deviation-center-line": 7.121053917268459, "driven_lanedir_consec": 3.2653509128575537}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15639
1402
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 07:51:22+00:00 2022-11-25 07:53:02+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15633
1404
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 07:35:29+00:00 2022-11-25 07:51:13+00:00 0:15:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.20000000000000284 driven_lanedir_consec_median 2.1565184275403313 deviation-center-line_median 6.8847539526335915
other stats deviation-center-line_max 8.505262062597504 deviation-center-line_mean 6.394382047888438 deviation-center-line_min 3.302758223689067 deviation-heading_max 3.5798145230604925 deviation-heading_mean 3.012446130364057 deviation-heading_median 3.033769498208445 deviation-heading_min 2.402431001978846 distance-from-start_max 2.264476618156332 distance-from-start_mean 1.734085808306428 distance-from-start_median 1.6868768650116457 distance-from-start_min 1.29811288504609 driven_any_max 3.579581555069671 driven_any_mean 2.4167183064098396 driven_any_median 2.2138464935031155 driven_any_min 1.6595986835634573 driven_lanedir_consec_max 3.3044744777527537 driven_lanedir_consec_mean 2.3124661245028157 driven_lanedir_consec_min 1.6323531651778471 driven_lanedir_max 3.561566929531012 driven_lanedir_mean 2.376739286489579 driven_lanedir_median 2.156518525624728 driven_lanedir_min 1.6323531651778471 in-drivable-lane_max 1.8499999999998948 in-drivable-lane_mean 0.5624999999999751 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579581555069671, "survival_time": 59.99999999999873, "driven_lanedir": 3.561566929531012, "in-drivable-lane": 0.0, "deviation-heading": 3.2546450343389006, "distance-from-start": 2.0440638678450447, "deviation-center-line": 3.302758223689067, "driven_lanedir_consec": 3.3044744777527537}, "4way-000-ego1": {"driven_any": 2.762094908064345, "survival_time": 59.99999999999873, "driven_lanedir": 2.6640283319084603, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.5798145230604925, "distance-from-start": 2.264476618156332, "deviation-center-line": 6.515047986085757, "driven_lanedir_consec": 2.664028135739667}, "4way-000-ego2": {"driven_any": 1.665598078941886, "survival_time": 59.99999999999873, "driven_lanedir": 1.6323531651778471, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 2.8128939620779896, "distance-from-start": 1.29811288504609, "deviation-center-line": 7.254459919181427, "driven_lanedir_consec": 1.6323531651778471}, "4way-000-ego3": {"driven_any": 1.6595986835634573, "survival_time": 59.99999999999873, "driven_lanedir": 1.6490087193409952, "in-drivable-lane": 0.0, "deviation-heading": 2.402431001978846, "distance-from-start": 1.3296898621782465, "deviation-center-line": 8.505262062597504, "driven_lanedir_consec": 1.6490087193409952}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15628
1405
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 07:29:15+00:00 2022-11-25 07:35:22+00:00 0:06:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.89181051149263 deviation-center-line_median 5.68144547559899
other stats deviation-center-line_max 5.68144547559899 deviation-center-line_mean 5.68144547559899 deviation-center-line_min 5.68144547559899 deviation-heading_max 11.49374085929236 deviation-heading_mean 11.49374085929236 deviation-heading_median 11.49374085929236 deviation-heading_min 11.49374085929236 distance-from-start_max 2.522917038266831 distance-from-start_mean 2.522917038266831 distance-from-start_median 2.522917038266831 distance-from-start_min 2.522917038266831 driven_any_max 3.426575056819777 driven_any_mean 3.426575056819777 driven_any_median 3.426575056819777 driven_any_min 3.426575056819777 driven_lanedir_consec_max 2.89181051149263 driven_lanedir_consec_mean 2.89181051149263 driven_lanedir_consec_min 2.89181051149263 driven_lanedir_max 3.0975603398117015 driven_lanedir_mean 3.0975603398117015 driven_lanedir_median 3.0975603398117015 driven_lanedir_min 3.0975603398117015 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.426575056819777, "survival_time": 59.99999999999873, "driven_lanedir": 3.0975603398117015, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.49374085929236, "distance-from-start": 2.522917038266831, "deviation-center-line": 5.68144547559899, "driven_lanedir_consec": 2.89181051149263}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15625
1406
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 07:26:55+00:00 2022-11-25 07:29:08+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15616
1408
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 07:13:55+00:00 2022-11-25 07:26:50+00:00 0:12:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0918531760676333 deviation-center-line_median 5.910477685795049
other stats deviation-center-line_max 5.910477685795049 deviation-center-line_mean 5.910477685795049 deviation-center-line_min 5.910477685795049 deviation-heading_max 8.289002671411088 deviation-heading_mean 8.289002671411088 deviation-heading_median 8.289002671411088 deviation-heading_min 8.289002671411088 distance-from-start_max 1.0313532441319608 distance-from-start_mean 1.0313532441319608 distance-from-start_median 1.0313532441319608 distance-from-start_min 1.0313532441319608 driven_any_max 3.4490819978293596 driven_any_mean 3.4490819978293596 driven_any_median 3.4490819978293596 driven_any_min 3.4490819978293596 driven_lanedir_consec_max 2.0918531760676333 driven_lanedir_consec_mean 2.0918531760676333 driven_lanedir_consec_min 2.0918531760676333 driven_lanedir_max 3.2042238074943747 driven_lanedir_mean 3.2042238074943747 driven_lanedir_median 3.2042238074943747 driven_lanedir_min 3.2042238074943747 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"autolab-000-ego0": {"driven_any": 3.4490819978293596, "survival_time": 59.99999999999873, "driven_lanedir": 3.2042238074943747, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.289002671411088, "distance-from-start": 1.0313532441319608, "deviation-center-line": 5.910477685795049, "driven_lanedir_consec": 2.0918531760676333}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15609
1410
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 07:05:44+00:00 2022-11-25 07:13:48+00:00 0:08:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.3499999999998806 driven_lanedir_consec_median 2.380620752906845 deviation-center-line_median 6.078324583568444
other stats deviation-center-line_max 6.569878400409913 deviation-center-line_mean 6.078324583568444 deviation-center-line_min 5.586770766726975 deviation-heading_max 8.265181027759835 deviation-heading_mean 7.317539588112885 deviation-heading_median 7.317539588112885 deviation-heading_min 6.369898148465933 distance-from-start_max 1.63164181697012 distance-from-start_mean 1.433389926870248 distance-from-start_median 1.433389926870248 distance-from-start_min 1.235138036770376 driven_any_max 3.486583615924898 driven_any_mean 3.479150650070676 driven_any_median 3.479150650070676 driven_any_min 3.471717684216453 driven_lanedir_consec_max 3.28796749924175 driven_lanedir_consec_mean 2.380620752906845 driven_lanedir_consec_min 1.4732740065719407 driven_lanedir_max 3.288000588512179 driven_lanedir_mean 3.287984043876964 driven_lanedir_median 3.287984043876964 driven_lanedir_min 3.28796749924175 in-drivable-lane_max 3.5999999999997954 in-drivable-lane_mean 3.3499999999998806 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.471717684216453, "survival_time": 59.99999999999873, "driven_lanedir": 3.28796749924175, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.369898148465933, "distance-from-start": 1.63164181697012, "deviation-center-line": 6.569878400409913, "driven_lanedir_consec": 3.28796749924175}, "loop2-000-ego1": {"driven_any": 3.486583615924898, "survival_time": 59.99999999999873, "driven_lanedir": 3.288000588512179, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181027759835, "distance-from-start": 1.235138036770376, "deviation-center-line": 5.586770766726975, "driven_lanedir_consec": 1.4732740065719407}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15602
1411
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 06:49:35+00:00 2022-11-25 07:05:25+00:00 0:15:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.9999999999999432 driven_lanedir_consec_median 2.7698955282609887 deviation-center-line_median 5.138314652956844
other stats deviation-center-line_max 5.756194777372426 deviation-center-line_mean 5.209270854058739 deviation-center-line_min 4.804259332948843 deviation-heading_max 6.908634530888926 deviation-heading_mean 4.98100070740749 deviation-heading_median 4.854233439147025 deviation-heading_min 3.306901420446983 distance-from-start_max 2.3695697937288083 distance-from-start_mean 1.915876448579448 distance-from-start_median 1.8549502450769235 distance-from-start_min 1.584035510435136 driven_any_max 3.579595424156211 driven_any_mean 3.3748668292703963 driven_any_median 3.501638142781199 driven_any_min 2.916595607362977 driven_lanedir_consec_max 3.5364749076240765 driven_lanedir_consec_mean 2.8157555010672786 driven_lanedir_consec_min 2.1867560401230626 driven_lanedir_max 3.5633303928470905 driven_lanedir_mean 3.282461667675166 driven_lanedir_median 3.333349215260178 driven_lanedir_min 2.899817847333218 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 1.312499999999961 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.483691022698869, "survival_time": 59.99999999999873, "driven_lanedir": 3.2991131995927705, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.230770184307429, "distance-from-start": 1.62980092342675, "deviation-center-line": 5.756194777372426, "driven_lanedir_consec": 2.1867560401230626}, "udem-000-ego1": {"driven_any": 3.579595424156211, "survival_time": 59.99999999999873, "driven_lanedir": 3.5633303928470905, "in-drivable-lane": 0.0, "deviation-heading": 3.306901420446983, "distance-from-start": 2.3695697937288083, "deviation-center-line": 4.804259332948843, "driven_lanedir_consec": 3.5364749076240765}, "udem-000-ego2": {"driven_any": 2.916595607362977, "survival_time": 59.99999999999873, "driven_lanedir": 2.899817847333218, "in-drivable-lane": 0.0, "deviation-heading": 3.477696693986621, "distance-from-start": 1.584035510435136, "deviation-center-line": 4.959405407533967, "driven_lanedir_consec": 2.883822177258341}, "udem-000-ego3": {"driven_any": 3.519585262863529, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675852309275847, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908634530888926, "distance-from-start": 2.080099566727098, "deviation-center-line": 5.317223898379722, "driven_lanedir_consec": 2.655968879263636}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15598
1414
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 06:45:35+00:00 2022-11-25 06:49:20+00:00 0:03:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.265479618005762 deviation-center-line_median 7.114499866441937
other stats deviation-center-line_max 7.114499866441937 deviation-center-line_mean 7.114499866441937 deviation-center-line_min 7.114499866441937 deviation-heading_max 5.7026362693789 deviation-heading_mean 5.7026362693789 deviation-heading_median 5.7026362693789 deviation-heading_min 5.7026362693789 distance-from-start_max 1.6303676024148757 distance-from-start_mean 1.6303676024148757 distance-from-start_median 1.6303676024148757 distance-from-start_min 1.6303676024148757 driven_any_max 3.4663369172887455 driven_any_mean 3.4663369172887455 driven_any_median 3.4663369172887455 driven_any_min 3.4663369172887455 driven_lanedir_consec_max 3.265479618005762 driven_lanedir_consec_mean 3.265479618005762 driven_lanedir_consec_min 3.265479618005762 driven_lanedir_max 3.265479618005762 driven_lanedir_mean 3.265479618005762 driven_lanedir_median 3.265479618005762 driven_lanedir_min 3.265479618005762 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4663369172887455, "survival_time": 59.99999999999873, "driven_lanedir": 3.265479618005762, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.7026362693789, "distance-from-start": 1.6303676024148757, "deviation-center-line": 7.114499866441937, "driven_lanedir_consec": 3.265479618005762}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15592
1415
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 06:40:07+00:00 2022-11-25 06:45:29+00:00 0:05:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4226928398281333 deviation-center-line_median 4.174748477462163
other stats deviation-center-line_max 4.174748477462163 deviation-center-line_mean 4.174748477462163 deviation-center-line_min 4.174748477462163 deviation-heading_max 4.533756317111154 deviation-heading_mean 4.533756317111154 deviation-heading_median 4.533756317111154 deviation-heading_min 4.533756317111154 distance-from-start_max 2.2784552815665835 distance-from-start_mean 2.2784552815665835 distance-from-start_median 2.2784552815665835 distance-from-start_min 2.2784552815665835 driven_any_max 3.579587154113982 driven_any_mean 3.579587154113982 driven_any_median 3.579587154113982 driven_any_min 3.579587154113982 driven_lanedir_consec_max 3.4226928398281333 driven_lanedir_consec_mean 3.4226928398281333 driven_lanedir_consec_min 3.4226928398281333 driven_lanedir_max 3.55610753301965 driven_lanedir_mean 3.55610753301965 driven_lanedir_median 3.55610753301965 driven_lanedir_min 3.55610753301965 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15586
1416
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 06:30:31+00:00 2022-11-25 06:40:00+00:00 0:09:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.200000000000017 driven_lanedir_consec_median 2.4146675176310586 deviation-center-line_median 3.947705796799454
other stats deviation-center-line_max 6.091229568413222 deviation-center-line_mean 4.214852861011506 deviation-center-line_min 2.872770282033897 deviation-heading_max 6.386481527905395 deviation-heading_mean 5.35354556440471 deviation-heading_median 5.451360814369008 deviation-heading_min 4.1249791009754295 distance-from-start_max 2.281674511474288 distance-from-start_mean 1.714053337572477 distance-from-start_median 1.836882099225881 distance-from-start_min 0.900774640363858 driven_any_max 3.579588827869872 driven_any_mean 3.2555873758340863 driven_any_median 3.5015869259609413 driven_any_min 2.4395868235445906 driven_lanedir_consec_max 3.4224970151785294 driven_lanedir_consec_mean 2.2942753407245777 driven_lanedir_consec_min 0.9252693124576647 driven_lanedir_max 3.5575561401701146 driven_lanedir_mean 3.1699347353913017 driven_lanedir_median 3.415152633778211 driven_lanedir_min 2.2918775338386688 in-drivable-lane_max 2.5000000000000355 in-drivable-lane_mean 1.2250000000000174 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 2.4395868235445906, "survival_time": 59.99999999999873, "driven_lanedir": 2.2918775338386688, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 6.080254254951424, "distance-from-start": 0.900774640363858, "deviation-center-line": 6.091229568413222, "driven_lanedir_consec": 0.9252693124576647}, "udem-001-ego1": {"driven_any": 3.5795872366067147, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575561401701146, "in-drivable-lane": 0.0, "deviation-heading": 4.1249791009754295, "distance-from-start": 2.227888326915521, "deviation-center-line": 2.872770282033897, "driven_lanedir_consec": 3.4083694793883828}, "udem-001-ego2": {"driven_any": 3.579588827869872, "survival_time": 59.99999999999873, "driven_lanedir": 3.554406946632496, "in-drivable-lane": 0.0, "deviation-heading": 4.822467373786592, "distance-from-start": 2.281674511474288, "deviation-center-line": 2.9756165082921022, "driven_lanedir_consec": 3.4224970151785294}, "udem-001-ego3": {"driven_any": 3.4235866153151684, "survival_time": 59.99999999999873, "driven_lanedir": 3.2758983209239267, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.386481527905395, "distance-from-start": 1.4458758715362408, "deviation-center-line": 4.919795085306806, "driven_lanedir_consec": 1.420965555873734}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15583
1417
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 06:26:30+00:00 2022-11-25 06:30:24+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.85000000000009 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.8682838146430726 deviation-center-line_median 0.9280014701980372
other stats deviation-center-line_max 0.9280014701980372 deviation-center-line_mean 0.9280014701980372 deviation-center-line_min 0.9280014701980372 deviation-heading_max 2.313567244971171 deviation-heading_mean 2.313567244971171 deviation-heading_median 2.313567244971171 deviation-heading_min 2.313567244971171 distance-from-start_max 0.7827181653982369 distance-from-start_mean 0.7827181653982369 distance-from-start_median 0.7827181653982369 distance-from-start_min 0.7827181653982369 driven_any_max 0.888597530769245 driven_any_mean 0.888597530769245 driven_any_median 0.888597530769245 driven_any_min 0.888597530769245 driven_lanedir_consec_max 0.8682838146430726 driven_lanedir_consec_mean 0.8682838146430726 driven_lanedir_consec_min 0.8682838146430726 driven_lanedir_max 0.8682838146430726 driven_lanedir_mean 0.8682838146430726 driven_lanedir_median 0.8682838146430726 driven_lanedir_min 0.8682838146430726 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 0.888597530769245, "survival_time": 15.85000000000009, "driven_lanedir": 0.8682838146430726, "in-drivable-lane": 0.0, "deviation-heading": 2.313567244971171, "distance-from-start": 0.7827181653982369, "deviation-center-line": 0.9280014701980372, "driven_lanedir_consec": 0.8682838146430726}}simulation-passed 1 survival_time_max 15.85000000000009 survival_time_mean 15.85000000000009 survival_time_min 15.85000000000009
No reset possible 15580
1418
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
468 error yes davinci-stage-02-6.2.51
2022-11-25 06:24:48+00:00 2022-11-25 06:26:15+00:00 0:01:27 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f8d47f67e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f8d47f67e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15576
1419
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 06:22:36+00:00 2022-11-25 06:24:27+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.850000000000048 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7038638560362473 deviation-center-line_median 0.4396047224602857
other stats deviation-center-line_max 0.4396047224602857 deviation-center-line_mean 0.4396047224602857 deviation-center-line_min 0.4396047224602857 deviation-heading_max 0.7151205809324869 deviation-heading_mean 0.7151205809324869 deviation-heading_median 0.7151205809324869 deviation-heading_min 0.7151205809324869 distance-from-start_max 0.7045347730331369 distance-from-start_mean 0.7045347730331369 distance-from-start_median 0.7045347730331369 distance-from-start_min 0.7045347730331369 driven_any_max 0.708599276888723 driven_any_mean 0.708599276888723 driven_any_median 0.708599276888723 driven_any_min 0.708599276888723 driven_lanedir_consec_max 0.7038638560362473 driven_lanedir_consec_mean 0.7038638560362473 driven_lanedir_consec_min 0.7038638560362473 driven_lanedir_max 0.7038638560362473 driven_lanedir_mean 0.7038638560362473 driven_lanedir_median 0.7038638560362473 driven_lanedir_min 0.7038638560362473 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.708599276888723, "survival_time": 12.850000000000048, "driven_lanedir": 0.7038638560362473, "in-drivable-lane": 0.0, "deviation-heading": 0.7151205809324869, "distance-from-start": 0.7045347730331369, "deviation-center-line": 0.4396047224602857, "driven_lanedir_consec": 0.7038638560362473}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 15570
1420
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 06:17:50+00:00 2022-11-25 06:22:07+00:00 0:04:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.04999999999878 in-drivable-lane_median 3.549999999999798 driven_lanedir_consec_median 3.250910080242586 deviation-center-line_median 6.40909921931243
other stats deviation-center-line_max 6.40909921931243 deviation-center-line_mean 6.40909921931243 deviation-center-line_min 6.40909921931243 deviation-heading_max 5.86874944154476 deviation-heading_mean 5.86874944154476 deviation-heading_median 5.86874944154476 deviation-heading_min 5.86874944154476 distance-from-start_max 1.63145897748322 distance-from-start_mean 1.63145897748322 distance-from-start_median 1.63145897748322 distance-from-start_min 1.63145897748322 driven_any_max 3.4043224992272147 driven_any_mean 3.4043224992272147 driven_any_median 3.4043224992272147 driven_any_min 3.4043224992272147 driven_lanedir_consec_max 3.250910080242586 driven_lanedir_consec_mean 3.250910080242586 driven_lanedir_consec_min 3.250910080242586 driven_lanedir_max 3.250910080242586 driven_lanedir_mean 3.250910080242586 driven_lanedir_median 3.250910080242586 driven_lanedir_min 3.250910080242586 in-drivable-lane_max 3.549999999999798 in-drivable-lane_mean 3.549999999999798 in-drivable-lane_min 3.549999999999798 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4043224992272147, "survival_time": 59.04999999999878, "driven_lanedir": 3.250910080242586, "in-drivable-lane": 3.549999999999798, "deviation-heading": 5.86874944154476, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.40909921931243, "driven_lanedir_consec": 3.250910080242586}}simulation-passed 1 survival_time_max 59.04999999999878 survival_time_mean 59.04999999999878 survival_time_min 59.04999999999878
No reset possible 15568
1421
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 06:15:40+00:00 2022-11-25 06:17:21+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15561
1423
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 06:04:17+00:00 2022-11-25 06:15:27+00:00 0:11:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3736117232564378 deviation-center-line_median 3.737280565079689
other stats deviation-center-line_max 3.737280565079689 deviation-center-line_mean 3.737280565079689 deviation-center-line_min 3.737280565079689 deviation-heading_max 4.891434118207675 deviation-heading_mean 4.891434118207675 deviation-heading_median 4.891434118207675 deviation-heading_min 4.891434118207675 distance-from-start_max 2.2750369053700705 distance-from-start_mean 2.2750369053700705 distance-from-start_median 2.2750369053700705 distance-from-start_min 2.2750369053700705 driven_any_max 3.5795882003110293 driven_any_mean 3.5795882003110293 driven_any_median 3.5795882003110293 driven_any_min 3.5795882003110293 driven_lanedir_consec_max 3.3736117232564378 driven_lanedir_consec_mean 3.3736117232564378 driven_lanedir_consec_min 3.3736117232564378 driven_lanedir_max 3.5508258394155683 driven_lanedir_mean 3.5508258394155683 driven_lanedir_median 3.5508258394155683 driven_lanedir_min 3.5508258394155683 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795882003110293, "survival_time": 59.99999999999873, "driven_lanedir": 3.5508258394155683, "in-drivable-lane": 0.0, "deviation-heading": 4.891434118207675, "distance-from-start": 2.2750369053700705, "deviation-center-line": 3.737280565079689, "driven_lanedir_consec": 3.3736117232564378}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15558
1423
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 05:59:02+00:00 2022-11-25 06:03:52+00:00 0:04:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.100000000000193 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3040934355288318 deviation-center-line_median 1.289217129104995
other stats deviation-center-line_max 1.289217129104995 deviation-center-line_mean 1.289217129104995 deviation-center-line_min 1.289217129104995 deviation-heading_max 2.1907426992170524 deviation-heading_mean 2.1907426992170524 deviation-heading_median 2.1907426992170524 deviation-heading_min 2.1907426992170524 distance-from-start_max 1.2851043260193775 distance-from-start_mean 1.2851043260193775 distance-from-start_median 1.2851043260193775 distance-from-start_min 1.2851043260193775 driven_any_max 1.3235977943332726 driven_any_mean 1.3235977943332726 driven_any_median 1.3235977943332726 driven_any_min 1.3235977943332726 driven_lanedir_consec_max 1.3040934355288318 driven_lanedir_consec_mean 1.3040934355288318 driven_lanedir_consec_min 1.3040934355288318 driven_lanedir_max 1.3040934355288318 driven_lanedir_mean 1.3040934355288318 driven_lanedir_median 1.3040934355288318 driven_lanedir_min 1.3040934355288318 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 1.3235977943332726, "survival_time": 23.100000000000193, "driven_lanedir": 1.3040934355288318, "in-drivable-lane": 0.0, "deviation-heading": 2.1907426992170524, "distance-from-start": 1.2851043260193775, "deviation-center-line": 1.289217129104995, "driven_lanedir_consec": 1.3040934355288318}}simulation-passed 1 survival_time_max 23.100000000000193 survival_time_mean 23.100000000000193 survival_time_min 23.100000000000193
No reset possible 15553
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-02-6.2.51
2022-11-25 05:51:37+00:00 2022-11-25 05:58:49+00:00 0:07:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15547
1425
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 05:41:03+00:00 2022-11-25 05:51:02+00:00 0:09:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204229695892396 deviation-center-line_median 4.903602912090087
other stats deviation-center-line_max 4.903602912090087 deviation-center-line_mean 4.903602912090087 deviation-center-line_min 4.903602912090087 deviation-heading_max 7.744574187082735 deviation-heading_mean 7.744574187082735 deviation-heading_median 7.744574187082735 deviation-heading_min 7.744574187082735 distance-from-start_max 1.206000814743228 distance-from-start_mean 1.206000814743228 distance-from-start_median 1.206000814743228 distance-from-start_min 1.206000814743228 driven_any_max 3.4850840176979623 driven_any_mean 3.4850840176979623 driven_any_median 3.4850840176979623 driven_any_min 3.4850840176979623 driven_lanedir_consec_max 1.4204229695892396 driven_lanedir_consec_mean 1.4204229695892396 driven_lanedir_consec_min 1.4204229695892396 driven_lanedir_max 3.2904978754707774 driven_lanedir_mean 3.2904978754707774 driven_lanedir_median 3.2904978754707774 driven_lanedir_min 3.2904978754707774 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop-000-ego0": {"driven_any": 3.4850840176979623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904978754707774, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574187082735, "distance-from-start": 1.206000814743228, "deviation-center-line": 4.903602912090087, "driven_lanedir_consec": 1.4204229695892396}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15546
1425
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 05:38:38+00:00 2022-11-25 05:40:44+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.649999999999984 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.33188081358015475 deviation-center-line_median 0.20422121163305057
other stats deviation-center-line_max 0.20422121163305057 deviation-center-line_mean 0.20422121163305057 deviation-center-line_min 0.20422121163305057 deviation-heading_max 0.7151394802499836 deviation-heading_mean 0.7151394802499836 deviation-heading_median 0.7151394802499836 deviation-heading_min 0.7151394802499836 distance-from-start_max 0.33329338421304333 distance-from-start_mean 0.33329338421304333 distance-from-start_median 0.33329338421304333 distance-from-start_min 0.33329338421304333 driven_any_max 0.33659927688888963 driven_any_mean 0.33659927688888963 driven_any_median 0.33659927688888963 driven_any_min 0.33659927688888963 driven_lanedir_consec_max 0.33188081358015475 driven_lanedir_consec_mean 0.33188081358015475 driven_lanedir_consec_min 0.33188081358015475 driven_lanedir_max 0.33188081358015475 driven_lanedir_mean 0.33188081358015475 driven_lanedir_median 0.33188081358015475 driven_lanedir_min 0.33188081358015475 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.33659927688888963, "survival_time": 6.649999999999984, "driven_lanedir": 0.33188081358015475, "in-drivable-lane": 0.0, "deviation-heading": 0.7151394802499836, "distance-from-start": 0.33329338421304333, "deviation-center-line": 0.20422121163305057, "driven_lanedir_consec": 0.33188081358015475}}simulation-passed 1 survival_time_max 6.649999999999984 survival_time_mean 6.649999999999984 survival_time_min 6.649999999999984
No reset possible 15541
1426
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 05:32:35+00:00 2022-11-25 05:38:32+00:00 0:05:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.099999999999824 driven_lanedir_consec_median 3.094905429410056 deviation-center-line_median 4.472617520975966
other stats deviation-center-line_max 4.472617520975966 deviation-center-line_mean 4.472617520975966 deviation-center-line_min 4.472617520975966 deviation-heading_max 11.268842029535884 deviation-heading_mean 11.268842029535884 deviation-heading_median 11.268842029535884 deviation-heading_min 11.268842029535884 distance-from-start_max 2.5739500581986148 distance-from-start_mean 2.5739500581986148 distance-from-start_median 2.5739500581986148 distance-from-start_min 2.5739500581986148 driven_any_max 3.486579242992935 driven_any_mean 3.486579242992935 driven_any_median 3.486579242992935 driven_any_min 3.486579242992935 driven_lanedir_consec_max 3.094905429410056 driven_lanedir_consec_mean 3.094905429410056 driven_lanedir_consec_min 3.094905429410056 driven_lanedir_max 3.2535717731810343 driven_lanedir_mean 3.2535717731810343 driven_lanedir_median 3.2535717731810343 driven_lanedir_min 3.2535717731810343 in-drivable-lane_max 3.099999999999824 in-drivable-lane_mean 3.099999999999824 in-drivable-lane_min 3.099999999999824 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.486579242992935, "survival_time": 59.99999999999873, "driven_lanedir": 3.2535717731810343, "in-drivable-lane": 3.099999999999824, "deviation-heading": 11.268842029535884, "distance-from-start": 2.5739500581986148, "deviation-center-line": 4.472617520975966, "driven_lanedir_consec": 3.094905429410056}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15535
1429
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 05:28:48+00:00 2022-11-25 05:32:09+00:00 0:03:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 10.950000000000044 driven_lanedir_consec_median 0.19955171937759708 deviation-center-line_median 0.12567511082985278
other stats deviation-center-line_max 0.12567511082985278 deviation-center-line_mean 0.12567511082985278 deviation-center-line_min 0.12567511082985278 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 1.924049384083022 distance-from-start_mean 1.924049384083022 distance-from-start_median 1.924049384083022 distance-from-start_min 1.924049384083022 driven_any_max 1.924195440713655 driven_any_mean 1.924195440713655 driven_any_median 1.924195440713655 driven_any_min 1.924195440713655 driven_lanedir_consec_max 0.19955171937759708 driven_lanedir_consec_mean 0.19955171937759708 driven_lanedir_consec_min 0.19955171937759708 driven_lanedir_max 0.19955171937759708 driven_lanedir_mean 0.19955171937759708 driven_lanedir_median 0.19955171937759708 driven_lanedir_min 0.19955171937759708 in-drivable-lane_max 10.950000000000044 in-drivable-lane_mean 10.950000000000044 in-drivable-lane_min 10.950000000000044 per-episodes details {"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 15529
1430
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 05:25:55+00:00 2022-11-25 05:28:41+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.3499999999999925 in-drivable-lane_median 2.5999999999999917 driven_lanedir_consec_median 0.1995533883076508 deviation-center-line_median 0.12567493837705537
other stats deviation-center-line_max 0.12567493837705537 deviation-center-line_mean 0.12567493837705537 deviation-center-line_min 0.12567493837705537 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.5484102917810773 distance-from-start_mean 0.5484102917810773 distance-from-start_median 0.5484102917810773 distance-from-start_min 0.5484102917810773 driven_any_max 0.5484215635455908 driven_any_mean 0.5484215635455908 driven_any_median 0.5484215635455908 driven_any_min 0.5484215635455908 driven_lanedir_consec_max 0.1995533883076508 driven_lanedir_consec_mean 0.1995533883076508 driven_lanedir_consec_min 0.1995533883076508 driven_lanedir_max 0.1995533883076508 driven_lanedir_mean 0.1995533883076508 driven_lanedir_median 0.1995533883076508 driven_lanedir_min 0.1995533883076508 in-drivable-lane_max 2.5999999999999917 in-drivable-lane_mean 2.5999999999999917 in-drivable-lane_min 2.5999999999999917 per-episodes details {"udem-000-ego0": {"driven_any": 0.5484215635455908, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1995533883076508, "in-drivable-lane": 2.5999999999999917, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.5484102917810773, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.1995533883076508}}simulation-passed 1 survival_time_max 4.3499999999999925 survival_time_mean 4.3499999999999925 survival_time_min 4.3499999999999925
No reset possible 15522
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 05:21:45+00:00 2022-11-25 05:25:28+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.250000000000025 in-drivable-lane_median 8.525000000000027 driven_lanedir_consec_median 0.3694034459669367 deviation-center-line_median 0.2032026824105824
other stats deviation-center-line_max 0.49385537805641655 deviation-center-line_mean 0.2564840317596989 deviation-center-line_min 0.1256753841612143 deviation-heading_max 2.207424396094566 deviation-heading_mean 1.2068820169473446 deviation-heading_median 0.9361471003737372 deviation-heading_min 0.7478094709473372 distance-from-start_max 1.6837476731392336 distance-from-start_mean 0.85867246141252 distance-from-start_median 0.688920693167693 distance-from-start_min 0.3731007861754605 driven_any_max 1.6838575324025151 driven_any_mean 0.8587081494464717 driven_any_median 0.6889338157826281 driven_any_min 0.3731074338181155 driven_lanedir_consec_max 0.737521974955665 driven_lanedir_consec_mean 0.40900650829720153 driven_lanedir_consec_min 0.15969716629926767 driven_lanedir_max 0.737521974955665 driven_lanedir_mean 0.40900650829720153 driven_lanedir_median 0.3694034459669367 driven_lanedir_min 0.15969716629926767 in-drivable-lane_max 9.800000000000026 in-drivable-lane_mean 8.17500000000003 in-drivable-lane_min 5.850000000000036 per-episodes details {"4way-000-ego0": {"driven_any": 0.3731074338181155, "survival_time": 11.250000000000025, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.3731007861754605, "deviation-center-line": 0.1256753841612143, "driven_lanedir_consec": 0.1995526730519679}, "4way-000-ego1": {"driven_any": 0.5816642445221152, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969716629926767, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.5816528382740916, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969716629926767}, "4way-000-ego2": {"driven_any": 0.7962033870431411, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392542188819056, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722451894284, "distance-from-start": 0.7961885480612942, "deviation-center-line": 0.27078045404289575, "driven_lanedir_consec": 0.5392542188819056}, "4way-000-ego3": {"driven_any": 1.6838575324025151, "survival_time": 11.250000000000025, "driven_lanedir": 0.737521974955665, "in-drivable-lane": 5.850000000000036, "deviation-heading": 2.207424396094566, "distance-from-start": 1.6837476731392336, "deviation-center-line": 0.49385537805641655, "driven_lanedir_consec": 0.737521974955665}}simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 11.250000000000025 survival_time_min 11.250000000000025
No reset possible 15518
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 05:19:35+00:00 2022-11-25 05:21:31+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1969489134232345 survival_time_median 10.450000000000014 deviation-center-line_median 0.1253905781126274 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.1253905781126274 deviation-center-line_mean 0.1253905781126274 deviation-center-line_min 0.1253905781126274 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 1.5508236376562057 distance-from-start_mean 1.5508236376562057 distance-from-start_median 1.5508236376562057 distance-from-start_min 1.5508236376562057 driven_any_max 1.5511368313112754 driven_any_mean 1.5511368313112754 driven_any_median 1.5511368313112754 driven_any_min 1.5511368313112754 driven_lanedir_consec_max 0.1969489134232345 driven_lanedir_consec_mean 0.1969489134232345 driven_lanedir_consec_min 0.1969489134232345 driven_lanedir_max 0.1969489134232345 driven_lanedir_mean 0.1969489134232345 driven_lanedir_median 0.1969489134232345 driven_lanedir_min 0.1969489134232345 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"loop-000-ego0": {"driven_any": 1.5511368313112754, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969489134232345, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.5508236376562057, "deviation-center-line": 0.1253905781126274, "driven_lanedir_consec": 0.1969489134232345}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 15514
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-0of4 host-error no davinci-stage-02-6.2.51
2022-11-25 05:19:04+00:00 2022-11-25 05:19:21+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15504
1434
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 05:13:45+00:00 2022-11-25 05:18:37+00:00 0:04:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.500000000000128 in-drivable-lane_median 16.02500000000013 driven_lanedir_consec_median 0.33013236525205236 deviation-center-line_median 0.20320251005949427
other stats deviation-center-line_max 0.2757414134419884 deviation-center-line_mean 0.20195540399126405 deviation-center-line_min 0.1256751824040792 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.8390919152844039 deviation-heading_median 0.8356409085548375 deviation-heading_min 0.7362638884698943 distance-from-start_max 2.887473103882224 distance-from-start_mean 1.46815084792022 distance-from-start_median 1.392449957467867 distance-from-start_min 0.20023037286292217 driven_any_max 2.8881823443375616 driven_any_mean 1.4683701164599607 driven_any_median 1.3925323730139962 driven_any_min 0.20023337547428863 driven_lanedir_consec_max 0.5392562706966588 driven_lanedir_consec_mean 0.33980394582856005 driven_lanedir_consec_min 0.15969478211347665 driven_lanedir_max 0.5392562706966588 driven_lanedir_mean 0.33980394582856005 driven_lanedir_median 0.33013236525205236 driven_lanedir_min 0.15969478211347665 in-drivable-lane_max 17.05000000000013 in-drivable-lane_mean 15.97500000000013 in-drivable-lane_min 14.800000000000132 per-episodes details {"loop-000-ego0": {"driven_any": 1.092910469671116, "survival_time": 18.500000000000128, "driven_lanedir": 0.199555653284208, "in-drivable-lane": 16.750000000000128, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.0928555098331485, "deviation-center-line": 0.1256751824040792, "driven_lanedir_consec": 0.199555653284208}, "loop-000-ego1": {"driven_any": 0.20023337547428863, "survival_time": 18.500000000000128, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 17.05000000000013, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.20023037286292217, "deviation-center-line": 0.1356249107782697, "driven_lanedir_consec": 0.15969478211347665}, "loop-000-ego2": {"driven_any": 1.6921542763568764, "survival_time": 18.500000000000128, "driven_lanedir": 0.5392562706966588, "in-drivable-lane": 14.800000000000132, "deviation-heading": 0.9234723461623382, "distance-from-start": 1.6920444051025856, "deviation-center-line": 0.27078010934071883, "driven_lanedir_consec": 0.5392562706966588}, "loop-000-ego3": {"driven_any": 2.8881823443375616, "survival_time": 18.500000000000128, "driven_lanedir": 0.46070907721989673, "in-drivable-lane": 15.300000000000132, "deviation-heading": 0.7362638884698943, "distance-from-start": 2.887473103882224, "deviation-center-line": 0.2757414134419884, "driven_lanedir_consec": 0.46070907721989673}}simulation-passed 1 survival_time_max 18.500000000000128 survival_time_mean 18.500000000000128 survival_time_min 18.500000000000128
No reset possible 15501
1435
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 05:11:45+00:00 2022-11-25 05:13:32+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.599999999999988 in-drivable-lane_median 4.149999999999988 driven_lanedir_consec_median 0.1397964307794325 deviation-center-line_median 0.0939067534990478
other stats deviation-center-line_max 0.0939067534990478 deviation-center-line_mean 0.0939067534990478 deviation-center-line_min 0.0939067534990478 deviation-heading_max 0.965418398279237 deviation-heading_mean 0.965418398279237 deviation-heading_median 0.965418398279237 deviation-heading_min 0.965418398279237 distance-from-start_max 0.7557867445766083 distance-from-start_mean 0.7557867445766083 distance-from-start_median 0.7557867445766083 distance-from-start_min 0.7557867445766083 driven_any_max 0.7557995755351957 driven_any_mean 0.7557995755351957 driven_any_median 0.7557995755351957 driven_any_min 0.7557995755351957 driven_lanedir_consec_max 0.1397964307794325 driven_lanedir_consec_mean 0.1397964307794325 driven_lanedir_consec_min 0.1397964307794325 driven_lanedir_max 0.1397964307794325 driven_lanedir_mean 0.1397964307794325 driven_lanedir_median 0.1397964307794325 driven_lanedir_min 0.1397964307794325 in-drivable-lane_max 4.149999999999988 in-drivable-lane_mean 4.149999999999988 in-drivable-lane_min 4.149999999999988 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7557995755351957, "survival_time": 5.599999999999988, "driven_lanedir": 0.1397964307794325, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.965418398279237, "distance-from-start": 0.7557867445766083, "deviation-center-line": 0.0939067534990478, "driven_lanedir_consec": 0.1397964307794325}}simulation-passed 1 survival_time_max 5.599999999999988 survival_time_mean 5.599999999999988 survival_time_min 5.599999999999988
No reset possible 15494
1439
Bea Baselines 🐤minimal-agent lx22-state-estimation
sim success yes davinci-stage-02-6.2.51
2022-11-25 05:07:32+00:00 2022-11-25 05:11:34+00:00 0:04:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.602316779928666 survival_time_median 11.250000000000025 deviation-center-line_median 0.25844063605243855 in-drivable-lane_median 6.600000000000033
other stats deviation-center-line_max 0.46940419435631386 deviation-center-line_mean 0.31601951040293014 deviation-center-line_min 0.220213700800038 deviation-heading_max 2.138198727189773 deviation-heading_mean 1.3887557886235824 deviation-heading_median 1.3576715425669252 deviation-heading_min 0.6703970961140492 distance-from-start_max 2.9006007855190927 distance-from-start_mean 2.0801990954134797 distance-from-start_median 1.6889817408539205 distance-from-start_min 1.651014759867426 driven_any_max 2.9015373770561546 driven_any_mean 2.0805808076947017 driven_any_median 1.68908053965813 driven_any_min 1.65112450636982 driven_lanedir_consec_max 0.6591118533086625 driven_lanedir_consec_mean 0.5555566616524058 driven_lanedir_consec_min 0.40524135171988895 driven_lanedir_max 0.6591118533086625 driven_lanedir_mean 0.5555566616524058 driven_lanedir_median 0.602316779928666 driven_lanedir_min 0.40524135171988895 in-drivable-lane_max 15.750000000000131 in-drivable-lane_mean 9.550000000000065 in-drivable-lane_min 6.300000000000031 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 1.65112450636982, "survival_time": 11.050000000000022, "driven_lanedir": 0.6591118533086625, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3576715425669252, "distance-from-start": 1.651014759867426, "deviation-center-line": 0.220213700800038, "driven_lanedir_consec": 0.6591118533086625}, "LF-zig-zag-001-ego0": {"driven_any": 2.9015373770561546, "survival_time": 18.60000000000013, "driven_lanedir": 0.40524135171988895, "in-drivable-lane": 15.750000000000131, "deviation-heading": 0.6703970961140492, "distance-from-start": 2.9006007855190927, "deviation-center-line": 0.25844063605243855, "driven_lanedir_consec": 0.40524135171988895}, "LF-zig-zag-002-ego0": {"driven_any": 1.68908053965813, "survival_time": 11.250000000000025, "driven_lanedir": 0.602316779928666, "in-drivable-lane": 6.600000000000033, "deviation-heading": 2.138198727189773, "distance-from-start": 1.6889817408539205, "deviation-center-line": 0.46940419435631386, "driven_lanedir_consec": 0.602316779928666}}simulation-passed 1 survival_time_max 18.60000000000013 survival_time_mean 13.633333333333391 survival_time_min 11.050000000000022
No reset possible 15490
1440
Bea Baselines 🐤minimal-agent lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-25 05:05:33+00:00 2022-11-25 05:07:13+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4895714408351146
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4895714408351146 distance-from-start_median 0.4895714408351146 distance-from-start_min 0.4895714408351146 driven_any_max 0.4895812966985538 driven_any_mean 0.4895812966985538 driven_any_median 0.4895812966985538 driven_any_min 0.4895812966985538 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.999999999999994 in-drivable-lane_mean 3.999999999999994 in-drivable-lane_median 3.999999999999994 in-drivable-lane_min 3.999999999999994 per-episodes details {"d60-ego0": {"driven_any": 0.4895812966985538, "survival_time": 3.999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 3.999999999999994, "deviation-heading": 0.0, "distance-from-start": 0.4895714408351146, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 3.999999999999994 survival_time_median 3.999999999999994 survival_time_min 3.999999999999994
No reset possible 15487
1448
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 05:02:26+00:00 2022-11-25 05:05:14+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.549999999999985 in-drivable-lane_median 5.149999999999984 driven_lanedir_consec_median 0.1366674275206068 deviation-center-line_median 0.10783868180360472
other stats deviation-center-line_max 0.10783868180360472 deviation-center-line_mean 0.10783868180360472 deviation-center-line_min 0.10783868180360472 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 0.9098858043373246 distance-from-start_mean 0.9098858043373246 distance-from-start_median 0.9098858043373246 distance-from-start_min 0.9098858043373246 driven_any_max 0.9099105248203296 driven_any_mean 0.9099105248203296 driven_any_median 0.9099105248203296 driven_any_min 0.9099105248203296 driven_lanedir_consec_max 0.1366674275206068 driven_lanedir_consec_mean 0.1366674275206068 driven_lanedir_consec_min 0.1366674275206068 driven_lanedir_max 0.1366674275206068 driven_lanedir_mean 0.1366674275206068 driven_lanedir_median 0.1366674275206068 driven_lanedir_min 0.1366674275206068 in-drivable-lane_max 5.149999999999984 in-drivable-lane_mean 5.149999999999984 in-drivable-lane_min 5.149999999999984 per-episodes details {"udem-000-ego0": {"driven_any": 0.9099105248203296, "survival_time": 6.549999999999985, "driven_lanedir": 0.1366674275206068, "in-drivable-lane": 5.149999999999984, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.9098858043373246, "deviation-center-line": 0.10783868180360472, "driven_lanedir_consec": 0.1366674275206068}}simulation-passed 1 survival_time_max 6.549999999999985 survival_time_mean 6.549999999999985 survival_time_min 6.549999999999985
No reset possible 15482
1448
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 05:00:31+00:00 2022-11-25 05:02:10+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15478
1449
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 04:58:46+00:00 2022-11-25 05:00:17+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15474
1450
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 04:56:59+00:00 2022-11-25 04:58:25+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1366657585905522 survival_time_median 7.549999999999981 deviation-center-line_median 0.10783809919009872 in-drivable-lane_median 6.149999999999981
other stats deviation-center-line_max 0.10783809919009872 deviation-center-line_mean 0.10783809919009872 deviation-center-line_min 0.10783809919009872 deviation-heading_max 0.9508048428349384 deviation-heading_mean 0.9508048428349384 deviation-heading_median 0.9508048428349384 deviation-heading_min 0.9508048428349384 distance-from-start_max 1.076322287151137 distance-from-start_mean 1.076322287151137 distance-from-start_median 1.076322287151137 distance-from-start_min 1.076322287151137 driven_any_max 1.0763767010128955 driven_any_mean 1.0763767010128955 driven_any_median 1.0763767010128955 driven_any_min 1.0763767010128955 driven_lanedir_consec_max 0.1366657585905522 driven_lanedir_consec_mean 0.1366657585905522 driven_lanedir_consec_min 0.1366657585905522 driven_lanedir_max 0.1366657585905522 driven_lanedir_mean 0.1366657585905522 driven_lanedir_median 0.1366657585905522 driven_lanedir_min 0.1366657585905522 in-drivable-lane_max 6.149999999999981 in-drivable-lane_mean 6.149999999999981 in-drivable-lane_min 6.149999999999981 per-episodes details {"loop-000-ego0": {"driven_any": 1.0763767010128955, "survival_time": 7.549999999999981, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.149999999999981, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.076322287151137, "deviation-center-line": 0.10783809919009872, "driven_lanedir_consec": 0.1366657585905522}}simulation-passed 1 survival_time_max 7.549999999999981 survival_time_mean 7.549999999999981 survival_time_min 7.549999999999981
No reset possible 15471
1451
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 04:54:53+00:00 2022-11-25 04:56:31+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15458
1454
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 04:38:21+00:00 2022-11-25 04:54:26+00:00 0:16:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.04999999999935 driven_lanedir_consec_median 0.5965292507803263 deviation-center-line_median 2.4355048172232285
other stats deviation-center-line_max 2.4355048172232285 deviation-center-line_mean 2.4355048172232285 deviation-center-line_min 2.4355048172232285 deviation-heading_max 23.405235075559773 deviation-heading_mean 23.405235075559773 deviation-heading_median 23.405235075559773 deviation-heading_min 23.405235075559773 distance-from-start_max 0.4130996862251528 distance-from-start_mean 0.4130996862251528 distance-from-start_median 0.4130996862251528 distance-from-start_min 0.4130996862251528 driven_any_max 2.2416676547390204 driven_any_mean 2.2416676547390204 driven_any_median 2.2416676547390204 driven_any_min 2.2416676547390204 driven_lanedir_consec_max 0.5965292507803263 driven_lanedir_consec_mean 0.5965292507803263 driven_lanedir_consec_min 0.5965292507803263 driven_lanedir_max 0.5965292507803263 driven_lanedir_mean 0.5965292507803263 driven_lanedir_median 0.5965292507803263 driven_lanedir_min 0.5965292507803263 in-drivable-lane_max 30.04999999999935 in-drivable-lane_mean 30.04999999999935 in-drivable-lane_min 30.04999999999935 per-episodes details {"loop-000-ego0": {"driven_any": 2.2416676547390204, "survival_time": 59.99999999999873, "driven_lanedir": 0.5965292507803263, "in-drivable-lane": 30.04999999999935, "deviation-heading": 23.405235075559773, "distance-from-start": 0.4130996862251528, "deviation-center-line": 2.4355048172232285, "driven_lanedir_consec": 0.5965292507803263}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15456
1455
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 04:36:16+00:00 2022-11-25 04:37:48+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15452
1455
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 04:34:23+00:00 2022-11-25 04:35:54+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15447
1458
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 04:29:34+00:00 2022-11-25 04:34:08+00:00 0:04:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.3 in-drivable-lane_median 1.0749999999999993 driven_lanedir_consec_median 0.04270981981436661 deviation-center-line_median 0.050637348173623184
other stats deviation-center-line_max 0.2737494956140398 deviation-center-line_mean 0.09626262541948512 deviation-center-line_min 0.010026309716654396 deviation-heading_max 2.851970877592204 deviation-heading_mean 1.290964680325826 deviation-heading_median 0.8072749582696874 deviation-heading_min 0.697337927171725 distance-from-start_max 0.16996056558005784 distance-from-start_mean 0.11425826261850314 distance-from-start_median 0.10316248907356929 distance-from-start_min 0.08074750674681615 driven_any_max 0.18984331333273055 driven_any_mean 0.12993361266420606 driven_any_median 0.12273950581719369 driven_any_min 0.08441212568970627 driven_lanedir_consec_max 0.09351530478600668 driven_lanedir_consec_mean 0.04853315069947845 driven_lanedir_consec_min 0.015197658383173884 driven_lanedir_max 0.09351530478600668 driven_lanedir_mean 0.04853315069947845 driven_lanedir_median 0.04270981981436661 driven_lanedir_min 0.015197658383173884 in-drivable-lane_max 1.4999999999999998 in-drivable-lane_mean 0.9124999999999996 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.1014596009755208, "survival_time": 2.3, "driven_lanedir": 0.015197658383173884, "in-drivable-lane": 1.4999999999999998, "deviation-heading": 0.697337927171725, "distance-from-start": 0.08169473764381799, "deviation-center-line": 0.010026309716654396, "driven_lanedir_consec": 0.015197658383173884}, "4way-000-ego1": {"driven_any": 0.08441212568970627, "survival_time": 2.3, "driven_lanedir": 0.04121503381256275, "in-drivable-lane": 0.0, "deviation-heading": 2.851970877592204, "distance-from-start": 0.08074750674681615, "deviation-center-line": 0.2737494956140398, "driven_lanedir_consec": 0.04121503381256275}, "4way-000-ego2": {"driven_any": 0.14401941065886653, "survival_time": 2.3, "driven_lanedir": 0.04420460581617047, "in-drivable-lane": 1.2999999999999996, "deviation-heading": 0.7018969740672518, "distance-from-start": 0.12463024050332056, "deviation-center-line": 0.036205014619833074, "driven_lanedir_consec": 0.04420460581617047}, "4way-000-ego3": {"driven_any": 0.18984331333273055, "survival_time": 2.3, "driven_lanedir": 0.09351530478600668, "in-drivable-lane": 0.8499999999999992, "deviation-heading": 0.9126529424721228, "distance-from-start": 0.16996056558005784, "deviation-center-line": 0.06506968172741329, "driven_lanedir_consec": 0.09351530478600668}}simulation-passed 1 survival_time_max 2.3 survival_time_mean 2.3 survival_time_min 2.3
No reset possible 15442
1554
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-02-6.2.51
2022-11-25 04:20:45+00:00 2022-11-25 04:29:07+00:00 0:08:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15432
1459
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 03:53:44+00:00 2022-11-25 04:20:23+00:00 0:26:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 47.249999999999034 driven_lanedir_consec_median 0.4607878715379628 deviation-center-line_median 1.100178873643307
other stats deviation-center-line_max 2.2874558884496845 deviation-center-line_mean 1.1284585021985394 deviation-center-line_min 0.026020373057859925 deviation-heading_max 21.224388424500884 deviation-heading_mean 10.406808127600094 deviation-heading_median 9.900765355626154 deviation-heading_min 0.60131337464718 distance-from-start_max 0.6752981131295959 distance-from-start_mean 0.4096308701167881 distance-from-start_median 0.4072988136478907 distance-from-start_min 0.14862774004177506 driven_any_max 6.96358105159095 driven_any_mean 3.054876103631685 driven_any_median 2.5050850153305846 driven_any_min 0.2457533322746216 driven_lanedir_consec_max 1.7691160249245217 driven_lanedir_consec_mean 0.6823376839180406 driven_lanedir_consec_min 0.03865896767171506 driven_lanedir_max 1.8683669439803747 driven_lanedir_mean 0.8000560984288242 driven_lanedir_median 0.6465992410316035 driven_lanedir_min 0.03865896767171506 in-drivable-lane_max 59.09999999999873 in-drivable-lane_mean 46.68749999999899 in-drivable-lane_min 33.149999999999146 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.2457533322746216, "survival_time": 59.99999999999873, "driven_lanedir": 0.03865896767171506, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.7763717714157476, "distance-from-start": 0.14862774004177506, "deviation-center-line": 0.026020373057859925, "driven_lanedir_consec": 0.03865896767171506}, "zigzag-000-ego1": {"driven_any": 0.3494579888961466, "survival_time": 59.99999999999873, "driven_lanedir": 0.1587703189458236, "in-drivable-lane": 58.84999999999873, "deviation-heading": 0.60131337464718, "distance-from-start": 0.3100900073587102, "deviation-center-line": 0.10061420583273126, "driven_lanedir_consec": 0.1587703189458236}, "zigzag-000-ego2": {"driven_any": 6.96358105159095, "survival_time": 59.99999999999873, "driven_lanedir": 1.8683669439803747, "in-drivable-lane": 33.149999999999146, "deviation-heading": 21.224388424500884, "distance-from-start": 0.6752981131295959, "deviation-center-line": 2.2874558884496845, "driven_lanedir_consec": 1.7691160249245217}, "zigzag-000-ego3": {"driven_any": 4.660712041765023, "survival_time": 59.99999999999873, "driven_lanedir": 1.1344281631173834, "in-drivable-lane": 35.64999999999934, "deviation-heading": 19.02515893983656, "distance-from-start": 0.5045076199370713, "deviation-center-line": 2.0997435414538823, "driven_lanedir_consec": 0.762805424130102}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15425
1462
Bea Baselines 🐤template-pytorch lx22-objdet
sim success yes davinci-stage-02-6.2.51
2022-11-25 03:40:22+00:00 2022-11-25 03:53:07+00:00 0:12:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 driven_lanedir_consec_median 0.762003548245923
other stats deviation-center-line_max 1.629539895380454 deviation-center-line_mean 1.172390211178107 deviation-center-line_median 1.172390211178107 deviation-center-line_min 0.7152405269757605 deviation-heading_max 14.199647827511363 deviation-heading_mean 10.814591169680252 deviation-heading_median 10.814591169680252 deviation-heading_min 7.42953451184914 distance-from-start_max 0.6971244167713545 distance-from-start_mean 0.5474389704336816 distance-from-start_median 0.5474389704336816 distance-from-start_min 0.3977535240960088 driven_any_max 8.98389219956127 driven_any_mean 8.382606819332468 driven_any_median 8.382606819332468 driven_any_min 7.781321439103667 driven_lanedir_consec_max 0.8696049075516432 driven_lanedir_consec_mean 0.762003548245923 driven_lanedir_consec_min 0.6544021889402027 driven_lanedir_max 1.970958033328228 driven_lanedir_mean 1.320016276434267 driven_lanedir_median 1.320016276434267 driven_lanedir_min 0.6690745195403063 in-drivable-lane_max 51.049999999998704 in-drivable-lane_mean 45.9249999999989 in-drivable-lane_median 45.9249999999989 in-drivable-lane_min 40.799999999999095 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 7.781321439103667, "survival_time": 59.99999999999873, "driven_lanedir": 0.6690745195403063, "in-drivable-lane": 51.049999999998704, "deviation-heading": 7.42953451184914, "distance-from-start": 0.3977535240960088, "deviation-center-line": 0.7152405269757605, "driven_lanedir_consec": 0.6544021889402027}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 8.98389219956127, "survival_time": 59.99999999999873, "driven_lanedir": 1.970958033328228, "in-drivable-lane": 40.799999999999095, "deviation-heading": 14.199647827511363, "distance-from-start": 0.6971244167713545, "deviation-center-line": 1.629539895380454, "driven_lanedir_consec": 0.8696049075516432}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15423
1465
Bea Baselines 🐤template-pytorch lx22-BV1
sim-2of5 success no davinci-stage-02-6.2.51
2022-11-25 03:37:52+00:00 2022-11-25 03:39:59+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.25079511951626254
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.25079511951626254 distance-from-start_median 0.25079511951626254 distance-from-start_min 0.25079511951626254 driven_any_max 0.3993085663523237 driven_any_mean 0.3993085663523237 driven_any_median 0.3993085663523237 driven_any_min 0.3993085663523237 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.699999999999995 in-drivable-lane_mean 3.699999999999995 in-drivable-lane_median 3.699999999999995 in-drivable-lane_min 3.699999999999995 per-episodes details {"d40-ego0": {"driven_any": 0.3993085663523237, "survival_time": 3.699999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 3.699999999999995, "deviation-heading": 0.0, "distance-from-start": 0.25079511951626254, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.699999999999995 survival_time_mean 3.699999999999995 survival_time_median 3.699999999999995 survival_time_min 3.699999999999995
No reset possible 15411
1473
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 03:20:01+00:00 2022-11-25 03:37:31+00:00 0:17:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 44.94999999999908 driven_lanedir_consec_median 1.005450704193484 deviation-center-line_median 1.8760134368207677
other stats deviation-center-line_max 1.8760134368207677 deviation-center-line_mean 1.8760134368207677 deviation-center-line_min 1.8760134368207677 deviation-heading_max 15.613668425579167 deviation-heading_mean 15.613668425579167 deviation-heading_median 15.613668425579167 deviation-heading_min 15.613668425579167 distance-from-start_max 0.476080415799928 distance-from-start_mean 0.476080415799928 distance-from-start_median 0.476080415799928 distance-from-start_min 0.476080415799928 driven_any_max 9.16980526462837 driven_any_mean 9.16980526462837 driven_any_median 9.16980526462837 driven_any_min 9.16980526462837 driven_lanedir_consec_max 1.005450704193484 driven_lanedir_consec_mean 1.005450704193484 driven_lanedir_consec_min 1.005450704193484 driven_lanedir_max 1.005450704193484 driven_lanedir_mean 1.005450704193484 driven_lanedir_median 1.005450704193484 driven_lanedir_min 1.005450704193484 in-drivable-lane_max 44.94999999999908 in-drivable-lane_mean 44.94999999999908 in-drivable-lane_min 44.94999999999908 per-episodes details {"udem-000-ego0": {"driven_any": 9.16980526462837, "survival_time": 59.99999999999873, "driven_lanedir": 1.005450704193484, "in-drivable-lane": 44.94999999999908, "deviation-heading": 15.613668425579167, "distance-from-start": 0.476080415799928, "deviation-center-line": 1.8760134368207677, "driven_lanedir_consec": 1.005450704193484}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15408
1474
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 03:16:55+00:00 2022-11-25 03:19:46+00:00 0:02:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.749999999999984 in-drivable-lane_median 2.79999999999999 driven_lanedir_consec_median 0.4470040050136219 deviation-center-line_median 0.19979008731082035
other stats deviation-center-line_max 0.19979008731082035 deviation-center-line_mean 0.19979008731082035 deviation-center-line_min 0.19979008731082035 deviation-heading_max 2.749861034643318 deviation-heading_mean 2.749861034643318 deviation-heading_median 2.749861034643318 deviation-heading_min 2.749861034643318 distance-from-start_max 0.3526017066344067 distance-from-start_mean 0.3526017066344067 distance-from-start_median 0.3526017066344067 distance-from-start_min 0.3526017066344067 driven_any_max 0.9260990960251236 driven_any_mean 0.9260990960251236 driven_any_median 0.9260990960251236 driven_any_min 0.9260990960251236 driven_lanedir_consec_max 0.4470040050136219 driven_lanedir_consec_mean 0.4470040050136219 driven_lanedir_consec_min 0.4470040050136219 driven_lanedir_max 0.4470040050136219 driven_lanedir_mean 0.4470040050136219 driven_lanedir_median 0.4470040050136219 driven_lanedir_min 0.4470040050136219 in-drivable-lane_max 2.79999999999999 in-drivable-lane_mean 2.79999999999999 in-drivable-lane_min 2.79999999999999 per-episodes details {"4way-000-ego0": {"driven_any": 0.9260990960251236, "survival_time": 6.749999999999984, "driven_lanedir": 0.4470040050136219, "in-drivable-lane": 2.79999999999999, "deviation-heading": 2.749861034643318, "distance-from-start": 0.3526017066344067, "deviation-center-line": 0.19979008731082035, "driven_lanedir_consec": 0.4470040050136219}}simulation-passed 1 survival_time_max 6.749999999999984 survival_time_mean 6.749999999999984 survival_time_min 6.749999999999984
No reset possible 15407
1474
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 03:14:54+00:00 2022-11-25 03:16:28+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15398
1476
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 02:52:52+00:00 2022-11-25 03:14:41+00:00 0:21:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 56.07499999999872 driven_lanedir_consec_median 0.33842165232771504 deviation-center-line_median 0.24166757920067616
other stats deviation-center-line_max 1.8616650116253028 deviation-center-line_mean 0.5952914305463288 deviation-center-line_min 0.03616555215866011 deviation-heading_max 21.007317212256137 deviation-heading_mean 6.496926639389109 deviation-heading_median 2.197325133914006 deviation-heading_min 0.5857390774722881 distance-from-start_max 0.474629763371012 distance-from-start_mean 0.29261430911510744 distance-from-start_median 0.3177579437091037 distance-from-start_min 0.06031158567121019 driven_any_max 2.626934114362115 driven_any_mean 1.1299870892216408 driven_any_median 0.9086080982089876 driven_any_min 0.07579804610647306 driven_lanedir_consec_max 0.784207267923489 driven_lanedir_consec_mean 0.36797404622113544 driven_lanedir_consec_min 0.010845612305622645 driven_lanedir_max 0.784207267923489 driven_lanedir_mean 0.36797404622113544 driven_lanedir_median 0.33842165232771504 driven_lanedir_min 0.010845612305622645 in-drivable-lane_max 59.34999999999873 in-drivable-lane_mean 51.087499999998826 in-drivable-lane_min 32.849999999999156 per-episodes details {"udem-000-ego0": {"driven_any": 2.626934114362115, "survival_time": 59.99999999999873, "driven_lanedir": 0.784207267923489, "in-drivable-lane": 54.349999999998715, "deviation-heading": 3.7381933565494454, "distance-from-start": 0.39476060818935566, "deviation-center-line": 0.3774121806438071, "driven_lanedir_consec": 0.784207267923489}, "udem-000-ego1": {"driven_any": 1.2324659681683054, "survival_time": 59.99999999999873, "driven_lanedir": 0.3660383645554859, "in-drivable-lane": 32.849999999999156, "deviation-heading": 21.007317212256137, "distance-from-start": 0.2407552792288517, "deviation-center-line": 1.8616650116253028, "driven_lanedir_consec": 0.3660383645554859}, "udem-000-ego2": {"driven_any": 0.5847502282496695, "survival_time": 59.99999999999873, "driven_lanedir": 0.3108049400999442, "in-drivable-lane": 57.79999999999873, "deviation-heading": 0.6564569112785665, "distance-from-start": 0.474629763371012, "deviation-center-line": 0.1059229777575452, "driven_lanedir_consec": 0.3108049400999442}, "udem-000-ego3": {"driven_any": 0.07579804610647306, "survival_time": 59.99999999999873, "driven_lanedir": 0.010845612305622645, "in-drivable-lane": 59.34999999999873, "deviation-heading": 0.5857390774722881, "distance-from-start": 0.06031158567121019, "deviation-center-line": 0.03616555215866011, "driven_lanedir_consec": 0.010845612305622645}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15397
1476
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 02:50:56+00:00 2022-11-25 02:52:30+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15396
1476
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 02:49:04+00:00 2022-11-25 02:50:36+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15391
1478
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 02:39:44+00:00 2022-11-25 02:48:57+00:00 0:09:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 48.199999999998624 driven_lanedir_consec_median 0.7969450226821448 deviation-center-line_median 1.1846578844800102
other stats deviation-center-line_max 1.1846578844800102 deviation-center-line_mean 1.1846578844800102 deviation-center-line_min 1.1846578844800102 deviation-heading_max 8.322204824214397 deviation-heading_mean 8.322204824214397 deviation-heading_median 8.322204824214397 deviation-heading_min 8.322204824214397 distance-from-start_max 0.7254018460955735 distance-from-start_mean 0.7254018460955735 distance-from-start_median 0.7254018460955735 distance-from-start_min 0.7254018460955735 driven_any_max 6.242039810810817 driven_any_mean 6.242039810810817 driven_any_median 6.242039810810817 driven_any_min 6.242039810810817 driven_lanedir_consec_max 0.7969450226821448 driven_lanedir_consec_mean 0.7969450226821448 driven_lanedir_consec_min 0.7969450226821448 driven_lanedir_max 0.7969450226821448 driven_lanedir_mean 0.7969450226821448 driven_lanedir_median 0.7969450226821448 driven_lanedir_min 0.7969450226821448 in-drivable-lane_max 48.199999999998624 in-drivable-lane_mean 48.199999999998624 in-drivable-lane_min 48.199999999998624 per-episodes details {"loop-000-ego0": {"driven_any": 6.242039810810817, "survival_time": 59.99999999999873, "driven_lanedir": 0.7969450226821448, "in-drivable-lane": 48.199999999998624, "deviation-heading": 8.322204824214397, "distance-from-start": 0.7254018460955735, "deviation-center-line": 1.1846578844800102, "driven_lanedir_consec": 0.7969450226821448}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15381
1480
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 02:27:47+00:00 2022-11-25 02:39:21+00:00 0:11:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.26764984149988424 deviation-center-line_median 0.7555295762526522
other stats deviation-center-line_max 0.7555295762526522 deviation-center-line_mean 0.7555295762526522 deviation-center-line_min 0.7555295762526522 deviation-heading_max 5.523299013646982 deviation-heading_mean 5.523299013646982 deviation-heading_median 5.523299013646982 deviation-heading_min 5.523299013646982 distance-from-start_max 1.044224797669204 distance-from-start_mean 1.044224797669204 distance-from-start_median 1.044224797669204 distance-from-start_min 1.044224797669204 driven_any_max 11.376062002465122 driven_any_mean 11.376062002465122 driven_any_median 11.376062002465122 driven_any_min 11.376062002465122 driven_lanedir_consec_max 0.26764984149988424 driven_lanedir_consec_mean 0.26764984149988424 driven_lanedir_consec_min 0.26764984149988424 driven_lanedir_max 0.24963678127672728 driven_lanedir_mean 0.24963678127672728 driven_lanedir_median 0.24963678127672728 driven_lanedir_min 0.24963678127672728 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"4way-000-ego0": {"driven_any": 11.376062002465122, "survival_time": 45.099999999999575, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299013646982, "distance-from-start": 1.044224797669204, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 15374
1482
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 02:23:29+00:00 2022-11-25 02:27:27+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2718401947993705 survival_time_median 27.70000000000026 deviation-center-line_median 0.7655517188189105 in-drivable-lane_median 19.150000000000237
other stats deviation-center-line_max 0.7655517188189105 deviation-center-line_mean 0.7655517188189105 deviation-center-line_min 0.7655517188189105 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7960980578537302 distance-from-start_mean 0.7960980578537302 distance-from-start_median 0.7960980578537302 distance-from-start_min 0.7960980578537302 driven_any_max 6.635455547557208 driven_any_mean 6.635455547557208 driven_any_median 6.635455547557208 driven_any_min 6.635455547557208 driven_lanedir_consec_max 0.2718401947993705 driven_lanedir_consec_mean 0.2718401947993705 driven_lanedir_consec_min 0.2718401947993705 driven_lanedir_max 0.25382904192484634 driven_lanedir_mean 0.25382904192484634 driven_lanedir_median 0.25382904192484634 driven_lanedir_min 0.25382904192484634 in-drivable-lane_max 19.150000000000237 in-drivable-lane_mean 19.150000000000237 in-drivable-lane_min 19.150000000000237 per-episodes details {"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 15372
1482
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 02:17:11+00:00 2022-11-25 02:23:01+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2701303550718044 survival_time_median 49.74999999999931 deviation-center-line_median 0.8041846674982114 in-drivable-lane_median 40.59999999999928
other stats deviation-center-line_max 0.8041846674982114 deviation-center-line_mean 0.8041846674982114 deviation-center-line_min 0.8041846674982114 deviation-heading_max 6.675380463416964 deviation-heading_mean 6.675380463416964 deviation-heading_median 6.675380463416964 deviation-heading_min 6.675380463416964 distance-from-start_max 1.137627771926658 distance-from-start_mean 1.137627771926658 distance-from-start_median 1.137627771926658 distance-from-start_min 1.137627771926658 driven_any_max 12.45015338279087 driven_any_mean 12.45015338279087 driven_any_median 12.45015338279087 driven_any_min 12.45015338279087 driven_lanedir_consec_max 0.2701303550718044 driven_lanedir_consec_mean 0.2701303550718044 driven_lanedir_consec_min 0.2701303550718044 driven_lanedir_max 0.2521152682910448 driven_lanedir_mean 0.2521152682910448 driven_lanedir_median 0.2521152682910448 driven_lanedir_min 0.2521152682910448 in-drivable-lane_max 40.59999999999928 in-drivable-lane_mean 40.59999999999928 in-drivable-lane_min 40.59999999999928 per-episodes details {"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 15371
1483
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 02:15:13+00:00 2022-11-25 02:16:40+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15365
1484
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 02:02:15+00:00 2022-11-25 02:15:07+00:00 0:12:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.250000000000306 in-drivable-lane_median 28.075000000000298 driven_lanedir_consec_median 0.1610207737330219 deviation-center-line_median 0.29879847452961933
other stats deviation-center-line_max 0.7438965564413397 deviation-center-line_mean 0.3444866849816528 deviation-center-line_min 0.03645323442603294 deviation-heading_max 5.151628362375439 deviation-heading_mean 3.250612996537796 deviation-heading_median 3.3709673175115276 deviation-heading_min 1.1088889887526905 distance-from-start_max 0.9340577697896384 distance-from-start_mean 0.6918300925811118 distance-from-start_median 0.6561491304294165 distance-from-start_min 0.5209643396759762 driven_any_max 7.865751162007197 driven_any_mean 4.149754186300885 driven_any_median 4.093549808670279 driven_any_min 0.5461659658557834 driven_lanedir_consec_max 0.34342719852355597 driven_lanedir_consec_mean 0.1843559383324774 driven_lanedir_consec_min 0.07195500734030984 driven_lanedir_max 0.34342719852355597 driven_lanedir_mean 0.17519082439080594 driven_lanedir_median 0.142690545849679 driven_lanedir_min 0.07195500734030984 in-drivable-lane_max 30.600000000000307 in-drivable-lane_mean 27.887500000000298 in-drivable-lane_min 24.80000000000028 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.557376740490916, "survival_time": 32.250000000000306, "driven_lanedir": 0.34342719852355597, "in-drivable-lane": 27.45000000000031, "deviation-heading": 4.085690366921237, "distance-from-start": 0.576509903181454, "deviation-center-line": 0.3481403947764579, "driven_lanedir_consec": 0.34342719852355597}, "zigzag-000-ego1": {"driven_any": 5.629722876849642, "survival_time": 32.250000000000306, "driven_lanedir": 0.19038935166124735, "in-drivable-lane": 24.80000000000028, "deviation-heading": 5.151628362375439, "distance-from-start": 0.7357883576773788, "deviation-center-line": 0.7438965564413397, "driven_lanedir_consec": 0.21133294232177}, "zigzag-000-ego2": {"driven_any": 7.865751162007197, "survival_time": 32.250000000000306, "driven_lanedir": 0.09499174003811064, "in-drivable-lane": 28.70000000000028, "deviation-heading": 2.6562442681018186, "distance-from-start": 0.9340577697896384, "deviation-center-line": 0.24945655428278077, "driven_lanedir_consec": 0.11070860514427378}, "zigzag-000-ego3": {"driven_any": 0.5461659658557834, "survival_time": 32.250000000000306, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 30.600000000000307, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}simulation-passed 1 survival_time_max 32.250000000000306 survival_time_mean 32.250000000000306 survival_time_min 32.250000000000306
No reset possible 15356
1489
Bea Baselines 🐤template-random lx22-state-estimation
sim success yes davinci-stage-02-6.2.51
2022-11-25 01:49:33+00:00 2022-11-25 02:02:09+00:00 0:12:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07536801496639489 survival_time_median 59.99999999999873 deviation-center-line_median 0.6735665136853142 in-drivable-lane_median 49.44999999999911
other stats deviation-center-line_max 0.8579388817399466 deviation-center-line_mean 0.6660984451379334 deviation-center-line_min 0.4667899399885391 deviation-heading_max 5.582370303572385 deviation-heading_mean 4.330594699634891 deviation-heading_median 3.851668979994983 deviation-heading_min 3.5577448153373066 distance-from-start_max 1.4108418329399044 distance-from-start_mean 1.2749217352766675 distance-from-start_median 1.4108418329398824 distance-from-start_min 1.0030815399502164 driven_any_max 15.32631084737068 driven_any_mean 13.156722223767504 driven_any_median 15.326310847370546 driven_any_min 8.81754497656128 driven_lanedir_consec_max 0.15436172858886033 driven_lanedir_consec_mean 0.06086423316366729 driven_lanedir_consec_min -0.04713704406425334 driven_lanedir_max 0.13361915084339548 driven_lanedir_mean 0.04596436275685415 driven_lanedir_median 0.06382708081740152 driven_lanedir_min -0.05955314339023454 in-drivable-lane_max 53.2499999999987 in-drivable-lane_mean 44.49999999999929 in-drivable-lane_min 30.80000000000006 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 15.326310847370546, "survival_time": 59.99999999999873, "driven_lanedir": 0.13361915084339548, "in-drivable-lane": 53.2499999999987, "deviation-heading": 3.851668979994983, "distance-from-start": 1.4108418329398824, "deviation-center-line": 0.6735665136853142, "driven_lanedir_consec": 0.15436172858886033}, "LF-zig-zag-001-ego0": {"driven_any": 8.81754497656128, "survival_time": 35.9000000000001, "driven_lanedir": 0.06382708081740152, "in-drivable-lane": 30.80000000000006, "deviation-heading": 3.5577448153373066, "distance-from-start": 1.0030815399502164, "deviation-center-line": 0.4667899399885391, "driven_lanedir_consec": 0.07536801496639489}, "LF-zig-zag-002-ego0": {"driven_any": 15.32631084737068, "survival_time": 59.99999999999873, "driven_lanedir": -0.05955314339023454, "in-drivable-lane": 49.44999999999911, "deviation-heading": 5.582370303572385, "distance-from-start": 1.4108418329399044, "deviation-center-line": 0.8579388817399466, "driven_lanedir_consec": -0.04713704406425334}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 51.96666666666585 survival_time_min 35.9000000000001
No reset possible 15353
1490
Bea Baselines 🐤template-random lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-25 01:46:46+00:00 2022-11-25 01:49:26+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5461575079396516
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5461575079396516 distance-from-start_median 0.5461575079396516 distance-from-start_min 0.5461575079396516 driven_any_max 2.35191748174678 driven_any_mean 2.35191748174678 driven_any_median 2.35191748174678 driven_any_min 2.35191748174678 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.450000000000028 in-drivable-lane_mean 11.450000000000028 in-drivable-lane_median 11.450000000000028 in-drivable-lane_min 11.450000000000028 per-episodes details {"d60-ego0": {"driven_any": 2.35191748174678, "survival_time": 11.450000000000028, "driven_lanedir": 0.0, "in-drivable-lane": 11.450000000000028, "deviation-heading": 0.0, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_median 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 15350
1493
Bea Baselines 🐤template-random aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.51
2022-11-25 01:45:26+00:00 2022-11-25 01:46:38+00:00 0:01:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.1920928955078125e-06 deviation-center-line_median 0.007457559042937448
other stats deviation-center-line_max 0.007457559042937448 deviation-center-line_mean 0.007457559042937448 deviation-center-line_min 0.007457559042937448 deviation-heading_max 0.1966171946901932 deviation-heading_mean 0.1966171946901932 deviation-heading_median 0.1966171946901932 deviation-heading_min 0.1966171946901932 distance-from-start_max 6.280369834735102e-16 distance-from-start_mean 6.280369834735102e-16 distance-from-start_median 6.280369834735102e-16 distance-from-start_min 6.280369834735102e-16 driven_any_max 4.1538810900383696e-15 driven_any_mean 4.1538810900383696e-15 driven_any_median 4.1538810900383696e-15 driven_any_min 4.1538810900383696e-15 driven_lanedir_consec_max 1.1920928955078125e-06 driven_lanedir_consec_mean 1.1920928955078125e-06 driven_lanedir_consec_min 1.1920928955078125e-06 driven_lanedir_max 1.1920928955078125e-06 driven_lanedir_mean 1.1920928955078125e-06 driven_lanedir_median 1.1920928955078125e-06 driven_lanedir_min 1.1920928955078125e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 4.1538810900383696e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15349
1497
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 01:40:13+00:00 2022-11-25 01:45:10+00:00 0:04:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.55000000000003 in-drivable-lane_median 8.100000000000017 driven_lanedir_consec_median 0.02948471913916273 deviation-center-line_median 0.3268414821574099
other stats deviation-center-line_max 0.3268414821574099 deviation-center-line_mean 0.3268414821574099 deviation-center-line_min 0.3268414821574099 deviation-heading_max 2.5488725860510586 deviation-heading_mean 2.5488725860510586 deviation-heading_median 2.5488725860510586 deviation-heading_min 2.5488725860510586 distance-from-start_max 0.5461575079396525 distance-from-start_mean 0.5461575079396525 distance-from-start_median 0.5461575079396525 distance-from-start_min 0.5461575079396525 driven_any_max 2.4097437221936646 driven_any_mean 2.4097437221936646 driven_any_median 2.4097437221936646 driven_any_min 2.4097437221936646 driven_lanedir_consec_max 0.02948471913916273 driven_lanedir_consec_mean 0.02948471913916273 driven_lanedir_consec_min 0.02948471913916273 driven_lanedir_max 0.032830942028507115 driven_lanedir_mean 0.032830942028507115 driven_lanedir_median 0.032830942028507115 driven_lanedir_min 0.032830942028507115 in-drivable-lane_max 8.100000000000017 in-drivable-lane_mean 8.100000000000017 in-drivable-lane_min 8.100000000000017 per-episodes details {"autolab-000-ego0": {"driven_any": 2.4097437221936646, "survival_time": 11.55000000000003, "driven_lanedir": 0.032830942028507115, "in-drivable-lane": 8.100000000000017, "deviation-heading": 2.5488725860510586, "distance-from-start": 0.5461575079396525, "deviation-center-line": 0.3268414821574099, "driven_lanedir_consec": 0.02948471913916273}}simulation-passed 1 survival_time_max 11.55000000000003 survival_time_mean 11.55000000000003 survival_time_min 11.55000000000003
No reset possible 15343
1498
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 01:35:41+00:00 2022-11-25 01:40:07+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.02729617395902917 deviation-center-line_median 0.32682195168324285
other stats deviation-center-line_max 0.32682195168324285 deviation-center-line_mean 0.32682195168324285 deviation-center-line_min 0.32682195168324285 deviation-heading_max 2.5540249040512006 deviation-heading_mean 2.5540249040512006 deviation-heading_median 2.5540249040512006 deviation-heading_min 2.5540249040512006 distance-from-start_max 0.5461575079396513 distance-from-start_mean 0.5461575079396513 distance-from-start_median 0.5461575079396513 distance-from-start_min 0.5461575079396513 driven_any_max 2.295525081876515 driven_any_mean 2.295525081876515 driven_any_median 2.295525081876515 driven_any_min 2.295525081876515 driven_lanedir_consec_max 0.02729617395902917 driven_lanedir_consec_mean 0.02729617395902917 driven_lanedir_consec_min 0.02729617395902917 driven_lanedir_max 0.030642516057663105 driven_lanedir_mean 0.030642516057663105 driven_lanedir_median 0.030642516057663105 driven_lanedir_min 0.030642516057663105 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.295525081876515, "survival_time": 11.350000000000026, "driven_lanedir": 0.030642516057663105, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.5540249040512006, "distance-from-start": 0.5461575079396513, "deviation-center-line": 0.32682195168324285, "driven_lanedir_consec": 0.02729617395902917}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 15335
1500
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 01:27:34+00:00 2022-11-25 01:35:28+00:00 0:07:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.012435476414101476 survival_time_median 59.99999999999873 deviation-center-line_median 0.5849703750508038 in-drivable-lane_median 53.74999999999868
other stats deviation-center-line_max 0.5849703750508038 deviation-center-line_mean 0.5849703750508038 deviation-center-line_min 0.5849703750508038 deviation-heading_max 4.775258785640045 deviation-heading_mean 4.775258785640045 deviation-heading_median 4.775258785640045 deviation-heading_min 4.775258785640045 distance-from-start_max 1.4108418329398955 distance-from-start_mean 1.4108418329398955 distance-from-start_median 1.4108418329398955 distance-from-start_min 1.4108418329398955 driven_any_max 15.326310847370571 driven_any_mean 15.326310847370571 driven_any_median 15.326310847370571 driven_any_min 15.326310847370571 driven_lanedir_consec_max 0.012435476414101476 driven_lanedir_consec_mean 0.012435476414101476 driven_lanedir_consec_min 0.012435476414101476 driven_lanedir_max 0.01578217614057431 driven_lanedir_mean 0.01578217614057431 driven_lanedir_median 0.01578217614057431 driven_lanedir_min 0.01578217614057431 in-drivable-lane_max 53.74999999999868 in-drivable-lane_mean 53.74999999999868 in-drivable-lane_min 53.74999999999868 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370571, "survival_time": 59.99999999999873, "driven_lanedir": 0.01578217614057431, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258785640045, "distance-from-start": 1.4108418329398955, "deviation-center-line": 0.5849703750508038, "driven_lanedir_consec": 0.012435476414101476}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15332
1501
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 01:19:32+00:00 2022-11-25 01:27:14+00:00 0:07:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.850000000000104 in-drivable-lane_median 12.125000000000089 driven_lanedir_consec_median 0.0914085509908058 deviation-center-line_median 0.43295730670036126
other stats deviation-center-line_max 0.9740434407320936 deviation-center-line_mean 0.4859958968604682 deviation-center-line_min 0.10402553330905678 deviation-heading_max 11.275693531416076 deviation-heading_mean 4.654809102682379 deviation-heading_median 2.965682219224468 deviation-heading_min 1.412178440864505 distance-from-start_max 0.6736010379604943 distance-from-start_mean 0.3985347917343786 distance-from-start_median 0.4602690644885098 distance-from-start_min 6.280369834735102e-16 driven_any_max 4.057822758459427 driven_any_mean 1.6869445200555797 driven_any_median 1.3449776608814374 driven_any_min 1.6723002649096045e-14 driven_lanedir_consec_max 0.3062479141509611 driven_lanedir_consec_mean 0.12226625403314316 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.3062479141509611 driven_lanedir_mean 0.11925650183156368 driven_lanedir_median 0.08538904658764679 driven_lanedir_min 0.0 in-drivable-lane_max 14.800000000000107 in-drivable-lane_mean 9.76250000000007 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.295525081876566, "survival_time": 16.850000000000104, "driven_lanedir": 0.03283062049203522, "in-drivable-lane": 13.400000000000093, "deviation-heading": 2.548872644626666, "distance-from-start": 0.5461575079396546, "deviation-center-line": 0.3268416966298657, "driven_lanedir_consec": 0.029485112858473883}, "4way-000-ego1": {"driven_any": 1.6723002649096045e-14, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.275693531416076, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.9740434407320936, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 4.057822758459427, "survival_time": 16.850000000000104, "driven_lanedir": 0.13794747268325835, "in-drivable-lane": 10.850000000000088, "deviation-heading": 3.3824917938222696, "distance-from-start": 0.6736010379604943, "deviation-center-line": 0.5390729167708568, "driven_lanedir_consec": 0.15333198912313772}, "4way-000-ego3": {"driven_any": 0.3944302398863089, "survival_time": 16.850000000000104, "driven_lanedir": 0.3062479141509611, "in-drivable-lane": 14.800000000000107, "deviation-heading": 1.412178440864505, "distance-from-start": 0.37438062103736497, "deviation-center-line": 0.10402553330905678, "driven_lanedir_consec": 0.3062479141509611}}simulation-passed 1 survival_time_max 16.850000000000104 survival_time_mean 16.850000000000104 survival_time_min 16.850000000000104
No reset possible 15331
1501
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 01:17:29+00:00 2022-11-25 01:18:58+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15328
1502
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 01:09:25+00:00 2022-11-25 01:17:03+00:00 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.99999999999958 in-drivable-lane_median 39.249999999999574 driven_lanedir_consec_median 0.1329316137267978 deviation-center-line_median 0.4769519451920501
other stats deviation-center-line_max 0.627148077892518 deviation-center-line_mean 0.4769519451920501 deviation-center-line_min 0.3267558124915822 deviation-heading_max 4.173256858222429 deviation-heading_mean 3.3650961945019375 deviation-heading_median 3.3650961945019375 deviation-heading_min 2.5569355307814456 distance-from-start_max 1.0442247976691823 distance-from-start_mean 0.7951911528044138 distance-from-start_median 0.7951911528044138 distance-from-start_min 0.5461575079396452 driven_any_max 11.349124250612952 driven_any_mean 6.923556868843365 driven_any_median 6.923556868843365 driven_any_min 2.497989487073778 driven_lanedir_consec_max 0.2397940766790495 driven_lanedir_consec_mean 0.1329316137267978 driven_lanedir_consec_min 0.02606915077454608 driven_lanedir_max 0.2256600500204217 driven_lanedir_mean 0.1275377118421561 driven_lanedir_median 0.1275377118421561 driven_lanedir_min 0.029415373663890465 in-drivable-lane_max 41.54999999999957 in-drivable-lane_mean 39.249999999999574 in-drivable-lane_min 36.94999999999958 per-episodes details {"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}simulation-passed 1 survival_time_max 44.99999999999958 survival_time_mean 44.99999999999958 survival_time_min 44.99999999999958
No reset possible 15325
1503
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 01:07:17+00:00 2022-11-25 01:09:18+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.300000000000026 in-drivable-lane_median 7.850000000000014 driven_lanedir_consec_median 0.02948472541340319 deviation-center-line_median 0.3268416970813497
other stats deviation-center-line_max 0.3268416970813497 deviation-center-line_mean 0.3268416970813497 deviation-center-line_min 0.3268416970813497 deviation-heading_max 2.548872596322993 deviation-heading_mean 2.548872596322993 deviation-heading_median 2.548872596322993 deviation-heading_min 2.548872596322993 distance-from-start_max 0.5461575079396523 distance-from-start_mean 0.5461575079396523 distance-from-start_median 0.5461575079396523 distance-from-start_min 0.5461575079396523 driven_any_max 2.2681416551684617 driven_any_mean 2.2681416551684617 driven_any_median 2.2681416551684617 driven_any_min 2.2681416551684617 driven_lanedir_consec_max 0.02948472541340319 driven_lanedir_consec_mean 0.02948472541340319 driven_lanedir_consec_min 0.02948472541340319 driven_lanedir_max 0.032831067512037126 driven_lanedir_mean 0.032831067512037126 driven_lanedir_median 0.032831067512037126 driven_lanedir_min 0.032831067512037126 in-drivable-lane_max 7.850000000000014 in-drivable-lane_mean 7.850000000000014 in-drivable-lane_min 7.850000000000014 per-episodes details {"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}simulation-passed 1 survival_time_max 11.300000000000026 survival_time_mean 11.300000000000026 survival_time_min 11.300000000000026
No reset possible 15320
1504
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 01:04:31+00:00 2022-11-25 01:06:43+00:00 0:02:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.0499999999999865 in-drivable-lane_median 4.04999999999999 driven_lanedir_consec_median 0.35089312033674136 deviation-center-line_median 0.15776031323972933
other stats deviation-center-line_max 0.15776031323972933 deviation-center-line_mean 0.15776031323972933 deviation-center-line_min 0.15776031323972933 deviation-heading_max 1.5084045806999196 deviation-heading_mean 1.5084045806999196 deviation-heading_median 1.5084045806999196 deviation-heading_min 1.5084045806999196 distance-from-start_max 1.5313548648961135 distance-from-start_mean 1.5313548648961135 distance-from-start_median 1.5313548648961135 distance-from-start_min 1.5313548648961135 driven_any_max 1.556576669982265 driven_any_mean 1.556576669982265 driven_any_median 1.556576669982265 driven_any_min 1.556576669982265 driven_lanedir_consec_max 0.35089312033674136 driven_lanedir_consec_mean 0.35089312033674136 driven_lanedir_consec_min 0.35089312033674136 driven_lanedir_max 0.35089312033674136 driven_lanedir_mean 0.35089312033674136 driven_lanedir_median 0.35089312033674136 driven_lanedir_min 0.35089312033674136 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 4.04999999999999 in-drivable-lane_min 4.04999999999999 per-episodes details {"loop2-000-ego0": {"driven_any": 1.556576669982265, "survival_time": 6.0499999999999865, "driven_lanedir": 0.35089312033674136, "in-drivable-lane": 4.04999999999999, "deviation-heading": 1.5084045806999196, "distance-from-start": 1.5313548648961135, "deviation-center-line": 0.15776031323972933, "driven_lanedir_consec": 0.35089312033674136}}simulation-passed 1 survival_time_max 6.0499999999999865 survival_time_mean 6.0499999999999865 survival_time_min 6.0499999999999865
No reset possible 15316
1505
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 01:02:53+00:00 2022-11-25 01:04:25+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15311
1506
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 01:00:27+00:00 2022-11-25 01:02:33+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.25 in-drivable-lane_median 1.2999999999999998 driven_lanedir_consec_median 0.1712202961860365 deviation-center-line_median 0.05495893093412712
other stats deviation-center-line_max 0.05495893093412712 deviation-center-line_mean 0.05495893093412712 deviation-center-line_min 0.05495893093412712 deviation-heading_max 0.5642186831153005 deviation-heading_mean 0.5642186831153005 deviation-heading_median 0.5642186831153005 deviation-heading_min 0.5642186831153005 distance-from-start_max 0.3920173158489758 distance-from-start_mean 0.3920173158489758 distance-from-start_median 0.3920173158489758 distance-from-start_min 0.3920173158489758 driven_any_max 0.3945359893156892 driven_any_mean 0.3945359893156892 driven_any_median 0.3945359893156892 driven_any_min 0.3945359893156892 driven_lanedir_consec_max 0.1712202961860365 driven_lanedir_consec_mean 0.1712202961860365 driven_lanedir_consec_min 0.1712202961860365 driven_lanedir_max 0.1712202961860365 driven_lanedir_mean 0.1712202961860365 driven_lanedir_median 0.1712202961860365 driven_lanedir_min 0.1712202961860365 in-drivable-lane_max 1.2999999999999998 in-drivable-lane_mean 1.2999999999999998 in-drivable-lane_min 1.2999999999999998 per-episodes details {"4way-000-ego0": {"driven_any": 0.3945359893156892, "survival_time": 2.25, "driven_lanedir": 0.1712202961860365, "in-drivable-lane": 1.2999999999999998, "deviation-heading": 0.5642186831153005, "distance-from-start": 0.3920173158489758, "deviation-center-line": 0.05495893093412712, "driven_lanedir_consec": 0.1712202961860365}}simulation-passed 1 survival_time_max 2.25 survival_time_mean 2.25 survival_time_min 2.25
No reset possible 15308
1507
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 00:58:11+00:00 2022-11-25 00:59:59+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2695041218185992 survival_time_median 5.299999999999989 deviation-center-line_median 0.09987151123779776 in-drivable-lane_median 3.9499999999999886
other stats deviation-center-line_max 0.09987151123779776 deviation-center-line_mean 0.09987151123779776 deviation-center-line_min 0.09987151123779776 deviation-heading_max 0.611712365627835 deviation-heading_mean 0.611712365627835 deviation-heading_median 0.611712365627835 deviation-heading_min 0.611712365627835 distance-from-start_max 1.2778149575242015 distance-from-start_mean 1.2778149575242015 distance-from-start_median 1.2778149575242015 distance-from-start_min 1.2778149575242015 driven_any_max 1.2867192215452647 driven_any_mean 1.2867192215452647 driven_any_median 1.2867192215452647 driven_any_min 1.2867192215452647 driven_lanedir_consec_max 0.2695041218185992 driven_lanedir_consec_mean 0.2695041218185992 driven_lanedir_consec_min 0.2695041218185992 driven_lanedir_max 0.2695041218185992 driven_lanedir_mean 0.2695041218185992 driven_lanedir_median 0.2695041218185992 driven_lanedir_min 0.2695041218185992 in-drivable-lane_max 3.9499999999999886 in-drivable-lane_mean 3.9499999999999886 in-drivable-lane_min 3.9499999999999886 per-episodes details {"loop-000-ego0": {"driven_any": 1.2867192215452647, "survival_time": 5.299999999999989, "driven_lanedir": 0.2695041218185992, "in-drivable-lane": 3.9499999999999886, "deviation-heading": 0.611712365627835, "distance-from-start": 1.2778149575242015, "deviation-center-line": 0.09987151123779776, "driven_lanedir_consec": 0.2695041218185992}}simulation-passed 1 survival_time_max 5.299999999999989 survival_time_mean 5.299999999999989 survival_time_min 5.299999999999989
No reset possible 15303
1508
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 00:56:26+00:00 2022-11-25 00:57:53+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15299
1509
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 00:53:49+00:00 2022-11-25 00:56:06+00:00 0:02:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.8999999999999835 in-drivable-lane_median 5.399999999999984 driven_lanedir_consec_median 0.28952341490251676 deviation-center-line_median 0.12399766823649014
other stats deviation-center-line_max 0.15627040460502611 deviation-center-line_mean 0.12399766823649014 deviation-center-line_min 0.09172493186795416 deviation-heading_max 1.4029219777947843 deviation-heading_mean 0.9344273521141429 deviation-heading_median 0.9344273521141429 deviation-heading_min 0.4659327264335015 distance-from-start_max 1.7309315804111918 distance-from-start_mean 1.0943853434955468 distance-from-start_median 1.0943853434955468 distance-from-start_min 0.457839106579902 driven_any_max 1.7944580570674225 driven_any_mean 1.1262765052047812 driven_any_median 1.1262765052047812 driven_any_min 0.45809495334213973 driven_lanedir_consec_max 0.3851474464309541 driven_lanedir_consec_mean 0.28952341490251676 driven_lanedir_consec_min 0.1938993833740794 driven_lanedir_max 0.3851474464309541 driven_lanedir_mean 0.28952341490251676 driven_lanedir_median 0.28952341490251676 driven_lanedir_min 0.1938993833740794 in-drivable-lane_max 5.8999999999999835 in-drivable-lane_mean 5.399999999999984 in-drivable-lane_min 4.899999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 1.7944580570674225, "survival_time": 6.8999999999999835, "driven_lanedir": 0.3851474464309541, "in-drivable-lane": 4.899999999999986, "deviation-heading": 1.4029219777947843, "distance-from-start": 1.7309315804111918, "deviation-center-line": 0.15627040460502611, "driven_lanedir_consec": 0.3851474464309541}, "loop2-000-ego1": {"driven_any": 0.45809495334213973, "survival_time": 6.8999999999999835, "driven_lanedir": 0.1938993833740794, "in-drivable-lane": 5.8999999999999835, "deviation-heading": 0.4659327264335015, "distance-from-start": 0.457839106579902, "deviation-center-line": 0.09172493186795416, "driven_lanedir_consec": 0.1938993833740794}}simulation-passed 1 survival_time_max 6.8999999999999835 survival_time_mean 6.8999999999999835 survival_time_min 6.8999999999999835
No reset possible 15295
1510
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 00:51:51+00:00 2022-11-25 00:53:28+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.5999999999999845 in-drivable-lane_median 4.199999999999985 driven_lanedir_consec_median 0.6747169316563228 deviation-center-line_median 0.18220960425759583
other stats deviation-center-line_max 0.18220960425759583 deviation-center-line_mean 0.18220960425759583 deviation-center-line_min 0.18220960425759583 deviation-heading_max 0.5294710351031631 deviation-heading_mean 0.5294710351031631 deviation-heading_median 0.5294710351031631 deviation-heading_min 0.5294710351031631 distance-from-start_max 1.6448851999409864 distance-from-start_mean 1.6448851999409864 distance-from-start_median 1.6448851999409864 distance-from-start_min 1.6448851999409864 driven_any_max 1.670916151319536 driven_any_mean 1.670916151319536 driven_any_median 1.670916151319536 driven_any_min 1.670916151319536 driven_lanedir_consec_max 0.6747169316563228 driven_lanedir_consec_mean 0.6747169316563228 driven_lanedir_consec_min 0.6747169316563228 driven_lanedir_max 0.6747169316563228 driven_lanedir_mean 0.6747169316563228 driven_lanedir_median 0.6747169316563228 driven_lanedir_min 0.6747169316563228 in-drivable-lane_max 4.199999999999985 in-drivable-lane_mean 4.199999999999985 in-drivable-lane_min 4.199999999999985 per-episodes details {"loop-000-ego0": {"driven_any": 1.670916151319536, "survival_time": 6.5999999999999845, "driven_lanedir": 0.6747169316563228, "in-drivable-lane": 4.199999999999985, "deviation-heading": 0.5294710351031631, "distance-from-start": 1.6448851999409864, "deviation-center-line": 0.18220960425759583, "driven_lanedir_consec": 0.6747169316563228}}simulation-passed 1 survival_time_max 6.5999999999999845 survival_time_mean 6.5999999999999845 survival_time_min 6.5999999999999845
No reset possible 15291
1513
Bea Baselines 🐤template-ros lx22-visservoing
sim success yes davinci-stage-02-6.2.51
2022-11-25 00:49:55+00:00 2022-11-25 00:51:45+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 2.7499999999999902 deviation-center-line_median 0.17688964199220994 driven_lanedir_consec_median 0.7448926940579148 survival_time_median 5.874999999999988
other stats deviation-center-line_max 0.247000549914311 deviation-center-line_mean 0.17688964199220994 deviation-center-line_min 0.10677873407010888 deviation-heading_max 1.277581640930528 deviation-heading_mean 0.9164734784541932 deviation-heading_median 0.9164734784541932 deviation-heading_min 0.5553653159778585 distance-from-start_max 1.5890020369056015 distance-from-start_mean 1.38872328283562 distance-from-start_median 1.38872328283562 distance-from-start_min 1.1884445287656389 driven_any_max 1.6878463703217892 driven_any_mean 1.4433452436925025 driven_any_median 1.4433452436925025 driven_any_min 1.198844117063216 driven_lanedir_consec_max 0.7676661817300642 driven_lanedir_consec_mean 0.7448926940579148 driven_lanedir_consec_min 0.7221192063857653 driven_lanedir_max 0.7676661817300642 driven_lanedir_mean 0.7448926940579148 driven_lanedir_median 0.7448926940579148 driven_lanedir_min 0.7221192063857653 in-drivable-lane_max 3.349999999999988 in-drivable-lane_mean 2.7499999999999902 in-drivable-lane_min 2.1499999999999924 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 1.198844117063216, "survival_time": 4.94999999999999, "driven_lanedir": 0.7221192063857653, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.5553653159778585, "distance-from-start": 1.1884445287656389, "deviation-center-line": 0.10677873407010888, "driven_lanedir_consec": 0.7221192063857653}, "LF-small-loop-001-ego0": {"driven_any": 1.6878463703217892, "survival_time": 6.799999999999984, "driven_lanedir": 0.7676661817300642, "in-drivable-lane": 3.349999999999988, "deviation-heading": 1.277581640930528, "distance-from-start": 1.5890020369056015, "deviation-center-line": 0.247000549914311, "driven_lanedir_consec": 0.7676661817300642}}simulation-passed 1 survival_time_max 6.799999999999984 survival_time_mean 5.874999999999988 survival_time_min 4.94999999999999
No reset possible 15284
1515
Bea Baselines 🐤template-ros lx22-BV1
sim-4of5 success no davinci-stage-02-6.2.51
2022-11-25 00:46:33+00:00 2022-11-25 00:49:33+00:00 0:03:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 4.186149133410969
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 4.186149133410969 distance-from-start_median 4.186149133410969 distance-from-start_min 4.186149133410969 driven_any_max 4.278790072792514 driven_any_mean 4.278790072792514 driven_any_median 4.278790072792514 driven_any_min 4.278790072792514 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 15.500000000000083 in-drivable-lane_mean 15.500000000000083 in-drivable-lane_median 15.500000000000083 in-drivable-lane_min 15.500000000000083 per-episodes details {"d60-ego0": {"driven_any": 4.278790072792514, "survival_time": 15.500000000000083, "driven_lanedir": 0.0, "in-drivable-lane": 15.500000000000083, "deviation-heading": 0.0, "distance-from-start": 4.186149133410969, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 15.500000000000083 survival_time_mean 15.500000000000083 survival_time_median 15.500000000000083 survival_time_min 15.500000000000083
No reset possible 15280
1522
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 00:43:54+00:00 2022-11-25 00:46:01+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.94999999999999 in-drivable-lane_median 3.2499999999999925 driven_lanedir_consec_median 0.208209627673958 deviation-center-line_median 0.13779941128310272
other stats deviation-center-line_max 0.13779941128310272 deviation-center-line_mean 0.13779941128310272 deviation-center-line_min 0.13779941128310272 deviation-heading_max 1.5283360047922008 deviation-heading_mean 1.5283360047922008 deviation-heading_median 1.5283360047922008 deviation-heading_min 1.5283360047922008 distance-from-start_max 1.148623120748047 distance-from-start_mean 1.148623120748047 distance-from-start_median 1.148623120748047 distance-from-start_min 1.148623120748047 driven_any_max 1.228767037003909 driven_any_mean 1.228767037003909 driven_any_median 1.228767037003909 driven_any_min 1.228767037003909 driven_lanedir_consec_max 0.208209627673958 driven_lanedir_consec_mean 0.208209627673958 driven_lanedir_consec_min 0.208209627673958 driven_lanedir_max 0.208209627673958 driven_lanedir_mean 0.208209627673958 driven_lanedir_median 0.208209627673958 driven_lanedir_min 0.208209627673958 in-drivable-lane_max 3.2499999999999925 in-drivable-lane_mean 3.2499999999999925 in-drivable-lane_min 3.2499999999999925 per-episodes details {"loop2-000-ego0": {"driven_any": 1.228767037003909, "survival_time": 4.94999999999999, "driven_lanedir": 0.208209627673958, "in-drivable-lane": 3.2499999999999925, "deviation-heading": 1.5283360047922008, "distance-from-start": 1.148623120748047, "deviation-center-line": 0.13779941128310272, "driven_lanedir_consec": 0.208209627673958}}simulation-passed 1 survival_time_max 4.94999999999999 survival_time_mean 4.94999999999999 survival_time_min 4.94999999999999
No reset possible 15275
1524
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 00:41:27+00:00 2022-11-25 00:43:34+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.8999999999999835 in-drivable-lane_median 5.249999999999986 driven_lanedir_consec_median 0.21559987667617597 deviation-center-line_median 0.1268046612601334
other stats deviation-center-line_max 0.1268046612601334 deviation-center-line_mean 0.1268046612601334 deviation-center-line_min 0.1268046612601334 deviation-heading_max 1.526036373796927 deviation-heading_mean 1.526036373796927 deviation-heading_median 1.526036373796927 deviation-heading_min 1.526036373796927 distance-from-start_max 1.5430281129153385 distance-from-start_mean 1.5430281129153385 distance-from-start_median 1.5430281129153385 distance-from-start_min 1.5430281129153385 driven_any_max 1.7842632822655893 driven_any_mean 1.7842632822655893 driven_any_median 1.7842632822655893 driven_any_min 1.7842632822655893 driven_lanedir_consec_max 0.21559987667617597 driven_lanedir_consec_mean 0.21559987667617597 driven_lanedir_consec_min 0.21559987667617597 driven_lanedir_max 0.21559987667617597 driven_lanedir_mean 0.21559987667617597 driven_lanedir_median 0.21559987667617597 driven_lanedir_min 0.21559987667617597 in-drivable-lane_max 5.249999999999986 in-drivable-lane_mean 5.249999999999986 in-drivable-lane_min 5.249999999999986 per-episodes details {"4way-000-ego0": {"driven_any": 1.7842632822655893, "survival_time": 6.8999999999999835, "driven_lanedir": 0.21559987667617597, "in-drivable-lane": 5.249999999999986, "deviation-heading": 1.526036373796927, "distance-from-start": 1.5430281129153385, "deviation-center-line": 0.1268046612601334, "driven_lanedir_consec": 0.21559987667617597}}simulation-passed 1 survival_time_max 6.8999999999999835 survival_time_mean 6.8999999999999835 survival_time_min 6.8999999999999835
No reset possible 15270
1525
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-25 00:39:14+00:00 2022-11-25 00:41:12+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2762451334585154 survival_time_median 10.100000000000009 deviation-center-line_median 0.12338343628539047 in-drivable-lane_median 8.800000000000008
other stats deviation-center-line_max 0.12338343628539047 deviation-center-line_mean 0.12338343628539047 deviation-center-line_min 0.12338343628539047 deviation-heading_max 0.5808471359394436 deviation-heading_mean 0.5808471359394436 deviation-heading_median 0.5808471359394436 deviation-heading_min 0.5808471359394436 distance-from-start_max 2.5060474384069957 distance-from-start_mean 2.5060474384069957 distance-from-start_median 2.5060474384069957 distance-from-start_min 2.5060474384069957 driven_any_max 2.752026343828092 driven_any_mean 2.752026343828092 driven_any_median 2.752026343828092 driven_any_min 2.752026343828092 driven_lanedir_consec_max 0.2762451334585154 driven_lanedir_consec_mean 0.2762451334585154 driven_lanedir_consec_min 0.2762451334585154 driven_lanedir_max 0.2762451334585154 driven_lanedir_mean 0.2762451334585154 driven_lanedir_median 0.2762451334585154 driven_lanedir_min 0.2762451334585154 in-drivable-lane_max 8.800000000000008 in-drivable-lane_mean 8.800000000000008 in-drivable-lane_min 8.800000000000008 per-episodes details {"autolab-000-ego0": {"driven_any": 2.752026343828092, "survival_time": 10.100000000000009, "driven_lanedir": 0.2762451334585154, "in-drivable-lane": 8.800000000000008, "deviation-heading": 0.5808471359394436, "distance-from-start": 2.5060474384069957, "deviation-center-line": 0.12338343628539047, "driven_lanedir_consec": 0.2762451334585154}}simulation-passed 1 survival_time_max 10.100000000000009 survival_time_mean 10.100000000000009 survival_time_min 10.100000000000009
No reset possible 15266
1526
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 00:36:08+00:00 2022-11-25 00:39:07+00:00 0:02:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.14999999999999 in-drivable-lane_median 3.774999999999989 driven_lanedir_consec_median 0.2726832198040353 deviation-center-line_median 0.10308316195428976
other stats deviation-center-line_max 0.22494065258332813 deviation-center-line_mean 0.12909529413843365 deviation-center-line_min 0.08527420006182698 deviation-heading_max 2.049654496471999 deviation-heading_mean 0.8456675722107118 deviation-heading_median 0.49510644868534814 deviation-heading_min 0.34280289500015143 distance-from-start_max 1.1008397630670597 distance-from-start_mean 0.641272139606981 distance-from-start_median 0.568691094745088 distance-from-start_min 0.32686660587068805 driven_any_max 1.119032123418687 driven_any_mean 0.648668680858042 driven_any_median 0.5742404852581939 driven_any_min 0.32716162949709304 driven_lanedir_consec_max 0.338887733688475 driven_lanedir_consec_mean 0.25911830249494433 driven_lanedir_consec_min 0.15221903668323167 driven_lanedir_max 0.338887733688475 driven_lanedir_mean 0.25911830249494433 driven_lanedir_median 0.2726832198040353 driven_lanedir_min 0.15221903668323167 in-drivable-lane_max 4.14999999999999 in-drivable-lane_mean 3.5624999999999907 in-drivable-lane_min 2.5499999999999954 per-episodes details {"4way-000-ego0": {"driven_any": 1.119032123418687, "survival_time": 5.14999999999999, "driven_lanedir": 0.31065953729638696, "in-drivable-lane": 2.5499999999999954, "deviation-heading": 2.049654496471999, "distance-from-start": 1.1008397630670597, "deviation-center-line": 0.22494065258332813, "driven_lanedir_consec": 0.31065953729638696}, "4way-000-ego1": {"driven_any": 0.36348945949326866, "survival_time": 5.14999999999999, "driven_lanedir": 0.23470690231168367, "in-drivable-lane": 4.049999999999989, "deviation-heading": 0.34280289500015143, "distance-from-start": 0.3613409458175709, "deviation-center-line": 0.11127395519337938, "driven_lanedir_consec": 0.23470690231168367}, "4way-000-ego2": {"driven_any": 0.7849915110231193, "survival_time": 5.14999999999999, "driven_lanedir": 0.338887733688475, "in-drivable-lane": 3.499999999999989, "deviation-heading": 0.4367151733318008, "distance-from-start": 0.7760412436726053, "deviation-center-line": 0.08527420006182698, "driven_lanedir_consec": 0.338887733688475}, "4way-000-ego3": {"driven_any": 0.32716162949709304, "survival_time": 5.14999999999999, "driven_lanedir": 0.15221903668323167, "in-drivable-lane": 4.14999999999999, "deviation-heading": 0.5534977240388955, "distance-from-start": 0.32686660587068805, "deviation-center-line": 0.09489236871520013, "driven_lanedir_consec": 0.15221903668323167}}simulation-passed 1 survival_time_max 5.14999999999999 survival_time_mean 5.14999999999999 survival_time_min 5.14999999999999
No reset possible 15263
1526
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 00:34:14+00:00 2022-11-25 00:35:42+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15260
1528
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-25 00:32:26+00:00 2022-11-25 00:34:07+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7999999999999945 in-drivable-lane_median 2.7999999999999945 driven_lanedir_consec_median 0.1320851300098118 deviation-center-line_median 0.06554424978833173
other stats deviation-center-line_max 0.06554424978833173 deviation-center-line_mean 0.06554424978833173 deviation-center-line_min 0.06554424978833173 deviation-heading_max 0.6872862587736456 deviation-heading_mean 0.6872862587736456 deviation-heading_median 0.6872862587736456 deviation-heading_min 0.6872862587736456 distance-from-start_max 0.7267651540559056 distance-from-start_mean 0.7267651540559056 distance-from-start_median 0.7267651540559056 distance-from-start_min 0.7267651540559056 driven_any_max 0.7719978208719794 driven_any_mean 0.7719978208719794 driven_any_median 0.7719978208719794 driven_any_min 0.7719978208719794 driven_lanedir_consec_max 0.1320851300098118 driven_lanedir_consec_mean 0.1320851300098118 driven_lanedir_consec_min 0.1320851300098118 driven_lanedir_max 0.1320851300098118 driven_lanedir_mean 0.1320851300098118 driven_lanedir_median 0.1320851300098118 driven_lanedir_min 0.1320851300098118 in-drivable-lane_max 2.7999999999999945 in-drivable-lane_mean 2.7999999999999945 in-drivable-lane_min 2.7999999999999945 per-episodes details {"loop-000-ego0": {"driven_any": 0.7719978208719794, "survival_time": 3.7999999999999945, "driven_lanedir": 0.1320851300098118, "in-drivable-lane": 2.7999999999999945, "deviation-heading": 0.6872862587736456, "distance-from-start": 0.7267651540559056, "deviation-center-line": 0.06554424978833173, "driven_lanedir_consec": 0.1320851300098118}}simulation-passed 1 survival_time_max 3.7999999999999945 survival_time_mean 3.7999999999999945 survival_time_min 3.7999999999999945
No reset possible 15252
1531
Bea Baselines 🐤template-tensorflow aido-LFI-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:29:46+00:00 2022-11-25 00:32:14+00:00 0:02:28 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15247
1530
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 00:27:50+00:00 2022-11-25 00:29:22+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15243
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:26:29+00:00 2022-11-25 00:27:29+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15238
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 00:24:38+00:00 2022-11-25 00:26:08+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15231
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-2of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:22:29+00:00 2022-11-25 00:24:10+00:00 0:01:41 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15227
1536
Bea Baselines 🐤template-tensorflow lx22-modcon
sim failed yes davinci-stage-02-6.2.51
2022-11-25 00:21:22+00:00 2022-11-25 00:22:21+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15221
1540
Bea Baselines 🐤template-tensorflow lx22-BV1
sim-0of5 failed no davinci-stage-02-6.2.51
2022-11-25 00:19:50+00:00 2022-11-25 00:20:47+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15218
1543
Bea Baselines 🐤template-tensorflow aido-hello-sim-validation
sanity-check failed no davinci-stage-02-6.2.51
2022-11-25 00:18:41+00:00 2022-11-25 00:19:43+00:00 0:01:02 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15213
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-1of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:16:53+00:00 2022-11-25 00:18:31+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15209
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:15:15+00:00 2022-11-25 00:16:46+00:00 0:01:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15205
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-2of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:14:09+00:00 2022-11-25 00:15:09+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15197
1551
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-25 00:12:22+00:00 2022-11-25 00:13:57+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15193
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-0of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:10:36+00:00 2022-11-25 00:12:00+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15191
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-2of4 failed no davinci-stage-02-6.2.51
2022-11-25 00:08:34+00:00 2022-11-25 00:10:29+00:00 0:01:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15184
1368
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-25 00:04:18+00:00 2022-11-25 00:08:19+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15177
1294
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-1of4 aborted no davinci-stage-02-6.2.51
2022-11-24 23:52:42+00:00 2022-11-25 00:03:57+00:00 0:11:15 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15172
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-2of4 success no davinci-stage-02-6.2.51
2022-11-24 23:45:51+00:00 2022-11-24 23:52:15+00:00 0:06:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.5526407316931015 survival_time_median 59.99999999999873 deviation-center-line_median 3.7436331785240857 in-drivable-lane_median 22.89999999999932
other stats deviation-center-line_max 3.7436331785240857 deviation-center-line_mean 3.7436331785240857 deviation-center-line_min 3.7436331785240857 deviation-heading_max 28.28368996369585 deviation-heading_mean 28.28368996369585 deviation-heading_median 28.28368996369585 deviation-heading_min 28.28368996369585 distance-from-start_max 0.1426563216114179 distance-from-start_mean 0.1426563216114179 distance-from-start_median 0.1426563216114179 distance-from-start_min 0.1426563216114179 driven_any_max 11.192473994741231 driven_any_mean 11.192473994741231 driven_any_median 11.192473994741231 driven_any_min 11.192473994741231 driven_lanedir_consec_max -2.5526407316931015 driven_lanedir_consec_mean -2.5526407316931015 driven_lanedir_consec_min -2.5526407316931015 driven_lanedir_max -2.5526407316931015 driven_lanedir_mean -2.5526407316931015 driven_lanedir_median -2.5526407316931015 driven_lanedir_min -2.5526407316931015 in-drivable-lane_max 22.89999999999932 in-drivable-lane_mean 22.89999999999932 in-drivable-lane_min 22.89999999999932 per-episodes details {"loop2-000-ego0": {"driven_any": 11.192473994741231, "survival_time": 59.99999999999873, "driven_lanedir": -2.5526407316931015, "in-drivable-lane": 22.89999999999932, "deviation-heading": 28.28368996369585, "distance-from-start": 0.1426563216114179, "deviation-center-line": 3.7436331785240857, "driven_lanedir_consec": -2.5526407316931015}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15163
1268
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-24 23:33:50+00:00 2022-11-24 23:45:44+00:00 0:11:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.26764984149988424 deviation-center-line_median 0.7555295762526522
other stats deviation-center-line_max 0.7555295762526522 deviation-center-line_mean 0.7555295762526522 deviation-center-line_min 0.7555295762526522 deviation-heading_max 5.523299013646982 deviation-heading_mean 5.523299013646982 deviation-heading_median 5.523299013646982 deviation-heading_min 5.523299013646982 distance-from-start_max 1.044224797669204 distance-from-start_mean 1.044224797669204 distance-from-start_median 1.044224797669204 distance-from-start_min 1.044224797669204 driven_any_max 11.376062002465122 driven_any_mean 11.376062002465122 driven_any_median 11.376062002465122 driven_any_min 11.376062002465122 driven_lanedir_consec_max 0.26764984149988424 driven_lanedir_consec_mean 0.26764984149988424 driven_lanedir_consec_min 0.26764984149988424 driven_lanedir_max 0.24963678127672728 driven_lanedir_mean 0.24963678127672728 driven_lanedir_median 0.24963678127672728 driven_lanedir_min 0.24963678127672728 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"4way-000-ego0": {"driven_any": 11.376062002465122, "survival_time": 45.099999999999575, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299013646982, "distance-from-start": 1.044224797669204, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 15161
1269
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-24 23:30:51+00:00 2022-11-24 23:33:24+00:00 0:02:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15154
1272
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-24 23:17:43+00:00 2022-11-24 23:30:44+00:00 0:13:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.250000000000306 in-drivable-lane_median 28.075000000000298 driven_lanedir_consec_median 0.1610207737330219 deviation-center-line_median 0.29879847452961933
other stats deviation-center-line_max 0.7438965564413397 deviation-center-line_mean 0.3444866849816528 deviation-center-line_min 0.03645323442603294 deviation-heading_max 5.151628362375439 deviation-heading_mean 3.250612996537796 deviation-heading_median 3.3709673175115276 deviation-heading_min 1.1088889887526905 distance-from-start_max 0.9340577697896384 distance-from-start_mean 0.6918300925811118 distance-from-start_median 0.6561491304294165 distance-from-start_min 0.5209643396759762 driven_any_max 7.865751162007197 driven_any_mean 4.149754186300885 driven_any_median 4.093549808670279 driven_any_min 0.5461659658557834 driven_lanedir_consec_max 0.34342719852355597 driven_lanedir_consec_mean 0.1843559383324774 driven_lanedir_consec_min 0.07195500734030984 driven_lanedir_max 0.34342719852355597 driven_lanedir_mean 0.17519082439080594 driven_lanedir_median 0.142690545849679 driven_lanedir_min 0.07195500734030984 in-drivable-lane_max 30.600000000000307 in-drivable-lane_mean 27.887500000000298 in-drivable-lane_min 24.80000000000028 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.557376740490916, "survival_time": 32.250000000000306, "driven_lanedir": 0.34342719852355597, "in-drivable-lane": 27.45000000000031, "deviation-heading": 4.085690366921237, "distance-from-start": 0.576509903181454, "deviation-center-line": 0.3481403947764579, "driven_lanedir_consec": 0.34342719852355597}, "zigzag-000-ego1": {"driven_any": 5.629722876849642, "survival_time": 32.250000000000306, "driven_lanedir": 0.19038935166124735, "in-drivable-lane": 24.80000000000028, "deviation-heading": 5.151628362375439, "distance-from-start": 0.7357883576773788, "deviation-center-line": 0.7438965564413397, "driven_lanedir_consec": 0.21133294232177}, "zigzag-000-ego2": {"driven_any": 7.865751162007197, "survival_time": 32.250000000000306, "driven_lanedir": 0.09499174003811064, "in-drivable-lane": 28.70000000000028, "deviation-heading": 2.6562442681018186, "distance-from-start": 0.9340577697896384, "deviation-center-line": 0.24945655428278077, "driven_lanedir_consec": 0.11070860514427378}, "zigzag-000-ego3": {"driven_any": 0.5461659658557834, "survival_time": 32.250000000000306, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 30.600000000000307, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}simulation-passed 1 survival_time_max 32.250000000000306 survival_time_mean 32.250000000000306 survival_time_min 32.250000000000306
No reset possible 15148
1267
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-1of4 success no davinci-stage-02-6.2.51
2022-11-24 23:10:59+00:00 2022-11-24 23:17:23+00:00 0:06:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.7000000000002 in-drivable-lane_median 14.450000000000168 driven_lanedir_consec_median 0.2737854971621658 deviation-center-line_median 0.899035755764141
other stats deviation-center-line_max 0.899035755764141 deviation-center-line_mean 0.899035755764141 deviation-center-line_min 0.899035755764141 deviation-heading_max 6.757937307021479 deviation-heading_mean 6.757937307021479 deviation-heading_median 6.757937307021479 deviation-heading_min 6.757937307021479 distance-from-start_max 0.7357883576773867 distance-from-start_mean 0.7357883576773867 distance-from-start_median 0.7357883576773867 distance-from-start_min 0.7357883576773867 driven_any_max 5.6000766802176365 driven_any_mean 5.6000766802176365 driven_any_median 5.6000766802176365 driven_any_min 5.6000766802176365 driven_lanedir_consec_max 0.2737854971621658 driven_lanedir_consec_mean 0.2737854971621658 driven_lanedir_consec_min 0.2737854971621658 driven_lanedir_max 0.2557752979619581 driven_lanedir_mean 0.2557752979619581 driven_lanedir_median 0.2557752979619581 driven_lanedir_min 0.2557752979619581 in-drivable-lane_max 14.450000000000168 in-drivable-lane_mean 14.450000000000168 in-drivable-lane_min 14.450000000000168 per-episodes details {"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}simulation-passed 1 survival_time_max 23.7000000000002 survival_time_mean 23.7000000000002 survival_time_min 23.7000000000002
No reset possible 15142
783
Andrea Daniele template-random aido-LF-sim-validation
sim-1of4 aborted no davinci-stage-02-6.2.51
2022-11-24 23:05:45+00:00 2022-11-24 23:10:50+00:00 0:05:05 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The admin aborted the submission.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15136
1273
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-24 23:01:35+00:00 2022-11-24 23:05:25+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.200000000000195 in-drivable-lane_median 14.65000000000017 driven_lanedir_consec_median 0.2737852330803683 deviation-center-line_median 0.7687318160431588
other stats deviation-center-line_max 0.7687318160431588 deviation-center-line_mean 0.7687318160431588 deviation-center-line_min 0.7687318160431588 deviation-heading_max 5.758343085491201 deviation-heading_mean 5.758343085491201 deviation-heading_median 5.758343085491201 deviation-heading_min 5.758343085491201 distance-from-start_max 0.7357883576773739 distance-from-start_mean 0.7357883576773739 distance-from-start_median 0.7357883576773739 distance-from-start_min 0.7357883576773739 driven_any_max 5.318401064622404 driven_any_mean 5.318401064622404 driven_any_median 5.318401064622404 driven_any_min 5.318401064622404 driven_lanedir_consec_max 0.2737852330803683 driven_lanedir_consec_mean 0.2737852330803683 driven_lanedir_consec_min 0.2737852330803683 driven_lanedir_max 0.2557745570433345 driven_lanedir_mean 0.2557745570433345 driven_lanedir_median 0.2557745570433345 driven_lanedir_min 0.2557745570433345 in-drivable-lane_max 14.65000000000017 in-drivable-lane_mean 14.65000000000017 in-drivable-lane_min 14.65000000000017 per-episodes details {"autolab-000-ego0": {"driven_any": 5.318401064622404, "survival_time": 23.200000000000195, "driven_lanedir": 0.2557745570433345, "in-drivable-lane": 14.65000000000017, "deviation-heading": 5.758343085491201, "distance-from-start": 0.7357883576773739, "deviation-center-line": 0.7687318160431588, "driven_lanedir_consec": 0.2737852330803683}}simulation-passed 1 survival_time_max 23.200000000000195 survival_time_mean 23.200000000000195 survival_time_min 23.200000000000195
No reset possible 15131
789
Andrea Daniele template-pytorch aido-LF-sim-validation
sim-3of4 success no davinci-stage-02-6.2.51
2022-11-24 22:58:42+00:00 2022-11-24 23:01:22+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1569795760307584 survival_time_median 12.500000000000044 deviation-center-line_median 0.12327981781960703 in-drivable-lane_median 10.800000000000043
other stats deviation-center-line_max 0.12327981781960703 deviation-center-line_mean 0.12327981781960703 deviation-center-line_min 0.12327981781960703 deviation-heading_max 1.492732963290677 deviation-heading_mean 1.492732963290677 deviation-heading_median 1.492732963290677 deviation-heading_min 1.492732963290677 distance-from-start_max 1.484420944815153 distance-from-start_mean 1.484420944815153 distance-from-start_median 1.484420944815153 distance-from-start_min 1.484420944815153 driven_any_max 2.685359363459636 driven_any_mean 2.685359363459636 driven_any_median 2.685359363459636 driven_any_min 2.685359363459636 driven_lanedir_consec_max 0.1569795760307584 driven_lanedir_consec_mean 0.1569795760307584 driven_lanedir_consec_min 0.1569795760307584 driven_lanedir_max 0.1569795760307584 driven_lanedir_mean 0.1569795760307584 driven_lanedir_median 0.1569795760307584 driven_lanedir_min 0.1569795760307584 in-drivable-lane_max 10.800000000000043 in-drivable-lane_mean 10.800000000000043 in-drivable-lane_min 10.800000000000043 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.685359363459636, "survival_time": 12.500000000000044, "driven_lanedir": 0.1569795760307584, "in-drivable-lane": 10.800000000000043, "deviation-heading": 1.492732963290677, "distance-from-start": 1.484420944815153, "deviation-center-line": 0.12327981781960703, "driven_lanedir_consec": 0.1569795760307584}}simulation-passed 1 survival_time_max 12.500000000000044 survival_time_mean 12.500000000000044 survival_time_min 12.500000000000044
No reset possible 15129
789
Andrea Daniele template-pytorch aido-LF-sim-validation
sim-0of4 success no davinci-stage-02-6.2.51
2022-11-24 22:54:12+00:00 2022-11-24 22:58:35+00:00 0:04:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.349688022257692 survival_time_median 20.950000000000163 deviation-center-line_median 0.6006507756461805 in-drivable-lane_median 11.10000000000009
other stats deviation-center-line_max 0.6006507756461805 deviation-center-line_mean 0.6006507756461805 deviation-center-line_min 0.6006507756461805 deviation-heading_max 7.0903045336325015 deviation-heading_mean 7.0903045336325015 deviation-heading_median 7.0903045336325015 deviation-heading_min 7.0903045336325015 distance-from-start_max 0.3023953122957024 distance-from-start_mean 0.3023953122957024 distance-from-start_median 0.3023953122957024 distance-from-start_min 0.3023953122957024 driven_any_max 4.153401306723025 driven_any_mean 4.153401306723025 driven_any_median 4.153401306723025 driven_any_min 4.153401306723025 driven_lanedir_consec_max 1.349688022257692 driven_lanedir_consec_mean 1.349688022257692 driven_lanedir_consec_min 1.349688022257692 driven_lanedir_max 1.349688022257692 driven_lanedir_mean 1.349688022257692 driven_lanedir_median 1.349688022257692 driven_lanedir_min 1.349688022257692 in-drivable-lane_max 11.10000000000009 in-drivable-lane_mean 11.10000000000009 in-drivable-lane_min 11.10000000000009 per-episodes details {"autolab-000-ego0": {"driven_any": 4.153401306723025, "survival_time": 20.950000000000163, "driven_lanedir": 1.349688022257692, "in-drivable-lane": 11.10000000000009, "deviation-heading": 7.0903045336325015, "distance-from-start": 0.3023953122957024, "deviation-center-line": 0.6006507756461805, "driven_lanedir_consec": 1.349688022257692}}simulation-passed 1 survival_time_max 20.950000000000163 survival_time_mean 20.950000000000163 survival_time_min 20.950000000000163
No reset possible 15071
1297
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 host-error yes davinci-stage-02-6.2.51
2022-11-24 19:41:12+00:00 2022-11-24 19:41:54+00:00 0:00:42 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d tag 2022_11_24_17_26_06
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible