Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 16663
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 host-error yes davinci-stage-05-6.2.51
2022-11-28 17:05:17+00:00 2022-11-28 17:05:18+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16655
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 host-error yes davinci-stage-05-6.2.51
2022-11-28 17:04:56+00:00 2022-11-28 17:04:57+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16650
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-0of3 host-error yes davinci-stage-05-6.2.51
2022-11-28 17:04:22+00:00 2022-11-28 17:04:23+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16648
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-3of4 timeout yes davinci-stage-05-6.2.51
2022-11-28 03:11:49+00:00 - - - - No reset possible 16642
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 03:05:30+00:00 2022-11-28 03:11:20+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.599999999999376 in-drivable-lane_median 3.099999999999902 driven_lanedir_consec_median 2.1822085786120473 deviation-center-line_median 4.281969506383752
other stats deviation-center-line_max 4.281969506383752 deviation-center-line_mean 4.281969506383752 deviation-center-line_min 4.281969506383752 deviation-heading_max 8.956926170181262 deviation-heading_mean 8.956926170181262 deviation-heading_median 8.956926170181262 deviation-heading_min 8.956926170181262 distance-from-start_max 1.84932503046977 distance-from-start_mean 1.84932503046977 distance-from-start_median 1.84932503046977 distance-from-start_min 1.84932503046977 driven_any_max 2.760582128240964 driven_any_mean 2.760582128240964 driven_any_median 2.760582128240964 driven_any_min 2.760582128240964 driven_lanedir_consec_max 2.1822085786120473 driven_lanedir_consec_mean 2.1822085786120473 driven_lanedir_consec_min 2.1822085786120473 driven_lanedir_max 2.5502818256429407 driven_lanedir_mean 2.5502818256429407 driven_lanedir_median 2.5502818256429407 driven_lanedir_min 2.5502818256429407 in-drivable-lane_max 3.099999999999902 in-drivable-lane_mean 3.099999999999902 in-drivable-lane_min 3.099999999999902 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}simulation-passed 1 survival_time_max 48.599999999999376 survival_time_mean 48.599999999999376 survival_time_min 48.599999999999376
No reset possible 16637
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:56:50+00:00 2022-11-28 03:05:17+00:00 0:08:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091626784820886 deviation-center-line_median 5.917240573756968
other stats deviation-center-line_max 5.917240573756968 deviation-center-line_mean 5.917240573756968 deviation-center-line_min 5.917240573756968 deviation-heading_max 8.389433025698892 deviation-heading_mean 8.389433025698892 deviation-heading_median 8.389433025698892 deviation-heading_min 8.389433025698892 distance-from-start_max 1.0307831250305386 distance-from-start_mean 1.0307831250305386 distance-from-start_median 1.0307831250305386 distance-from-start_min 1.0307831250305386 driven_any_max 3.4490819837243656 driven_any_mean 3.4490819837243656 driven_any_median 3.4490819837243656 driven_any_min 3.4490819837243656 driven_lanedir_consec_max 2.091626784820886 driven_lanedir_consec_mean 2.091626784820886 driven_lanedir_consec_min 2.091626784820886 driven_lanedir_max 3.203992280226659 driven_lanedir_mean 3.203992280226659 driven_lanedir_median 3.203992280226659 driven_lanedir_min 3.203992280226659 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16634
1703
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:49:12+00:00 2022-11-28 02:56:38+00:00 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.548233752078826 deviation-center-line_median 3.912747138035832
other stats deviation-center-line_max 3.912747138035832 deviation-center-line_mean 3.912747138035832 deviation-center-line_min 3.912747138035832 deviation-heading_max 4.215826059025193 deviation-heading_mean 4.215826059025193 deviation-heading_median 4.215826059025193 deviation-heading_min 4.215826059025193 distance-from-start_max 2.339774613830501 distance-from-start_mean 2.339774613830501 distance-from-start_median 2.339774613830501 distance-from-start_min 2.339774613830501 driven_any_max 3.5795947794156975 driven_any_mean 3.5795947794156975 driven_any_median 3.5795947794156975 driven_any_min 3.5795947794156975 driven_lanedir_consec_max 3.548233752078826 driven_lanedir_consec_mean 3.548233752078826 driven_lanedir_consec_min 3.548233752078826 driven_lanedir_max 3.555210141629624 driven_lanedir_mean 3.555210141629624 driven_lanedir_median 3.555210141629624 driven_lanedir_min 3.555210141629624 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.5795947794156975, "survival_time": 59.99999999999873, "driven_lanedir": 3.555210141629624, "in-drivable-lane": 0.0, "deviation-heading": 4.215826059025193, "distance-from-start": 2.339774613830501, "deviation-center-line": 3.912747138035832, "driven_lanedir_consec": 3.548233752078826}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16626
1705
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:32:43+00:00 2022-11-28 02:49:05+00:00 0:16:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.9999999999999432 driven_lanedir_consec_median 2.7698955282609887 deviation-center-line_median 5.138314652956844
other stats deviation-center-line_max 5.756194777372426 deviation-center-line_mean 5.209270854058739 deviation-center-line_min 4.804259332948843 deviation-heading_max 6.908634530888926 deviation-heading_mean 4.98100070740749 deviation-heading_median 4.854233439147025 deviation-heading_min 3.306901420446983 distance-from-start_max 2.3695697937288083 distance-from-start_mean 1.915876448579448 distance-from-start_median 1.8549502450769235 distance-from-start_min 1.584035510435136 driven_any_max 3.579595424156211 driven_any_mean 3.3748668292703963 driven_any_median 3.501638142781199 driven_any_min 2.916595607362977 driven_lanedir_consec_max 3.5364749076240765 driven_lanedir_consec_mean 2.8157555010672786 driven_lanedir_consec_min 2.1867560401230626 driven_lanedir_max 3.5633303928470905 driven_lanedir_mean 3.282461667675166 driven_lanedir_median 3.333349215260178 driven_lanedir_min 2.899817847333218 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 1.312499999999961 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.483691022698869, "survival_time": 59.99999999999873, "driven_lanedir": 3.2991131995927705, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.230770184307429, "distance-from-start": 1.62980092342675, "deviation-center-line": 5.756194777372426, "driven_lanedir_consec": 2.1867560401230626}, "udem-000-ego1": {"driven_any": 3.579595424156211, "survival_time": 59.99999999999873, "driven_lanedir": 3.5633303928470905, "in-drivable-lane": 0.0, "deviation-heading": 3.306901420446983, "distance-from-start": 2.3695697937288083, "deviation-center-line": 4.804259332948843, "driven_lanedir_consec": 3.5364749076240765}, "udem-000-ego2": {"driven_any": 2.916595607362977, "survival_time": 59.99999999999873, "driven_lanedir": 2.899817847333218, "in-drivable-lane": 0.0, "deviation-heading": 3.477696693986621, "distance-from-start": 1.584035510435136, "deviation-center-line": 4.959405407533967, "driven_lanedir_consec": 2.883822177258341}, "udem-000-ego3": {"driven_any": 3.519585262863529, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675852309275847, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908634530888926, "distance-from-start": 2.080099566727098, "deviation-center-line": 5.317223898379722, "driven_lanedir_consec": 2.655968879263636}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16620
1706
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:27:20+00:00 2022-11-28 02:32:28+00:00 0:05:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0916627772105003 deviation-center-line_median 5.917247390668543
other stats deviation-center-line_max 5.917247390668543 deviation-center-line_mean 5.917247390668543 deviation-center-line_min 5.917247390668543 deviation-heading_max 8.389432170044804 deviation-heading_mean 8.389432170044804 deviation-heading_median 8.389432170044804 deviation-heading_min 8.389432170044804 distance-from-start_max 1.030783297990397 distance-from-start_mean 1.030783297990397 distance-from-start_median 1.030783297990397 distance-from-start_min 1.030783297990397 driven_any_max 3.4490819837251045 driven_any_mean 3.4490819837251045 driven_any_median 3.4490819837251045 driven_any_min 3.4490819837251045 driven_lanedir_consec_max 2.0916627772105003 driven_lanedir_consec_mean 2.0916627772105003 driven_lanedir_consec_min 2.0916627772105003 driven_lanedir_max 3.204014087213283 driven_lanedir_mean 3.204014087213283 driven_lanedir_median 3.204014087213283 driven_lanedir_min 3.204014087213283 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819837251045, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014087213283, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432170044804, "distance-from-start": 1.030783297990397, "deviation-center-line": 5.917247390668543, "driven_lanedir_consec": 2.0916627772105003}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16610
1710
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:16:54+00:00 2022-11-28 02:26:46+00:00 0:09:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.0889200570209905 deviation-center-line_median 4.314589046654948
other stats deviation-center-line_max 4.8936832240285515 deviation-center-line_mean 4.21123266117369 deviation-center-line_min 3.322069327356314 deviation-heading_max 4.486523530569267 deviation-heading_mean 3.521671102618294 deviation-heading_median 3.585810169469168 deviation-heading_min 2.4285405409655727 distance-from-start_max 2.3451607383802098 distance-from-start_mean 2.0486952679802566 distance-from-start_median 2.129939218686506 distance-from-start_min 1.5897418961678045 driven_any_max 3.5795869614824305 driven_any_mean 3.25109025299247 driven_any_median 3.2660893638644968 driven_any_min 2.8925953227584573 driven_lanedir_consec_max 3.397941501351981 driven_lanedir_consec_mean 3.109352247171395 driven_lanedir_consec_min 2.8616273732916166 driven_lanedir_max 3.5621601978351585 driven_lanedir_mean 3.221959634688333 driven_lanedir_median 3.226336335661105 driven_lanedir_min 2.873005669595961 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 0.27499999999998437 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.9525969188333514, "survival_time": 59.99999999999873, "driven_lanedir": 2.895716604572407, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4285405409655727, "distance-from-start": 2.3451607383802098, "deviation-center-line": 4.511140920492081, "driven_lanedir_consec": 2.895716415698084}, "4way-001-ego1": {"driven_any": 2.8925953227584573, "survival_time": 59.99999999999873, "driven_lanedir": 2.873005669595961, "in-drivable-lane": 0.0, "deviation-heading": 3.9504849161101903, "distance-from-start": 1.5897418961678045, "deviation-center-line": 4.8936832240285515, "driven_lanedir_consec": 2.8616273732916166}, "4way-001-ego2": {"driven_any": 3.5795869614824305, "survival_time": 59.99999999999873, "driven_lanedir": 3.556956066749803, "in-drivable-lane": 0.0, "deviation-heading": 4.486523530569267, "distance-from-start": 2.2859218093052247, "deviation-center-line": 4.1180371728178145, "driven_lanedir_consec": 3.397941501351981}, "4way-001-ego3": {"driven_any": 3.579581808895642, "survival_time": 59.99999999999873, "driven_lanedir": 3.5621601978351585, "in-drivable-lane": 0.0, "deviation-heading": 3.221135422828146, "distance-from-start": 1.9739566280677876, "deviation-center-line": 3.322069327356314, "driven_lanedir_consec": 3.282123698343897}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16604
1711
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:06:56+00:00 2022-11-28 02:16:38+00:00 0:09:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.29523972955995 deviation-center-line_median 3.2365915346637033
other stats deviation-center-line_max 3.2365915346637033 deviation-center-line_mean 3.2365915346637033 deviation-center-line_min 3.2365915346637033 deviation-heading_max 2.8126081910568588 deviation-heading_mean 2.8126081910568588 deviation-heading_median 2.8126081910568588 deviation-heading_min 2.8126081910568588 distance-from-start_max 2.0188492106698117 distance-from-start_mean 2.0188492106698117 distance-from-start_median 2.0188492106698117 distance-from-start_min 2.0188492106698117 driven_any_max 3.5795821627460884 driven_any_mean 3.5795821627460884 driven_any_median 3.5795821627460884 driven_any_min 3.5795821627460884 driven_lanedir_consec_max 3.29523972955995 driven_lanedir_consec_mean 3.29523972955995 driven_lanedir_consec_min 3.29523972955995 driven_lanedir_max 3.5654143377633662 driven_lanedir_mean 3.5654143377633662 driven_lanedir_median 3.5654143377633662 driven_lanedir_min 3.5654143377633662 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 3.5795821627460884, "survival_time": 59.99999999999873, "driven_lanedir": 3.5654143377633662, "in-drivable-lane": 0.0, "deviation-heading": 2.8126081910568588, "distance-from-start": 2.0188492106698117, "deviation-center-line": 3.2365915346637033, "driven_lanedir_consec": 3.29523972955995}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16601
1713
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:04:42+00:00 2022-11-28 02:06:29+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.850000000000048 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7038638560362473 deviation-center-line_median 0.4396047224602857
other stats deviation-center-line_max 0.4396047224602857 deviation-center-line_mean 0.4396047224602857 deviation-center-line_min 0.4396047224602857 deviation-heading_max 0.7151205809324869 deviation-heading_mean 0.7151205809324869 deviation-heading_median 0.7151205809324869 deviation-heading_min 0.7151205809324869 distance-from-start_max 0.7045347730331369 distance-from-start_mean 0.7045347730331369 distance-from-start_median 0.7045347730331369 distance-from-start_min 0.7045347730331369 driven_any_max 0.708599276888723 driven_any_mean 0.708599276888723 driven_any_median 0.708599276888723 driven_any_min 0.708599276888723 driven_lanedir_consec_max 0.7038638560362473 driven_lanedir_consec_mean 0.7038638560362473 driven_lanedir_consec_min 0.7038638560362473 driven_lanedir_max 0.7038638560362473 driven_lanedir_mean 0.7038638560362473 driven_lanedir_median 0.7038638560362473 driven_lanedir_min 0.7038638560362473 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.708599276888723, "survival_time": 12.850000000000048, "driven_lanedir": 0.7038638560362473, "in-drivable-lane": 0.0, "deviation-heading": 0.7151205809324869, "distance-from-start": 0.7045347730331369, "deviation-center-line": 0.4396047224602857, "driven_lanedir_consec": 0.7038638560362473}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 16596
1714
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 02:00:30+00:00 2022-11-28 02:04:22+00:00 0:03:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 1.601745896224546 deviation-center-line_median 5.338593212765516
other stats deviation-center-line_max 5.338593212765516 deviation-center-line_mean 5.338593212765516 deviation-center-line_min 5.338593212765516 deviation-heading_max 6.235252951727364 deviation-heading_mean 6.235252951727364 deviation-heading_median 6.235252951727364 deviation-heading_min 6.235252951727364 distance-from-start_max 1.390965508634873 distance-from-start_mean 1.390965508634873 distance-from-start_median 1.390965508634873 distance-from-start_min 1.390965508634873 driven_any_max 3.4836910006517208 driven_any_mean 3.4836910006517208 driven_any_median 3.4836910006517208 driven_any_min 3.4836910006517208 driven_lanedir_consec_max 1.601745896224546 driven_lanedir_consec_mean 1.601745896224546 driven_lanedir_consec_min 1.601745896224546 driven_lanedir_max 3.2989420775531983 driven_lanedir_mean 3.2989420775531983 driven_lanedir_median 3.2989420775531983 driven_lanedir_min 3.2989420775531983 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"loop-000-ego0": {"driven_any": 3.4836910006517208, "survival_time": 59.99999999999873, "driven_lanedir": 3.2989420775531983, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.235252951727364, "distance-from-start": 1.390965508634873, "deviation-center-line": 5.338593212765516, "driven_lanedir_consec": 1.601745896224546}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16588
1716
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:50:37+00:00 2022-11-28 02:00:08+00:00 0:09:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5500000000000078 driven_lanedir_consec_median 2.825841304293628 deviation-center-line_median 6.148412844000683
other stats deviation-center-line_max 7.459308588139718 deviation-center-line_mean 5.79704956898892 deviation-center-line_min 3.4320639998145963 deviation-heading_max 5.71924387882506 deviation-heading_mean 3.762143800377421 deviation-heading_median 3.459178970777112 deviation-heading_min 2.410973381130398 distance-from-start_max 2.3395282410041216 distance-from-start_mean 1.7201588165346102 distance-from-start_median 1.841509860392298 distance-from-start_min 0.8580873043497238 driven_any_max 3.579593143168887 driven_any_mean 2.845719156432434 driven_any_median 2.859597815206898 driven_any_min 2.0840878521470536 driven_lanedir_consec_max 3.541021205942728 driven_lanedir_consec_mean 2.496966407955825 driven_lanedir_consec_min 0.795161817293316 driven_lanedir_max 3.5571658869822893 driven_lanedir_mean 2.7899921003455295 driven_lanedir_median 2.8258414934613327 driven_lanedir_min 1.9511195274771624 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.7875000000000112 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 2.889596951730418, "survival_time": 59.99999999999873, "driven_lanedir": 2.8328219934740586, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.497059451447388, "distance-from-start": 2.1662522780274744, "deviation-center-line": 7.459308588139718, "driven_lanedir_consec": 2.8328219934740586}, "udem-001-ego1": {"driven_any": 2.0840878521470536, "survival_time": 59.99999999999873, "driven_lanedir": 1.9511195274771624, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.71924387882506, "distance-from-start": 0.8580873043497238, "deviation-center-line": 6.835139580883994, "driven_lanedir_consec": 0.795161817293316}, "udem-001-ego2": {"driven_any": 2.8295986786833778, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486073, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130398, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113197}, "udem-001-ego3": {"driven_any": 3.579593143168887, "survival_time": 59.99999999999873, "driven_lanedir": 3.5571658869822893, "in-drivable-lane": 0.0, "deviation-heading": 4.421298490106836, "distance-from-start": 1.5167674427571216, "deviation-center-line": 3.4320639998145963, "driven_lanedir_consec": 3.541021205942728}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16581
1717
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:41:58+00:00 2022-11-28 01:50:10+00:00 0:08:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.74999999999931 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 2.833004579842016 deviation-center-line_median 4.613202410731162
other stats deviation-center-line_max 4.613202410731162 deviation-center-line_mean 4.613202410731162 deviation-center-line_min 4.613202410731162 deviation-heading_max 2.4939487126008157 deviation-heading_mean 2.4939487126008157 deviation-heading_median 2.4939487126008157 deviation-heading_min 2.4939487126008157 distance-from-start_max 2.3401405715621477 distance-from-start_mean 2.3401405715621477 distance-from-start_median 2.3401405715621477 distance-from-start_min 2.3401405715621477 driven_any_max 2.889596956965826 driven_any_mean 2.889596956965826 driven_any_median 2.889596956965826 driven_any_min 2.889596956965826 driven_lanedir_consec_max 2.833004579842016 driven_lanedir_consec_mean 2.833004579842016 driven_lanedir_consec_min 2.833004579842016 driven_lanedir_max 2.833004579842016 driven_lanedir_mean 2.833004579842016 driven_lanedir_median 2.833004579842016 driven_lanedir_min 2.833004579842016 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 1.0999999999999377 in-drivable-lane_min 1.0999999999999377 per-episodes details {"4way-001-ego0": {"driven_any": 2.889596956965826, "survival_time": 49.74999999999931, "driven_lanedir": 2.833004579842016, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939487126008157, "distance-from-start": 2.3401405715621477, "deviation-center-line": 4.613202410731162, "driven_lanedir_consec": 2.833004579842016}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 16574
1719
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:30:54+00:00 2022-11-28 01:41:44+00:00 0:10:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.305795356040574 deviation-center-line_median 7.1542258236818705
other stats deviation-center-line_max 7.1542258236818705 deviation-center-line_mean 7.1542258236818705 deviation-center-line_min 7.1542258236818705 deviation-heading_max 5.348097044239231 deviation-heading_mean 5.348097044239231 deviation-heading_median 5.348097044239231 deviation-heading_min 5.348097044239231 distance-from-start_max 1.6303676290838451 distance-from-start_mean 1.6303676290838451 distance-from-start_median 1.6303676290838451 distance-from-start_min 1.6303676290838451 driven_any_max 3.4760910958010065 driven_any_mean 3.4760910958010065 driven_any_median 3.4760910958010065 driven_any_min 3.4760910958010065 driven_lanedir_consec_max 3.305795356040574 driven_lanedir_consec_mean 3.305795356040574 driven_lanedir_consec_min 3.305795356040574 driven_lanedir_max 3.305795356040574 driven_lanedir_mean 3.305795356040574 driven_lanedir_median 3.305795356040574 driven_lanedir_min 3.305795356040574 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"autolab-000-ego0": {"driven_any": 3.4760910958010065, "survival_time": 59.99999999999873, "driven_lanedir": 3.305795356040574, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097044239231, "distance-from-start": 1.6303676290838451, "deviation-center-line": 7.1542258236818705, "driven_lanedir_consec": 3.305795356040574}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16571
1720
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:25:15+00:00 2022-11-28 01:30:25+00:00 0:05:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091675968172336 deviation-center-line_median 5.914160547874868
other stats deviation-center-line_max 5.914160547874868 deviation-center-line_mean 5.914160547874868 deviation-center-line_min 5.914160547874868 deviation-heading_max 8.38876582052179 deviation-heading_mean 8.38876582052179 deviation-heading_median 8.38876582052179 deviation-heading_min 8.38876582052179 distance-from-start_max 1.0308143802054677 distance-from-start_mean 1.0308143802054677 distance-from-start_median 1.0308143802054677 distance-from-start_min 1.0308143802054677 driven_any_max 3.4490819834539503 driven_any_mean 3.4490819834539503 driven_any_median 3.4490819834539503 driven_any_min 3.4490819834539503 driven_lanedir_consec_max 2.091675968172336 driven_lanedir_consec_mean 2.091675968172336 driven_lanedir_consec_min 2.091675968172336 driven_lanedir_max 3.204051662096265 driven_lanedir_mean 3.204051662096265 driven_lanedir_median 3.204051662096265 driven_lanedir_min 3.204051662096265 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819834539503, "survival_time": 59.99999999999873, "driven_lanedir": 3.204051662096265, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.38876582052179, "distance-from-start": 1.0308143802054677, "deviation-center-line": 5.914160547874868, "driven_lanedir_consec": 2.091675968172336}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16567
1721
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:21:00+00:00 2022-11-28 01:24:43+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091631317677411 deviation-center-line_median 5.914152927086772
other stats deviation-center-line_max 5.914152927086772 deviation-center-line_mean 5.914152927086772 deviation-center-line_min 5.914152927086772 deviation-heading_max 8.388766833741702 deviation-heading_mean 8.388766833741702 deviation-heading_median 8.388766833741702 deviation-heading_min 8.388766833741702 distance-from-start_max 1.0308142273247416 distance-from-start_mean 1.0308142273247416 distance-from-start_median 1.0308142273247416 distance-from-start_min 1.0308142273247416 driven_any_max 3.449081983452879 driven_any_mean 3.449081983452879 driven_any_median 3.449081983452879 driven_any_min 3.449081983452879 driven_lanedir_consec_max 2.091631317677411 driven_lanedir_consec_mean 2.091631317677411 driven_lanedir_consec_min 2.091631317677411 driven_lanedir_max 3.203997570451749 driven_lanedir_mean 3.203997570451749 driven_lanedir_median 3.203997570451749 driven_lanedir_min 3.203997570451749 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.449081983452879, "survival_time": 59.99999999999873, "driven_lanedir": 3.203997570451749, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.388766833741702, "distance-from-start": 1.0308142273247416, "deviation-center-line": 5.914152927086772, "driven_lanedir_consec": 2.091631317677411}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16563
1722
Bea Baselines 🐤minimal-agent-state aido-hello-sim-state-validation
sanity-check success yes davinci-stage-05-6.2.51
2022-11-28 01:19:16+00:00 2022-11-28 01:20:42+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.010100888678529872 deviation-center-line_median 0.00637454737911999
other stats deviation-center-line_max 0.00637454737911999 deviation-center-line_mean 0.00637454737911999 deviation-center-line_min 0.00637454737911999 deviation-heading_max 0.2614212407761817 deviation-heading_mean 0.2614212407761817 deviation-heading_median 0.2614212407761817 deviation-heading_min 0.2614212407761817 distance-from-start_max 0.011536496219628309 distance-from-start_mean 0.011536496219628309 distance-from-start_median 0.011536496219628309 distance-from-start_min 0.011536496219628309 driven_any_max 0.011538646402324344 driven_any_mean 0.011538646402324344 driven_any_median 0.011538646402324344 driven_any_min 0.011538646402324344 driven_lanedir_consec_max 0.010100888678529872 driven_lanedir_consec_mean 0.010100888678529872 driven_lanedir_consec_min 0.010100888678529872 driven_lanedir_max 0.010100888678529872 driven_lanedir_mean 0.010100888678529872 driven_lanedir_median 0.010100888678529872 driven_lanedir_min 0.010100888678529872 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.011538646402324344, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100888678529872, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628309, "deviation-center-line": 0.00637454737911999, "driven_lanedir_consec": 0.010100888678529872}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16558
1724
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:16:48+00:00 2022-11-28 01:19:10+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.3499999999999925 in-drivable-lane_median 2.5999999999999917 driven_lanedir_consec_median 0.1995533883076508 deviation-center-line_median 0.12567493837705537
other stats deviation-center-line_max 0.12567493837705537 deviation-center-line_mean 0.12567493837705537 deviation-center-line_min 0.12567493837705537 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.5484102917810773 distance-from-start_mean 0.5484102917810773 distance-from-start_median 0.5484102917810773 distance-from-start_min 0.5484102917810773 driven_any_max 0.5484215635455908 driven_any_mean 0.5484215635455908 driven_any_median 0.5484215635455908 driven_any_min 0.5484215635455908 driven_lanedir_consec_max 0.1995533883076508 driven_lanedir_consec_mean 0.1995533883076508 driven_lanedir_consec_min 0.1995533883076508 driven_lanedir_max 0.1995533883076508 driven_lanedir_mean 0.1995533883076508 driven_lanedir_median 0.1995533883076508 driven_lanedir_min 0.1995533883076508 in-drivable-lane_max 2.5999999999999917 in-drivable-lane_mean 2.5999999999999917 in-drivable-lane_min 2.5999999999999917 per-episodes details {"udem-000-ego0": {"driven_any": 0.5484215635455908, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1995533883076508, "in-drivable-lane": 2.5999999999999917, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.5484102917810773, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.1995533883076508}}simulation-passed 1 survival_time_max 4.3499999999999925 survival_time_mean 4.3499999999999925 survival_time_min 4.3499999999999925
No reset possible 16547
1727
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:11:19+00:00 2022-11-28 01:16:39+00:00 0:05:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.95000000000015 in-drivable-lane_median 15.575000000000143 driven_lanedir_consec_median 0.3010218083101922 deviation-center-line_median 0.3970118868681207
other stats deviation-center-line_max 2.2346112831306932 deviation-center-line_mean 0.7885775545340169 deviation-center-line_min 0.12567516126913286 deviation-heading_max 4.797258948144445 deviation-heading_mean 2.707299691495644 deviation-heading_median 2.642065173445396 deviation-heading_min 0.7478094709473367 distance-from-start_max 3.129125828735781 distance-from-start_mean 1.1662292771696292 distance-from-start_median 0.5771403828427081 distance-from-start_min 0.3815105142573194 driven_any_max 3.129843909463842 driven_any_mean 1.166415544369201 driven_any_median 0.5771503990770468 driven_any_min 0.3815174698588687 driven_lanedir_consec_max 0.7928447585809935 driven_lanedir_consec_mean 0.3886457893287136 driven_lanedir_consec_min 0.15969478211347665 driven_lanedir_max 0.8014890585195535 driven_lanedir_mean 0.39080686431335365 driven_lanedir_median 0.3010218083101922 driven_lanedir_min 0.15969478211347665 in-drivable-lane_max 18.50000000000015 in-drivable-lane_mean 12.412500000000112 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.3815174698588687, "survival_time": 19.95000000000015, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 18.20000000000015, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3815105142573194, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.7395025092531806, "survival_time": 19.95000000000015, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 18.50000000000015, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.7394902813305423, "deviation-center-line": 0.13562525098197173, "driven_lanedir_consec": 0.15969478211347665}, "udem-000-ego2": {"driven_any": 0.41479828890091297, "survival_time": 19.95000000000015, "driven_lanedir": 0.4024921356613664, "in-drivable-lane": 0.0, "deviation-heading": 4.797258948144445, "distance-from-start": 0.4147904843548739, "deviation-center-line": 2.2346112831306932, "driven_lanedir_consec": 0.4024921356613664}, "udem-000-ego3": {"driven_any": 3.129843909463842, "survival_time": 19.95000000000015, "driven_lanedir": 0.8014890585195535, "in-drivable-lane": 12.95000000000014, "deviation-heading": 4.335308391332746, "distance-from-start": 3.129125828735781, "deviation-center-line": 0.6583985227542697, "driven_lanedir_consec": 0.7928447585809935}}simulation-passed 1 survival_time_max 19.95000000000015 survival_time_mean 19.95000000000015 survival_time_min 19.95000000000015
No reset possible 16541
1728
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:06:20+00:00 2022-11-28 01:11:05+00:00 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.500000000000128 in-drivable-lane_median 16.02500000000013 driven_lanedir_consec_median 0.33013236525205236 deviation-center-line_median 0.20320251005949427
other stats deviation-center-line_max 0.2757414134419884 deviation-center-line_mean 0.20195540399126405 deviation-center-line_min 0.1256751824040792 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.8390919152844039 deviation-heading_median 0.8356409085548375 deviation-heading_min 0.7362638884698943 distance-from-start_max 2.887473103882224 distance-from-start_mean 1.46815084792022 distance-from-start_median 1.392449957467867 distance-from-start_min 0.20023037286292217 driven_any_max 2.8881823443375616 driven_any_mean 1.4683701164599607 driven_any_median 1.3925323730139962 driven_any_min 0.20023337547428863 driven_lanedir_consec_max 0.5392562706966588 driven_lanedir_consec_mean 0.33980394582856005 driven_lanedir_consec_min 0.15969478211347665 driven_lanedir_max 0.5392562706966588 driven_lanedir_mean 0.33980394582856005 driven_lanedir_median 0.33013236525205236 driven_lanedir_min 0.15969478211347665 in-drivable-lane_max 17.05000000000013 in-drivable-lane_mean 15.97500000000013 in-drivable-lane_min 14.800000000000132 per-episodes details {"loop-000-ego0": {"driven_any": 1.092910469671116, "survival_time": 18.500000000000128, "driven_lanedir": 0.199555653284208, "in-drivable-lane": 16.750000000000128, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.0928555098331485, "deviation-center-line": 0.1256751824040792, "driven_lanedir_consec": 0.199555653284208}, "loop-000-ego1": {"driven_any": 0.20023337547428863, "survival_time": 18.500000000000128, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 17.05000000000013, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.20023037286292217, "deviation-center-line": 0.1356249107782697, "driven_lanedir_consec": 0.15969478211347665}, "loop-000-ego2": {"driven_any": 1.6921542763568764, "survival_time": 18.500000000000128, "driven_lanedir": 0.5392562706966588, "in-drivable-lane": 14.800000000000132, "deviation-heading": 0.9234723461623382, "distance-from-start": 1.6920444051025856, "deviation-center-line": 0.27078010934071883, "driven_lanedir_consec": 0.5392562706966588}, "loop-000-ego3": {"driven_any": 2.8881823443375616, "survival_time": 18.500000000000128, "driven_lanedir": 0.46070907721989673, "in-drivable-lane": 15.300000000000132, "deviation-heading": 0.7362638884698943, "distance-from-start": 2.887473103882224, "deviation-center-line": 0.2757414134419884, "driven_lanedir_consec": 0.46070907721989673}}simulation-passed 1 survival_time_max 18.500000000000128 survival_time_mean 18.500000000000128 survival_time_min 18.500000000000128
No reset possible 16538
1729
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:04:49+00:00 2022-11-28 01:06:13+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.299999999999989 in-drivable-lane_median 3.5499999999999883 driven_lanedir_consec_median 0.1995526730519679 deviation-center-line_median 0.12567493837705493
other stats deviation-center-line_max 0.12567493837705493 deviation-center-line_mean 0.12567493837705493 deviation-center-line_min 0.12567493837705493 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.7065171257852313 distance-from-start_mean 0.7065171257852313 distance-from-start_median 0.7065171257852313 distance-from-start_min 0.7065171257852313 driven_any_max 0.7065288976667109 driven_any_mean 0.7065288976667109 driven_any_median 0.7065288976667109 driven_any_min 0.7065288976667109 driven_lanedir_consec_max 0.1995526730519679 driven_lanedir_consec_mean 0.1995526730519679 driven_lanedir_consec_min 0.1995526730519679 driven_lanedir_max 0.1995526730519679 driven_lanedir_mean 0.1995526730519679 driven_lanedir_median 0.1995526730519679 driven_lanedir_min 0.1995526730519679 in-drivable-lane_max 3.5499999999999883 in-drivable-lane_mean 3.5499999999999883 in-drivable-lane_min 3.5499999999999883 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7065288976667109, "survival_time": 5.299999999999989, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 3.5499999999999883, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.7065171257852313, "deviation-center-line": 0.12567493837705493, "driven_lanedir_consec": 0.1995526730519679}}simulation-passed 1 survival_time_max 5.299999999999989 survival_time_mean 5.299999999999989 survival_time_min 5.299999999999989
No reset possible 16536
1729
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 01:03:04+00:00 2022-11-28 01:04:42+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.599999999999988 in-drivable-lane_median 4.149999999999988 driven_lanedir_consec_median 0.1397964307794325 deviation-center-line_median 0.0939067534990478
other stats deviation-center-line_max 0.0939067534990478 deviation-center-line_mean 0.0939067534990478 deviation-center-line_min 0.0939067534990478 deviation-heading_max 0.965418398279237 deviation-heading_mean 0.965418398279237 deviation-heading_median 0.965418398279237 deviation-heading_min 0.965418398279237 distance-from-start_max 0.7557867445766083 distance-from-start_mean 0.7557867445766083 distance-from-start_median 0.7557867445766083 distance-from-start_min 0.7557867445766083 driven_any_max 0.7557995755351957 driven_any_mean 0.7557995755351957 driven_any_median 0.7557995755351957 driven_any_min 0.7557995755351957 driven_lanedir_consec_max 0.1397964307794325 driven_lanedir_consec_mean 0.1397964307794325 driven_lanedir_consec_min 0.1397964307794325 driven_lanedir_max 0.1397964307794325 driven_lanedir_mean 0.1397964307794325 driven_lanedir_median 0.1397964307794325 driven_lanedir_min 0.1397964307794325 in-drivable-lane_max 4.149999999999988 in-drivable-lane_mean 4.149999999999988 in-drivable-lane_min 4.149999999999988 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7557995755351957, "survival_time": 5.599999999999988, "driven_lanedir": 0.1397964307794325, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.965418398279237, "distance-from-start": 0.7557867445766083, "deviation-center-line": 0.0939067534990478, "driven_lanedir_consec": 0.1397964307794325}}simulation-passed 1 survival_time_max 5.599999999999988 survival_time_mean 5.599999999999988 survival_time_min 5.599999999999988
No reset possible 16533
1732
Bea Baselines 🐤minimal-agent lx22-visservoing
sim success yes davinci-stage-05-6.2.51
2022-11-28 01:00:33+00:00 2022-11-28 01:02:38+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 2.6499999999999924 deviation-center-line_median 0.17493349275674216 driven_lanedir_consec_median 0.8221776345283069 survival_time_median 8.14999999999998
other stats deviation-center-line_max 0.17647811751212122 deviation-center-line_mean 0.17493349275674216 deviation-center-line_min 0.1733888680013631 deviation-heading_max 0.7383278077616701 deviation-heading_mean 0.7099934263375745 deviation-heading_median 0.7099934263375745 deviation-heading_min 0.681659044913479 distance-from-start_max 1.175276406473093 distance-from-start_mean 1.175237634650054 distance-from-start_median 1.175237634650054 distance-from-start_min 1.1751988628270151 driven_any_max 1.1755804280577309 driven_any_mean 1.175457669946736 driven_any_median 1.175457669946736 driven_any_min 1.175334911835741 driven_lanedir_consec_max 0.8828170026503562 driven_lanedir_consec_mean 0.8221776345283069 driven_lanedir_consec_min 0.7615382664062577 driven_lanedir_max 0.8828170026503562 driven_lanedir_mean 0.8221776345283069 driven_lanedir_median 0.8221776345283069 driven_lanedir_min 0.7615382664062577 in-drivable-lane_max 2.999999999999991 in-drivable-lane_mean 2.6499999999999924 in-drivable-lane_min 2.2999999999999936 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 1.1755804280577309, "survival_time": 8.14999999999998, "driven_lanedir": 0.7615382664062577, "in-drivable-lane": 2.999999999999991, "deviation-heading": 0.681659044913479, "distance-from-start": 1.1751988628270151, "deviation-center-line": 0.1733888680013631, "driven_lanedir_consec": 0.7615382664062577}, "LF-small-loop-001-ego0": {"driven_any": 1.175334911835741, "survival_time": 8.14999999999998, "driven_lanedir": 0.8828170026503562, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.7383278077616701, "distance-from-start": 1.175276406473093, "deviation-center-line": 0.17647811751212122, "driven_lanedir_consec": 0.8828170026503562}}simulation-passed 1 survival_time_max 8.14999999999998 survival_time_mean 8.14999999999998 survival_time_min 8.14999999999998
No reset possible 16524
1741
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:55:24+00:00 2022-11-28 01:00:05+00:00 0:04:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.950000000000106 in-drivable-lane_median 10.550000000000091 driven_lanedir_consec_median 0.8098306254279477 deviation-center-line_median 0.6056754982599343
other stats deviation-center-line_max 0.6056754982599343 deviation-center-line_mean 0.6056754982599343 deviation-center-line_min 0.6056754982599343 deviation-heading_max 3.6841553172183903 deviation-heading_mean 3.6841553172183903 deviation-heading_median 3.6841553172183903 deviation-heading_min 3.6841553172183903 distance-from-start_max 2.628171879536872 distance-from-start_mean 2.628171879536872 distance-from-start_median 2.628171879536872 distance-from-start_min 2.628171879536872 driven_any_max 2.628857921604552 driven_any_mean 2.628857921604552 driven_any_median 2.628857921604552 driven_any_min 2.628857921604552 driven_lanedir_consec_max 0.8098306254279477 driven_lanedir_consec_mean 0.8098306254279477 driven_lanedir_consec_min 0.8098306254279477 driven_lanedir_max 0.8098306254279477 driven_lanedir_mean 0.8098306254279477 driven_lanedir_median 0.8098306254279477 driven_lanedir_min 0.8098306254279477 in-drivable-lane_max 10.550000000000091 in-drivable-lane_mean 10.550000000000091 in-drivable-lane_min 10.550000000000091 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.628857921604552, "survival_time": 16.950000000000106, "driven_lanedir": 0.8098306254279477, "in-drivable-lane": 10.550000000000091, "deviation-heading": 3.6841553172183903, "distance-from-start": 2.628171879536872, "deviation-center-line": 0.6056754982599343, "driven_lanedir_consec": 0.8098306254279477}}simulation-passed 1 survival_time_max 16.950000000000106 survival_time_mean 16.950000000000106 survival_time_min 16.950000000000106
No reset possible 16520
1742
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:53:40+00:00 2022-11-28 00:55:11+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16515
1743
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:51:49+00:00 2022-11-28 00:53:21+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16511
1744
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:49:44+00:00 2022-11-28 00:51:43+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.3224736988087771 survival_time_median 15.250000000000082 deviation-center-line_median 0.2741150615740815 in-drivable-lane_median 12.100000000000056
other stats deviation-center-line_max 0.2741150615740815 deviation-center-line_mean 0.2741150615740815 deviation-center-line_min 0.2741150615740815 deviation-heading_max 2.486301423131022 deviation-heading_mean 2.486301423131022 deviation-heading_median 2.486301423131022 deviation-heading_min 2.486301423131022 distance-from-start_max 2.346684322024178 distance-from-start_mean 2.346684322024178 distance-from-start_median 2.346684322024178 distance-from-start_min 2.346684322024178 driven_any_max 2.3472858269950745 driven_any_mean 2.3472858269950745 driven_any_median 2.3472858269950745 driven_any_min 2.3472858269950745 driven_lanedir_consec_max 0.3224736988087771 driven_lanedir_consec_mean 0.3224736988087771 driven_lanedir_consec_min 0.3224736988087771 driven_lanedir_max 0.3224736988087771 driven_lanedir_mean 0.3224736988087771 driven_lanedir_median 0.3224736988087771 driven_lanedir_min 0.3224736988087771 in-drivable-lane_max 12.100000000000056 in-drivable-lane_mean 12.100000000000056 in-drivable-lane_min 12.100000000000056 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.3472858269950745, "survival_time": 15.250000000000082, "driven_lanedir": 0.3224736988087771, "in-drivable-lane": 12.100000000000056, "deviation-heading": 2.486301423131022, "distance-from-start": 2.346684322024178, "deviation-center-line": 0.2741150615740815, "driven_lanedir_consec": 0.3224736988087771}}simulation-passed 1 survival_time_max 15.250000000000082 survival_time_mean 15.250000000000082 survival_time_min 15.250000000000082
No reset possible 16506
1746
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:45:11+00:00 2022-11-28 00:49:38+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 10.375000000000036 driven_lanedir_consec_median 0.2917316817322182 deviation-center-line_median 0.3629004861869609
other stats deviation-center-line_max 0.8581383651069324 deviation-center-line_mean 0.42294435916773776 deviation-center-line_min 0.1078380991900969 deviation-heading_max 2.3443591222660065 deviation-heading_mean 1.288863217377771 deviation-heading_median 1.0259544132050231 deviation-heading_min 0.7591849208350303 distance-from-start_max 2.2726748388714895 distance-from-start_mean 0.9481278044889968 distance-from-start_median 0.535788907847825 distance-from-start_min 0.4482585633888487 driven_any_max 2.2731784865558287 driven_any_mean 0.9482607511676968 driven_any_median 0.5357988542299352 driven_any_min 0.4482668096550876 driven_lanedir_consec_max 1.1053767537677208 driven_lanedir_consec_mean 0.4508020778201367 driven_lanedir_consec_min 0.1143681940483896 driven_lanedir_max 1.1053767537677208 driven_lanedir_mean 0.4508020778201367 driven_lanedir_median 0.2917316817322182 driven_lanedir_min 0.1143681940483896 in-drivable-lane_max 13.600000000000076 in-drivable-lane_mean 8.587500000000038 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.4482668096550913, "survival_time": 14.800000000000075, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 13.400000000000077, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4482585633888487, "deviation-center-line": 0.1078380991900969, "driven_lanedir_consec": 0.13665955970746824}, "autolab-000-ego1": {"driven_any": 2.2731784865558287, "survival_time": 14.800000000000075, "driven_lanedir": 1.1053767537677208, "in-drivable-lane": 7.349999999999999, "deviation-heading": 2.3443591222660065, "distance-from-start": 2.2726748388714895, "deviation-center-line": 0.6095492402054283, "driven_lanedir_consec": 1.1053767537677208}, "autolab-000-ego2": {"driven_any": 0.4482668096550876, "survival_time": 14.800000000000075, "driven_lanedir": 0.44680380375696815, "in-drivable-lane": 0.0, "deviation-heading": 1.1011039835751082, "distance-from-start": 0.44825856338885, "deviation-center-line": 0.8581383651069324, "driven_lanedir_consec": 0.44680380375696815}, "autolab-000-ego3": {"driven_any": 0.6233308988047791, "survival_time": 14.800000000000075, "driven_lanedir": 0.1143681940483896, "in-drivable-lane": 13.600000000000076, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.11625173216849344, "driven_lanedir_consec": 0.1143681940483896}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 16503
1746
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:42:33+00:00 2022-11-28 00:45:05+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.650000000000002 in-drivable-lane_median 7.325000000000005 driven_lanedir_consec_median 0.22238961894840312 deviation-center-line_median 0.2217639861515468
other stats deviation-center-line_max 0.3356899474445727 deviation-center-line_mean 0.2217639861515468 deviation-center-line_min 0.10783802485852088 deviation-heading_max 2.3398302467533574 deviation-heading_mean 1.645317544794148 deviation-heading_median 1.645317544794148 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.4215609490996366 distance-from-start_mean 1.232352636856231 distance-from-start_median 1.232352636856231 distance-from-start_min 1.0431443246128251 driven_any_max 1.421667748584305 driven_any_mean 1.2324324663788455 driven_any_median 1.2324324663788455 driven_any_min 1.043197184173386 driven_lanedir_consec_max 0.3081134793062541 driven_lanedir_consec_mean 0.22238961894840312 driven_lanedir_consec_min 0.1366657585905522 driven_lanedir_max 0.3081134793062541 driven_lanedir_mean 0.22238961894840312 driven_lanedir_median 0.22238961894840312 driven_lanedir_min 0.1366657585905522 in-drivable-lane_max 8.250000000000002 in-drivable-lane_mean 7.325000000000005 in-drivable-lane_min 6.400000000000007 per-episodes details {"loop2-000-ego0": {"driven_any": 1.043197184173386, "survival_time": 9.650000000000002, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.250000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128251, "deviation-center-line": 0.10783802485852088, "driven_lanedir_consec": 0.1366657585905522}, "loop2-000-ego1": {"driven_any": 1.421667748584305, "survival_time": 9.650000000000002, "driven_lanedir": 0.3081134793062541, "in-drivable-lane": 6.400000000000007, "deviation-heading": 2.3398302467533574, "distance-from-start": 1.4215609490996366, "deviation-center-line": 0.3356899474445727, "driven_lanedir_consec": 0.3081134793062541}}simulation-passed 1 survival_time_max 9.650000000000002 survival_time_mean 9.650000000000002 survival_time_min 9.650000000000002
No reset possible 16501
1747
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:40:10+00:00 2022-11-28 00:41:58+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666480491623578 deviation-center-line_median 0.10783813033632964
other stats deviation-center-line_max 0.10783813033632964 deviation-center-line_mean 0.10783813033632964 deviation-center-line_min 0.10783813033632964 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.6182798682575148 distance-from-start_mean 1.6182798682575148 distance-from-start_median 1.6182798682575148 distance-from-start_min 1.6182798682575148 driven_any_max 1.618389277101394 driven_any_mean 1.618389277101394 driven_any_median 1.618389277101394 driven_any_min 1.618389277101394 driven_lanedir_consec_max 0.13666480491623578 driven_lanedir_consec_mean 0.13666480491623578 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.13666480491623578 driven_lanedir_mean 0.13666480491623578 driven_lanedir_median 0.13666480491623578 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"loop-000-ego0": {"driven_any": 1.618389277101394, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666480491623578}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 16499
1747
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:38:06+00:00 2022-11-28 00:39:56+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.15000000000001 in-drivable-lane_median 7.050000000000014 driven_lanedir_consec_median 0.3090241265730129 deviation-center-line_median 0.2686164080772624
other stats deviation-center-line_max 0.2686164080772624 deviation-center-line_mean 0.2686164080772624 deviation-center-line_min 0.2686164080772624 deviation-heading_max 2.49953375601749 deviation-heading_mean 2.49953375601749 deviation-heading_median 2.49953375601749 deviation-heading_min 2.49953375601749 distance-from-start_max 1.5040665006803369 distance-from-start_mean 1.5040665006803369 distance-from-start_median 1.5040665006803369 distance-from-start_min 1.5040665006803369 driven_any_max 1.5041747780934245 driven_any_mean 1.5041747780934245 driven_any_median 1.5041747780934245 driven_any_min 1.5041747780934245 driven_lanedir_consec_max 0.3090241265730129 driven_lanedir_consec_mean 0.3090241265730129 driven_lanedir_consec_min 0.3090241265730129 driven_lanedir_max 0.3090241265730129 driven_lanedir_mean 0.3090241265730129 driven_lanedir_median 0.3090241265730129 driven_lanedir_min 0.3090241265730129 in-drivable-lane_max 7.050000000000014 in-drivable-lane_mean 7.050000000000014 in-drivable-lane_min 7.050000000000014 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.5041747780934245, "survival_time": 10.15000000000001, "driven_lanedir": 0.3090241265730129, "in-drivable-lane": 7.050000000000014, "deviation-heading": 2.49953375601749, "distance-from-start": 1.5040665006803369, "deviation-center-line": 0.2686164080772624, "driven_lanedir_consec": 0.3090241265730129}}simulation-passed 1 survival_time_max 10.15000000000001 survival_time_mean 10.15000000000001 survival_time_min 10.15000000000001
No reset possible 16482
1752
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-28 00:17:26+00:00 2022-11-28 00:37:58+00:00 0:20:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 47.32499999999884 driven_lanedir_consec_median 0.11625464645611527 deviation-center-line_median 0.537178081616765
other stats deviation-center-line_max 6.883815290266723 deviation-center-line_mean 1.9974461382615791 deviation-center-line_min 0.03161309954606321 deviation-heading_max 67.03724554008122 deviation-heading_mean 21.712408538907983 deviation-heading_median 9.609278330927678 deviation-heading_min 0.5938319536953539 distance-from-start_max 0.3317492849495698 distance-from-start_mean 0.1836073209145632 distance-from-start_median 0.16971581070231295 distance-from-start_min 0.06324837730405725 driven_any_max 1.7166431856988702 driven_any_mean 0.5845254055176279 driven_any_median 0.2785986962598207 driven_any_min 0.06426104385199982 driven_lanedir_consec_max 0.4392952062757238 driven_lanedir_consec_mean 0.17691663617882486 driven_lanedir_consec_min 0.035862045527345066 driven_lanedir_max 0.4392952062757238 driven_lanedir_mean 0.17691663617882486 driven_lanedir_median 0.11625464645611527 driven_lanedir_min 0.035862045527345066 in-drivable-lane_max 59.09999999999873 in-drivable-lane_mean 38.437499999999105 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.7166431856988702, "survival_time": 59.99999999999873, "driven_lanedir": 0.4392952062757238, "in-drivable-lane": 36.49999999999896, "deviation-heading": 18.217180971114583, "distance-from-start": 0.3317492849495698, "deviation-center-line": 1.002167506527839, "driven_lanedir_consec": 0.4392952062757238}, "4way-000-ego1": {"driven_any": 0.06426104385199982, "survival_time": 59.99999999999873, "driven_lanedir": 0.042676500024724895, "in-drivable-lane": 0.0, "deviation-heading": 67.03724554008122, "distance-from-start": 0.06324837730405725, "deviation-center-line": 6.883815290266723, "driven_lanedir_consec": 0.042676500024724895}, "4way-000-ego2": {"driven_any": 0.13112387746303605, "survival_time": 59.99999999999873, "driven_lanedir": 0.035862045527345066, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.5938319536953539, "distance-from-start": 0.0845647335167353, "deviation-center-line": 0.03161309954606321, "driven_lanedir_consec": 0.035862045527345066}, "4way-000-ego3": {"driven_any": 0.4260735150566054, "survival_time": 59.99999999999873, "driven_lanedir": 0.18983279288750565, "in-drivable-lane": 58.14999999999873, "deviation-heading": 1.0013756907407725, "distance-from-start": 0.2548668878878906, "deviation-center-line": 0.07218865670569091, "driven_lanedir_consec": 0.18983279288750565}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16475
1753
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:54:14+00:00 2022-11-28 00:17:04+00:00 0:22:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.84999999999869 driven_lanedir_consec_median 0.6030597951057937 deviation-center-line_median 0.5047970465577761
other stats deviation-center-line_max 2.158498977245296 deviation-center-line_mean 0.8048552757130962 deviation-center-line_min 0.05132803249153678 deviation-heading_max 17.500999226441266 deviation-heading_mean 6.9841028943877035 deviation-heading_median 4.866716275743437 deviation-heading_min 0.7019797996226742 distance-from-start_max 1.1818868170589532 distance-from-start_mean 0.6065073733961259 distance-from-start_median 0.528504195356901 distance-from-start_min 0.18713428581174865 driven_any_max 5.667788956765779 driven_any_mean 2.9896604336414487 driven_any_median 3.039851957061191 driven_any_min 0.21114886367763405 driven_lanedir_consec_max 1.2769794928445606 driven_lanedir_consec_mean 0.6356813404008703 driven_lanedir_consec_min 0.05962627854733338 driven_lanedir_max 1.2779952483803283 driven_lanedir_mean 0.6996774336160099 driven_lanedir_median 0.7305441037681888 driven_lanedir_min 0.05962627854733338 in-drivable-lane_max 58.99999999999873 in-drivable-lane_mean 51.01249999999881 in-drivable-lane_min 37.3499999999991 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.21114886367763405, "survival_time": 59.99999999999873, "driven_lanedir": 0.05962627854733338, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.9025466656325424, "distance-from-start": 0.18713428581174865, "deviation-center-line": 0.05132803249153678, "driven_lanedir_consec": 0.05962627854733338}, "zigzag-000-ego1": {"driven_any": 5.667788956765779, "survival_time": 59.99999999999873, "driven_lanedir": 1.128798787392474, "in-drivable-lane": 49.59999999999864, "deviation-heading": 8.830885885854332, "distance-from-start": 1.1818868170589532, "deviation-center-line": 0.922515562410636, "driven_lanedir_consec": 0.8738301700676838}, "zigzag-000-ego2": {"driven_any": 0.6944588310144657, "survival_time": 59.99999999999873, "driven_lanedir": 0.33228942014390345, "in-drivable-lane": 58.09999999999873, "deviation-heading": 0.7019797996226742, "distance-from-start": 0.38561762542356653, "deviation-center-line": 0.08707853070491636, "driven_lanedir_consec": 0.33228942014390345}, "zigzag-000-ego3": {"driven_any": 5.3852450831079155, "survival_time": 59.99999999999873, "driven_lanedir": 1.2779952483803283, "in-drivable-lane": 37.3499999999991, "deviation-heading": 17.500999226441266, "distance-from-start": 0.6713907652902353, "deviation-center-line": 2.158498977245296, "driven_lanedir_consec": 1.2769794928445606}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16471
1754
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:52:14+00:00 2022-11-27 23:54:00+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.0500000000000007 in-drivable-lane_median 1.0000000000000004 driven_lanedir_consec_median 0.11249806090619607 deviation-center-line_median 0.05815339642112582
other stats deviation-center-line_max 0.05815339642112582 deviation-center-line_mean 0.05815339642112582 deviation-center-line_min 0.05815339642112582 deviation-heading_max 0.7636963532402183 deviation-heading_mean 0.7636963532402183 deviation-heading_median 0.7636963532402183 deviation-heading_min 0.7636963532402183 distance-from-start_max 0.2359769144683445 distance-from-start_mean 0.2359769144683445 distance-from-start_median 0.2359769144683445 distance-from-start_min 0.2359769144683445 driven_any_max 0.2415050131316303 driven_any_mean 0.2415050131316303 driven_any_median 0.2415050131316303 driven_any_min 0.2415050131316303 driven_lanedir_consec_max 0.11249806090619607 driven_lanedir_consec_mean 0.11249806090619607 driven_lanedir_consec_min 0.11249806090619607 driven_lanedir_max 0.11249806090619607 driven_lanedir_mean 0.11249806090619607 driven_lanedir_median 0.11249806090619607 driven_lanedir_min 0.11249806090619607 in-drivable-lane_max 1.0000000000000004 in-drivable-lane_mean 1.0000000000000004 in-drivable-lane_min 1.0000000000000004 per-episodes details {"loop-000-ego0": {"driven_any": 0.2415050131316303, "survival_time": 2.0500000000000007, "driven_lanedir": 0.11249806090619607, "in-drivable-lane": 1.0000000000000004, "deviation-heading": 0.7636963532402183, "distance-from-start": 0.2359769144683445, "deviation-center-line": 0.05815339642112582, "driven_lanedir_consec": 0.11249806090619607}}simulation-passed 1 survival_time_max 2.0500000000000007 survival_time_mean 2.0500000000000007 survival_time_min 2.0500000000000007
No reset possible 16465
1758
Bea Baselines 🐤template-pytorch lx22-state-estimation
sim success yes davinci-stage-05-6.2.51
2022-11-27 23:37:36+00:00 2022-11-27 23:52:05+00:00 0:14:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.298773323966386 survival_time_median 59.99999999999873 deviation-center-line_median 1.0828428454809207 in-drivable-lane_median 47.649999999999
other stats deviation-center-line_max 1.5117397461537956 deviation-center-line_mean 1.1405057573787611 deviation-center-line_min 0.8269346805015674 deviation-heading_max 8.24699899945721 deviation-heading_mean 7.110347814164736 deviation-heading_median 7.301583641215986 deviation-heading_min 5.782460801821013 distance-from-start_max 2.7067307191528416 distance-from-start_mean 2.403140842369601 distance-from-start_median 2.572670411423351 distance-from-start_min 1.9300213965326096 driven_any_max 16.10482939317085 driven_any_mean 15.96132435367385 driven_any_median 16.059711202267064 driven_any_min 15.71943246558364 driven_lanedir_consec_max 3.009921158531117 driven_lanedir_consec_mean 2.304984115407366 driven_lanedir_consec_min 1.6062578637245957 driven_lanedir_max 3.009921158531117 driven_lanedir_mean 2.323155675602987 driven_lanedir_median 2.298773323966386 driven_lanedir_min 1.660772544311459 in-drivable-lane_max 50.54999999999875 in-drivable-lane_mean 47.53333333333222 in-drivable-lane_min 44.39999999999892 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 15.71943246558364, "survival_time": 59.99999999999873, "driven_lanedir": 3.009921158531117, "in-drivable-lane": 44.39999999999892, "deviation-heading": 8.24699899945721, "distance-from-start": 1.9300213965326096, "deviation-center-line": 1.5117397461537956, "driven_lanedir_consec": 3.009921158531117}, "LF-zig-zag-001-ego0": {"driven_any": 16.059711202267064, "survival_time": 59.99999999999873, "driven_lanedir": 1.660772544311459, "in-drivable-lane": 50.54999999999875, "deviation-heading": 5.782460801821013, "distance-from-start": 2.572670411423351, "deviation-center-line": 0.8269346805015674, "driven_lanedir_consec": 1.6062578637245957}, "LF-zig-zag-002-ego0": {"driven_any": 16.10482939317085, "survival_time": 59.99999999999873, "driven_lanedir": 2.298773323966386, "in-drivable-lane": 47.649999999999, "deviation-heading": 7.301583641215986, "distance-from-start": 2.7067307191528416, "deviation-center-line": 1.0828428454809207, "driven_lanedir_consec": 2.298773323966386}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16457
1766
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:27:52+00:00 2022-11-27 23:37:24+00:00 0:09:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 41.749999999998906 driven_lanedir_consec_median 2.7296277339373214 deviation-center-line_median 1.675518493855503
other stats deviation-center-line_max 1.675518493855503 deviation-center-line_mean 1.675518493855503 deviation-center-line_min 1.675518493855503 deviation-heading_max 11.663676357476984 deviation-heading_mean 11.663676357476984 deviation-heading_median 11.663676357476984 deviation-heading_min 11.663676357476984 distance-from-start_max 0.7733224635892195 distance-from-start_mean 0.7733224635892195 distance-from-start_median 0.7733224635892195 distance-from-start_min 0.7733224635892195 driven_any_max 12.495819472945822 driven_any_mean 12.495819472945822 driven_any_median 12.495819472945822 driven_any_min 12.495819472945822 driven_lanedir_consec_max 2.7296277339373214 driven_lanedir_consec_mean 2.7296277339373214 driven_lanedir_consec_min 2.7296277339373214 driven_lanedir_max 2.7296277339373214 driven_lanedir_mean 2.7296277339373214 driven_lanedir_median 2.7296277339373214 driven_lanedir_min 2.7296277339373214 in-drivable-lane_max 41.749999999998906 in-drivable-lane_mean 41.749999999998906 in-drivable-lane_min 41.749999999998906 per-episodes details {"loop2-000-ego0": {"driven_any": 12.495819472945822, "survival_time": 59.99999999999873, "driven_lanedir": 2.7296277339373214, "in-drivable-lane": 41.749999999998906, "deviation-heading": 11.663676357476984, "distance-from-start": 0.7733224635892195, "deviation-center-line": 1.675518493855503, "driven_lanedir_consec": 2.7296277339373214}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16452
1767
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:25:57+00:00 2022-11-27 23:27:31+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16446
1769
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:16:46+00:00 2022-11-27 23:25:42+00:00 0:08:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.5803001597002169 survival_time_median 59.99999999999873 deviation-center-line_median 1.8189442222643324 in-drivable-lane_median 38.94999999999888
other stats deviation-center-line_max 1.8189442222643324 deviation-center-line_mean 1.8189442222643324 deviation-center-line_min 1.8189442222643324 deviation-heading_max 17.4496225944034 deviation-heading_mean 17.4496225944034 deviation-heading_median 17.4496225944034 deviation-heading_min 17.4496225944034 distance-from-start_max 1.329185399769436 distance-from-start_mean 1.329185399769436 distance-from-start_median 1.329185399769436 distance-from-start_min 1.329185399769436 driven_any_max 6.51485655274887 driven_any_mean 6.51485655274887 driven_any_median 6.51485655274887 driven_any_min 6.51485655274887 driven_lanedir_consec_max 1.5803001597002169 driven_lanedir_consec_mean 1.5803001597002169 driven_lanedir_consec_min 1.5803001597002169 driven_lanedir_max 1.582756922232253 driven_lanedir_mean 1.582756922232253 driven_lanedir_median 1.582756922232253 driven_lanedir_min 1.582756922232253 in-drivable-lane_max 38.94999999999888 in-drivable-lane_mean 38.94999999999888 in-drivable-lane_min 38.94999999999888 per-episodes details {"loop-000-ego0": {"driven_any": 6.51485655274887, "survival_time": 59.99999999999873, "driven_lanedir": 1.582756922232253, "in-drivable-lane": 38.94999999999888, "deviation-heading": 17.4496225944034, "distance-from-start": 1.329185399769436, "deviation-center-line": 1.8189442222643324, "driven_lanedir_consec": 1.5803001597002169}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16441
1770
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:06:57+00:00 2022-11-27 23:16:33+00:00 0:09:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.00000000000022 in-drivable-lane_median 23.70000000000022 driven_lanedir_consec_median 0.11771443049292309 deviation-center-line_median 0.0950408310868188
other stats deviation-center-line_max 0.7567273632336758 deviation-center-line_mean 0.2494761346219446 deviation-center-line_min 0.05109551308046499 deviation-heading_max 7.444999192966669 deviation-heading_mean 2.3963562024040774 deviation-heading_median 0.7360036132093637 deviation-heading_min 0.6684183902309138 distance-from-start_max 0.43695302205766506 distance-from-start_mean 0.25051806990003317 distance-from-start_median 0.22885687503458532 distance-from-start_min 0.1074055074732969 driven_any_max 3.944669044077602 driven_any_mean 1.1868054473865357 driven_any_median 0.3406089681589505 driven_any_min 0.12133480915063868 driven_lanedir_consec_max 0.7681925088969064 driven_lanedir_consec_mean 0.2572599039940039 driven_lanedir_consec_min 0.02541824609326304 driven_lanedir_max 0.7681925088969064 driven_lanedir_mean 0.2572599039940039 driven_lanedir_median 0.11771443049292309 driven_lanedir_min 0.02541824609326304 in-drivable-lane_max 24.25000000000022 in-drivable-lane_mean 22.112500000000203 in-drivable-lane_min 16.800000000000146 per-episodes details {"udem-000-ego0": {"driven_any": 3.944669044077602, "survival_time": 25.00000000000022, "driven_lanedir": 0.7681925088969064, "in-drivable-lane": 16.800000000000146, "deviation-heading": 7.444999192966669, "distance-from-start": 0.43695302205766506, "deviation-center-line": 0.7567273632336758, "driven_lanedir_consec": 0.7681925088969064}, "udem-000-ego1": {"driven_any": 0.2612073451937928, "survival_time": 25.00000000000022, "driven_lanedir": 0.0792287855267364, "in-drivable-lane": 23.95000000000022, "deviation-heading": 0.6684183902309138, "distance-from-start": 0.2315706266124853, "deviation-center-line": 0.10060124999913243, "driven_lanedir_consec": 0.0792287855267364}, "udem-000-ego2": {"driven_any": 0.4200105911241082, "survival_time": 25.00000000000022, "driven_lanedir": 0.15620007545910974, "in-drivable-lane": 23.45000000000022, "deviation-heading": 0.7965631132701495, "distance-from-start": 0.22614312345668536, "deviation-center-line": 0.08948041217450513, "driven_lanedir_consec": 0.15620007545910974}, "udem-000-ego3": {"driven_any": 0.12133480915063868, "survival_time": 25.00000000000022, "driven_lanedir": 0.02541824609326304, "in-drivable-lane": 24.25000000000022, "deviation-heading": 0.6754441131485779, "distance-from-start": 0.1074055074732969, "deviation-center-line": 0.05109551308046499, "driven_lanedir_consec": 0.02541824609326304}}simulation-passed 1 survival_time_max 25.00000000000022 survival_time_mean 25.00000000000022 survival_time_min 25.00000000000022
No reset possible 16440
1770
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 23:04:24+00:00 2022-11-27 23:06:26+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16435
1771
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 22:53:53+00:00 2022-11-27 23:04:11+00:00 0:10:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.52499999999945 driven_lanedir_consec_median 0.7312050318520338 deviation-center-line_median 4.64142184647317
other stats deviation-center-line_max 7.864930353253185 deviation-center-line_mean 4.64142184647317 deviation-center-line_min 1.4179133396931558 deviation-heading_max 58.594238392181985 deviation-heading_mean 35.19497413114783 deviation-heading_median 35.19497413114783 deviation-heading_min 11.79570987011368 distance-from-start_max 0.5537485138327338 distance-from-start_mean 0.4711620793373573 distance-from-start_median 0.4711620793373573 distance-from-start_min 0.38857564484198087 driven_any_max 12.391120681421244 driven_any_mean 6.416154017366627 driven_any_median 6.416154017366627 driven_any_min 0.44118735331200926 driven_lanedir_consec_max 1.0826791687483188 driven_lanedir_consec_mean 0.7312050318520338 driven_lanedir_consec_min 0.37973089495574874 driven_lanedir_max 1.397891358469339 driven_lanedir_mean 0.888811126712544 driven_lanedir_median 0.888811126712544 driven_lanedir_min 0.37973089495574874 in-drivable-lane_max 47.0499999999989 in-drivable-lane_mean 23.52499999999945 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 0.44118735331200926, "survival_time": 59.99999999999873, "driven_lanedir": 0.37973089495574874, "in-drivable-lane": 0.0, "deviation-heading": 58.594238392181985, "distance-from-start": 0.38857564484198087, "deviation-center-line": 7.864930353253185, "driven_lanedir_consec": 0.37973089495574874}, "loop2-000-ego1": {"driven_any": 12.391120681421244, "survival_time": 59.99999999999873, "driven_lanedir": 1.397891358469339, "in-drivable-lane": 47.0499999999989, "deviation-heading": 11.79570987011368, "distance-from-start": 0.5537485138327338, "deviation-center-line": 1.4179133396931558, "driven_lanedir_consec": 1.0826791687483188}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16430
1772
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 22:44:51+00:00 2022-11-27 22:53:25+00:00 0:08:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 55.74999999999873 driven_lanedir_consec_median 0.3997414202055758 deviation-center-line_median 0.2312164973139035
other stats deviation-center-line_max 0.2312164973139035 deviation-center-line_mean 0.2312164973139035 deviation-center-line_min 0.2312164973139035 deviation-heading_max 2.8221583004241717 deviation-heading_mean 2.8221583004241717 deviation-heading_median 2.8221583004241717 deviation-heading_min 2.8221583004241717 distance-from-start_max 0.7198604446850232 distance-from-start_mean 0.7198604446850232 distance-from-start_median 0.7198604446850232 distance-from-start_min 0.7198604446850232 driven_any_max 9.48212640882839 driven_any_mean 9.48212640882839 driven_any_median 9.48212640882839 driven_any_min 9.48212640882839 driven_lanedir_consec_max 0.3997414202055758 driven_lanedir_consec_mean 0.3997414202055758 driven_lanedir_consec_min 0.3997414202055758 driven_lanedir_max 0.3997414202055758 driven_lanedir_mean 0.3997414202055758 driven_lanedir_median 0.3997414202055758 driven_lanedir_min 0.3997414202055758 in-drivable-lane_max 55.74999999999873 in-drivable-lane_mean 55.74999999999873 in-drivable-lane_min 55.74999999999873 per-episodes details {"loop2-000-ego0": {"driven_any": 9.48212640882839, "survival_time": 59.99999999999873, "driven_lanedir": 0.3997414202055758, "in-drivable-lane": 55.74999999999873, "deviation-heading": 2.8221583004241717, "distance-from-start": 0.7198604446850232, "deviation-center-line": 0.2312164973139035, "driven_lanedir_consec": 0.3997414202055758}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16426
1773
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 22:38:33+00:00 2022-11-27 22:44:31+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.7000000000002 in-drivable-lane_median 14.450000000000168 driven_lanedir_consec_median 0.2737854971621658 deviation-center-line_median 0.899035755764141
other stats deviation-center-line_max 0.899035755764141 deviation-center-line_mean 0.899035755764141 deviation-center-line_min 0.899035755764141 deviation-heading_max 6.757937307021479 deviation-heading_mean 6.757937307021479 deviation-heading_median 6.757937307021479 deviation-heading_min 6.757937307021479 distance-from-start_max 0.7357883576773867 distance-from-start_mean 0.7357883576773867 distance-from-start_median 0.7357883576773867 distance-from-start_min 0.7357883576773867 driven_any_max 5.6000766802176365 driven_any_mean 5.6000766802176365 driven_any_median 5.6000766802176365 driven_any_min 5.6000766802176365 driven_lanedir_consec_max 0.2737854971621658 driven_lanedir_consec_mean 0.2737854971621658 driven_lanedir_consec_min 0.2737854971621658 driven_lanedir_max 0.2557752979619581 driven_lanedir_mean 0.2557752979619581 driven_lanedir_median 0.2557752979619581 driven_lanedir_min 0.2557752979619581 in-drivable-lane_max 14.450000000000168 in-drivable-lane_mean 14.450000000000168 in-drivable-lane_min 14.450000000000168 per-episodes details {"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}simulation-passed 1 survival_time_max 23.7000000000002 survival_time_mean 23.7000000000002 survival_time_min 23.7000000000002
No reset possible 16419
1775
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 22:34:19+00:00 2022-11-27 22:38:26+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.70000000000016 in-drivable-lane_median 12.150000000000135 driven_lanedir_consec_median 0.2718508044257806 deviation-center-line_median 0.7655525719315331
other stats deviation-center-line_max 0.7655525719315331 deviation-center-line_mean 0.7655525719315331 deviation-center-line_min 0.7655525719315331 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7357883576773756 distance-from-start_mean 0.7357883576773756 distance-from-start_median 0.7357883576773756 distance-from-start_min 0.7357883576773756 driven_any_max 5.001991003394682 driven_any_mean 5.001991003394682 driven_any_median 5.001991003394682 driven_any_min 5.001991003394682 driven_lanedir_consec_max 0.2718508044257806 driven_lanedir_consec_mean 0.2718508044257806 driven_lanedir_consec_min 0.2718508044257806 driven_lanedir_max 0.2538357176450212 driven_lanedir_mean 0.2538357176450212 driven_lanedir_median 0.2538357176450212 driven_lanedir_min 0.2538357176450212 in-drivable-lane_max 12.150000000000135 in-drivable-lane_mean 12.150000000000135 in-drivable-lane_min 12.150000000000135 per-episodes details {"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}simulation-passed 1 survival_time_max 20.70000000000016 survival_time_mean 20.70000000000016 survival_time_min 20.70000000000016
No reset possible 16408
1778
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 22:12:57+00:00 2022-11-27 22:34:03+00:00 0:21:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 54.674999999998704 driven_lanedir_consec_median 0.12251247869641724 deviation-center-line_median 0.4433920965103467
other stats deviation-center-line_max 1.2038527288241243 deviation-center-line_mean 0.5423174087533363 deviation-center-line_min 0.07863271316852748 deviation-heading_max 14.288552729590728 deviation-heading_mean 5.627247694260051 deviation-heading_median 3.416903566880354 deviation-heading_min 1.38663091368877 distance-from-start_max 1.4108418329398955 distance-from-start_mean 0.8799981600642298 distance-from-start_median 0.7992095848737366 distance-from-start_min 0.5107316375695505 driven_any_max 15.326310847370582 driven_any_mean 7.171771192512803 driven_any_median 6.412570219301883 driven_any_min 0.5356334840768605 driven_lanedir_consec_max 0.4413235258740946 driven_lanedir_consec_mean 0.1898162935783138 driven_lanedir_consec_min 0.07291669104632614 driven_lanedir_max 0.4413235258740946 driven_lanedir_mean 0.1804353170531879 driven_lanedir_median 0.1104128284063164 driven_lanedir_min 0.05959208552602435 in-drivable-lane_max 57.749999999998735 in-drivable-lane_mean 52.93749999999879 in-drivable-lane_min 44.649999999999025 per-episodes details {"autolab-000-ego0": {"driven_any": 0.5356334840768605, "survival_time": 59.99999999999873, "driven_lanedir": 0.4413235258740946, "in-drivable-lane": 57.749999999998735, "deviation-heading": 1.38663091368877, "distance-from-start": 0.5107316375695505, "deviation-center-line": 0.07863271316852748, "driven_lanedir_consec": 0.4413235258740946}, "autolab-000-ego1": {"driven_any": 15.326310847370582, "survival_time": 59.99999999999873, "driven_lanedir": 0.05959208552602435, "in-drivable-lane": 44.649999999999025, "deviation-heading": 14.288552729590728, "distance-from-start": 1.4108418329398955, "deviation-center-line": 1.2038527288241243, "driven_lanedir_consec": 0.07291669104632614}, "autolab-000-ego2": {"driven_any": 7.342290201921084, "survival_time": 59.99999999999873, "driven_lanedir": 0.1334588763696649, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.0294981006515846, "distance-from-start": 0.8626308120701035, "deviation-center-line": 0.4429996774431571, "driven_lanedir_consec": 0.14670729988336562}, "autolab-000-ego3": {"driven_any": 5.482850236682682, "survival_time": 59.99999999999873, "driven_lanedir": 0.08736678044296786, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109123, "distance-from-start": 0.7357883576773698, "deviation-center-line": 0.44378451557753634, "driven_lanedir_consec": 0.09831765750946886}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16400
1781
Bea Baselines 🐤template-random lx22-objdet
sim success yes davinci-stage-05-6.2.51
2022-11-27 22:00:13+00:00 2022-11-27 22:12:34+00:00 0:12:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 54.49999999999904 driven_lanedir_consec_median 0.26709798212212443
other stats deviation-center-line_max 1.037569790997506 deviation-center-line_mean 0.8435604085256779 deviation-center-line_median 0.8435604085256779 deviation-center-line_min 0.64955102605385 deviation-heading_max 4.206744090268851 deviation-heading_mean 4.053028283662815 deviation-heading_median 4.053028283662815 deviation-heading_min 3.899312477056781 distance-from-start_max 1.4108418329398793 distance-from-start_mean 1.2742348024332677 distance-from-start_median 1.2742348024332677 distance-from-start_min 1.1376277719266563 driven_any_max 15.326310847370594 driven_any_mean 13.855133975004188 driven_any_median 13.855133975004188 driven_any_min 12.38395710263778 driven_lanedir_consec_max 0.46522399883077714 driven_lanedir_consec_mean 0.26709798212212443 driven_lanedir_consec_min 0.06897196541347173 driven_lanedir_max 0.4443159195617077 driven_lanedir_mean 0.24618990285305495 driven_lanedir_median 0.24618990285305495 driven_lanedir_min 0.04806388614440227 in-drivable-lane_max 53.699999999998695 in-drivable-lane_mean 46.67499999999907 in-drivable-lane_median 46.67499999999907 in-drivable-lane_min 39.64999999999946 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 15.326310847370594, "survival_time": 59.99999999999873, "driven_lanedir": 0.4443159195617077, "in-drivable-lane": 53.699999999998695, "deviation-heading": 3.899312477056781, "distance-from-start": 1.4108418329398793, "deviation-center-line": 0.64955102605385, "driven_lanedir_consec": 0.46522399883077714}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 12.38395710263778, "survival_time": 48.99999999999935, "driven_lanedir": 0.04806388614440227, "in-drivable-lane": 39.64999999999946, "deviation-heading": 4.206744090268851, "distance-from-start": 1.1376277719266563, "deviation-center-line": 1.037569790997506, "driven_lanedir_consec": 0.06897196541347173}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 54.49999999999904 survival_time_min 48.99999999999935
No reset possible 16396
1784
Bea Baselines 🐤template-random lx22-BV1
sim-1of5 success yes davinci-stage-05-6.2.51
2022-11-27 21:57:29+00:00 2022-11-27 22:00:07+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d45-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 16393
1784
Bea Baselines 🐤template-random lx22-BV1
sim-2of5 success yes davinci-stage-05-6.2.51
2022-11-27 21:54:42+00:00 2022-11-27 21:57:09+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d40-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 16392
1787
Bea Baselines 🐤template-random aido-hello-sim-validation
sanity-check success yes davinci-stage-05-6.2.51
2022-11-27 21:53:06+00:00 2022-11-27 21:54:13+00:00 0:01:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.1920928955078125e-06 deviation-center-line_median 0.007457559042937448
other stats deviation-center-line_max 0.007457559042937448 deviation-center-line_mean 0.007457559042937448 deviation-center-line_min 0.007457559042937448 deviation-heading_max 0.1966171946901932 deviation-heading_mean 0.1966171946901932 deviation-heading_median 0.1966171946901932 deviation-heading_min 0.1966171946901932 distance-from-start_max 6.280369834735102e-16 distance-from-start_mean 6.280369834735102e-16 distance-from-start_median 6.280369834735102e-16 distance-from-start_min 6.280369834735102e-16 driven_any_max 4.1538810900383696e-15 driven_any_mean 4.1538810900383696e-15 driven_any_median 4.1538810900383696e-15 driven_any_min 4.1538810900383696e-15 driven_lanedir_consec_max 1.1920928955078125e-06 driven_lanedir_consec_mean 1.1920928955078125e-06 driven_lanedir_consec_min 1.1920928955078125e-06 driven_lanedir_max 1.1920928955078125e-06 driven_lanedir_mean 1.1920928955078125e-06 driven_lanedir_median 1.1920928955078125e-06 driven_lanedir_min 1.1920928955078125e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 4.1538810900383696e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16389
1791
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:48:15+00:00 2022-11-27 21:52:59+00:00 0:04:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.55000000000003 in-drivable-lane_median 8.100000000000017 driven_lanedir_consec_median 0.02948471913916273 deviation-center-line_median 0.3268414821574099
other stats deviation-center-line_max 0.3268414821574099 deviation-center-line_mean 0.3268414821574099 deviation-center-line_min 0.3268414821574099 deviation-heading_max 2.5488725860510586 deviation-heading_mean 2.5488725860510586 deviation-heading_median 2.5488725860510586 deviation-heading_min 2.5488725860510586 distance-from-start_max 0.5461575079396525 distance-from-start_mean 0.5461575079396525 distance-from-start_median 0.5461575079396525 distance-from-start_min 0.5461575079396525 driven_any_max 2.4097437221936646 driven_any_mean 2.4097437221936646 driven_any_median 2.4097437221936646 driven_any_min 2.4097437221936646 driven_lanedir_consec_max 0.02948471913916273 driven_lanedir_consec_mean 0.02948471913916273 driven_lanedir_consec_min 0.02948471913916273 driven_lanedir_max 0.032830942028507115 driven_lanedir_mean 0.032830942028507115 driven_lanedir_median 0.032830942028507115 driven_lanedir_min 0.032830942028507115 in-drivable-lane_max 8.100000000000017 in-drivable-lane_mean 8.100000000000017 in-drivable-lane_min 8.100000000000017 per-episodes details {"autolab-000-ego0": {"driven_any": 2.4097437221936646, "survival_time": 11.55000000000003, "driven_lanedir": 0.032830942028507115, "in-drivable-lane": 8.100000000000017, "deviation-heading": 2.5488725860510586, "distance-from-start": 0.5461575079396525, "deviation-center-line": 0.3268414821574099, "driven_lanedir_consec": 0.02948471913916273}}simulation-passed 1 survival_time_max 11.55000000000003 survival_time_mean 11.55000000000003 survival_time_min 11.55000000000003
No reset possible 16387
1792
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:46:30+00:00 2022-11-27 21:48:02+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16383
1793
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:43:02+00:00 2022-11-27 21:46:04+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16381
1793
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:40:58+00:00 2022-11-27 21:42:29+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16376
1794
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:36:07+00:00 2022-11-27 21:40:44+00:00 0:04:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24555746228952957 survival_time_median 39.24999999999991 deviation-center-line_median 1.3919847015555789 in-drivable-lane_median 25.24999999999981
other stats deviation-center-line_max 1.3919847015555789 deviation-center-line_mean 1.3919847015555789 deviation-center-line_min 1.3919847015555789 deviation-heading_max 9.906601177812297 deviation-heading_mean 9.906601177812297 deviation-heading_median 9.906601177812297 deviation-heading_min 9.906601177812297 distance-from-start_max 1.0093404360059268 distance-from-start_mean 1.0093404360059268 distance-from-start_median 1.0093404360059268 distance-from-start_min 1.0093404360059268 driven_any_max 9.462416332537492 driven_any_mean 9.462416332537492 driven_any_median 9.462416332537492 driven_any_min 9.462416332537492 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.24555746228952957 driven_lanedir_consec_min 0.24555746228952957 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.2358197494342854 driven_lanedir_median 0.2358197494342854 driven_lanedir_min 0.2358197494342854 in-drivable-lane_max 25.24999999999981 in-drivable-lane_mean 25.24999999999981 in-drivable-lane_min 25.24999999999981 per-episodes details {"loop-000-ego0": {"driven_any": 9.462416332537492, "survival_time": 39.24999999999991, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 25.24999999999981, "deviation-heading": 9.906601177812297, "distance-from-start": 1.0093404360059268, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}}simulation-passed 1 survival_time_max 39.24999999999991 survival_time_mean 39.24999999999991 survival_time_min 39.24999999999991
No reset possible 16375
1794
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:32:32+00:00 2022-11-27 21:35:37+00:00 0:03:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.15869649764514326 survival_time_median 15.900000000000093 deviation-center-line_median 0.4544941711289141 in-drivable-lane_median 11.05000000000006
other stats deviation-center-line_max 0.4544941711289141 deviation-center-line_mean 0.4544941711289141 deviation-center-line_min 0.4544941711289141 deviation-heading_max 3.664036561158003 deviation-heading_mean 3.664036561158003 deviation-heading_median 3.664036561158003 deviation-heading_min 3.664036561158003 distance-from-start_max 0.6653201232297334 distance-from-start_mean 0.6653201232297334 distance-from-start_median 0.6653201232297334 distance-from-start_min 0.6653201232297334 driven_any_max 3.642720741594881 driven_any_mean 3.642720741594881 driven_any_median 3.642720741594881 driven_any_min 3.642720741594881 driven_lanedir_consec_max 0.15869649764514326 driven_lanedir_consec_mean 0.15869649764514326 driven_lanedir_consec_min 0.15869649764514326 driven_lanedir_max 0.1620428397437772 driven_lanedir_mean 0.1620428397437772 driven_lanedir_median 0.1620428397437772 driven_lanedir_min 0.1620428397437772 in-drivable-lane_max 11.05000000000006 in-drivable-lane_mean 11.05000000000006 in-drivable-lane_min 11.05000000000006 per-episodes details {"loop2-000-ego0": {"driven_any": 3.642720741594881, "survival_time": 15.900000000000093, "driven_lanedir": 0.1620428397437772, "in-drivable-lane": 11.05000000000006, "deviation-heading": 3.664036561158003, "distance-from-start": 0.6653201232297334, "deviation-center-line": 0.4544941711289141, "driven_lanedir_consec": 0.15869649764514326}}simulation-passed 1 survival_time_max 15.900000000000093 survival_time_mean 15.900000000000093 survival_time_min 15.900000000000093
No reset possible 16368
1796
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:15:21+00:00 2022-11-27 21:32:10+00:00 0:16:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.399999999999615 in-drivable-lane_median 36.89999999999958 driven_lanedir_consec_median 0.16636007500288152 deviation-center-line_median 0.6465381124900755
other stats deviation-center-line_max 3.843921290582837 deviation-center-line_mean 1.365959723489658 deviation-center-line_min 0.3268413783956437 deviation-heading_max 34.73068339720075 deviation-heading_mean 11.863967459268938 deviation-heading_median 5.088156815887916 deviation-heading_min 2.548872808099167 distance-from-start_max 1.0442247976691943 distance-from-start_mean 0.7726084491662092 distance-from-start_median 0.7348495479070991 distance-from-start_min 0.5765099031814445 driven_any_max 11.02110496898546 driven_any_mean 5.960730691438496 driven_any_median 5.132220528138905 driven_any_min 2.5573767404907164 driven_lanedir_consec_max 0.2424977297667874 driven_lanedir_consec_mean 0.1511732098444039 driven_lanedir_consec_min 0.029474959605065187 driven_lanedir_max 0.22840118579828728 driven_lanedir_mean 0.13782421614551926 driven_lanedir_median 0.14503534079604596 driven_lanedir_min 0.03282499719169785 in-drivable-lane_max 40.949999999999605 in-drivable-lane_mean 31.049999999999716 in-drivable-lane_min 9.450000000000106 per-episodes details {"autolab-000-ego0": {"driven_any": 2.5573767404907164, "survival_time": 44.399999999999615, "driven_lanedir": 0.03282499719169785, "in-drivable-lane": 40.949999999999605, "deviation-heading": 2.548872808099167, "distance-from-start": 0.5765099031814445, "deviation-center-line": 0.3268413783956437, "driven_lanedir_consec": 0.029474959605065187}, "autolab-000-ego1": {"driven_any": 4.1683236267102375, "survival_time": 44.399999999999615, "driven_lanedir": 0.22840118579828728, "in-drivable-lane": 9.450000000000106, "deviation-heading": 34.73068339720075, "distance-from-start": 0.6736010379604851, "deviation-center-line": 3.843921290582837, "driven_lanedir_consec": 0.2424977297667874}, "autolab-000-ego2": {"driven_any": 11.02110496898546, "survival_time": 44.399999999999615, "driven_lanedir": 0.13091508050074063, "in-drivable-lane": 37.59999999999958, "deviation-heading": 3.900775995746317, "distance-from-start": 1.0442247976691943, "deviation-center-line": 0.686307068420695, "driven_lanedir_consec": 0.15293047772426194}, "autolab-000-ego3": {"driven_any": 6.096117429567572, "survival_time": 44.399999999999615, "driven_lanedir": 0.1591556010913513, "in-drivable-lane": 36.19999999999958, "deviation-heading": 6.275537636029516, "distance-from-start": 0.7960980578537132, "deviation-center-line": 0.6067691565594562, "driven_lanedir_consec": 0.1797896722815011}}simulation-passed 1 survival_time_max 44.399999999999615 survival_time_mean 44.399999999999615 survival_time_min 44.399999999999615
No reset possible 16365
1797
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:12:39+00:00 2022-11-27 21:15:08+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.94999999999998 in-drivable-lane_median 5.549999999999983 driven_lanedir_consec_median 0.020891462039611675 deviation-center-line_median 0.16974575483481455
other stats deviation-center-line_max 0.16974575483481455 deviation-center-line_mean 0.16974575483481455 deviation-center-line_min 0.16974575483481455 deviation-heading_max 1.6654350665682798 deviation-heading_mean 1.6654350665682798 deviation-heading_median 1.6654350665682798 deviation-heading_min 1.6654350665682798 distance-from-start_max 0.5351951936475464 distance-from-start_mean 0.5351951936475464 distance-from-start_median 0.5351951936475464 distance-from-start_min 0.5351951936475464 driven_any_max 1.5709859611218706 driven_any_mean 1.5709859611218706 driven_any_median 1.5709859611218706 driven_any_min 1.5709859611218706 driven_lanedir_consec_max 0.020891462039611675 driven_lanedir_consec_mean 0.020891462039611675 driven_lanedir_consec_min 0.020891462039611675 driven_lanedir_max 0.020891462039611675 driven_lanedir_mean 0.020891462039611675 driven_lanedir_median 0.020891462039611675 driven_lanedir_min 0.020891462039611675 in-drivable-lane_max 5.549999999999983 in-drivable-lane_mean 5.549999999999983 in-drivable-lane_min 5.549999999999983 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}simulation-passed 1 survival_time_max 7.94999999999998 survival_time_mean 7.94999999999998 survival_time_min 7.94999999999998
No reset possible 16360
1798
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:10:02+00:00 2022-11-27 21:12:23+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.9499999999999975 in-drivable-lane_median 1.9499999999999973 driven_lanedir_consec_median 0.15874224213842347 deviation-center-line_median 0.06106668527237201
other stats deviation-center-line_max 0.06106668527237201 deviation-center-line_mean 0.06106668527237201 deviation-center-line_min 0.06106668527237201 deviation-heading_max 0.6324174438134117 deviation-heading_mean 0.6324174438134117 deviation-heading_median 0.6324174438134117 deviation-heading_min 0.6324174438134117 distance-from-start_max 0.5137597552357388 distance-from-start_mean 0.5137597552357388 distance-from-start_median 0.5137597552357388 distance-from-start_min 0.5137597552357388 driven_any_max 0.5513770233523144 driven_any_mean 0.5513770233523144 driven_any_median 0.5513770233523144 driven_any_min 0.5513770233523144 driven_lanedir_consec_max 0.15874224213842347 driven_lanedir_consec_mean 0.15874224213842347 driven_lanedir_consec_min 0.15874224213842347 driven_lanedir_max 0.15874224213842347 driven_lanedir_mean 0.15874224213842347 driven_lanedir_median 0.15874224213842347 driven_lanedir_min 0.15874224213842347 in-drivable-lane_max 1.9499999999999973 in-drivable-lane_mean 1.9499999999999973 in-drivable-lane_min 1.9499999999999973 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5513770233523144, "survival_time": 2.9499999999999975, "driven_lanedir": 0.15874224213842347, "in-drivable-lane": 1.9499999999999973, "deviation-heading": 0.6324174438134117, "distance-from-start": 0.5137597552357388, "deviation-center-line": 0.06106668527237201, "driven_lanedir_consec": 0.15874224213842347}}simulation-passed 1 survival_time_max 2.9499999999999975 survival_time_mean 2.9499999999999975 survival_time_min 2.9499999999999975
No reset possible 16357
1799
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:08:06+00:00 2022-11-27 21:09:40+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16352
1800
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:06:14+00:00 2022-11-27 21:07:47+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16348
1801
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 21:04:19+00:00 2022-11-27 21:05:59+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5798164695136199 survival_time_median 6.349999999999985 deviation-center-line_median 0.22708549926505828 in-drivable-lane_median 3.5999999999999885
other stats deviation-center-line_max 0.22708549926505828 deviation-center-line_mean 0.22708549926505828 deviation-center-line_min 0.22708549926505828 deviation-heading_max 1.4507776538819763 deviation-heading_mean 1.4507776538819763 deviation-heading_median 1.4507776538819763 deviation-heading_min 1.4507776538819763 distance-from-start_max 1.4923869831165126 distance-from-start_mean 1.4923869831165126 distance-from-start_median 1.4923869831165126 distance-from-start_min 1.4923869831165126 driven_any_max 1.5656301664036625 driven_any_mean 1.5656301664036625 driven_any_median 1.5656301664036625 driven_any_min 1.5656301664036625 driven_lanedir_consec_max 0.5798164695136199 driven_lanedir_consec_mean 0.5798164695136199 driven_lanedir_consec_min 0.5798164695136199 driven_lanedir_max 0.5798164695136199 driven_lanedir_mean 0.5798164695136199 driven_lanedir_median 0.5798164695136199 driven_lanedir_min 0.5798164695136199 in-drivable-lane_max 3.5999999999999885 in-drivable-lane_mean 3.5999999999999885 in-drivable-lane_min 3.5999999999999885 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.5656301664036625, "survival_time": 6.349999999999985, "driven_lanedir": 0.5798164695136199, "in-drivable-lane": 3.5999999999999885, "deviation-heading": 1.4507776538819763, "distance-from-start": 1.4923869831165126, "deviation-center-line": 0.22708549926505828, "driven_lanedir_consec": 0.5798164695136199}}simulation-passed 1 survival_time_max 6.349999999999985 survival_time_mean 6.349999999999985 survival_time_min 6.349999999999985
No reset possible 16339
1803
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:57:37+00:00 2022-11-27 21:03:54+00:00 0:06:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.5000000000001 in-drivable-lane_median 14.7500000000001 driven_lanedir_consec_median 0.41412418445003296 deviation-center-line_median 0.10828111832461004
other stats deviation-center-line_max 0.7237329582094527 deviation-center-line_mean 0.2527189948659744 deviation-center-line_min 0.07058078460522461 deviation-heading_max 3.023265815599519 deviation-heading_mean 1.1337622723685246 deviation-heading_median 0.5552593191539248 deviation-heading_min 0.4012646355667289 distance-from-start_max 4.1887196218918685 distance-from-start_mean 2.268092467959452 distance-from-start_median 2.217491959704898 distance-from-start_min 0.44866633053614247 driven_any_max 4.791312559073251 driven_any_mean 2.5674428910342706 driven_any_median 2.5102885767618544 driven_any_min 0.45788185154012256 driven_lanedir_consec_max 1.871608360005372 driven_lanedir_consec_mean 0.7108164475272231 driven_lanedir_consec_min 0.14340906120345398 driven_lanedir_max 1.871608360005372 driven_lanedir_mean 0.7108164475272231 driven_lanedir_median 0.41412418445003296 driven_lanedir_min 0.14340906120345398 in-drivable-lane_max 15.650000000000098 in-drivable-lane_mean 13.537500000000092 in-drivable-lane_min 9.000000000000075 per-episodes details {"autolab-000-ego0": {"driven_any": 0.45788185154012256, "survival_time": 16.5000000000001, "driven_lanedir": 0.1808084734321218, "in-drivable-lane": 15.400000000000098, "deviation-heading": 0.6507923043185136, "distance-from-start": 0.44866633053614247, "deviation-center-line": 0.07273108444447778, "driven_lanedir_consec": 0.1808084734321218}, "autolab-000-ego1": {"driven_any": 2.947475636268131, "survival_time": 16.5000000000001, "driven_lanedir": 0.14340906120345398, "in-drivable-lane": 15.650000000000098, "deviation-heading": 0.459726333989336, "distance-from-start": 2.611113189986997, "deviation-center-line": 0.07058078460522461, "driven_lanedir_consec": 0.14340906120345398}, "autolab-000-ego2": {"driven_any": 4.791312559073251, "survival_time": 16.5000000000001, "driven_lanedir": 1.871608360005372, "in-drivable-lane": 9.000000000000075, "deviation-heading": 3.023265815599519, "distance-from-start": 4.1887196218918685, "deviation-center-line": 0.7237329582094527, "driven_lanedir_consec": 1.871608360005372}, "autolab-000-ego3": {"driven_any": 2.0731015172555782, "survival_time": 16.5000000000001, "driven_lanedir": 0.6474398954679441, "in-drivable-lane": 14.1000000000001, "deviation-heading": 0.4012646355667289, "distance-from-start": 1.8238707294227992, "deviation-center-line": 0.14383115220474232, "driven_lanedir_consec": 0.6474398954679441}}simulation-passed 1 survival_time_max 16.5000000000001 survival_time_mean 16.5000000000001 survival_time_min 16.5000000000001
No reset possible 16336
1804
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:55:51+00:00 2022-11-27 20:57:12+00:00 0:01:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.1999999999999966 in-drivable-lane_median 2.0499999999999963 driven_lanedir_consec_median 0.2020723326809566 deviation-center-line_median 0.07012490385272656
other stats deviation-center-line_max 0.07012490385272656 deviation-center-line_mean 0.07012490385272656 deviation-center-line_min 0.07012490385272656 deviation-heading_max 0.6113007089011521 deviation-heading_mean 0.6113007089011521 deviation-heading_median 0.6113007089011521 deviation-heading_min 0.6113007089011521 distance-from-start_max 0.5747440023098318 distance-from-start_mean 0.5747440023098318 distance-from-start_median 0.5747440023098318 distance-from-start_min 0.5747440023098318 driven_any_max 0.5769417539247871 driven_any_mean 0.5769417539247871 driven_any_median 0.5769417539247871 driven_any_min 0.5769417539247871 driven_lanedir_consec_max 0.2020723326809566 driven_lanedir_consec_mean 0.2020723326809566 driven_lanedir_consec_min 0.2020723326809566 driven_lanedir_max 0.2020723326809566 driven_lanedir_mean 0.2020723326809566 driven_lanedir_median 0.2020723326809566 driven_lanedir_min 0.2020723326809566 in-drivable-lane_max 2.0499999999999963 in-drivable-lane_mean 2.0499999999999963 in-drivable-lane_min 2.0499999999999963 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5769417539247871, "survival_time": 3.1999999999999966, "driven_lanedir": 0.2020723326809566, "in-drivable-lane": 2.0499999999999963, "deviation-heading": 0.6113007089011521, "distance-from-start": 0.5747440023098318, "deviation-center-line": 0.07012490385272656, "driven_lanedir_consec": 0.2020723326809566}}simulation-passed 1 survival_time_max 3.1999999999999966 survival_time_mean 3.1999999999999966 survival_time_min 3.1999999999999966
No reset possible 16332
1807
Bea Baselines 🐤template-ros lx22-visservoing
sim success yes davinci-stage-05-6.2.51
2022-11-27 20:53:27+00:00 2022-11-27 20:55:17+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 2.549999999999991 deviation-center-line_median 0.14681848678004755 driven_lanedir_consec_median 0.5469819418287473 survival_time_median 4.899999999999991
other stats deviation-center-line_max 0.18284582685946923 deviation-center-line_mean 0.14681848678004755 deviation-center-line_min 0.11079114670062584 deviation-heading_max 1.292715712754918 deviation-heading_mean 0.8313439384385722 deviation-heading_median 0.8313439384385722 deviation-heading_min 0.3699721641222265 distance-from-start_max 1.1837005430497711 distance-from-start_mean 1.1797786506403378 distance-from-start_median 1.1797786506403378 distance-from-start_min 1.1758567582309043 driven_any_max 1.2075204172389544 driven_any_mean 1.2052868631421705 driven_any_median 1.2052868631421705 driven_any_min 1.203053309045386 driven_lanedir_consec_max 0.5679091941269349 driven_lanedir_consec_mean 0.5469819418287473 driven_lanedir_consec_min 0.5260546895305597 driven_lanedir_max 0.5679091941269349 driven_lanedir_mean 0.5469819418287473 driven_lanedir_median 0.5469819418287473 driven_lanedir_min 0.5260546895305597 in-drivable-lane_max 2.8999999999999897 in-drivable-lane_mean 2.549999999999991 in-drivable-lane_min 2.199999999999992 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 1.203053309045386, "survival_time": 4.899999999999991, "driven_lanedir": 0.5679091941269349, "in-drivable-lane": 2.199999999999992, "deviation-heading": 1.292715712754918, "distance-from-start": 1.1837005430497711, "deviation-center-line": 0.18284582685946923, "driven_lanedir_consec": 0.5679091941269349}, "LF-small-loop-001-ego0": {"driven_any": 1.2075204172389544, "survival_time": 4.899999999999991, "driven_lanedir": 0.5260546895305597, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 0.3699721641222265, "distance-from-start": 1.1758567582309043, "deviation-center-line": 0.11079114670062584, "driven_lanedir_consec": 0.5260546895305597}}simulation-passed 1 survival_time_max 4.899999999999991 survival_time_mean 4.899999999999991 survival_time_min 4.899999999999991
No reset possible 16327
1809
Bea Baselines 🐤template-ros lx22-BV1
sim-1of5 success yes davinci-stage-05-6.2.51
2022-11-27 20:51:06+00:00 2022-11-27 20:52:52+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5974642621432446
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5974642621432446 distance-from-start_median 0.5974642621432446 distance-from-start_min 0.5974642621432446 driven_any_max 0.5980230110654506 driven_any_mean 0.5980230110654506 driven_any_median 0.5980230110654506 driven_any_min 0.5980230110654506 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.099999999999997 in-drivable-lane_mean 3.099999999999997 in-drivable-lane_median 3.099999999999997 in-drivable-lane_min 3.099999999999997 per-episodes details {"d45-ego0": {"driven_any": 0.5980230110654506, "survival_time": 3.099999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 3.099999999999997, "deviation-heading": 0.0, "distance-from-start": 0.5974642621432446, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.099999999999997 survival_time_mean 3.099999999999997 survival_time_median 3.099999999999997 survival_time_min 3.099999999999997
No reset possible 16323
1812
Bea Baselines 🐤template-ros aido-hello-sim-validation
sanity-check success yes davinci-stage-05-6.2.51
2022-11-27 20:49:17+00:00 2022-11-27 20:50:33+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.04446353856716945 deviation-center-line_median 0.005979709794511572
other stats deviation-center-line_max 0.005979709794511572 deviation-center-line_mean 0.005979709794511572 deviation-center-line_min 0.005979709794511572 deviation-heading_max 0.26007996667228694 deviation-heading_mean 0.26007996667228694 deviation-heading_median 0.26007996667228694 deviation-heading_min 0.26007996667228694 distance-from-start_max 0.050371916415944934 distance-from-start_mean 0.050371916415944934 distance-from-start_median 0.050371916415944934 distance-from-start_min 0.050371916415944934 driven_any_max 0.050450758341584495 driven_any_mean 0.050450758341584495 driven_any_median 0.050450758341584495 driven_any_min 0.050450758341584495 driven_lanedir_consec_max 0.04446353856716945 driven_lanedir_consec_mean 0.04446353856716945 driven_lanedir_consec_min 0.04446353856716945 driven_lanedir_max 0.04446353856716945 driven_lanedir_mean 0.04446353856716945 driven_lanedir_median 0.04446353856716945 driven_lanedir_min 0.04446353856716945 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.050450758341584495, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04446353856716945, "in-drivable-lane": 0.0, "deviation-heading": 0.26007996667228694, "distance-from-start": 0.050371916415944934, "deviation-center-line": 0.005979709794511572, "driven_lanedir_consec": 0.04446353856716945}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16320
1817
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:47:29+00:00 2022-11-27 20:49:03+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16314
1818
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:44:28+00:00 2022-11-27 20:46:52+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.199999999999982 in-drivable-lane_median 6.549999999999984 driven_lanedir_consec_median 0.24925130448512367 deviation-center-line_median 0.12847446682195596
other stats deviation-center-line_max 0.12847446682195596 deviation-center-line_mean 0.12847446682195596 deviation-center-line_min 0.12847446682195596 deviation-heading_max 1.444217578603031 deviation-heading_mean 1.444217578603031 deviation-heading_median 1.444217578603031 deviation-heading_min 1.444217578603031 distance-from-start_max 1.9013944633213715 distance-from-start_mean 1.9013944633213715 distance-from-start_median 1.9013944633213715 distance-from-start_min 1.9013944633213715 driven_any_max 2.130217683529578 driven_any_mean 2.130217683529578 driven_any_median 2.130217683529578 driven_any_min 2.130217683529578 driven_lanedir_consec_max 0.24925130448512367 driven_lanedir_consec_mean 0.24925130448512367 driven_lanedir_consec_min 0.24925130448512367 driven_lanedir_max 0.24925130448512367 driven_lanedir_mean 0.24925130448512367 driven_lanedir_median 0.24925130448512367 driven_lanedir_min 0.24925130448512367 in-drivable-lane_max 6.549999999999984 in-drivable-lane_mean 6.549999999999984 in-drivable-lane_min 6.549999999999984 per-episodes details {"4way-000-ego0": {"driven_any": 2.130217683529578, "survival_time": 8.199999999999982, "driven_lanedir": 0.24925130448512367, "in-drivable-lane": 6.549999999999984, "deviation-heading": 1.444217578603031, "distance-from-start": 1.9013944633213715, "deviation-center-line": 0.12847446682195596, "driven_lanedir_consec": 0.24925130448512367}}simulation-passed 1 survival_time_max 8.199999999999982 survival_time_mean 8.199999999999982 survival_time_min 8.199999999999982
No reset possible 16309
1819
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:41:54+00:00 2022-11-27 20:44:06+00:00 0:02:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1124686039767373 survival_time_median 10.300000000000011 deviation-center-line_median 0.056188716962679075 in-drivable-lane_median 9.45000000000001
other stats deviation-center-line_max 0.056188716962679075 deviation-center-line_mean 0.056188716962679075 deviation-center-line_min 0.056188716962679075 deviation-heading_max 0.6400929479645148 deviation-heading_mean 0.6400929479645148 deviation-heading_median 0.6400929479645148 deviation-heading_min 0.6400929479645148 distance-from-start_max 2.7349936984545464 distance-from-start_mean 2.7349936984545464 distance-from-start_median 2.7349936984545464 distance-from-start_min 2.7349936984545464 driven_any_max 2.793786900684581 driven_any_mean 2.793786900684581 driven_any_median 2.793786900684581 driven_any_min 2.793786900684581 driven_lanedir_consec_max 0.1124686039767373 driven_lanedir_consec_mean 0.1124686039767373 driven_lanedir_consec_min 0.1124686039767373 driven_lanedir_max 0.1124686039767373 driven_lanedir_mean 0.1124686039767373 driven_lanedir_median 0.1124686039767373 driven_lanedir_min 0.1124686039767373 in-drivable-lane_max 9.45000000000001 in-drivable-lane_mean 9.45000000000001 in-drivable-lane_min 9.45000000000001 per-episodes details {"autolab-000-ego0": {"driven_any": 2.793786900684581, "survival_time": 10.300000000000011, "driven_lanedir": 0.1124686039767373, "in-drivable-lane": 9.45000000000001, "deviation-heading": 0.6400929479645148, "distance-from-start": 2.7349936984545464, "deviation-center-line": 0.056188716962679075, "driven_lanedir_consec": 0.1124686039767373}}simulation-passed 1 survival_time_max 10.300000000000011 survival_time_mean 10.300000000000011 survival_time_min 10.300000000000011
No reset possible 16304
1820
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:38:23+00:00 2022-11-27 20:41:21+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.899999999999991 in-drivable-lane_median 3.8499999999999903 driven_lanedir_consec_median 0.15870802871022005 deviation-center-line_median 0.09490846957194364
other stats deviation-center-line_max 0.23403533776392363 deviation-center-line_mean 0.12057472879484832 deviation-center-line_min 0.058446638271582446 deviation-heading_max 1.074233362059435 deviation-heading_mean 0.6661998694764152 deviation-heading_median 0.5771247638224529 deviation-heading_min 0.4363165882013197 distance-from-start_max 1.0928690479309795 distance-from-start_mean 0.5732607076917614 distance-from-start_median 0.43660940867077913 distance-from-start_min 0.3269549654945077 driven_any_max 1.1143603236763535 driven_any_mean 0.5807041943412821 driven_any_median 0.44040198577738654 driven_any_min 0.3276524821340016 driven_lanedir_consec_max 0.9846583324837388 driven_lanedir_consec_mean 0.35268523497053494 driven_lanedir_consec_min 0.10866654997796088 driven_lanedir_max 0.9846583324837388 driven_lanedir_mean 0.35268523497053494 driven_lanedir_median 0.15870802871022005 driven_lanedir_min 0.10866654997796088 in-drivable-lane_max 4.149999999999991 in-drivable-lane_mean 3.199999999999992 in-drivable-lane_min 0.9499999999999966 per-episodes details {"4way-000-ego0": {"driven_any": 0.5205641560061298, "survival_time": 4.899999999999991, "driven_lanedir": 0.10866654997796088, "in-drivable-lane": 3.9999999999999902, "deviation-heading": 0.6815406700295852, "distance-from-start": 0.5156135609709953, "deviation-center-line": 0.058446638271582446, "driven_lanedir_consec": 0.10866654997796088}, "4way-000-ego1": {"driven_any": 0.3602398155486433, "survival_time": 4.899999999999991, "driven_lanedir": 0.1927728261583712, "in-drivable-lane": 3.6999999999999904, "deviation-heading": 0.4363165882013197, "distance-from-start": 0.357605256370563, "deviation-center-line": 0.12004751202439948, "driven_lanedir_consec": 0.1927728261583712}, "4way-000-ego2": {"driven_any": 1.1143603236763535, "survival_time": 4.899999999999991, "driven_lanedir": 0.9846583324837388, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.074233362059435, "distance-from-start": 1.0928690479309795, "deviation-center-line": 0.23403533776392363, "driven_lanedir_consec": 0.9846583324837388}, "4way-000-ego3": {"driven_any": 0.3276524821340016, "survival_time": 4.899999999999991, "driven_lanedir": 0.12464323126206887, "in-drivable-lane": 4.149999999999991, "deviation-heading": 0.4727088576153206, "distance-from-start": 0.3269549654945077, "deviation-center-line": 0.06976942711948778, "driven_lanedir_consec": 0.12464323126206887}}simulation-passed 1 survival_time_max 4.899999999999991 survival_time_mean 4.899999999999991 survival_time_min 4.899999999999991
No reset possible 16299
1822
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 20:36:19+00:00 2022-11-27 20:38:09+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.65000000000003 in-drivable-lane_median 5.950000000000047 driven_lanedir_consec_median 1.4686512352597352 deviation-center-line_median 0.4873228403245476
other stats deviation-center-line_max 0.4873228403245476 deviation-center-line_mean 0.4873228403245476 deviation-center-line_min 0.4873228403245476 deviation-heading_max 2.4524449983717473 deviation-heading_mean 2.4524449983717473 deviation-heading_median 2.4524449983717473 deviation-heading_min 2.4524449983717473 distance-from-start_max 1.9807943641309136 distance-from-start_mean 1.9807943641309136 distance-from-start_median 1.9807943641309136 distance-from-start_min 1.9807943641309136 driven_any_max 3.269928528322151 driven_any_mean 3.269928528322151 driven_any_median 3.269928528322151 driven_any_min 3.269928528322151 driven_lanedir_consec_max 1.4686512352597352 driven_lanedir_consec_mean 1.4686512352597352 driven_lanedir_consec_min 1.4686512352597352 driven_lanedir_max 1.4686512352597352 driven_lanedir_mean 1.4686512352597352 driven_lanedir_median 1.4686512352597352 driven_lanedir_min 1.4686512352597352 in-drivable-lane_max 5.950000000000047 in-drivable-lane_mean 5.950000000000047 in-drivable-lane_min 5.950000000000047 per-episodes details {"loop2-000-ego0": {"driven_any": 3.269928528322151, "survival_time": 11.65000000000003, "driven_lanedir": 1.4686512352597352, "in-drivable-lane": 5.950000000000047, "deviation-heading": 2.4524449983717473, "distance-from-start": 1.9807943641309136, "deviation-center-line": 0.4873228403245476, "driven_lanedir_consec": 1.4686512352597352}}simulation-passed 1 survival_time_max 11.65000000000003 survival_time_mean 11.65000000000003 survival_time_min 11.65000000000003
No reset possible 16296
1848
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-05-6.2.51
2022-11-27 20:31:08+00:00 2022-11-27 20:36:12+00:00 0:05:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.759280027834195
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.759280027834195 distance-from-start_median 5.759280027834195 distance-from-start_min 5.759280027834195 driven_any_max 5.96101325868878 driven_any_mean 5.96101325868878 driven_any_median 5.96101325868878 driven_any_min 5.96101325868878 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 45.19999999999957 in-drivable-lane_mean 45.19999999999957 in-drivable-lane_median 45.19999999999957 in-drivable-lane_min 45.19999999999957 per-episodes details {"d30-ego0": {"driven_any": 5.96101325868878, "survival_time": 45.19999999999957, "driven_lanedir": 0.0, "in-drivable-lane": 45.19999999999957, "deviation-heading": 0.0, "distance-from-start": 5.759280027834195, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 45.19999999999957 survival_time_mean 45.19999999999957 survival_time_median 45.19999999999957 survival_time_min 45.19999999999957
No reset possible 16288
1843
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-1of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:28:51+00:00 2022-11-27 20:30:33+00:00 0:01:42 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16286
1844
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-0of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:27:32+00:00 2022-11-27 20:28:31+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16280
1845
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-1of4 host-error yes davinci-stage-05-6.2.51
2022-11-27 20:24:31+00:00 2022-11-27 20:26:25+00:00 0:01:54 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16276
1846
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-1of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:22:10+00:00 2022-11-27 20:24:03+00:00 0:01:53 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16269
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-1of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:20:06+00:00 2022-11-27 20:21:37+00:00 0:01:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16265
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-05-6.2.51
2022-11-27 20:17:43+00:00 2022-11-27 20:19:31+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.184486153139945
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.184486153139945 distance-from-start_median 1.184486153139945 distance-from-start_min 1.184486153139945 driven_any_max 1.5515229844064191 driven_any_mean 1.5515229844064191 driven_any_median 1.5515229844064191 driven_any_min 1.5515229844064191 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 5.349999999999989 in-drivable-lane_mean 5.349999999999989 in-drivable-lane_median 5.349999999999989 in-drivable-lane_min 5.349999999999989 per-episodes details {"d45-ego0": {"driven_any": 1.5515229844064191, "survival_time": 5.349999999999989, "driven_lanedir": 0.0, "in-drivable-lane": 5.349999999999989, "deviation-heading": 0.0, "distance-from-start": 1.184486153139945, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 5.349999999999989 survival_time_mean 5.349999999999989 survival_time_median 5.349999999999989 survival_time_min 5.349999999999989
No reset possible 16260
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success yes davinci-stage-05-6.2.51
2022-11-27 20:15:54+00:00 2022-11-27 20:17:26+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.32616750001817346
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.32616750001817346 distance-from-start_median 0.32616750001817346 distance-from-start_min 0.32616750001817346 driven_any_max 0.3261675000181755 driven_any_mean 0.3261675000181755 driven_any_median 0.3261675000181755 driven_any_min 0.3261675000181755 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.549999999999999 in-drivable-lane_mean 2.549999999999999 in-drivable-lane_median 2.549999999999999 in-drivable-lane_min 2.549999999999999 per-episodes details {"d40-ego0": {"driven_any": 0.3261675000181755, "survival_time": 2.549999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 2.549999999999999, "deviation-heading": 0.0, "distance-from-start": 0.32616750001817346, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.549999999999999 survival_time_mean 2.549999999999999 survival_time_median 2.549999999999999 survival_time_min 2.549999999999999
No reset possible 16257
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 aborted no davinci-stage-05-6.2.51
2022-11-27 20:14:24+00:00 2022-11-27 20:15:08+00:00 0:00:44 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16252
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-0of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:12:31+00:00 2022-11-27 20:13:56+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16247
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-1of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:10:32+00:00 2022-11-27 20:11:59+00:00 0:01:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16243
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-2of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:09:19+00:00 2022-11-27 20:10:17+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16240
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-0of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:08:12+00:00 2022-11-27 20:09:12+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16233
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-2of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:05:44+00:00 2022-11-27 20:07:48+00:00 0:02:04 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16227
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-2of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:03:42+00:00 2022-11-27 20:05:24+00:00 0:01:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16224
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-0of4 failed yes davinci-stage-05-6.2.51
2022-11-27 20:02:32+00:00 2022-11-27 20:03:35+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16218
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 19:55:23+00:00 2022-11-27 20:02:22+00:00 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.927486652539536 survival_time_median 59.99999999999873 deviation-center-line_median 2.965464144950961 in-drivable-lane_median 23.649999999999416
other stats deviation-center-line_max 2.965464144950961 deviation-center-line_mean 2.965464144950961 deviation-center-line_min 2.965464144950961 deviation-heading_max 28.47420136201491 deviation-heading_mean 28.47420136201491 deviation-heading_median 28.47420136201491 deviation-heading_min 28.47420136201491 distance-from-start_max 0.1479823032098923 distance-from-start_mean 0.1479823032098923 distance-from-start_median 0.1479823032098923 distance-from-start_min 0.1479823032098923 driven_any_max 10.783108745168224 driven_any_mean 10.783108745168224 driven_any_median 10.783108745168224 driven_any_min 10.783108745168224 driven_lanedir_consec_max -2.927486652539536 driven_lanedir_consec_mean -2.927486652539536 driven_lanedir_consec_min -2.927486652539536 driven_lanedir_max -2.927486652539536 driven_lanedir_mean -2.927486652539536 driven_lanedir_median -2.927486652539536 driven_lanedir_min -2.927486652539536 in-drivable-lane_max 23.649999999999416 in-drivable-lane_mean 23.649999999999416 in-drivable-lane_min 23.649999999999416 per-episodes details {"loop-000-ego0": {"driven_any": 10.783108745168224, "survival_time": 59.99999999999873, "driven_lanedir": -2.927486652539536, "in-drivable-lane": 23.649999999999416, "deviation-heading": 28.47420136201491, "distance-from-start": 0.1479823032098923, "deviation-center-line": 2.965464144950961, "driven_lanedir_consec": -2.927486652539536}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16212
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-3of4 failed yes davinci-stage-05-6.2.51
2022-11-27 19:54:13+00:00 2022-11-27 19:55:11+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16210
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-1of4 timeout yes davinci-stage-05-6.2.51
2022-11-27 19:52:10+00:00 2022-11-27 19:53:58+00:00 0:01:48 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16203
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-05-6.2.51
2022-11-27 07:04:57+00:00 2022-11-27 07:06:50+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5424300388603489
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5424300388603489 distance-from-start_median 0.5424300388603489 distance-from-start_min 0.5424300388603489 driven_any_max 0.5795592285422482 driven_any_mean 0.5795592285422482 driven_any_median 0.5795592285422482 driven_any_min 0.5795592285422482 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.6499999999999986 in-drivable-lane_mean 2.6499999999999986 in-drivable-lane_median 2.6499999999999986 in-drivable-lane_min 2.6499999999999986 per-episodes details {"d30-ego0": {"driven_any": 0.5795592285422482, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 2.6499999999999986, "deviation-heading": 0.0, "distance-from-start": 0.5424300388603489, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.6499999999999986 survival_time_mean 2.6499999999999986 survival_time_median 2.6499999999999986 survival_time_min 2.6499999999999986
No reset possible 16196
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-05-6.2.51
2022-11-27 03:48:09+00:00 2022-11-27 03:57:16+00:00 0:09:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16189
1596
Andrea Daniele planning-exercise lx22-planning-cc-empty-test
step1 success yes davinci-stage-05-6.2.51
2022-11-27 00:46:43+00:00 2022-11-27 01:03:19+00:00 0:16:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16184
1592
Andrea Daniele planning-exercise lx22-planning-dd-static-test
step1-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:42:10+00:00 2022-11-27 00:46:24+00:00 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16180
1586
Andrea Daniele planning-exercise lx22-planning-dd-static-vali
step1-0of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:37:02+00:00 2022-11-27 00:41:32+00:00 0:04:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.036006063470573536
other stats No reset possible 16176
1594
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-test
step1-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:36:11+00:00 2022-11-27 00:36:40+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16174
1595
Andrea Daniele planning-exercise lx22-planning-cc-static-test
step1-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:35:24+00:00 2022-11-27 00:35:58+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16170
1586
Andrea Daniele planning-exercise lx22-planning-dd-static-vali
step1-3of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:30:45+00:00 2022-11-27 00:34:56+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16168
1588
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-vali
step1-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:29:42+00:00 2022-11-27 00:30:10+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16166
1588
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-vali
step1-2of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:29:00+00:00 2022-11-27 00:29:28+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16159
1589
Andrea Daniele planning-exercise lx22-planning-cc-static-vali
step1-1of4 success yes davinci-stage-05-6.2.51
2022-11-27 00:27:31+00:00 2022-11-27 00:28:26+00:00 0:00:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16154
1584
Andrea Censi exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-05-6.2.51
2022-11-26 23:25:54+00:00 2022-11-26 23:36:30+00:00 0:10:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16148
1577
Andrea Censi planning-exercise lx22-planning-dd-static-test
step1-1of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:42:07+00:00 2022-11-26 22:46:52+00:00 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16146
1582
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 success yes davinci-stage-05-6.2.51
2022-11-26 22:40:33+00:00 2022-11-26 22:41:41+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate 0.39 false_positive_rate 0.47
other stats No reset possible 16143
1577
Andrea Censi planning-exercise lx22-planning-dd-static-test
step1-3of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:35:50+00:00 2022-11-26 22:40:15+00:00 0:04:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16142
1570
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-2of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:34:58+00:00 2022-11-26 22:35:45+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16137
1571
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-2of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:30:11+00:00 2022-11-26 22:34:37+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16135
1571
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-0of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:25:23+00:00 2022-11-26 22:30:05+00:00 0:04:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.036006063470573536
other stats No reset possible 16132
1579
Andrea Censi planning-exercise lx22-planning-cc-dynamic-test
step1-3of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:24:30+00:00 2022-11-26 22:25:17+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16126
1571
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-3of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:19:37+00:00 2022-11-26 22:24:10+00:00 0:04:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16118
1574
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-0of4 success yes davinci-stage-05-6.2.51
2022-11-26 22:14:48+00:00 2022-11-26 22:19:23+00:00 0:04:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16115
1558
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-0of4 failed yes davinci-stage-05-6.2.51
2022-11-26 21:00:36+00:00 2022-11-26 21:01:15+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16113
1559
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-2of4 failed yes davinci-stage-05-6.2.51
2022-11-26 20:59:44+00:00 2022-11-26 21:00:23+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16104
1559
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-1of4 failed yes davinci-stage-05-6.2.51
2022-11-26 20:58:30+00:00 2022-11-26 20:59:07+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16102
1560
Andrea Censi planning-exercise lx22-planning-dd-empty-vali
step1 failed yes davinci-stage-05-6.2.51
2022-11-26 20:57:45+00:00 2022-11-26 20:58:23+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16098
1562
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-2of4 failed yes davinci-stage-05-6.2.51
2022-11-26 20:54:08+00:00 2022-11-26 20:57:18+00:00 0:03:10 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16089
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-05-6.2.51
2022-11-26 19:41:57+00:00 2022-11-26 19:52:36+00:00 0:10:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16087
1556
Frank (Chude) Qian exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-05-6.2.51
2022-11-26 19:18:12+00:00 2022-11-26 19:26:40+00:00 0:08:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16080
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 host-error no davinci-stage-05-6.2.51
2022-11-25 17:13:26+00:00 2022-11-25 17:16:01+00:00 0:02:35 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-05-6.2.51-job16080-789128, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.51-job16080-789128', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16078
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 16:31:05+00:00 2022-11-25 17:05:43+00:00 0:34:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.799999999999336 driven_lanedir_consec_median -3.0389848679589777 deviation-center-line_median 2.914100463091116
other stats deviation-center-line_max 3.9477585319274167 deviation-center-line_mean 3.1081654602387356 deviation-center-line_min 2.656702382845294 deviation-heading_max 30.646670940839908 deviation-heading_mean 28.498397484719032 deviation-heading_median 28.378763939543155 deviation-heading_min 26.5893911189499 distance-from-start_max 0.20651763460190545 distance-from-start_mean 0.18513074444069913 distance-from-start_median 0.18461969907069073 distance-from-start_min 0.1647659450195096 driven_any_max 12.581111839525224 driven_any_mean 11.675733086759683 driven_any_median 11.670136152503758 driven_any_min 10.781548202506002 driven_lanedir_consec_max -2.6222003253743096 driven_lanedir_consec_mean -3.044865420772898 driven_lanedir_consec_min -3.4792916217993253 driven_lanedir_max -2.6778571306582184 driven_lanedir_mean -3.6288713023563206 driven_lanedir_median -3.165144988790228 driven_lanedir_min -5.507338101186607 in-drivable-lane_max 28.49999999999932 in-drivable-lane_mean 22.787499999999376 in-drivable-lane_min 15.049999999999496 per-episodes details {"loop-000-ego0": {"driven_any": 10.781548202506002, "survival_time": 59.99999999999873, "driven_lanedir": -2.6778571306582184, "in-drivable-lane": 24.69999999999933, "deviation-heading": 28.47058049678555, "distance-from-start": 0.19651016477152977, "deviation-center-line": 2.897948563329967, "driven_lanedir_consec": -2.6222003253743096}, "loop-000-ego1": {"driven_any": 11.61789327924788, "survival_time": 59.99999999999873, "driven_lanedir": -2.9377481479146215, "in-drivable-lane": 28.49999999999932, "deviation-heading": 26.5893911189499, "distance-from-start": 0.17272923336985171, "deviation-center-line": 2.9302523628522654, "driven_lanedir_consec": -2.9377481479146215}, "loop-000-ego2": {"driven_any": 12.581111839525224, "survival_time": 59.99999999999873, "driven_lanedir": -5.507338101186607, "in-drivable-lane": 15.049999999999496, "deviation-heading": 30.646670940839908, "distance-from-start": 0.20651763460190545, "deviation-center-line": 3.9477585319274167, "driven_lanedir_consec": -3.4792916217993253}, "loop-000-ego3": {"driven_any": 11.72237902575964, "survival_time": 59.99999999999873, "driven_lanedir": -3.3925418296658343, "in-drivable-lane": 22.899999999999345, "deviation-heading": 28.286947382300763, "distance-from-start": 0.1647659450195096, "deviation-center-line": 2.656702382845294, "driven_lanedir_consec": -3.1402215880033344}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16073
386
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 16:20:16+00:00 2022-11-25 16:30:30+00:00 0:10:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 14.84999999999947 driven_lanedir_consec_median -4.361125631378368 deviation-center-line_median 4.67502856453183
other stats deviation-center-line_max 4.67502856453183 deviation-center-line_mean 4.67502856453183 deviation-center-line_min 4.67502856453183 deviation-heading_max 29.26036058956054 deviation-heading_mean 29.26036058956054 deviation-heading_median 29.26036058956054 deviation-heading_min 29.26036058956054 distance-from-start_max 0.3193280087831494 distance-from-start_mean 0.3193280087831494 distance-from-start_median 0.3193280087831494 distance-from-start_min 0.3193280087831494 driven_any_max 14.859019065709912 driven_any_mean 14.859019065709912 driven_any_median 14.859019065709912 driven_any_min 14.859019065709912 driven_lanedir_consec_max -4.361125631378368 driven_lanedir_consec_mean -4.361125631378368 driven_lanedir_consec_min -4.361125631378368 driven_lanedir_max -7.900655719107809 driven_lanedir_mean -7.900655719107809 driven_lanedir_median -7.900655719107809 driven_lanedir_min -7.900655719107809 in-drivable-lane_max 14.84999999999947 in-drivable-lane_mean 14.84999999999947 in-drivable-lane_min 14.84999999999947 per-episodes details {"zigzag-000-ego0": {"driven_any": 14.859019065709912, "survival_time": 59.99999999999873, "driven_lanedir": -7.900655719107809, "in-drivable-lane": 14.84999999999947, "deviation-heading": 29.26036058956054, "distance-from-start": 0.3193280087831494, "deviation-center-line": 4.67502856453183, "driven_lanedir_consec": -4.361125631378368}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16067
387
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 16:00:14+00:00 2022-11-25 16:19:56+00:00 0:19:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 8.399999999999814 driven_lanedir_consec_median -4.604120560162658 deviation-center-line_median 5.916339428993071
other stats deviation-center-line_max 5.916339428993071 deviation-center-line_mean 5.916339428993071 deviation-center-line_min 5.916339428993071 deviation-heading_max 33.82236303177908 deviation-heading_mean 33.82236303177908 deviation-heading_median 33.82236303177908 deviation-heading_min 33.82236303177908 distance-from-start_max 0.3110978991074925 distance-from-start_mean 0.3110978991074925 distance-from-start_median 0.3110978991074925 distance-from-start_min 0.3110978991074925 driven_any_max 13.583215102739038 driven_any_mean 13.583215102739038 driven_any_median 13.583215102739038 driven_any_min 13.583215102739038 driven_lanedir_consec_max -4.604120560162658 driven_lanedir_consec_mean -4.604120560162658 driven_lanedir_consec_min -4.604120560162658 driven_lanedir_max -7.777995455635725 driven_lanedir_mean -7.777995455635725 driven_lanedir_median -7.777995455635725 driven_lanedir_min -7.777995455635725 in-drivable-lane_max 8.399999999999814 in-drivable-lane_mean 8.399999999999814 in-drivable-lane_min 8.399999999999814 per-episodes details {"zigzag-000-ego0": {"driven_any": 13.583215102739038, "survival_time": 59.99999999999873, "driven_lanedir": -7.777995455635725, "in-drivable-lane": 8.399999999999814, "deviation-heading": 33.82236303177908, "distance-from-start": 0.3110978991074925, "deviation-center-line": 5.916339428993071, "driven_lanedir_consec": -4.604120560162658}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16065
388
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 15:58:32+00:00 2022-11-25 16:00:01+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16063
388
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 15:56:51+00:00 2022-11-25 15:58:21+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16059
390
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 15:48:06+00:00 2022-11-25 15:56:38+00:00 0:08:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -3.3993912148390826 survival_time_median 59.99999999999873 deviation-center-line_median 2.665412657544988 in-drivable-lane_median 25.599999999999337
other stats deviation-center-line_max 2.665412657544988 deviation-center-line_mean 2.665412657544988 deviation-center-line_min 2.665412657544988 deviation-heading_max 28.183416177366485 deviation-heading_mean 28.183416177366485 deviation-heading_median 28.183416177366485 deviation-heading_min 28.183416177366485 distance-from-start_max 0.15177635743855117 distance-from-start_mean 0.15177635743855117 distance-from-start_median 0.15177635743855117 distance-from-start_min 0.15177635743855117 driven_any_max 12.145520715092692 driven_any_mean 12.145520715092692 driven_any_median 12.145520715092692 driven_any_min 12.145520715092692 driven_lanedir_consec_max -3.3993912148390826 driven_lanedir_consec_mean -3.3993912148390826 driven_lanedir_consec_min -3.3993912148390826 driven_lanedir_max -3.3993912148390826 driven_lanedir_mean -3.3993912148390826 driven_lanedir_median -3.3993912148390826 driven_lanedir_min -3.3993912148390826 in-drivable-lane_max 25.599999999999337 in-drivable-lane_mean 25.599999999999337 in-drivable-lane_min 25.599999999999337 per-episodes details {"autolab-000-ego0": {"driven_any": 12.145520715092692, "survival_time": 59.99999999999873, "driven_lanedir": -3.3993912148390826, "in-drivable-lane": 25.599999999999337, "deviation-heading": 28.183416177366485, "distance-from-start": 0.15177635743855117, "deviation-center-line": 2.665412657544988, "driven_lanedir_consec": -3.3993912148390826}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16049
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 15:14:06+00:00 2022-11-25 15:47:42+00:00 0:33:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 31.59999999999926 driven_lanedir_consec_median -2.844137148714699 deviation-center-line_median 2.072588332552473
other stats deviation-center-line_max 3.1812098077354705 deviation-center-line_mean 2.1440006954931214 deviation-center-line_min 1.2496163091320691 deviation-heading_max 32.28689424556786 deviation-heading_mean 23.040673339412 deviation-heading_median 24.325857803959675 deviation-heading_min 11.224083504160784 distance-from-start_max 0.1715706739875174 distance-from-start_mean 0.1613676353434629 distance-from-start_median 0.16410227805600755 distance-from-start_min 0.1456953112743192 driven_any_max 11.858558429530891 driven_any_mean 9.73977390860354 driven_any_median 11.447952087765897 driven_any_min 4.204633029351466 driven_lanedir_consec_max -0.10434065984874664 driven_lanedir_consec_mean -2.4122979175670527 driven_lanedir_consec_min -3.856576712990064 driven_lanedir_max -0.10434065984874664 driven_lanedir_mean -2.533561728319301 driven_lanedir_median -3.0866647702191967 driven_lanedir_min -3.856576712990064 in-drivable-lane_max 47.39999999999867 in-drivable-lane_mean 32.78749999999917 in-drivable-lane_min 20.549999999999493 per-episodes details {"zigzag-000-ego0": {"driven_any": 11.272086324097916, "survival_time": 59.99999999999873, "driven_lanedir": -3.6058179004977418, "in-drivable-lane": 20.549999999999493, "deviation-heading": 32.28689424556786, "distance-from-start": 0.16213994972520465, "deviation-center-line": 2.1080618548333185, "driven_lanedir_consec": -3.6058179004977418}, "zigzag-000-ego1": {"driven_any": 11.623817851433872, "survival_time": 59.99999999999873, "driven_lanedir": -3.856576712990064, "in-drivable-lane": 24.299999999999457, "deviation-heading": 31.037245148668127, "distance-from-start": 0.1456953112743192, "deviation-center-line": 3.1812098077354705, "driven_lanedir_consec": -3.856576712990064}, "zigzag-000-ego2": {"driven_any": 11.858558429530891, "survival_time": 59.99999999999873, "driven_lanedir": -2.567511639940652, "in-drivable-lane": 38.89999999999906, "deviation-heading": 17.614470459251223, "distance-from-start": 0.16606460638681045, "deviation-center-line": 2.037114810271628, "driven_lanedir_consec": -2.082456396931657}, "zigzag-000-ego3": {"driven_any": 4.204633029351466, "survival_time": 59.99999999999873, "driven_lanedir": -0.10434065984874664, "in-drivable-lane": 47.39999999999867, "deviation-heading": 11.224083504160784, "distance-from-start": 0.1715706739875174, "deviation-center-line": 1.2496163091320691, "driven_lanedir_consec": -0.10434065984874664}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16045
393
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 15:04:08+00:00 2022-11-25 15:13:44+00:00 0:09:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.399999999999313 driven_lanedir_consec_median -3.3214178502473564 deviation-center-line_median 2.864537991676434
other stats deviation-center-line_max 2.864537991676434 deviation-center-line_mean 2.864537991676434 deviation-center-line_min 2.864537991676434 deviation-heading_max 26.202419292287512 deviation-heading_mean 26.202419292287512 deviation-heading_median 26.202419292287512 deviation-heading_min 26.202419292287512 distance-from-start_max 0.15858075790528425 distance-from-start_mean 0.15858075790528425 distance-from-start_median 0.15858075790528425 distance-from-start_min 0.15858075790528425 driven_any_max 11.90752008719024 driven_any_mean 11.90752008719024 driven_any_median 11.90752008719024 driven_any_min 11.90752008719024 driven_lanedir_consec_max -3.3214178502473564 driven_lanedir_consec_mean -3.3214178502473564 driven_lanedir_consec_min -3.3214178502473564 driven_lanedir_max -3.3214178502473564 driven_lanedir_mean -3.3214178502473564 driven_lanedir_median -3.3214178502473564 driven_lanedir_min -3.3214178502473564 in-drivable-lane_max 30.399999999999313 in-drivable-lane_mean 30.399999999999313 in-drivable-lane_min 30.399999999999313 per-episodes details {"loop-000-ego0": {"driven_any": 11.90752008719024, "survival_time": 59.99999999999873, "driven_lanedir": -3.3214178502473564, "in-drivable-lane": 30.399999999999313, "deviation-heading": 26.202419292287512, "distance-from-start": 0.15858075790528425, "deviation-center-line": 2.864537991676434, "driven_lanedir_consec": -3.3214178502473564}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16043
393
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:59:32+00:00 2022-11-25 15:03:41+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.85000000000016 in-drivable-lane_median 8.300000000000093 driven_lanedir_consec_median -0.978885437806206 deviation-center-line_median 0.8954241442431231
other stats deviation-center-line_max 0.8954241442431231 deviation-center-line_mean 0.8954241442431231 deviation-center-line_min 0.8954241442431231 deviation-heading_max 10.728785198035272 deviation-heading_mean 10.728785198035272 deviation-heading_median 10.728785198035272 deviation-heading_min 10.728785198035272 distance-from-start_max 0.16867142443710975 distance-from-start_mean 0.16867142443710975 distance-from-start_median 0.16867142443710975 distance-from-start_min 0.16867142443710975 driven_any_max 3.685363692775411 driven_any_mean 3.685363692775411 driven_any_median 3.685363692775411 driven_any_min 3.685363692775411 driven_lanedir_consec_max -0.978885437806206 driven_lanedir_consec_mean -0.978885437806206 driven_lanedir_consec_min -0.978885437806206 driven_lanedir_max -0.978885437806206 driven_lanedir_mean -0.978885437806206 driven_lanedir_median -0.978885437806206 driven_lanedir_min -0.978885437806206 in-drivable-lane_max 8.300000000000093 in-drivable-lane_mean 8.300000000000093 in-drivable-lane_min 8.300000000000093 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.685363692775411, "survival_time": 20.85000000000016, "driven_lanedir": -0.978885437806206, "in-drivable-lane": 8.300000000000093, "deviation-heading": 10.728785198035272, "distance-from-start": 0.16867142443710975, "deviation-center-line": 0.8954241442431231, "driven_lanedir_consec": -0.978885437806206}}simulation-passed 1 survival_time_max 20.85000000000016 survival_time_mean 20.85000000000016 survival_time_min 20.85000000000016
No reset possible 16039
394
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 14:49:56+00:00 2022-11-25 14:59:23+00:00 0:09:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 24.24999999999949 driven_lanedir_consec_median -2.9433325508408186 deviation-center-line_median 3.3741568597261575
other stats deviation-center-line_max 3.3741568597261575 deviation-center-line_mean 3.3741568597261575 deviation-center-line_min 3.3741568597261575 deviation-heading_max 27.422845502752217 deviation-heading_mean 27.422845502752217 deviation-heading_median 27.422845502752217 deviation-heading_min 27.422845502752217 distance-from-start_max 0.15757237483345468 distance-from-start_mean 0.15757237483345468 distance-from-start_median 0.15757237483345468 distance-from-start_min 0.15757237483345468 driven_any_max 11.308906935888624 driven_any_mean 11.308906935888624 driven_any_median 11.308906935888624 driven_any_min 11.308906935888624 driven_lanedir_consec_max -2.9433325508408186 driven_lanedir_consec_mean -2.9433325508408186 driven_lanedir_consec_min -2.9433325508408186 driven_lanedir_max -2.9433325508408186 driven_lanedir_mean -2.9433325508408186 driven_lanedir_median -2.9433325508408186 driven_lanedir_min -2.9433325508408186 in-drivable-lane_max 24.24999999999949 in-drivable-lane_mean 24.24999999999949 in-drivable-lane_min 24.24999999999949 per-episodes details {"loop2-000-ego0": {"driven_any": 11.308906935888624, "survival_time": 59.99999999999873, "driven_lanedir": -2.9433325508408186, "in-drivable-lane": 24.24999999999949, "deviation-heading": 27.422845502752217, "distance-from-start": 0.15757237483345468, "deviation-center-line": 3.3741568597261575, "driven_lanedir_consec": -2.9433325508408186}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16037
395
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 14:42:23+00:00 2022-11-25 14:49:36+00:00 0:07:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.300000000000168 in-drivable-lane_median 9.700000000000076 driven_lanedir_consec_median -1.4570540314112013 deviation-center-line_median 0.4696054372955525
other stats deviation-center-line_max 0.4696054372955525 deviation-center-line_mean 0.4696054372955525 deviation-center-line_min 0.4696054372955525 deviation-heading_max 9.198476670531589 deviation-heading_mean 9.198476670531589 deviation-heading_median 9.198476670531589 deviation-heading_min 9.198476670531589 distance-from-start_max 0.1637998586269455 distance-from-start_mean 0.1637998586269455 distance-from-start_median 0.1637998586269455 distance-from-start_min 0.1637998586269455 driven_any_max 4.623766403409595 driven_any_mean 4.623766403409595 driven_any_median 4.623766403409595 driven_any_min 4.623766403409595 driven_lanedir_consec_max -1.4570540314112013 driven_lanedir_consec_mean -1.4570540314112013 driven_lanedir_consec_min -1.4570540314112013 driven_lanedir_max -1.4486520952224722 driven_lanedir_mean -1.4486520952224722 driven_lanedir_median -1.4486520952224722 driven_lanedir_min -1.4486520952224722 in-drivable-lane_max 9.700000000000076 in-drivable-lane_mean 9.700000000000076 in-drivable-lane_min 9.700000000000076 per-episodes details {"4way-000-ego0": {"driven_any": 4.623766403409595, "survival_time": 21.300000000000168, "driven_lanedir": -1.4486520952224722, "in-drivable-lane": 9.700000000000076, "deviation-heading": 9.198476670531589, "distance-from-start": 0.1637998586269455, "deviation-center-line": 0.4696054372955525, "driven_lanedir_consec": -1.4570540314112013}}simulation-passed 1 survival_time_max 21.300000000000168 survival_time_mean 21.300000000000168 survival_time_min 21.300000000000168
No reset possible 16036
395
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 14:40:15+00:00 2022-11-25 14:42:04+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16034
395
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:38:35+00:00 2022-11-25 14:40:03+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16032
396
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:36:48+00:00 2022-11-25 14:38:16+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16030
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:35:16+00:00 2022-11-25 14:36:29+00:00 0:01:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16024
514
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-validation
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:33:37+00:00 2022-11-25 14:34:52+00:00 0:01:15 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16020
515
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-validation
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:32:27+00:00 2022-11-25 14:33:24+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16014
516
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-validation
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:30:35+00:00 2022-11-25 14:32:02+00:00 0:01:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16009
517
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 14:28:45+00:00 2022-11-25 14:30:15+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16004
519
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-validation
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:27:33+00:00 2022-11-25 14:28:30+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16002
519
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-validation
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:26:31+00:00 2022-11-25 14:27:26+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15997
521
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-testing
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:24:42+00:00 2022-11-25 14:26:05+00:00 0:01:23 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15993
522
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-testing
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:23:16+00:00 2022-11-25 14:24:16+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15990
522
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-testing
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:22:00+00:00 2022-11-25 14:23:01+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15987
523
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-testing
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:20:20+00:00 2022-11-25 14:21:44+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15984
524
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-testing
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 14:18:38+00:00 2022-11-25 14:20:12+00:00 0:01:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15981
525
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:16:47+00:00 2022-11-25 14:18:24+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15972
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 14:07:13+00:00 2022-11-25 14:16:27+00:00 0:09:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 10.545305589967723 deviation-center-line_median 2.4280128605986784
other stats deviation-center-line_max 2.4803510657608667 deviation-center-line_mean 2.4280128605986784 deviation-center-line_min 2.37567465543649 deviation-heading_max 11.19365338341788 deviation-heading_mean 10.984489738460098 deviation-heading_median 10.984489738460098 deviation-heading_min 10.775326093502317 distance-from-start_max 1.0851263270913405 distance-from-start_mean 1.072522069068667 distance-from-start_median 1.072522069068667 distance-from-start_min 1.0599178110459937 driven_any_max 10.822838883377038 driven_any_mean 10.81476036039138 driven_any_median 10.81476036039138 driven_any_min 10.806681837405725 driven_lanedir_consec_max 10.547549973867326 driven_lanedir_consec_mean 10.545305589967723 driven_lanedir_consec_min 10.543061206068124 driven_lanedir_max 10.547549973867326 driven_lanedir_mean 10.545305589967723 driven_lanedir_median 10.545305589967723 driven_lanedir_min 10.543061206068124 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 10.822838883377038, "survival_time": 59.99999999999873, "driven_lanedir": 10.543061206068124, "in-drivable-lane": 0.0, "deviation-heading": 11.19365338341788, "distance-from-start": 1.0851263270913405, "deviation-center-line": 2.4803510657608667, "driven_lanedir_consec": 10.543061206068124}, "loop2-000-ego1": {"driven_any": 10.806681837405725, "survival_time": 59.99999999999873, "driven_lanedir": 10.547549973867326, "in-drivable-lane": 0.0, "deviation-heading": 10.775326093502317, "distance-from-start": 1.0599178110459937, "deviation-center-line": 2.37567465543649, "driven_lanedir_consec": 10.547549973867326}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15970
529
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 14:04:34+00:00 2022-11-25 14:07:06+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.90000000000002 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.608820644871392 deviation-center-line_median 0.6532866145887696
other stats deviation-center-line_max 0.6532866145887696 deviation-center-line_mean 0.6532866145887696 deviation-center-line_min 0.6532866145887696 deviation-heading_max 3.314722724790656 deviation-heading_mean 3.314722724790656 deviation-heading_median 3.314722724790656 deviation-heading_min 3.314722724790656 distance-from-start_max 1.4079399288691516 distance-from-start_mean 1.4079399288691516 distance-from-start_median 1.4079399288691516 distance-from-start_min 1.4079399288691516 driven_any_max 1.7379551495181564 driven_any_mean 1.7379551495181564 driven_any_median 1.7379551495181564 driven_any_min 1.7379551495181564 driven_lanedir_consec_max 1.608820644871392 driven_lanedir_consec_mean 1.608820644871392 driven_lanedir_consec_min 1.608820644871392 driven_lanedir_max 1.608820644871392 driven_lanedir_mean 1.608820644871392 driven_lanedir_median 1.608820644871392 driven_lanedir_min 1.608820644871392 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.7379551495181564, "survival_time": 10.90000000000002, "driven_lanedir": 1.608820644871392, "in-drivable-lane": 0.0, "deviation-heading": 3.314722724790656, "distance-from-start": 1.4079399288691516, "deviation-center-line": 0.6532866145887696, "driven_lanedir_consec": 1.608820644871392}}simulation-passed 1 survival_time_max 10.90000000000002 survival_time_mean 10.90000000000002 survival_time_min 10.90000000000002
No reset possible 15966
529
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 14:02:09+00:00 2022-11-25 14:04:21+00:00 0:02:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.55000000000003 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.2426739109924745 deviation-center-line_median 0.3265257204548337
other stats deviation-center-line_max 0.3265257204548337 deviation-center-line_mean 0.3265257204548337 deviation-center-line_min 0.3265257204548337 deviation-heading_max 1.9769419565735984 deviation-heading_mean 1.9769419565735984 deviation-heading_median 1.9769419565735984 deviation-heading_min 1.9769419565735984 distance-from-start_max 1.0973318601374134 distance-from-start_mean 1.0973318601374134 distance-from-start_median 1.0973318601374134 distance-from-start_min 1.0973318601374134 driven_any_max 1.2681558517138465 driven_any_mean 1.2681558517138465 driven_any_median 1.2681558517138465 driven_any_min 1.2681558517138465 driven_lanedir_consec_max 1.2426739109924745 driven_lanedir_consec_mean 1.2426739109924745 driven_lanedir_consec_min 1.2426739109924745 driven_lanedir_max 1.2426739109924745 driven_lanedir_mean 1.2426739109924745 driven_lanedir_median 1.2426739109924745 driven_lanedir_min 1.2426739109924745 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.2681558517138465, "survival_time": 11.55000000000003, "driven_lanedir": 1.2426739109924745, "in-drivable-lane": 0.0, "deviation-heading": 1.9769419565735984, "distance-from-start": 1.0973318601374134, "deviation-center-line": 0.3265257204548337, "driven_lanedir_consec": 1.2426739109924745}}simulation-passed 1 survival_time_max 11.55000000000003 survival_time_mean 11.55000000000003 survival_time_min 11.55000000000003
No reset possible 15965
530
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 13:58:45+00:00 2022-11-25 14:01:35+00:00 0:02:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.449999999999989 in-drivable-lane_median 0.6999999999999975 driven_lanedir_consec_median 0.8112008064540728 deviation-center-line_median 0.2133091367143772
other stats deviation-center-line_max 0.2133091367143772 deviation-center-line_mean 0.2133091367143772 deviation-center-line_min 0.2133091367143772 deviation-heading_max 1.2917139295236182 deviation-heading_mean 1.2917139295236182 deviation-heading_median 1.2917139295236182 deviation-heading_min 1.2917139295236182 distance-from-start_max 0.7727663096555661 distance-from-start_mean 0.7727663096555661 distance-from-start_median 0.7727663096555661 distance-from-start_min 0.7727663096555661 driven_any_max 0.8468954439708101 driven_any_mean 0.8468954439708101 driven_any_median 0.8468954439708101 driven_any_min 0.8468954439708101 driven_lanedir_consec_max 0.8112008064540728 driven_lanedir_consec_mean 0.8112008064540728 driven_lanedir_consec_min 0.8112008064540728 driven_lanedir_max 0.8112008064540728 driven_lanedir_mean 0.8112008064540728 driven_lanedir_median 0.8112008064540728 driven_lanedir_min 0.8112008064540728 in-drivable-lane_max 0.6999999999999975 in-drivable-lane_mean 0.6999999999999975 in-drivable-lane_min 0.6999999999999975 per-episodes details {"autolab-000-ego0": {"driven_any": 0.8468954439708101, "survival_time": 5.449999999999989, "driven_lanedir": 0.8112008064540728, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 1.2917139295236182, "distance-from-start": 0.7727663096555661, "deviation-center-line": 0.2133091367143772, "driven_lanedir_consec": 0.8112008064540728}}simulation-passed 1 survival_time_max 5.449999999999989 survival_time_mean 5.449999999999989 survival_time_min 5.449999999999989
No reset possible 15961
531
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 13:55:03+00:00 2022-11-25 13:58:25+00:00 0:03:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.5 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.257714295894386 deviation-center-line_median 0.36016891009394975
other stats deviation-center-line_max 0.36016891009394975 deviation-center-line_mean 0.36016891009394975 deviation-center-line_min 0.36016891009394975 deviation-heading_max 2.410647634992213 deviation-heading_mean 2.410647634992213 deviation-heading_median 2.410647634992213 deviation-heading_min 2.410647634992213 distance-from-start_max 0.9443743599835686 distance-from-start_mean 0.9443743599835686 distance-from-start_median 0.9443743599835686 distance-from-start_min 0.9443743599835686 driven_any_max 1.3046354021354185 driven_any_mean 1.3046354021354185 driven_any_median 1.3046354021354185 driven_any_min 1.3046354021354185 driven_lanedir_consec_max 1.257714295894386 driven_lanedir_consec_mean 1.257714295894386 driven_lanedir_consec_min 1.257714295894386 driven_lanedir_max 1.257714295894386 driven_lanedir_mean 1.257714295894386 driven_lanedir_median 1.257714295894386 driven_lanedir_min 1.257714295894386 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.3046354021354185, "survival_time": 9.5, "driven_lanedir": 1.257714295894386, "in-drivable-lane": 0.0, "deviation-heading": 2.410647634992213, "distance-from-start": 0.9443743599835686, "deviation-center-line": 0.36016891009394975, "driven_lanedir_consec": 1.257714295894386}}simulation-passed 1 survival_time_max 9.5 survival_time_mean 9.5 survival_time_min 9.5
No reset possible 15943
535
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 13:31:37+00:00 2022-11-25 13:54:42+00:00 0:23:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 9.090911260676428 deviation-center-line_median 3.158220939383041
other stats deviation-center-line_max 3.2726003268484005 deviation-center-line_mean 2.9005652909130246 deviation-center-line_min 2.013218958037615 deviation-heading_max 15.727020708905702 deviation-heading_mean 12.049798669934637 deviation-heading_median 11.742110738067034 deviation-heading_min 8.98795249469877 distance-from-start_max 5.043642941193645 distance-from-start_mean 4.087322040319058 distance-from-start_median 4.432043047819415 distance-from-start_min 2.441559124443755 driven_any_max 9.926792143482606 driven_any_mean 9.353832670613544 driven_any_median 9.398643811763431 driven_any_min 8.691250915444705 driven_lanedir_consec_max 9.416669476501491 driven_lanedir_consec_mean 9.031342310340042 driven_lanedir_consec_min 8.526877243505817 driven_lanedir_max 9.416669476501491 driven_lanedir_mean 9.031342310340042 driven_lanedir_median 9.090911260676428 driven_lanedir_min 8.526877243505817 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.748841061611978, "survival_time": 59.99999999999873, "driven_lanedir": 9.416669476501491, "in-drivable-lane": 0.0, "deviation-heading": 12.395015578735787, "distance-from-start": 2.441559124443755, "deviation-center-line": 3.1492094193341753, "driven_lanedir_consec": 9.416669476501491}, "zigzag-000-ego1": {"driven_any": 8.691250915444705, "survival_time": 59.99999999999873, "driven_lanedir": 8.526877243505817, "in-drivable-lane": 0.0, "deviation-heading": 8.98795249469877, "distance-from-start": 4.438055613918835, "deviation-center-line": 2.013218958037615, "driven_lanedir_consec": 8.526877243505817}, "zigzag-000-ego2": {"driven_any": 9.048446561914885, "survival_time": 59.99999999999873, "driven_lanedir": 8.810730384881285, "in-drivable-lane": 0.0, "deviation-heading": 11.089205897398278, "distance-from-start": 4.426030481719995, "deviation-center-line": 3.167232459431907, "driven_lanedir_consec": 8.810730384881285}, "zigzag-000-ego3": {"driven_any": 9.926792143482606, "survival_time": 59.99999999999873, "driven_lanedir": 9.371092136471573, "in-drivable-lane": 0.0, "deviation-heading": 15.727020708905702, "distance-from-start": 5.043642941193645, "deviation-center-line": 3.2726003268484005, "driven_lanedir_consec": 9.371092136471573}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15940
536
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 13:29:00+00:00 2022-11-25 13:31:18+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.050000000000107 in-drivable-lane_median 8.950000000000106 driven_lanedir_consec_median 1.2033110872409492 deviation-center-line_median 0.5560616676032651
other stats deviation-center-line_max 0.5560616676032651 deviation-center-line_mean 0.5560616676032651 deviation-center-line_min 0.5560616676032651 deviation-heading_max 4.077190486693433 deviation-heading_mean 4.077190486693433 deviation-heading_median 4.077190486693433 deviation-heading_min 4.077190486693433 distance-from-start_max 1.8012058195666234 distance-from-start_mean 1.8012058195666234 distance-from-start_median 1.8012058195666234 distance-from-start_min 1.8012058195666234 driven_any_max 2.866804557852363 driven_any_mean 2.866804557852363 driven_any_median 2.866804557852363 driven_any_min 2.866804557852363 driven_lanedir_consec_max 1.2033110872409492 driven_lanedir_consec_mean 1.2033110872409492 driven_lanedir_consec_min 1.2033110872409492 driven_lanedir_max 1.2033110872409492 driven_lanedir_mean 1.2033110872409492 driven_lanedir_median 1.2033110872409492 driven_lanedir_min 1.2033110872409492 in-drivable-lane_max 8.950000000000106 in-drivable-lane_mean 8.950000000000106 in-drivable-lane_min 8.950000000000106 per-episodes details {"loop2-000-ego0": {"driven_any": 2.866804557852363, "survival_time": 17.050000000000107, "driven_lanedir": 1.2033110872409492, "in-drivable-lane": 8.950000000000106, "deviation-heading": 4.077190486693433, "distance-from-start": 1.8012058195666234, "deviation-center-line": 0.5560616676032651, "driven_lanedir_consec": 1.2033110872409492}}simulation-passed 1 survival_time_max 17.050000000000107 survival_time_mean 17.050000000000107 survival_time_min 17.050000000000107
No reset possible 15937
536
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 13:26:17+00:00 2022-11-25 13:28:53+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.000000000000107 in-drivable-lane_median 0.350000000000005 driven_lanedir_consec_median 2.9145641529210655 deviation-center-line_median 0.9809769598654964
other stats deviation-center-line_max 0.9809769598654964 deviation-center-line_mean 0.9809769598654964 deviation-center-line_min 0.9809769598654964 deviation-heading_max 4.450453408112397 deviation-heading_mean 4.450453408112397 deviation-heading_median 4.450453408112397 deviation-heading_min 4.450453408112397 distance-from-start_max 1.6673746557307765 distance-from-start_mean 1.6673746557307765 distance-from-start_median 1.6673746557307765 distance-from-start_min 1.6673746557307765 driven_any_max 3.108601374188401 driven_any_mean 3.108601374188401 driven_any_median 3.108601374188401 driven_any_min 3.108601374188401 driven_lanedir_consec_max 2.9145641529210655 driven_lanedir_consec_mean 2.9145641529210655 driven_lanedir_consec_min 2.9145641529210655 driven_lanedir_max 2.9145641529210655 driven_lanedir_mean 2.9145641529210655 driven_lanedir_median 2.9145641529210655 driven_lanedir_min 2.9145641529210655 in-drivable-lane_max 0.350000000000005 in-drivable-lane_mean 0.350000000000005 in-drivable-lane_min 0.350000000000005 per-episodes details {"loop-000-ego0": {"driven_any": 3.108601374188401, "survival_time": 17.000000000000107, "driven_lanedir": 2.9145641529210655, "in-drivable-lane": 0.350000000000005, "deviation-heading": 4.450453408112397, "distance-from-start": 1.6673746557307765, "deviation-center-line": 0.9809769598654964, "driven_lanedir_consec": 2.9145641529210655}}simulation-passed 1 survival_time_max 17.000000000000107 survival_time_mean 17.000000000000107 survival_time_min 17.000000000000107
No reset possible 15934
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 13:18:07+00:00 2022-11-25 13:25:55+00:00 0:07:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.6499999999999737 driven_lanedir_consec_median 9.723166176267982 deviation-center-line_median 4.0039273964299795
other stats deviation-center-line_max 4.0039273964299795 deviation-center-line_mean 4.0039273964299795 deviation-center-line_min 4.0039273964299795 deviation-heading_max 21.20196126661224 deviation-heading_mean 21.20196126661224 deviation-heading_median 21.20196126661224 deviation-heading_min 21.20196126661224 distance-from-start_max 1.6019283071733272 distance-from-start_mean 1.6019283071733272 distance-from-start_median 1.6019283071733272 distance-from-start_min 1.6019283071733272 driven_any_max 11.595428923016884 driven_any_mean 11.595428923016884 driven_any_median 11.595428923016884 driven_any_min 11.595428923016884 driven_lanedir_consec_max 9.723166176267982 driven_lanedir_consec_mean 9.723166176267982 driven_lanedir_consec_min 9.723166176267982 driven_lanedir_max 9.723166176267982 driven_lanedir_mean 9.723166176267982 driven_lanedir_median 9.723166176267982 driven_lanedir_min 9.723166176267982 in-drivable-lane_max 3.6499999999999737 in-drivable-lane_mean 3.6499999999999737 in-drivable-lane_min 3.6499999999999737 per-episodes details {"loop2-000-ego0": {"driven_any": 11.595428923016884, "survival_time": 59.99999999999873, "driven_lanedir": 9.723166176267982, "in-drivable-lane": 3.6499999999999737, "deviation-heading": 21.20196126661224, "distance-from-start": 1.6019283071733272, "deviation-center-line": 4.0039273964299795, "driven_lanedir_consec": 9.723166176267982}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15920
542
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 13:03:23+00:00 2022-11-25 13:17:45+00:00 0:14:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.74999999999965 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3776334902351723 deviation-center-line_median 2.0752278597712897
other stats deviation-center-line_max 3.567125211202066 deviation-center-line_mean 2.027006599410085 deviation-center-line_min 0.3904454668956948 deviation-heading_max 19.98364521801826 deviation-heading_mean 10.629474507570622 deviation-heading_median 10.194137600830317 deviation-heading_min 2.145977610603595 distance-from-start_max 3.268941664027547 distance-from-start_mean 1.5219349924514316 distance-from-start_median 0.9557516755446208 distance-from-start_min 0.9072949546889378 driven_any_max 7.52462696436585 driven_any_mean 3.444581384571768 driven_any_median 2.5040601045471753 driven_any_min 1.2455783648268717 driven_lanedir_consec_max 6.563424914724208 driven_lanedir_consec_mean 3.084003346253565 driven_lanedir_consec_min 1.0173214898197072 driven_lanedir_max 7.094709066961351 driven_lanedir_mean 3.216824384312851 driven_lanedir_median 2.3776334902351723 driven_lanedir_min 1.0173214898197072 in-drivable-lane_max 35.79999999999967 in-drivable-lane_mean 8.949999999999918 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.2646227493266398, "survival_time": 43.74999999999965, "driven_lanedir": 1.206201667552786, "in-drivable-lane": 0.0, "deviation-heading": 8.978736047543661, "distance-from-start": 0.9662516506314232, "deviation-center-line": 1.6958892530684229, "driven_lanedir_consec": 1.206201667552786}, "4way-000-ego1": {"driven_any": 3.74349745976771, "survival_time": 43.74999999999965, "driven_lanedir": 3.5490653129175587, "in-drivable-lane": 0.0, "deviation-heading": 19.98364521801826, "distance-from-start": 0.9452517004578184, "deviation-center-line": 3.567125211202066, "driven_lanedir_consec": 3.5490653129175587}, "4way-000-ego2": {"driven_any": 1.2455783648268717, "survival_time": 43.74999999999965, "driven_lanedir": 1.0173214898197072, "in-drivable-lane": 35.79999999999967, "deviation-heading": 2.145977610603595, "distance-from-start": 0.9072949546889378, "deviation-center-line": 0.3904454668956948, "driven_lanedir_consec": 1.0173214898197072}, "4way-000-ego3": {"driven_any": 7.52462696436585, "survival_time": 43.74999999999965, "driven_lanedir": 7.094709066961351, "in-drivable-lane": 0.0, "deviation-heading": 11.40953915411697, "distance-from-start": 3.268941664027547, "deviation-center-line": 2.454566466474157, "driven_lanedir_consec": 6.563424914724208}}simulation-passed 1 survival_time_max 43.74999999999965 survival_time_mean 43.74999999999965 survival_time_min 43.74999999999965
No reset possible 15916
617
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035 aido-hello-sim-validation
sanity-check success no davinci-stage-05-6.2.51
2022-11-25 13:02:11+00:00 2022-11-25 13:03:17+00:00 0:01:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0685239140380891 deviation-center-line_median 0.008288071749605065
other stats deviation-center-line_max 0.008288071749605065 deviation-center-line_mean 0.008288071749605065 deviation-center-line_min 0.008288071749605065 deviation-heading_max 0.2761395018631402 deviation-heading_mean 0.2761395018631402 deviation-heading_median 0.2761395018631402 deviation-heading_min 0.2761395018631402 distance-from-start_max 0.08149308313969392 distance-from-start_mean 0.08149308313969392 distance-from-start_median 0.08149308313969392 distance-from-start_min 0.08149308313969392 driven_any_max 0.08151009612589004 driven_any_mean 0.08151009612589004 driven_any_median 0.08151009612589004 driven_any_min 0.08151009612589004 driven_lanedir_consec_max 0.0685239140380891 driven_lanedir_consec_mean 0.0685239140380891 driven_lanedir_consec_min 0.0685239140380891 driven_lanedir_max 0.0685239140380891 driven_lanedir_mean 0.0685239140380891 driven_lanedir_median 0.0685239140380891 driven_lanedir_min 0.0685239140380891 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.08151009612589004, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0685239140380891, "in-drivable-lane": 0.0, "deviation-heading": 0.2761395018631402, "distance-from-start": 0.08149308313969392, "deviation-center-line": 0.008288071749605065, "driven_lanedir_consec": 0.0685239140380891}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15911
768
Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484 aido-hello-sim-validation
sanity-check success no davinci-stage-05-6.2.51
2022-11-25 13:00:56+00:00 2022-11-25 13:02:05+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.00929100987989684 deviation-center-line_median 0.007007135405909351
other stats deviation-center-line_max 0.007007135405909351 deviation-center-line_mean 0.007007135405909351 deviation-center-line_min 0.007007135405909351 deviation-heading_max 0.2628760768576907 deviation-heading_mean 0.2628760768576907 deviation-heading_median 0.2628760768576907 deviation-heading_min 0.2628760768576907 distance-from-start_max 0.010492653603379197 distance-from-start_mean 0.010492653603379197 distance-from-start_median 0.010492653603379197 distance-from-start_min 0.010492653603379197 driven_any_max 0.010496763921740284 driven_any_mean 0.010496763921740284 driven_any_median 0.010496763921740284 driven_any_min 0.010496763921740284 driven_lanedir_consec_max 0.00929100987989684 driven_lanedir_consec_mean 0.00929100987989684 driven_lanedir_consec_min 0.00929100987989684 driven_lanedir_max 0.00929100987989684 driven_lanedir_mean 0.00929100987989684 driven_lanedir_median 0.00929100987989684 driven_lanedir_min 0.00929100987989684 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.010496763921740284, "survival_time": 0.49999999999999994, "driven_lanedir": 0.00929100987989684, "in-drivable-lane": 0.0, "deviation-heading": 0.2628760768576907, "distance-from-start": 0.010492653603379197, "deviation-center-line": 0.007007135405909351, "driven_lanedir_consec": 0.00929100987989684}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15901
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 12:55:52+00:00 2022-11-25 13:00:35+00:00 0:04:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 9.938760268113356e-05 deviation-center-line_median 0.8948971250979786
other stats deviation-center-line_max 0.8948971250979786 deviation-center-line_mean 0.8948971250979786 deviation-center-line_min 0.8948971250979786 deviation-heading_max 32.2491476465892 deviation-heading_mean 32.2491476465892 deviation-heading_median 32.2491476465892 deviation-heading_min 32.2491476465892 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 9.938760268113356e-05 driven_lanedir_consec_mean 9.938760268113356e-05 driven_lanedir_consec_min 9.938760268113356e-05 driven_lanedir_max 9.938760268113356e-05 driven_lanedir_mean 9.938760268113356e-05 driven_lanedir_median 9.938760268113356e-05 driven_lanedir_min 9.938760268113356e-05 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 9.938760268113356e-05, "in-drivable-lane": 0.0, "deviation-heading": 32.2491476465892, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8948971250979786, "driven_lanedir_consec": 9.938760268113356e-05}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15893
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 12:45:11+00:00 2022-11-25 12:55:31+00:00 0:10:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.35641596777958673 deviation-center-line_median 0.5955312146522322
other stats deviation-center-line_max 2.128491974247639 deviation-center-line_mean 0.9139675952717752 deviation-center-line_min 0.33631597753499803 deviation-heading_max 30.712966764077652 deviation-heading_mean 12.7034688538512 deviation-heading_median 8.860215367203583 deviation-heading_min 2.3804779169199795 distance-from-start_max 2.866773837264375 distance-from-start_mean 0.8802267381267181 distance-from-start_median 0.3270665576212487 distance-from-start_min 2.2887833992611187e-16 driven_any_max 4.95910239753371 driven_any_mean 1.4197330129653098 driven_any_median 0.3599148271636274 driven_any_min 2.746540079113375e-13 driven_lanedir_consec_max 4.9492867887322785 driven_lanedir_consec_mean 1.415529681072863 driven_lanedir_consec_min 0.0 driven_lanedir_max 4.9492867887322785 driven_lanedir_mean 1.415529681072863 driven_lanedir_median 0.35641596777958673 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.7198296543267219, "survival_time": 59.99999999999873, "driven_lanedir": 0.7128319355591735, "in-drivable-lane": 0.0, "deviation-heading": 3.8060895796891416, "distance-from-start": 0.654133115242497, "deviation-center-line": 0.8533318010395783, "driven_lanedir_consec": 0.7128319355591735}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 4.95910239753371, "survival_time": 59.99999999999873, "driven_lanedir": 4.9492867887322785, "in-drivable-lane": 0.0, "deviation-heading": 2.3804779169199795, "distance-from-start": 2.866773837264375, "deviation-center-line": 0.33631597753499803, "driven_lanedir_consec": 4.9492867887322785}, "udem-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.33773062826488615, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15888
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 12:34:20+00:00 2022-11-25 12:44:40+00:00 0:10:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3318472576969511 deviation-center-line_median 0.6648693526614008
other stats deviation-center-line_max 0.6648693526614008 deviation-center-line_mean 0.6648693526614008 deviation-center-line_min 0.6648693526614008 deviation-heading_max 4.49371507747449 deviation-heading_mean 4.49371507747449 deviation-heading_median 4.49371507747449 deviation-heading_min 4.49371507747449 distance-from-start_max 1.4319552848600958 distance-from-start_mean 1.4319552848600958 distance-from-start_median 1.4319552848600958 distance-from-start_min 1.4319552848600958 driven_any_max 1.8616750012145875 driven_any_mean 1.8616750012145875 driven_any_median 1.8616750012145875 driven_any_min 1.8616750012145875 driven_lanedir_consec_max 1.3318472576969511 driven_lanedir_consec_mean 1.3318472576969511 driven_lanedir_consec_min 1.3318472576969511 driven_lanedir_max 1.8544941763277367 driven_lanedir_mean 1.8544941763277367 driven_lanedir_median 1.8544941763277367 driven_lanedir_min 1.8544941763277367 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.8616750012145875, "survival_time": 59.99999999999873, "driven_lanedir": 1.8544941763277367, "in-drivable-lane": 0.0, "deviation-heading": 4.49371507747449, "distance-from-start": 1.4319552848600958, "deviation-center-line": 0.6648693526614008, "driven_lanedir_consec": 1.3318472576969511}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15882
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 12:30:32+00:00 2022-11-25 12:34:14+00:00 0:03:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.250000000000306 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.064552505017095 deviation-center-line_median 0.2147705908085717
other stats deviation-center-line_max 0.2147705908085717 deviation-center-line_mean 0.2147705908085717 deviation-center-line_min 0.2147705908085717 deviation-heading_max 2.0427908857831625 deviation-heading_mean 2.0427908857831625 deviation-heading_median 2.0427908857831625 deviation-heading_min 2.0427908857831625 distance-from-start_max 2.4774569280358056 distance-from-start_mean 2.4774569280358056 distance-from-start_median 2.4774569280358056 distance-from-start_min 2.4774569280358056 driven_any_max 3.0766443175721947 driven_any_mean 3.0766443175721947 driven_any_median 3.0766443175721947 driven_any_min 3.0766443175721947 driven_lanedir_consec_max 3.064552505017095 driven_lanedir_consec_mean 3.064552505017095 driven_lanedir_consec_min 3.064552505017095 driven_lanedir_max 3.064552505017095 driven_lanedir_mean 3.064552505017095 driven_lanedir_median 3.064552505017095 driven_lanedir_min 3.064552505017095 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.0766443175721947, "survival_time": 32.250000000000306, "driven_lanedir": 3.064552505017095, "in-drivable-lane": 0.0, "deviation-heading": 2.0427908857831625, "distance-from-start": 2.4774569280358056, "deviation-center-line": 0.2147705908085717, "driven_lanedir_consec": 3.064552505017095}}simulation-passed 1 survival_time_max 32.250000000000306 survival_time_mean 32.250000000000306 survival_time_min 32.250000000000306
No reset possible 15877
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 12:25:35+00:00 2022-11-25 12:30:12+00:00 0:04:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.791208880785928 deviation-center-line_median 0.422779318982871
other stats deviation-center-line_max 0.422779318982871 deviation-center-line_mean 0.422779318982871 deviation-center-line_min 0.422779318982871 deviation-heading_max 3.5609142078788527 deviation-heading_mean 3.5609142078788527 deviation-heading_median 3.5609142078788527 deviation-heading_min 3.5609142078788527 distance-from-start_max 3.7147561232030184 distance-from-start_mean 3.7147561232030184 distance-from-start_median 3.7147561232030184 distance-from-start_min 3.7147561232030184 driven_any_max 5.812151887501377 driven_any_mean 5.812151887501377 driven_any_median 5.812151887501377 driven_any_min 5.812151887501377 driven_lanedir_consec_max 5.791208880785928 driven_lanedir_consec_mean 5.791208880785928 driven_lanedir_consec_min 5.791208880785928 driven_lanedir_max 5.791208880785928 driven_lanedir_mean 5.791208880785928 driven_lanedir_median 5.791208880785928 driven_lanedir_min 5.791208880785928 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.812151887501377, "survival_time": 59.99999999999873, "driven_lanedir": 5.791208880785928, "in-drivable-lane": 0.0, "deviation-heading": 3.5609142078788527, "distance-from-start": 3.7147561232030184, "deviation-center-line": 0.422779318982871, "driven_lanedir_consec": 5.791208880785928}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15872
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 12:20:27+00:00 2022-11-25 12:25:22+00:00 0:04:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065102356187873
other stats deviation-center-line_max 0.4065102356187873 deviation-center-line_mean 0.4065102356187873 deviation-center-line_min 0.4065102356187873 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 7.63278329429795e-17 distance-from-start_mean 7.63278329429795e-17 distance-from-start_median 7.63278329429795e-17 distance-from-start_min 7.63278329429795e-17 driven_any_max 9.15933995315754e-14 driven_any_mean 9.15933995315754e-14 driven_any_median 9.15933995315754e-14 driven_any_min 9.15933995315754e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356187873, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15867
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 12:08:43+00:00 2022-11-25 12:19:49+00:00 0:11:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.9255344112495525 deviation-center-line_median 0.16823253637776917
other stats deviation-center-line_max 0.16823253637776917 deviation-center-line_mean 0.16823253637776917 deviation-center-line_min 0.16823253637776917 deviation-heading_max 1.2427067181497071 deviation-heading_mean 1.2427067181497071 deviation-heading_median 1.2427067181497071 deviation-heading_min 1.2427067181497071 distance-from-start_max 3.1528512934161523 distance-from-start_mean 3.1528512934161523 distance-from-start_median 3.1528512934161523 distance-from-start_min 3.1528512934161523 driven_any_max 5.930776876357659 driven_any_mean 5.930776876357659 driven_any_median 5.930776876357659 driven_any_min 5.930776876357659 driven_lanedir_consec_max 5.9255344112495525 driven_lanedir_consec_mean 5.9255344112495525 driven_lanedir_consec_min 5.9255344112495525 driven_lanedir_max 5.9255344226858995 driven_lanedir_mean 5.9255344226858995 driven_lanedir_median 5.9255344226858995 driven_lanedir_min 5.9255344226858995 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.930776876357659, "survival_time": 59.99999999999873, "driven_lanedir": 5.9255344226858995, "in-drivable-lane": 0.0, "deviation-heading": 1.2427067181497071, "distance-from-start": 3.1528512934161523, "deviation-center-line": 0.16823253637776917, "driven_lanedir_consec": 5.9255344112495525}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15862
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 11:58:59+00:00 2022-11-25 12:08:37+00:00 0:09:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.806165216596741 deviation-center-line_median 0.346929751854674
other stats deviation-center-line_max 3.4683962371431485 deviation-center-line_mean 1.0771419870569272 deviation-center-line_min 0.14631220737521272 deviation-heading_max 18.309428016005143 deviation-heading_mean 6.183544615708726 deviation-heading_median 2.5217690015662964 deviation-heading_min 1.3812124436971696 distance-from-start_max 3.2999669320195104 distance-from-start_mean 1.5546858371442225 distance-from-start_median 1.459388208278689 distance-from-start_min 3.1401849173675503e-16 driven_any_max 5.037078959860759 driven_any_mean 2.168309320245248 driven_any_median 1.818079160559928 driven_any_min 3.7682219008410875e-13 driven_lanedir_consec_max 5.026911335982149 driven_lanedir_consec_mean 2.159846205080773 driven_lanedir_consec_min 0.0001430511474609375 driven_lanedir_max 5.026911335982149 driven_lanedir_mean 2.159846205080773 driven_lanedir_median 1.806165216596741 driven_lanedir_min 0.0001430511474609375 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.631893286204257, "survival_time": 59.99999999999873, "driven_lanedir": 1.6201843097857167, "in-drivable-lane": 0.0, "deviation-heading": 1.3812124436971696, "distance-from-start": 1.2742263432539964, "deviation-center-line": 0.14631220737521272, "driven_lanedir_consec": 1.6201843097857167}, "autolab-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0001430511474609375}, "autolab-000-ego2": {"driven_any": 5.037078959860759, "survival_time": 59.99999999999873, "driven_lanedir": 5.026911335982149, "in-drivable-lane": 0.0, "deviation-heading": 2.8050873323880503, "distance-from-start": 3.2999669320195104, "deviation-center-line": 0.3909808473609087, "driven_lanedir_consec": 5.026911335982149}, "autolab-000-ego3": {"driven_any": 2.0042650349155986, "survival_time": 59.99999999999873, "driven_lanedir": 1.992146123407765, "in-drivable-lane": 0.0, "deviation-heading": 2.2384506707445424, "distance-from-start": 1.644550073303382, "deviation-center-line": 0.3028786563484393, "driven_lanedir_consec": 1.992146123407765}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15857
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 11:48:21+00:00 2022-11-25 11:58:35+00:00 0:10:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.085488757766068 deviation-center-line_median 0.29109357156287574
other stats deviation-center-line_max 0.29109357156287574 deviation-center-line_mean 0.29109357156287574 deviation-center-line_min 0.29109357156287574 deviation-heading_max 2.2331060010618957 deviation-heading_mean 2.2331060010618957 deviation-heading_median 2.2331060010618957 deviation-heading_min 2.2331060010618957 distance-from-start_max 2.255025037659017 distance-from-start_mean 2.255025037659017 distance-from-start_median 2.255025037659017 distance-from-start_min 2.255025037659017 driven_any_max 4.097561841074084 driven_any_mean 4.097561841074084 driven_any_median 4.097561841074084 driven_any_min 4.097561841074084 driven_lanedir_consec_max 4.085488757766068 driven_lanedir_consec_mean 4.085488757766068 driven_lanedir_consec_min 4.085488757766068 driven_lanedir_max 4.085488757766068 driven_lanedir_mean 4.085488757766068 driven_lanedir_median 4.085488757766068 driven_lanedir_min 4.085488757766068 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 4.097561841074084, "survival_time": 59.99999999999873, "driven_lanedir": 4.085488757766068, "in-drivable-lane": 0.0, "deviation-heading": 2.2331060010618957, "distance-from-start": 2.255025037659017, "deviation-center-line": 0.29109357156287574, "driven_lanedir_consec": 4.085488757766068}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15853
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 11:45:17+00:00 2022-11-25 11:47:46+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.649999999999988 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4132337880721526 deviation-center-line_median 0.17972902691412632
other stats deviation-center-line_max 0.17972902691412632 deviation-center-line_mean 0.17972902691412632 deviation-center-line_min 0.17972902691412632 deviation-heading_max 1.5025479858278594 deviation-heading_mean 1.5025479858278594 deviation-heading_median 1.5025479858278594 deviation-heading_min 1.5025479858278594 distance-from-start_max 0.37886290004634626 distance-from-start_mean 0.37886290004634626 distance-from-start_median 0.37886290004634626 distance-from-start_min 0.37886290004634626 driven_any_max 0.4316381850886603 driven_any_mean 0.4316381850886603 driven_any_median 0.4316381850886603 driven_any_min 0.4316381850886603 driven_lanedir_consec_max 0.4132337880721526 driven_lanedir_consec_mean 0.4132337880721526 driven_lanedir_consec_min 0.4132337880721526 driven_lanedir_max 0.4132337880721526 driven_lanedir_mean 0.4132337880721526 driven_lanedir_median 0.4132337880721526 driven_lanedir_min 0.4132337880721526 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.4316381850886603, "survival_time": 5.649999999999988, "driven_lanedir": 0.4132337880721526, "in-drivable-lane": 0.0, "deviation-heading": 1.5025479858278594, "distance-from-start": 0.37886290004634626, "deviation-center-line": 0.17972902691412632, "driven_lanedir_consec": 0.4132337880721526}}simulation-passed 1 survival_time_max 5.649999999999988 survival_time_mean 5.649999999999988 survival_time_min 5.649999999999988
No reset possible 15849
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 11:43:20+00:00 2022-11-25 11:45:09+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.800000000000004 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.838943310921324 deviation-center-line_median 0.1433047164551813
other stats deviation-center-line_max 0.1433047164551813 deviation-center-line_mean 0.1433047164551813 deviation-center-line_min 0.1433047164551813 deviation-heading_max 1.2694840494293371 deviation-heading_mean 1.2694840494293371 deviation-heading_median 1.2694840494293371 deviation-heading_min 1.2694840494293371 distance-from-start_max 0.6851393057632532 distance-from-start_mean 0.6851393057632532 distance-from-start_median 0.6851393057632532 distance-from-start_min 0.6851393057632532 driven_any_max 0.8503814872464346 driven_any_mean 0.8503814872464346 driven_any_median 0.8503814872464346 driven_any_min 0.8503814872464346 driven_lanedir_consec_max 0.838943310921324 driven_lanedir_consec_mean 0.838943310921324 driven_lanedir_consec_min 0.838943310921324 driven_lanedir_max 0.838943310921324 driven_lanedir_mean 0.838943310921324 driven_lanedir_median 0.838943310921324 driven_lanedir_min 0.838943310921324 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.8503814872464346, "survival_time": 9.800000000000004, "driven_lanedir": 0.838943310921324, "in-drivable-lane": 0.0, "deviation-heading": 1.2694840494293371, "distance-from-start": 0.6851393057632532, "deviation-center-line": 0.1433047164551813, "driven_lanedir_consec": 0.838943310921324}}simulation-passed 1 survival_time_max 9.800000000000004 survival_time_mean 9.800000000000004 survival_time_min 9.800000000000004
No reset possible 15843
1324
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:41:47+00:00 2022-11-25 11:42:58+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15840
1326
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:40:28+00:00 2022-11-25 11:41:40+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15836
1327
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:39:14+00:00 2022-11-25 11:40:14+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15828
1328
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:37:37+00:00 2022-11-25 11:38:47+00:00 0:01:10 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15824
1329
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:36:20+00:00 2022-11-25 11:37:31+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15819
1331
Bea Baselines 🐤baseline-RPL-ros lx22-modcon
sim failed yes davinci-stage-05-6.2.51
2022-11-25 11:34:56+00:00 2022-11-25 11:35:54+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15814
1335
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-1of5 failed no davinci-stage-05-6.2.51
2022-11-25 11:33:31+00:00 2022-11-25 11:34:30+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15809
1342
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:31:27+00:00 2022-11-25 11:32:55+00:00 0:01:28 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15804
1343
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:29:48+00:00 2022-11-25 11:31:00+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15799
1344
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:28:17+00:00 2022-11-25 11:29:30+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15796
1345
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:27:10+00:00 2022-11-25 11:28:10+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15793
1346
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:25:44+00:00 2022-11-25 11:26:56+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15788
1346
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:24:18+00:00 2022-11-25 11:25:30+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15785
1348
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 11:22:49+00:00 2022-11-25 11:23:58+00:00 0:01:09 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15778
1349
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 11:15:02+00:00 2022-11-25 11:22:28+00:00 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 7.849999999999827 driven_lanedir_consec_median 6.696391530615115 deviation-center-line_median 6.1304188083857225
other stats deviation-center-line_max 6.1304188083857225 deviation-center-line_mean 6.1304188083857225 deviation-center-line_min 6.1304188083857225 deviation-heading_max 8.834904601805986 deviation-heading_mean 8.834904601805986 deviation-heading_median 8.834904601805986 deviation-heading_min 8.834904601805986 distance-from-start_max 1.0801425326919183 distance-from-start_mean 1.0801425326919183 distance-from-start_median 1.0801425326919183 distance-from-start_min 1.0801425326919183 driven_any_max 7.907683430283059 driven_any_mean 7.907683430283059 driven_any_median 7.907683430283059 driven_any_min 7.907683430283059 driven_lanedir_consec_max 6.696391530615115 driven_lanedir_consec_mean 6.696391530615115 driven_lanedir_consec_min 6.696391530615115 driven_lanedir_max 6.696391530615115 driven_lanedir_mean 6.696391530615115 driven_lanedir_median 6.696391530615115 driven_lanedir_min 6.696391530615115 in-drivable-lane_max 7.849999999999827 in-drivable-lane_mean 7.849999999999827 in-drivable-lane_min 7.849999999999827 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907683430283059, "survival_time": 59.99999999999873, "driven_lanedir": 6.696391530615115, "in-drivable-lane": 7.849999999999827, "deviation-heading": 8.834904601805986, "distance-from-start": 1.0801425326919183, "deviation-center-line": 6.1304188083857225, "driven_lanedir_consec": 6.696391530615115}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15763
1353
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 10:53:52+00:00 2022-11-25 11:14:41+00:00 0:20:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 50.24999999999928 in-drivable-lane_median 11.549999999999724 driven_lanedir_consec_median 1.4349183311341205 deviation-center-line_median 3.4282898239202355
other stats deviation-center-line_max 6.524123614538165 deviation-center-line_mean 3.5443371413933584 deviation-center-line_min 0.7966453031947988 deviation-heading_max 49.48703086323664 deviation-heading_mean 23.414471316389836 deviation-heading_median 20.33887748800631 deviation-heading_min 3.4930994263100867 distance-from-start_max 0.7979075289972716 distance-from-start_mean 0.6729486050653741 distance-from-start_median 0.7348465411734836 distance-from-start_min 0.42419380891725783 driven_any_max 6.525410755259913 driven_any_mean 3.6350139537376105 driven_any_median 3.7710073048934616 driven_any_min 0.4726304499036077 driven_lanedir_consec_max 2.6567448279533905 driven_lanedir_consec_mean 1.4852624537180554 driven_lanedir_consec_min 0.4144683246505907 driven_lanedir_max 3.732257851259041 driven_lanedir_mean 2.1568271879953405 driven_lanedir_median 2.2402912880358645 driven_lanedir_min 0.4144683246505907 in-drivable-lane_max 40.39999999999927 in-drivable-lane_mean 15.87499999999968 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.4726304499036077, "survival_time": 50.24999999999928, "driven_lanedir": 0.4144683246505907, "in-drivable-lane": 0.0, "deviation-heading": 49.48703086323664, "distance-from-start": 0.42419380891725783, "deviation-center-line": 6.524123614538165, "driven_lanedir_consec": 0.4144683246505907}, "4way-000-ego1": {"driven_any": 5.363737356748975, "survival_time": 50.24999999999928, "driven_lanedir": 3.410120851508994, "in-drivable-lane": 7.999999999999951, "deviation-heading": 22.290698551054977, "distance-from-start": 0.7979075289972716, "deviation-center-line": 4.018630590702876, "driven_lanedir_consec": 1.937571380449849}, "4way-000-ego2": {"driven_any": 6.525410755259913, "survival_time": 50.24999999999928, "driven_lanedir": 3.732257851259041, "in-drivable-lane": 15.0999999999995, "deviation-heading": 18.38705642495765, "distance-from-start": 0.7850471371320302, "deviation-center-line": 2.837949057137595, "driven_lanedir_consec": 2.6567448279533905}, "4way-000-ego3": {"driven_any": 2.1782772530379484, "survival_time": 50.24999999999928, "driven_lanedir": 1.0704617245627357, "in-drivable-lane": 40.39999999999927, "deviation-heading": 3.4930994263100867, "distance-from-start": 0.6846459452149369, "deviation-center-line": 0.7966453031947988, "driven_lanedir_consec": 0.932265281818392}}simulation-passed 1 survival_time_max 50.24999999999928 survival_time_mean 50.24999999999928 survival_time_min 50.24999999999928
No reset possible 15761
1353
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 10:51:57+00:00 2022-11-25 10:53:27+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15749
1359
Bea Baselines 🐤baseline-duckietown-ml lx22-state-estimation
sim success yes davinci-stage-05-6.2.51
2022-11-25 10:33:58+00:00 2022-11-25 10:51:35+00:00 0:17:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 7.219564449924671 survival_time_median 59.99999999999873 deviation-center-line_median 4.315141065384787 in-drivable-lane_median 3.300000000000047
other stats deviation-center-line_max 4.797257300822525 deviation-center-line_mean 4.273967135420981 deviation-center-line_min 3.709503040055631 deviation-heading_max 10.095343680969629 deviation-heading_mean 8.649248344527598 deviation-heading_median 8.973258339107026 deviation-heading_min 6.879143013506142 distance-from-start_max 3.199481778315765 distance-from-start_mean 2.925705836045752 distance-from-start_median 2.950180236639051 distance-from-start_min 2.627455493182438 driven_any_max 7.921207850326108 driven_any_mean 7.916724539521173 driven_any_median 7.92108341024198 driven_any_min 7.907882357995429 driven_lanedir_consec_max 7.280352049453244 driven_lanedir_consec_mean 7.117196931128017 driven_lanedir_consec_min 6.851674294006138 driven_lanedir_max 7.280352049453244 driven_lanedir_mean 7.117196931128017 driven_lanedir_median 7.219564449924671 driven_lanedir_min 6.851674294006138 in-drivable-lane_max 6.899999999999945 in-drivable-lane_mean 4.449999999999993 in-drivable-lane_min 3.149999999999988 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 7.907882357995429, "survival_time": 59.99999999999873, "driven_lanedir": 7.280352049453244, "in-drivable-lane": 3.149999999999988, "deviation-heading": 8.973258339107026, "distance-from-start": 2.627455493182438, "deviation-center-line": 3.709503040055631, "driven_lanedir_consec": 7.280352049453244}, "LF-zig-zag-001-ego0": {"driven_any": 7.92108341024198, "survival_time": 59.99999999999873, "driven_lanedir": 7.219564449924671, "in-drivable-lane": 3.300000000000047, "deviation-heading": 10.095343680969629, "distance-from-start": 2.950180236639051, "deviation-center-line": 4.797257300822525, "driven_lanedir_consec": 7.219564449924671}, "LF-zig-zag-002-ego0": {"driven_any": 7.921207850326108, "survival_time": 59.99999999999873, "driven_lanedir": 6.851674294006138, "in-drivable-lane": 6.899999999999945, "deviation-heading": 6.879143013506142, "distance-from-start": 3.199481778315765, "deviation-center-line": 4.315141065384787, "driven_lanedir_consec": 6.851674294006138}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15746
1360
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-0of5 success no davinci-stage-05-6.2.51
2022-11-25 10:30:42+00:00 2022-11-25 10:33:21+00:00 0:02:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 2.0389222051768927
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 2.0389222051768927 distance-from-start_median 2.0389222051768927 distance-from-start_min 2.0389222051768927 driven_any_max 2.1389646638223914 driven_any_mean 2.1389646638223914 driven_any_median 2.1389646638223914 driven_any_min 2.1389646638223914 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 17.25000000000011 in-drivable-lane_mean 17.25000000000011 in-drivable-lane_median 17.25000000000011 in-drivable-lane_min 17.25000000000011 per-episodes details {"d30-ego0": {"driven_any": 2.1389646638223914, "survival_time": 17.25000000000011, "driven_lanedir": 0.0, "in-drivable-lane": 17.25000000000011, "deviation-heading": 0.0, "distance-from-start": 2.0389222051768927, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 17.25000000000011 survival_time_mean 17.25000000000011 survival_time_median 17.25000000000011 survival_time_min 17.25000000000011
No reset possible 15744
1363
Bea Baselines 🐤baseline-duckietown-ml aido-hello-sim-validation
sanity-check success no davinci-stage-05-6.2.51
2022-11-25 10:29:08+00:00 2022-11-25 10:30:36+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.012868196598853745 deviation-center-line_median 0.006511669204326057
other stats deviation-center-line_max 0.006511669204326057 deviation-center-line_mean 0.006511669204326057 deviation-center-line_min 0.006511669204326057 deviation-heading_max 0.2708616114961228 deviation-heading_mean 0.2708616114961228 deviation-heading_median 0.2708616114961228 deviation-heading_min 0.2708616114961228 distance-from-start_max 0.015084794070111734 distance-from-start_mean 0.015084794070111734 distance-from-start_median 0.015084794070111734 distance-from-start_min 0.015084794070111734 driven_any_max 0.01508487591518893 driven_any_mean 0.01508487591518893 driven_any_median 0.01508487591518893 driven_any_min 0.01508487591518893 driven_lanedir_consec_max 0.012868196598853745 driven_lanedir_consec_mean 0.012868196598853745 driven_lanedir_consec_min 0.012868196598853745 driven_lanedir_max 0.012868196598853745 driven_lanedir_mean 0.012868196598853745 driven_lanedir_median 0.012868196598853745 driven_lanedir_min 0.012868196598853745 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.01508487591518893, "survival_time": 0.49999999999999994, "driven_lanedir": 0.012868196598853745, "in-drivable-lane": 0.0, "deviation-heading": 0.2708616114961228, "distance-from-start": 0.015084794070111734, "deviation-center-line": 0.006511669204326057, "driven_lanedir_consec": 0.012868196598853745}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15740
1367
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 10:19:29+00:00 2022-11-25 10:29:02+00:00 0:09:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 35.35000000000013 in-drivable-lane_median 9.600000000000136 driven_lanedir_consec_median 1.6655796203110325 deviation-center-line_median 1.8236789298350664
other stats deviation-center-line_max 1.8236789298350664 deviation-center-line_mean 1.8236789298350664 deviation-center-line_min 1.8236789298350664 deviation-heading_max 8.593113035390816 deviation-heading_mean 8.593113035390816 deviation-heading_median 8.593113035390816 deviation-heading_min 8.593113035390816 distance-from-start_max 1.4452406660895474 distance-from-start_mean 1.4452406660895474 distance-from-start_median 1.4452406660895474 distance-from-start_min 1.4452406660895474 driven_any_max 4.548339546186094 driven_any_mean 4.548339546186094 driven_any_median 4.548339546186094 driven_any_min 4.548339546186094 driven_lanedir_consec_max 1.6655796203110325 driven_lanedir_consec_mean 1.6655796203110325 driven_lanedir_consec_min 1.6655796203110325 driven_lanedir_max 2.8987609296864605 driven_lanedir_mean 2.8987609296864605 driven_lanedir_median 2.8987609296864605 driven_lanedir_min 2.8987609296864605 in-drivable-lane_max 9.600000000000136 in-drivable-lane_mean 9.600000000000136 in-drivable-lane_min 9.600000000000136 per-episodes details {"autolab-000-ego0": {"driven_any": 4.548339546186094, "survival_time": 35.35000000000013, "driven_lanedir": 2.8987609296864605, "in-drivable-lane": 9.600000000000136, "deviation-heading": 8.593113035390816, "distance-from-start": 1.4452406660895474, "deviation-center-line": 1.8236789298350664, "driven_lanedir_consec": 1.6655796203110325}}simulation-passed 1 survival_time_max 35.35000000000013 survival_time_mean 35.35000000000013 survival_time_min 35.35000000000013
No reset possible 15727
1372
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 09:53:43+00:00 2022-11-25 10:18:47+00:00 0:25:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 33.49999999999883 driven_lanedir_consec_median 1.6824903528329596 deviation-center-line_median 2.2511022163694565
other stats deviation-center-line_max 3.5576599275689076 deviation-center-line_mean 2.1607086973800427 deviation-center-line_min 0.5829704292123494 deviation-heading_max 23.75366430163335 deviation-heading_mean 13.61944551818472 deviation-heading_median 14.71109723024887 deviation-heading_min 1.3019233106077877 distance-from-start_max 1.8449737243778224 distance-from-start_mean 1.5218140720270226 distance-from-start_median 1.5647384234333508 distance-from-start_min 1.1128057168635663 driven_any_max 7.912943794544215 driven_any_mean 5.916964859482992 driven_any_median 6.174063673307504 driven_any_min 3.4067882967727434 driven_lanedir_consec_max 3.0758105472479813 driven_lanedir_consec_mean 1.883994208845502 driven_lanedir_consec_min 1.0951855824681074 driven_lanedir_max 4.4776244214775325 driven_lanedir_mean 2.766502140900726 driven_lanedir_median 2.7465992798286325 driven_lanedir_min 1.0951855824681074 in-drivable-lane_max 51.04999999999873 in-drivable-lane_mean 33.674999999999 in-drivable-lane_min 16.649999999999622 per-episodes details {"autolab-000-ego0": {"driven_any": 4.435262470369597, "survival_time": 59.99999999999873, "driven_lanedir": 2.0865733632992267, "in-drivable-lane": 40.89999999999859, "deviation-heading": 9.52828265073543, "distance-from-start": 1.8449737243778224, "deviation-center-line": 1.2125780022352095, "driven_lanedir_consec": 1.1040830525049574}, "autolab-000-ego1": {"driven_any": 7.912864876245412, "survival_time": 59.99999999999873, "driven_lanedir": 4.4776244214775325, "in-drivable-lane": 16.649999999999622, "deviation-heading": 23.75366430163335, "distance-from-start": 1.533041301884141, "deviation-center-line": 3.5576599275689076, "driven_lanedir_consec": 3.0758105472479813}, "autolab-000-ego2": {"driven_any": 3.4067882967727434, "survival_time": 59.99999999999873, "driven_lanedir": 1.0951855824681074, "in-drivable-lane": 51.04999999999873, "deviation-heading": 1.3019233106077877, "distance-from-start": 1.1128057168635663, "deviation-center-line": 0.5829704292123494, "driven_lanedir_consec": 1.0951855824681074}, "autolab-000-ego3": {"driven_any": 7.912943794544215, "survival_time": 59.99999999999873, "driven_lanedir": 3.4066251963580383, "in-drivable-lane": 26.099999999999064, "deviation-heading": 19.893911809762308, "distance-from-start": 1.5964355449825605, "deviation-center-line": 3.2896264305037035, "driven_lanedir_consec": 2.2608976531609617}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15719
1374
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 09:44:13+00:00 2022-11-25 09:53:19+00:00 0:09:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 38.89999999999993 in-drivable-lane_median 9.999999999999964 driven_lanedir_consec_median 1.885176427356721 deviation-center-line_median 1.9328187661061096
other stats deviation-center-line_max 1.9328187661061096 deviation-center-line_mean 1.9328187661061096 deviation-center-line_min 1.9328187661061096 deviation-heading_max 14.556307910375695 deviation-heading_mean 14.556307910375695 deviation-heading_median 14.556307910375695 deviation-heading_min 14.556307910375695 distance-from-start_max 0.8105403367769171 distance-from-start_mean 0.8105403367769171 distance-from-start_median 0.8105403367769171 distance-from-start_min 0.8105403367769171 driven_any_max 5.019198508801678 driven_any_mean 5.019198508801678 driven_any_median 5.019198508801678 driven_any_min 5.019198508801678 driven_lanedir_consec_max 1.885176427356721 driven_lanedir_consec_mean 1.885176427356721 driven_lanedir_consec_min 1.885176427356721 driven_lanedir_max 3.010307642190286 driven_lanedir_mean 3.010307642190286 driven_lanedir_median 3.010307642190286 driven_lanedir_min 3.010307642190286 in-drivable-lane_max 9.999999999999964 in-drivable-lane_mean 9.999999999999964 in-drivable-lane_min 9.999999999999964 per-episodes details {"loop-000-ego0": {"driven_any": 5.019198508801678, "survival_time": 38.89999999999993, "driven_lanedir": 3.010307642190286, "in-drivable-lane": 9.999999999999964, "deviation-heading": 14.556307910375695, "distance-from-start": 0.8105403367769171, "deviation-center-line": 1.9328187661061096, "driven_lanedir_consec": 1.885176427356721}}simulation-passed 1 survival_time_max 38.89999999999993 survival_time_mean 38.89999999999993 survival_time_min 38.89999999999993
No reset possible 15710
1375
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 09:39:20+00:00 2022-11-25 09:44:00+00:00 0:04:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.850000000000032 in-drivable-lane_median 1.750000000000007 driven_lanedir_consec_median 1.1184710756444427 deviation-center-line_median 0.7472706446847741
other stats deviation-center-line_max 0.7472706446847741 deviation-center-line_mean 0.7472706446847741 deviation-center-line_min 0.7472706446847741 deviation-heading_max 3.936382396065548 deviation-heading_mean 3.936382396065548 deviation-heading_median 3.936382396065548 deviation-heading_min 3.936382396065548 distance-from-start_max 1.0788419089173469 distance-from-start_mean 1.0788419089173469 distance-from-start_median 1.0788419089173469 distance-from-start_min 1.0788419089173469 driven_any_max 1.428452141916615 driven_any_mean 1.428452141916615 driven_any_median 1.428452141916615 driven_any_min 1.428452141916615 driven_lanedir_consec_max 1.1184710756444427 driven_lanedir_consec_mean 1.1184710756444427 driven_lanedir_consec_min 1.1184710756444427 driven_lanedir_max 1.1184710756444427 driven_lanedir_mean 1.1184710756444427 driven_lanedir_median 1.1184710756444427 driven_lanedir_min 1.1184710756444427 in-drivable-lane_max 1.750000000000007 in-drivable-lane_mean 1.750000000000007 in-drivable-lane_min 1.750000000000007 per-episodes details {"4way-000-ego0": {"driven_any": 1.428452141916615, "survival_time": 11.850000000000032, "driven_lanedir": 1.1184710756444427, "in-drivable-lane": 1.750000000000007, "deviation-heading": 3.936382396065548, "distance-from-start": 1.0788419089173469, "deviation-center-line": 0.7472706446847741, "driven_lanedir_consec": 1.1184710756444427}}simulation-passed 1 survival_time_max 11.850000000000032 survival_time_mean 11.850000000000032 survival_time_min 11.850000000000032
No reset possible 15698
1379
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 09:16:25+00:00 2022-11-25 09:39:12+00:00 0:22:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 31.37499999999916 driven_lanedir_consec_median 0.9506530343540532 deviation-center-line_median 2.4242470469233206
other stats deviation-center-line_max 5.721074790825627 deviation-center-line_mean 2.812286349534997 deviation-center-line_min 0.679576513467718 deviation-heading_max 24.924879843926465 deviation-heading_mean 12.11323926836273 deviation-heading_median 8.866458710293136 deviation-heading_min 5.7951598089381875 distance-from-start_max 1.3787485214224735 distance-from-start_mean 0.8654251120150735 distance-from-start_median 0.8143757216086813 distance-from-start_min 0.4542004834204581 driven_any_max 7.913186283005181 driven_any_mean 3.8128488997677983 driven_any_median 2.6529678172841127 driven_any_min 2.0322736814977853 driven_lanedir_consec_max 3.1381250535865166 driven_lanedir_consec_mean 1.3862627543934347 driven_lanedir_consec_min 0.5056198952791155 driven_lanedir_max 4.84717126318089 driven_lanedir_mean 2.101236988881811 driven_lanedir_median 1.295084238596219 driven_lanedir_min 0.967608215153918 in-drivable-lane_max 50.04999999999866 in-drivable-lane_mean 28.599999999999245 in-drivable-lane_min 1.5999999999999988 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.0322736814977853, "survival_time": 59.99999999999873, "driven_lanedir": 0.967608215153918, "in-drivable-lane": 50.04999999999866, "deviation-heading": 5.7951598089381875, "distance-from-start": 0.4542004834204581, "deviation-center-line": 0.679576513467718, "driven_lanedir_consec": 0.8434015010479481}, "zigzag-000-ego1": {"driven_any": 3.273597329716565, "survival_time": 59.99999999999873, "driven_lanedir": 1.0802120938114852, "in-drivable-lane": 48.99999999999871, "deviation-heading": 5.946716633602129, "distance-from-start": 1.0709270854818858, "deviation-center-line": 1.084938630573418, "driven_lanedir_consec": 0.5056198952791155}, "zigzag-000-ego2": {"driven_any": 7.913186283005181, "survival_time": 59.99999999999873, "driven_lanedir": 4.84717126318089, "in-drivable-lane": 13.749999999999616, "deviation-heading": 24.924879843926465, "distance-from-start": 1.3787485214224735, "deviation-center-line": 3.763555463273223, "driven_lanedir_consec": 3.1381250535865166}, "zigzag-000-ego3": {"driven_any": 2.032338304851661, "survival_time": 59.99999999999873, "driven_lanedir": 1.5099563833809522, "in-drivable-lane": 1.5999999999999988, "deviation-heading": 11.786200786984145, "distance-from-start": 0.5578243577354768, "deviation-center-line": 5.721074790825627, "driven_lanedir_consec": 1.0579045676601582}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15694
1380
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 09:12:07+00:00 2022-11-25 09:16:19+00:00 0:04:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.5 in-drivable-lane_median 1.0000000000000089 driven_lanedir_consec_median 0.8992999458387496 deviation-center-line_median 0.2641388233104657
other stats deviation-center-line_max 0.2641388233104657 deviation-center-line_mean 0.2641388233104657 deviation-center-line_min 0.2641388233104657 deviation-heading_max 3.502621340416551 deviation-heading_mean 3.502621340416551 deviation-heading_median 3.502621340416551 deviation-heading_min 3.502621340416551 distance-from-start_max 0.7820262839601014 distance-from-start_mean 0.7820262839601014 distance-from-start_median 0.7820262839601014 distance-from-start_min 0.7820262839601014 driven_any_max 1.1165753826733793 driven_any_mean 1.1165753826733793 driven_any_median 1.1165753826733793 driven_any_min 1.1165753826733793 driven_lanedir_consec_max 0.8992999458387496 driven_lanedir_consec_mean 0.8992999458387496 driven_lanedir_consec_min 0.8992999458387496 driven_lanedir_max 0.8994665999381892 driven_lanedir_mean 0.8994665999381892 driven_lanedir_median 0.8994665999381892 driven_lanedir_min 0.8994665999381892 in-drivable-lane_max 1.0000000000000089 in-drivable-lane_mean 1.0000000000000089 in-drivable-lane_min 1.0000000000000089 per-episodes details {"loop2-000-ego0": {"driven_any": 1.1165753826733793, "survival_time": 9.5, "driven_lanedir": 0.8994665999381892, "in-drivable-lane": 1.0000000000000089, "deviation-heading": 3.502621340416551, "distance-from-start": 0.7820262839601014, "deviation-center-line": 0.2641388233104657, "driven_lanedir_consec": 0.8992999458387496}}simulation-passed 1 survival_time_max 9.5 survival_time_mean 9.5 survival_time_min 9.5
No reset possible 15689
1383
Bea Baselines 🐤baseline-duckietown lx22-visservoing
sim success yes davinci-stage-05-6.2.51
2022-11-25 09:03:57+00:00 2022-11-25 09:12:01+00:00 0:08:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 24.9749999999994 deviation-center-line_median 4.761676933390179 driven_lanedir_consec_median 4.500765967966744 survival_time_median 59.99999999999873
other stats deviation-center-line_max 4.827691132706644 deviation-center-line_mean 4.761676933390179 deviation-center-line_min 4.695662734073715 deviation-heading_max 4.8766475098338935 deviation-heading_mean 4.3386216332502165 deviation-heading_median 4.3386216332502165 deviation-heading_min 3.800595756666539 distance-from-start_max 1.4809512521932684 distance-from-start_mean 1.2442609770932584 distance-from-start_median 1.2442609770932584 distance-from-start_min 1.0075707019932485 driven_any_max 7.920817465312554 driven_any_mean 7.914344186244791 driven_any_median 7.914344186244791 driven_any_min 7.907870907177028 driven_lanedir_consec_max 4.73796970649624 driven_lanedir_consec_mean 4.500765967966744 driven_lanedir_consec_min 4.263562229437247 driven_lanedir_max 4.73796970649624 driven_lanedir_mean 4.500765967966744 driven_lanedir_median 4.500765967966744 driven_lanedir_min 4.263562229437247 in-drivable-lane_max 26.899999999999466 in-drivable-lane_mean 24.9749999999994 in-drivable-lane_min 23.049999999999336 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 7.920817465312554, "survival_time": 59.99999999999873, "driven_lanedir": 4.263562229437247, "in-drivable-lane": 26.899999999999466, "deviation-heading": 3.800595756666539, "distance-from-start": 1.0075707019932485, "deviation-center-line": 4.827691132706644, "driven_lanedir_consec": 4.263562229437247}, "LF-small-loop-001-ego0": {"driven_any": 7.907870907177028, "survival_time": 59.99999999999873, "driven_lanedir": 4.73796970649624, "in-drivable-lane": 23.049999999999336, "deviation-heading": 4.8766475098338935, "distance-from-start": 1.4809512521932684, "deviation-center-line": 4.695662734073715, "driven_lanedir_consec": 4.73796970649624}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15679
1392
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 08:45:37+00:00 2022-11-25 09:03:29+00:00 0:17:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.149999999999887 driven_lanedir_consec_median 4.401119486636188 deviation-center-line_median 3.779340112942702
other stats deviation-center-line_max 3.779340112942702 deviation-center-line_mean 3.779340112942702 deviation-center-line_min 3.779340112942702 deviation-heading_max 19.76948789720062 deviation-heading_mean 19.76948789720062 deviation-heading_median 19.76948789720062 deviation-heading_min 19.76948789720062 distance-from-start_max 3.1156002083199645 distance-from-start_mean 3.1156002083199645 distance-from-start_median 3.1156002083199645 distance-from-start_min 3.1156002083199645 driven_any_max 7.913790362106744 driven_any_mean 7.913790362106744 driven_any_median 7.913790362106744 driven_any_min 7.913790362106744 driven_lanedir_consec_max 4.401119486636188 driven_lanedir_consec_mean 4.401119486636188 driven_lanedir_consec_min 4.401119486636188 driven_lanedir_max 6.422576270686498 driven_lanedir_mean 6.422576270686498 driven_lanedir_median 6.422576270686498 driven_lanedir_min 6.422576270686498 in-drivable-lane_max 5.149999999999887 in-drivable-lane_mean 5.149999999999887 in-drivable-lane_min 5.149999999999887 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.913790362106744, "survival_time": 59.99999999999873, "driven_lanedir": 6.422576270686498, "in-drivable-lane": 5.149999999999887, "deviation-heading": 19.76948789720062, "distance-from-start": 3.1156002083199645, "deviation-center-line": 3.779340112942702, "driven_lanedir_consec": 4.401119486636188}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15661
1397
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 08:17:21+00:00 2022-11-25 08:45:23+00:00 0:28:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.324999999999328 driven_lanedir_consec_median 4.245846819325868 deviation-center-line_median 3.8206000971148697
other stats deviation-center-line_max 4.856279720529347 deviation-center-line_mean 3.944985207878138 deviation-center-line_min 3.2824609167534624 deviation-heading_max 18.641734403876985 deviation-heading_mean 17.05207965260371 deviation-heading_median 17.214888776424154 deviation-heading_min 15.136806653689543 distance-from-start_max 2.8911947850766317 distance-from-start_mean 2.381835744233314 distance-from-start_median 2.364971203516319 distance-from-start_min 1.9062057848239855 driven_any_max 7.913642913721509 driven_any_mean 7.913384122107414 driven_any_median 7.913337054024758 driven_any_min 7.913219466658628 driven_lanedir_consec_max 4.392017162831847 driven_lanedir_consec_mean 4.190377559626755 driven_lanedir_consec_min 3.877799437023437 driven_lanedir_max 5.715702239968321 driven_lanedir_mean 4.521298828910874 driven_lanedir_median 4.245846819325868 driven_lanedir_min 3.877799437023437 in-drivable-lane_max 25.54999999999928 in-drivable-lane_mean 20.424999999999372 in-drivable-lane_min 11.49999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 7.913642913721509, "survival_time": 59.99999999999873, "driven_lanedir": 5.715702239968321, "in-drivable-lane": 11.49999999999956, "deviation-heading": 18.641734403876985, "distance-from-start": 2.8911947850766317, "deviation-center-line": 4.856279720529347, "driven_lanedir_consec": 4.392017162831847}, "loop-000-ego1": {"driven_any": 7.913219466658628, "survival_time": 59.99999999999873, "driven_lanedir": 4.114079668785397, "in-drivable-lane": 23.199999999999353, "deviation-heading": 17.31630182602115, "distance-from-start": 2.2062683625642627, "deviation-center-line": 4.069144759831289, "driven_lanedir_consec": 4.114079668785397}, "loop-000-ego2": {"driven_any": 7.913406014141701, "survival_time": 59.99999999999873, "driven_lanedir": 3.877799437023437, "in-drivable-lane": 25.54999999999928, "deviation-heading": 15.136806653689543, "distance-from-start": 2.523674044468375, "deviation-center-line": 3.2824609167534624, "driven_lanedir_consec": 3.877799437023437}, "loop-000-ego3": {"driven_any": 7.913268093907814, "survival_time": 59.99999999999873, "driven_lanedir": 4.3776139698663386, "in-drivable-lane": 21.4499999999993, "deviation-heading": 17.113475726827158, "distance-from-start": 1.9062057848239855, "deviation-center-line": 3.57205543439845, "driven_lanedir_consec": 4.3776139698663386}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15658
1398
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 08:13:19+00:00 2022-11-25 08:17:13+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.10000000000015 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.445951444359971 deviation-center-line_median 1.6150752543552165
other stats deviation-center-line_max 1.6150752543552165 deviation-center-line_mean 1.6150752543552165 deviation-center-line_min 1.6150752543552165 deviation-heading_max 3.936478657896296 deviation-heading_mean 3.936478657896296 deviation-heading_median 3.936478657896296 deviation-heading_min 3.936478657896296 distance-from-start_max 2.153369876402656 distance-from-start_mean 2.153369876402656 distance-from-start_median 2.153369876402656 distance-from-start_min 2.153369876402656 driven_any_max 2.517342844550034 driven_any_mean 2.517342844550034 driven_any_median 2.517342844550034 driven_any_min 2.517342844550034 driven_lanedir_consec_max 2.445951444359971 driven_lanedir_consec_mean 2.445951444359971 driven_lanedir_consec_min 2.445951444359971 driven_lanedir_max 2.445951444359971 driven_lanedir_mean 2.445951444359971 driven_lanedir_median 2.445951444359971 driven_lanedir_min 2.445951444359971 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.517342844550034, "survival_time": 20.10000000000015, "driven_lanedir": 2.445951444359971, "in-drivable-lane": 0.0, "deviation-heading": 3.936478657896296, "distance-from-start": 2.153369876402656, "deviation-center-line": 1.6150752543552165, "driven_lanedir_consec": 2.445951444359971}}simulation-passed 1 survival_time_max 20.10000000000015 survival_time_mean 20.10000000000015 survival_time_min 20.10000000000015
No reset possible 15656
1398
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 08:11:22+00:00 2022-11-25 08:13:03+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.899999999999991 in-drivable-lane_median 1.3499999999999968 driven_lanedir_consec_median 0.1246780989147046 deviation-center-line_median 0.30529540923776055
other stats deviation-center-line_max 0.30529540923776055 deviation-center-line_mean 0.30529540923776055 deviation-center-line_min 0.30529540923776055 deviation-heading_max 2.823797478406276 deviation-heading_mean 2.823797478406276 deviation-heading_median 2.823797478406276 deviation-heading_min 2.823797478406276 distance-from-start_max 0.3453603282715334 distance-from-start_mean 0.3453603282715334 distance-from-start_median 0.3453603282715334 distance-from-start_min 0.3453603282715334 driven_any_max 0.5057521197092666 driven_any_mean 0.5057521197092666 driven_any_median 0.5057521197092666 driven_any_min 0.5057521197092666 driven_lanedir_consec_max 0.1246780989147046 driven_lanedir_consec_mean 0.1246780989147046 driven_lanedir_consec_min 0.1246780989147046 driven_lanedir_max 0.20520285938299276 driven_lanedir_mean 0.20520285938299276 driven_lanedir_median 0.20520285938299276 driven_lanedir_min 0.20520285938299276 in-drivable-lane_max 1.3499999999999968 in-drivable-lane_mean 1.3499999999999968 in-drivable-lane_min 1.3499999999999968 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5057521197092666, "survival_time": 4.899999999999991, "driven_lanedir": 0.20520285938299276, "in-drivable-lane": 1.3499999999999968, "deviation-heading": 2.823797478406276, "distance-from-start": 0.3453603282715334, "deviation-center-line": 0.30529540923776055, "driven_lanedir_consec": 0.1246780989147046}}simulation-passed 1 survival_time_max 4.899999999999991 survival_time_mean 4.899999999999991 survival_time_min 4.899999999999991
No reset possible 15644
1401
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 07:58:18+00:00 2022-11-25 08:11:09+00:00 0:12:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0499999999998835 driven_lanedir_consec_median 3.175459974733086 deviation-center-line_median 7.758676361053286
other stats deviation-center-line_max 7.758676361053286 deviation-center-line_mean 7.758676361053286 deviation-center-line_min 7.758676361053286 deviation-heading_max 5.162282612890801 deviation-heading_mean 5.162282612890801 deviation-heading_median 5.162282612890801 deviation-heading_min 5.162282612890801 distance-from-start_max 2.770171492994891 distance-from-start_mean 2.770171492994891 distance-from-start_median 2.770171492994891 distance-from-start_min 2.770171492994891 driven_any_max 3.518087280478298 driven_any_mean 3.518087280478298 driven_any_median 3.518087280478298 driven_any_min 3.518087280478298 driven_lanedir_consec_max 3.175459974733086 driven_lanedir_consec_mean 3.175459974733086 driven_lanedir_consec_min 3.175459974733086 driven_lanedir_max 3.381680904589276 driven_lanedir_mean 3.381680904589276 driven_lanedir_median 3.381680904589276 driven_lanedir_min 3.381680904589276 in-drivable-lane_max 2.0499999999998835 in-drivable-lane_mean 2.0499999999998835 in-drivable-lane_min 2.0499999999998835 per-episodes details {"autolab-000-ego0": {"driven_any": 3.518087280478298, "survival_time": 59.99999999999873, "driven_lanedir": 3.381680904589276, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.162282612890801, "distance-from-start": 2.770171492994891, "deviation-center-line": 7.758676361053286, "driven_lanedir_consec": 3.175459974733086}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15638
1402
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 07:51:17+00:00 2022-11-25 07:57:45+00:00 0:06:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.5265618997780304 deviation-center-line_median 3.553964307961913
other stats deviation-center-line_max 3.553964307961913 deviation-center-line_mean 3.553964307961913 deviation-center-line_min 3.553964307961913 deviation-heading_max 4.887734095372573 deviation-heading_mean 4.887734095372573 deviation-heading_median 4.887734095372573 deviation-heading_min 4.887734095372573 distance-from-start_max 1.5359325577938203 distance-from-start_mean 1.5359325577938203 distance-from-start_median 1.5359325577938203 distance-from-start_min 1.5359325577938203 driven_any_max 3.579592227332615 driven_any_mean 3.579592227332615 driven_any_median 3.579592227332615 driven_any_min 3.579592227332615 driven_lanedir_consec_max 3.5265618997780304 driven_lanedir_consec_mean 3.5265618997780304 driven_lanedir_consec_min 3.5265618997780304 driven_lanedir_max 3.553623248038845 driven_lanedir_mean 3.553623248038845 driven_lanedir_median 3.553623248038845 driven_lanedir_min 3.553623248038845 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.579592227332615, "survival_time": 59.99999999999873, "driven_lanedir": 3.553623248038845, "in-drivable-lane": 0.0, "deviation-heading": 4.887734095372573, "distance-from-start": 1.5359325577938203, "deviation-center-line": 3.553964307961913, "driven_lanedir_consec": 3.5265618997780304}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15631
1404
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 07:34:27+00:00 2022-11-25 07:51:08+00:00 0:16:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.181141245854967 deviation-center-line_median 3.637790649976113
other stats deviation-center-line_max 4.94306639156408 deviation-center-line_mean 3.6384672153214295 deviation-center-line_min 2.335221169769412 deviation-heading_max 8.096258955413703 deviation-heading_mean 4.529231763948582 deviation-heading_median 3.72621262109843 deviation-heading_min 2.5682428581837655 distance-from-start_max 2.691073047423519 distance-from-start_mean 2.018255833360554 distance-from-start_median 1.9479902375273632 distance-from-start_min 1.4859698109639692 driven_any_max 3.579594996204495 driven_any_mean 3.415340175689185 driven_any_median 3.5570850562678142 driven_any_min 2.967595594016612 driven_lanedir_consec_max 3.539826151958123 driven_lanedir_consec_mean 2.923537151224604 driven_lanedir_consec_min 1.792039961230358 driven_lanedir_max 3.5660962143307464 driven_lanedir_mean 3.362317352125506 driven_lanedir_median 3.4666651400264885 driven_lanedir_min 2.949842914118302 in-drivable-lane_max 1.499999999999929 in-drivable-lane_mean 0.37499999999998224 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.579594996204495, "survival_time": 59.99999999999873, "driven_lanedir": 3.5595521168819433, "in-drivable-lane": 0.0, "deviation-heading": 3.735588116547547, "distance-from-start": 2.3422362133197785, "deviation-center-line": 3.1814195463645407, "driven_lanedir_consec": 3.539826151958123}, "udem-000-ego1": {"driven_any": 3.534579691227877, "survival_time": 59.99999999999873, "driven_lanedir": 3.3737781631710337, "in-drivable-lane": 1.499999999999929, "deviation-heading": 8.096258955413703, "distance-from-start": 1.4859698109639692, "deviation-center-line": 4.094161753587684, "driven_lanedir_consec": 1.792039961230358}, "udem-000-ego2": {"driven_any": 2.967595594016612, "survival_time": 59.99999999999873, "driven_lanedir": 2.949842914118302, "in-drivable-lane": 0.0, "deviation-heading": 3.716837125649313, "distance-from-start": 1.5537442617349484, "deviation-center-line": 4.94306639156408, "driven_lanedir_consec": 2.9382421148856936}, "udem-000-ego3": {"driven_any": 3.579590421307752, "survival_time": 59.99999999999873, "driven_lanedir": 3.5660962143307464, "in-drivable-lane": 0.0, "deviation-heading": 2.5682428581837655, "distance-from-start": 2.691073047423519, "deviation-center-line": 2.335221169769412, "driven_lanedir_consec": 3.4240403768242405}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15627
1405
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 07:28:49+00:00 2022-11-25 07:33:59+00:00 0:05:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 3.4553761243508863 deviation-center-line_median 4.120476289903731
other stats deviation-center-line_max 4.120476289903731 deviation-center-line_mean 4.120476289903731 deviation-center-line_min 4.120476289903731 deviation-heading_max 6.775158807062685 deviation-heading_mean 6.775158807062685 deviation-heading_median 6.775158807062685 deviation-heading_min 6.775158807062685 distance-from-start_max 2.7414345611822344 distance-from-start_mean 2.7414345611822344 distance-from-start_median 2.7414345611822344 distance-from-start_min 2.7414345611822344 driven_any_max 3.5465926378379353 driven_any_mean 3.5465926378379353 driven_any_median 3.5465926378379353 driven_any_min 3.5465926378379353 driven_lanedir_consec_max 3.4553761243508863 driven_lanedir_consec_mean 3.4553761243508863 driven_lanedir_consec_min 3.4553761243508863 driven_lanedir_max 3.4553761243508863 driven_lanedir_mean 3.4553761243508863 driven_lanedir_median 3.4553761243508863 driven_lanedir_min 3.4553761243508863 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 1.0999999999999377 in-drivable-lane_min 1.0999999999999377 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465926378379353, "survival_time": 59.99999999999873, "driven_lanedir": 3.4553761243508863, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 6.775158807062685, "distance-from-start": 2.7414345611822344, "deviation-center-line": 4.120476289903731, "driven_lanedir_consec": 3.4553761243508863}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15621
1407
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 07:23:38+00:00 2022-11-25 07:28:41+00:00 0:05:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4203998040440715 deviation-center-line_median 4.904463356399461
other stats deviation-center-line_max 4.904463356399461 deviation-center-line_mean 4.904463356399461 deviation-center-line_min 4.904463356399461 deviation-heading_max 7.745124858723169 deviation-heading_mean 7.745124858723169 deviation-heading_median 7.745124858723169 deviation-heading_min 7.745124858723169 distance-from-start_max 1.2059816832534165 distance-from-start_mean 1.2059816832534165 distance-from-start_median 1.2059816832534165 distance-from-start_min 1.2059816832534165 driven_any_max 3.485084016236962 driven_any_mean 3.485084016236962 driven_any_median 3.485084016236962 driven_any_min 3.485084016236962 driven_lanedir_consec_max 1.4203998040440715 driven_lanedir_consec_mean 1.4203998040440715 driven_lanedir_consec_min 1.4203998040440715 driven_lanedir_max 3.2905050472289954 driven_lanedir_mean 3.2905050472289954 driven_lanedir_median 3.2905050472289954 driven_lanedir_min 3.2905050472289954 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15618
1407
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 07:20:03+00:00 2022-11-25 07:23:22+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.200000000000223 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.3557424143249113 deviation-center-line_median 2.2764052687353016
other stats deviation-center-line_max 2.2764052687353016 deviation-center-line_mean 2.2764052687353016 deviation-center-line_min 2.2764052687353016 deviation-heading_max 2.9201829757406066 deviation-heading_mean 2.9201829757406066 deviation-heading_median 2.9201829757406066 deviation-heading_min 2.9201829757406066 distance-from-start_max 1.1340032910142968 distance-from-start_mean 1.1340032910142968 distance-from-start_median 1.1340032910142968 distance-from-start_min 1.1340032910142968 driven_any_max 1.4165963270662665 driven_any_mean 1.4165963270662665 driven_any_median 1.4165963270662665 driven_any_min 1.4165963270662665 driven_lanedir_consec_max 1.3557424143249113 driven_lanedir_consec_mean 1.3557424143249113 driven_lanedir_consec_min 1.3557424143249113 driven_lanedir_max 1.3557424143249113 driven_lanedir_mean 1.3557424143249113 driven_lanedir_median 1.3557424143249113 driven_lanedir_min 1.3557424143249113 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}simulation-passed 1 survival_time_max 25.200000000000223 survival_time_mean 25.200000000000223 survival_time_min 25.200000000000223
No reset possible 15614
1409
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 07:13:32+00:00 2022-11-25 07:19:33+00:00 0:06:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.548233752078826 deviation-center-line_median 3.912747138035832
other stats deviation-center-line_max 3.912747138035832 deviation-center-line_mean 3.912747138035832 deviation-center-line_min 3.912747138035832 deviation-heading_max 4.215826059025193 deviation-heading_mean 4.215826059025193 deviation-heading_median 4.215826059025193 deviation-heading_min 4.215826059025193 distance-from-start_max 2.339774613830501 distance-from-start_mean 2.339774613830501 distance-from-start_median 2.339774613830501 distance-from-start_min 2.339774613830501 driven_any_max 3.5795947794156975 driven_any_mean 3.5795947794156975 driven_any_median 3.5795947794156975 driven_any_min 3.5795947794156975 driven_lanedir_consec_max 3.548233752078826 driven_lanedir_consec_mean 3.548233752078826 driven_lanedir_consec_min 3.548233752078826 driven_lanedir_max 3.555210141629624 driven_lanedir_mean 3.555210141629624 driven_lanedir_median 3.555210141629624 driven_lanedir_min 3.555210141629624 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.5795947794156975, "survival_time": 59.99999999999873, "driven_lanedir": 3.555210141629624, "in-drivable-lane": 0.0, "deviation-heading": 4.215826059025193, "distance-from-start": 2.339774613830501, "deviation-center-line": 3.912747138035832, "driven_lanedir_consec": 3.548233752078826}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15611
1409
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 07:10:40+00:00 2022-11-25 07:13:12+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15608
1410
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:54:26+00:00 2022-11-25 07:10:33+00:00 0:16:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.5250000000000004 driven_lanedir_consec_median 3.406408562624881 deviation-center-line_median 6.266768623971568
other stats deviation-center-line_max 7.117542782609248 deviation-center-line_mean 6.142154630645523 deviation-center-line_min 4.91753849202971 deviation-heading_max 7.697145560292741 deviation-heading_mean 6.307290167834601 deviation-heading_median 7.224037098686265 deviation-heading_min 3.0839409136731364 distance-from-start_max 2.99468876105913 distance-from-start_mean 2.7483388598984284 distance-from-start_median 2.8894993963916855 distance-from-start_min 2.2196678857512127 driven_any_max 3.579597577109405 driven_any_mean 3.5248411750169293 driven_any_median 3.5338399362754243 driven_any_min 3.4520872504074633 driven_lanedir_consec_max 3.561467582428756 driven_lanedir_consec_mean 3.3987951569791877 driven_lanedir_consec_min 3.220895920238234 driven_lanedir_max 3.561467582428756 driven_lanedir_mean 3.3987951569791877 driven_lanedir_median 3.406408562624881 driven_lanedir_min 3.220895920238234 in-drivable-lane_max 4.249999999999897 in-drivable-lane_mean 1.8249999999999744 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.579597577109405, "survival_time": 59.99999999999873, "driven_lanedir": 3.561467582428756, "in-drivable-lane": 0.0, "deviation-heading": 3.0839409136731364, "distance-from-start": 2.99468876105913, "deviation-center-line": 6.841254966965407, "driven_lanedir_consec": 3.561467582428756}, "loop-000-ego1": {"driven_any": 3.4520872504074633, "survival_time": 59.99999999999873, "driven_lanedir": 3.220895920238234, "in-drivable-lane": 4.249999999999897, "deviation-heading": 7.290457220494497, "distance-from-start": 2.2196678857512127, "deviation-center-line": 7.117542782609248, "driven_lanedir_consec": 3.220895920238234}, "loop-000-ego2": {"driven_any": 3.5465917398544935, "survival_time": 59.99999999999873, "driven_lanedir": 3.44715177737184, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.1576169768780336, "distance-from-start": 2.7896290117542013, "deviation-center-line": 4.91753849202971, "driven_lanedir_consec": 3.44715177737184}, "loop-000-ego3": {"driven_any": 3.521088132696355, "survival_time": 59.99999999999873, "driven_lanedir": 3.365665347877921, "in-drivable-lane": 1.949999999999985, "deviation-heading": 7.697145560292741, "distance-from-start": 2.98936978102917, "deviation-center-line": 5.692282280977729, "driven_lanedir_consec": 3.365665347877921}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15601
1412
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:49:01+00:00 2022-11-25 06:54:02+00:00 0:05:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1999999999999318 driven_lanedir_consec_median 3.4359165318271345 deviation-center-line_median 4.892013423501352
other stats deviation-center-line_max 4.892013423501352 deviation-center-line_mean 4.892013423501352 deviation-center-line_min 4.892013423501352 deviation-heading_max 7.875545669467039 deviation-heading_mean 7.875545669467039 deviation-heading_median 7.875545669467039 deviation-heading_min 7.875545669467039 distance-from-start_max 2.786057442773228 distance-from-start_mean 2.786057442773228 distance-from-start_median 2.786057442773228 distance-from-start_min 2.786057442773228 driven_any_max 3.5436077823063186 driven_any_mean 3.5436077823063186 driven_any_median 3.5436077823063186 driven_any_min 3.5436077823063186 driven_lanedir_consec_max 3.4359165318271345 driven_lanedir_consec_mean 3.4359165318271345 driven_lanedir_consec_min 3.4359165318271345 driven_lanedir_max 3.4359165318271345 driven_lanedir_mean 3.4359165318271345 driven_lanedir_median 3.4359165318271345 driven_lanedir_min 3.4359165318271345 in-drivable-lane_max 1.1999999999999318 in-drivable-lane_mean 1.1999999999999318 in-drivable-lane_min 1.1999999999999318 per-episodes details {"loop-000-ego0": {"driven_any": 3.5436077823063186, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359165318271345, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.875545669467039, "distance-from-start": 2.786057442773228, "deviation-center-line": 4.892013423501352, "driven_lanedir_consec": 3.4359165318271345}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15595
1414
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 06:44:31+00:00 2022-11-25 06:48:39+00:00 0:04:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 3.4856553091076994 deviation-center-line_median 7.514935466498128
other stats deviation-center-line_max 7.514935466498128 deviation-center-line_mean 7.514935466498128 deviation-center-line_min 7.514935466498128 deviation-heading_max 2.919831926025915 deviation-heading_mean 2.919831926025915 deviation-heading_median 2.919831926025915 deviation-heading_min 2.919831926025915 distance-from-start_max 2.8766441843618256 distance-from-start_mean 2.8766441843618256 distance-from-start_median 2.8766441843618256 distance-from-start_min 2.8766441843618256 driven_any_max 3.5465963271067142 driven_any_mean 3.5465963271067142 driven_any_median 3.5465963271067142 driven_any_min 3.5465963271067142 driven_lanedir_consec_max 3.4856553091076994 driven_lanedir_consec_mean 3.4856553091076994 driven_lanedir_consec_min 3.4856553091076994 driven_lanedir_max 3.4856553091076994 driven_lanedir_mean 3.4856553091076994 driven_lanedir_median 3.4856553091076994 driven_lanedir_min 3.4856553091076994 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15587
1416
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:34:36+00:00 2022-11-25 06:44:18+00:00 0:09:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.522558677891614 deviation-center-line_median 5.123208250925155
other stats deviation-center-line_max 7.953308842217784 deviation-center-line_mean 5.026103289778249 deviation-center-line_min 1.904687815044904 deviation-heading_max 7.817092400173712 deviation-heading_mean 5.15630723293663 deviation-heading_median 4.732874626105395 deviation-heading_min 3.3423872793620153 distance-from-start_max 2.224084223392078 distance-from-start_mean 1.372418883130667 distance-from-start_median 1.2029346346602598 distance-from-start_min 0.8597220398100703 driven_any_max 3.579587032303966 driven_any_mean 2.260716204012659 driven_any_median 1.9288422979916977 driven_any_min 1.605593187763276 driven_lanedir_consec_max 3.4576714425164017 driven_lanedir_consec_mean 1.8357601162686237 driven_lanedir_consec_min 0.8402516667748646 driven_lanedir_max 3.5592470379137566 driven_lanedir_mean 2.213681704953217 driven_lanedir_median 1.8578137794091545 driven_lanedir_min 1.5798522230808028 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.5125000000000073 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.6055966761902978, "survival_time": 59.99999999999873, "driven_lanedir": 1.5798522230808028, "in-drivable-lane": 0.0, "deviation-heading": 3.3423872793620153, "distance-from-start": 1.2287147051666274, "deviation-center-line": 7.953308842217784, "driven_lanedir_consec": 1.5798522230808028}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 2.252087919793097, "survival_time": 59.99999999999873, "driven_lanedir": 2.1195031205111157, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.702231952315873, "distance-from-start": 0.8597220398100703, "deviation-center-line": 6.865196295541358, "driven_lanedir_consec": 0.8402516667748646}, "udem-000-ego3": {"driven_any": 1.605593187763276, "survival_time": 59.99999999999873, "driven_lanedir": 1.5961244383071926, "in-drivable-lane": 0.0, "deviation-heading": 7.817092400173712, "distance-from-start": 1.1771545641538923, "deviation-center-line": 1.904687815044904, "driven_lanedir_consec": 1.465265132702425}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15582
1417
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:26:01+00:00 2022-11-25 06:34:20+00:00 0:08:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613408548548 deviation-center-line_median 3.8033318362841073
other stats deviation-center-line_max 3.8033318362841073 deviation-center-line_mean 3.8033318362841073 deviation-center-line_min 3.8033318362841073 deviation-heading_max 4.074858735595133 deviation-heading_mean 4.074858735595133 deviation-heading_median 4.074858735595133 deviation-heading_min 4.074858735595133 distance-from-start_max 1.574553399562494 distance-from-start_mean 1.574553399562494 distance-from-start_median 1.574553399562494 distance-from-start_min 1.574553399562494 driven_any_max 2.9375948144939867 driven_any_mean 2.9375948144939867 driven_any_median 2.9375948144939867 driven_any_min 2.9375948144939867 driven_lanedir_consec_max 2.896613408548548 driven_lanedir_consec_mean 2.896613408548548 driven_lanedir_consec_min 2.896613408548548 driven_lanedir_max 2.916242176218421 driven_lanedir_mean 2.916242176218421 driven_lanedir_median 2.916242176218421 driven_lanedir_min 2.916242176218421 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 15579
1418
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
467 error yes davinci-stage-05-6.2.51
2022-11-25 06:24:28+00:00 2022-11-25 06:25:54+00:00 0:01:26 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fda4c7ade50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fda4c7ade50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15574
1419
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 06:20:34+00:00 2022-11-25 06:24:16+00:00 0:03:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 38.69999999999994 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 2.128702834048944 deviation-center-line_median 2.983588623443892
other stats deviation-center-line_max 2.983588623443892 deviation-center-line_mean 2.983588623443892 deviation-center-line_min 2.983588623443892 deviation-heading_max 7.04246757923185 deviation-heading_mean 7.04246757923185 deviation-heading_median 7.04246757923185 deviation-heading_min 7.04246757923185 distance-from-start_max 1.8921505020832197 distance-from-start_mean 1.8921505020832197 distance-from-start_median 1.8921505020832197 distance-from-start_min 1.8921505020832197 driven_any_max 2.2265921855085775 driven_any_mean 2.2265921855085775 driven_any_median 2.2265921855085775 driven_any_min 2.2265921855085775 driven_lanedir_consec_max 2.128702834048944 driven_lanedir_consec_mean 2.128702834048944 driven_lanedir_consec_min 2.128702834048944 driven_lanedir_max 2.128702834048944 driven_lanedir_mean 2.128702834048944 driven_lanedir_median 2.128702834048944 driven_lanedir_min 2.128702834048944 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 2.2265921855085775, "survival_time": 38.69999999999994, "driven_lanedir": 2.128702834048944, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.04246757923185, "distance-from-start": 1.8921505020832197, "deviation-center-line": 2.983588623443892, "driven_lanedir_consec": 2.128702834048944}}simulation-passed 1 survival_time_max 38.69999999999994 survival_time_mean 38.69999999999994 survival_time_min 38.69999999999994
No reset possible 15567
1421
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:15:39+00:00 2022-11-25 06:20:28+00:00 0:04:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.548280526093551 deviation-center-line_median 3.9116147681867446
other stats deviation-center-line_max 3.9116147681867446 deviation-center-line_mean 3.9116147681867446 deviation-center-line_min 3.9116147681867446 deviation-heading_max 4.21820918012117 deviation-heading_mean 4.21820918012117 deviation-heading_median 4.21820918012117 deviation-heading_min 4.21820918012117 distance-from-start_max 2.3398538209611455 distance-from-start_mean 2.3398538209611455 distance-from-start_median 2.3398538209611455 distance-from-start_min 2.3398538209611455 driven_any_max 3.579594786375953 driven_any_mean 3.579594786375953 driven_any_median 3.579594786375953 driven_any_min 3.579594786375953 driven_lanedir_consec_max 3.548280526093551 driven_lanedir_consec_mean 3.548280526093551 driven_lanedir_consec_min 3.548280526093551 driven_lanedir_max 3.5551990211644577 driven_lanedir_mean 3.5551990211644577 driven_lanedir_median 3.5551990211644577 driven_lanedir_min 3.5551990211644577 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.579594786375953, "survival_time": 59.99999999999873, "driven_lanedir": 3.5551990211644577, "in-drivable-lane": 0.0, "deviation-heading": 4.21820918012117, "distance-from-start": 2.3398538209611455, "deviation-center-line": 3.9116147681867446, "driven_lanedir_consec": 3.548280526093551}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15564
1422
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 06:05:52+00:00 2022-11-25 06:15:13+00:00 0:09:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0000000000000142 driven_lanedir_consec_median 1.857807625020336 deviation-center-line_median 5.28259065053435
other stats deviation-center-line_max 6.835139014020123 deviation-center-line_mean 5.43336239298157 deviation-center-line_min 4.333129256837456 deviation-heading_max 10.8119794492084 deviation-heading_mean 6.0042732735036015 deviation-heading_median 4.89679221006279 deviation-heading_min 3.4115292246804296 distance-from-start_max 2.2673905887925794 distance-from-start_mean 1.383447713974703 distance-from-start_median 1.2056823254161633 distance-from-start_min 0.8550356162739062 driven_any_max 3.5795879547671228 driven_any_mean 2.5262149201005553 driven_any_median 2.515341830463492 driven_any_min 1.494588064708115 driven_lanedir_consec_max 3.438860731479879 driven_lanedir_consec_mean 1.982872428209739 driven_lanedir_consec_min 0.7770137313184056 driven_lanedir_max 3.560278357516038 driven_lanedir_mean 2.4513049805698603 driven_lanedir_median 2.440455044725664 driven_lanedir_min 1.3640314753120752 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 1.0125000000000144 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 3.5795879547671228, "survival_time": 59.99999999999873, "driven_lanedir": 3.560278357516038, "in-drivable-lane": 0.0, "deviation-heading": 4.074339221369879, "distance-from-start": 2.2673905887925794, "deviation-center-line": 4.333129256837456, "driven_lanedir_consec": 3.438860731479879}, "4way-001-ego1": {"driven_any": 2.0840878521440405, "survival_time": 59.99999999999873, "driven_lanedir": 1.951170455689099, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.7192451987557, "distance-from-start": 0.8580872602580342, "deviation-center-line": 6.835139014020123, "driven_lanedir_consec": 0.7951700224687287}, "4way-001-ego2": {"driven_any": 1.494588064708115, "survival_time": 59.99999999999873, "driven_lanedir": 1.3640314753120752, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 10.8119794492084, "distance-from-start": 0.8550356162739062, "deviation-center-line": 5.503515330064552, "driven_lanedir_consec": 0.7770137313184056}, "4way-001-ego3": {"driven_any": 2.946595808782943, "survival_time": 59.99999999999873, "driven_lanedir": 2.929739633762229, "in-drivable-lane": 0.0, "deviation-heading": 3.4115292246804296, "distance-from-start": 1.5532773905742925, "deviation-center-line": 5.061665971004148, "driven_lanedir_consec": 2.9204452275719435}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15560
1423
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 06:01:15+00:00 2022-11-25 06:05:44+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.95000000000015 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.1174902161570546 deviation-center-line_median 1.2140705885565546
other stats deviation-center-line_max 1.2140705885565546 deviation-center-line_mean 1.2140705885565546 deviation-center-line_min 1.2140705885565546 deviation-heading_max 2.8854089656463153 deviation-heading_mean 2.8854089656463153 deviation-heading_median 2.8854089656463153 deviation-heading_min 2.8854089656463153 distance-from-start_max 1.0329580261748834 distance-from-start_mean 1.0329580261748834 distance-from-start_median 1.0329580261748834 distance-from-start_min 1.0329580261748834 driven_any_max 1.134597717566756 driven_any_mean 1.134597717566756 driven_any_median 1.134597717566756 driven_any_min 1.134597717566756 driven_lanedir_consec_max 1.1174902161570546 driven_lanedir_consec_mean 1.1174902161570546 driven_lanedir_consec_min 1.1174902161570546 driven_lanedir_max 1.1174902161570546 driven_lanedir_mean 1.1174902161570546 driven_lanedir_median 1.1174902161570546 driven_lanedir_min 1.1174902161570546 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.134597717566756, "survival_time": 19.95000000000015, "driven_lanedir": 1.1174902161570546, "in-drivable-lane": 0.0, "deviation-heading": 2.8854089656463153, "distance-from-start": 1.0329580261748834, "deviation-center-line": 1.2140705885565546, "driven_lanedir_consec": 1.1174902161570546}}simulation-passed 1 survival_time_max 19.95000000000015 survival_time_mean 19.95000000000015 survival_time_min 19.95000000000015
No reset possible 15555
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-05-6.2.51
2022-11-25 05:54:30+00:00 2022-11-25 06:01:08+00:00 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15550
1425
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 05:43:01+00:00 2022-11-25 05:54:03+00:00 0:11:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.305795356040574 deviation-center-line_median 7.1542258236818705
other stats deviation-center-line_max 7.1542258236818705 deviation-center-line_mean 7.1542258236818705 deviation-center-line_min 7.1542258236818705 deviation-heading_max 5.348097044239231 deviation-heading_mean 5.348097044239231 deviation-heading_median 5.348097044239231 deviation-heading_min 5.348097044239231 distance-from-start_max 1.6303676290838451 distance-from-start_mean 1.6303676290838451 distance-from-start_median 1.6303676290838451 distance-from-start_min 1.6303676290838451 driven_any_max 3.4760910958010065 driven_any_mean 3.4760910958010065 driven_any_median 3.4760910958010065 driven_any_min 3.4760910958010065 driven_lanedir_consec_max 3.305795356040574 driven_lanedir_consec_mean 3.305795356040574 driven_lanedir_consec_min 3.305795356040574 driven_lanedir_max 3.305795356040574 driven_lanedir_mean 3.305795356040574 driven_lanedir_median 3.305795356040574 driven_lanedir_min 3.305795356040574 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"autolab-000-ego0": {"driven_any": 3.4760910958010065, "survival_time": 59.99999999999873, "driven_lanedir": 3.305795356040574, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097044239231, "distance-from-start": 1.6303676290838451, "deviation-center-line": 7.1542258236818705, "driven_lanedir_consec": 3.305795356040574}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15545
1426
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:36:14+00:00 2022-11-25 05:42:36+00:00 0:06:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091675968172336 deviation-center-line_median 5.914160547874868
other stats deviation-center-line_max 5.914160547874868 deviation-center-line_mean 5.914160547874868 deviation-center-line_min 5.914160547874868 deviation-heading_max 8.38876582052179 deviation-heading_mean 8.38876582052179 deviation-heading_median 8.38876582052179 deviation-heading_min 8.38876582052179 distance-from-start_max 1.0308143802054677 distance-from-start_mean 1.0308143802054677 distance-from-start_median 1.0308143802054677 distance-from-start_min 1.0308143802054677 driven_any_max 3.4490819834539503 driven_any_mean 3.4490819834539503 driven_any_median 3.4490819834539503 driven_any_min 3.4490819834539503 driven_lanedir_consec_max 2.091675968172336 driven_lanedir_consec_mean 2.091675968172336 driven_lanedir_consec_min 2.091675968172336 driven_lanedir_max 3.204051662096265 driven_lanedir_mean 3.204051662096265 driven_lanedir_median 3.204051662096265 driven_lanedir_min 3.204051662096265 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819834539503, "survival_time": 59.99999999999873, "driven_lanedir": 3.204051662096265, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.38876582052179, "distance-from-start": 1.0308143802054677, "deviation-center-line": 5.914160547874868, "driven_lanedir_consec": 2.091675968172336}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15538
1427
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 05:30:37+00:00 2022-11-25 05:36:08+00:00 0:05:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.489526926942431 deviation-center-line_median 5.459978779188341
other stats deviation-center-line_max 5.459978779188341 deviation-center-line_mean 5.459978779188341 deviation-center-line_min 5.459978779188341 deviation-heading_max 11.314241959835243 deviation-heading_mean 11.314241959835243 deviation-heading_median 11.314241959835243 deviation-heading_min 11.314241959835243 distance-from-start_max 3.0851207054617977 distance-from-start_mean 3.0851207054617977 distance-from-start_median 3.0851207054617977 distance-from-start_min 3.0851207054617977 driven_any_max 3.57958884925181 driven_any_mean 3.57958884925181 driven_any_median 3.57958884925181 driven_any_min 3.57958884925181 driven_lanedir_consec_max 3.489526926942431 driven_lanedir_consec_mean 3.489526926942431 driven_lanedir_consec_min 3.489526926942431 driven_lanedir_max 3.489526926942431 driven_lanedir_mean 3.489526926942431 driven_lanedir_median 3.489526926942431 driven_lanedir_min 3.489526926942431 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.57958884925181, "survival_time": 59.99999999999873, "driven_lanedir": 3.489526926942431, "in-drivable-lane": 0.0, "deviation-heading": 11.314241959835243, "distance-from-start": 3.0851207054617977, "deviation-center-line": 5.459978779188341, "driven_lanedir_consec": 3.489526926942431}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15534
1429
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:28:00+00:00 2022-11-25 05:30:26+00:00 0:02:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.400000000000013 in-drivable-lane_median 7.100000000000017 driven_lanedir_consec_median 0.33123013524902545 deviation-center-line_median 0.26973522366843383
other stats deviation-center-line_max 0.26973522366843383 deviation-center-line_mean 0.26973522366843383 deviation-center-line_min 0.26973522366843383 deviation-heading_max 2.53835057480462 deviation-heading_mean 2.53835057480462 deviation-heading_median 2.53835057480462 deviation-heading_min 2.53835057480462 distance-from-start_max 1.5453191784191067 distance-from-start_mean 1.5453191784191067 distance-from-start_median 1.5453191784191067 distance-from-start_min 1.5453191784191067 driven_any_max 1.545427894810905 driven_any_mean 1.545427894810905 driven_any_median 1.545427894810905 driven_any_min 1.545427894810905 driven_lanedir_consec_max 0.33123013524902545 driven_lanedir_consec_mean 0.33123013524902545 driven_lanedir_consec_min 0.33123013524902545 driven_lanedir_max 0.33123013524902545 driven_lanedir_mean 0.33123013524902545 driven_lanedir_median 0.33123013524902545 driven_lanedir_min 0.33123013524902545 in-drivable-lane_max 7.100000000000017 in-drivable-lane_mean 7.100000000000017 in-drivable-lane_min 7.100000000000017 per-episodes details {"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}simulation-passed 1 survival_time_max 10.400000000000013 survival_time_mean 10.400000000000013 survival_time_min 10.400000000000013
No reset possible 15530
1430
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:25:56+00:00 2022-11-25 05:27:53+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15525
1431
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 05:23:36+00:00 2022-11-25 05:25:26+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2999999999999963 in-drivable-lane_median 1.5499999999999954 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.12567511082985364
other stats deviation-center-line_max 0.12567511082985364 deviation-center-line_mean 0.12567511082985364 deviation-center-line_min 0.12567511082985364 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.3731007861754618 distance-from-start_mean 0.3731007861754618 distance-from-start_median 0.3731007861754618 distance-from-start_min 0.3731007861754618 driven_any_max 0.37310743381811584 driven_any_mean 0.37310743381811584 driven_any_median 0.37310743381811584 driven_any_min 0.37310743381811584 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 1.5499999999999954 in-drivable-lane_mean 1.5499999999999954 in-drivable-lane_min 1.5499999999999954 per-episodes details {"4way-000-ego0": {"driven_any": 0.37310743381811584, "survival_time": 3.2999999999999963, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 1.5499999999999954, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3731007861754618, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 3.2999999999999963 survival_time_mean 3.2999999999999963 survival_time_min 3.2999999999999963
No reset possible 15521
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:21:44+00:00 2022-11-25 05:23:23+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19694617160956465 survival_time_median 10.450000000000014 deviation-center-line_median 0.1253907294304808 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.1253907294304808 deviation-center-line_mean 0.1253907294304808 deviation-center-line_min 0.1253907294304808 deviation-heading_max 0.9520924629376074 deviation-heading_mean 0.9520924629376074 deviation-heading_median 0.9520924629376074 deviation-heading_min 0.9520924629376074 distance-from-start_max 1.5508236376562086 distance-from-start_mean 1.5508236376562086 distance-from-start_median 1.5508236376562086 distance-from-start_min 1.5508236376562086 driven_any_max 1.5511368313112877 driven_any_mean 1.5511368313112877 driven_any_median 1.5511368313112877 driven_any_min 1.5511368313112877 driven_lanedir_consec_max 0.19694617160956465 driven_lanedir_consec_mean 0.19694617160956465 driven_lanedir_consec_min 0.19694617160956465 driven_lanedir_max 0.19694617160956465 driven_lanedir_mean 0.19694617160956465 driven_lanedir_median 0.19694617160956465 driven_lanedir_min 0.19694617160956465 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"loop2-000-ego0": {"driven_any": 1.5511368313112877, "survival_time": 10.450000000000014, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376074, "distance-from-start": 1.5508236376562086, "deviation-center-line": 0.1253907294304808, "driven_lanedir_consec": 0.19694617160956465}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 15516
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 05:19:33+00:00 2022-11-25 05:21:37+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1969462908187456 survival_time_median 10.450000000000014 deviation-center-line_median 0.12539072943048185 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.12539072943048185 deviation-center-line_mean 0.12539072943048185 deviation-center-line_min 0.12539072943048185 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 1.550823637656203 distance-from-start_mean 1.550823637656203 distance-from-start_median 1.550823637656203 distance-from-start_min 1.550823637656203 driven_any_max 1.5511368313112863 driven_any_mean 1.5511368313112863 driven_any_median 1.5511368313112863 driven_any_min 1.5511368313112863 driven_lanedir_consec_max 0.1969462908187456 driven_lanedir_consec_mean 0.1969462908187456 driven_lanedir_consec_min 0.1969462908187456 driven_lanedir_max 0.1969462908187456 driven_lanedir_mean 0.1969462908187456 driven_lanedir_median 0.1969462908187456 driven_lanedir_min 0.1969462908187456 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5511368313112863, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969462908187456, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.550823637656203, "deviation-center-line": 0.12539072943048185, "driven_lanedir_consec": 0.1969462908187456}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 15511
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-3of4 host-error no davinci-stage-05-6.2.51
2022-11-25 05:18:36+00:00 2022-11-25 05:19:06+00:00 0:00:30 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15509
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-0of4 host-error no davinci-stage-05-6.2.51
2022-11-25 05:18:11+00:00 2022-11-25 05:18:28+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15507
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:16:16+00:00 2022-11-25 05:17:46+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15503
1434
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 05:12:54+00:00 2022-11-25 05:15:48+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 10.325000000000047 driven_lanedir_consec_median 0.2454627567044649 deviation-center-line_median 0.20268004628951308
other stats deviation-center-line_max 0.2697354450181819 deviation-center-line_mean 0.20268004628951308 deviation-center-line_min 0.13562464756084422 deviation-heading_max 2.5383505748046193 deviation-heading_mean 1.643080022875978 deviation-heading_median 1.643080022875978 deviation-heading_min 0.7478094709473364 distance-from-start_max 1.9240493840830373 distance-from-start_mean 1.152779949170181 distance-from-start_median 1.152779949170181 distance-from-start_min 0.3815105142573241 driven_any_max 1.9241954407136783 driven_any_mean 1.1528564552862215 driven_any_median 1.1528564552862215 driven_any_min 0.38151746985876434 driven_lanedir_consec_max 0.33122977762117056 driven_lanedir_consec_mean 0.2454627567044649 driven_lanedir_consec_min 0.1596957357877593 driven_lanedir_max 0.33122977762117056 driven_lanedir_mean 0.2454627567044649 driven_lanedir_median 0.2454627567044649 driven_lanedir_min 0.1596957357877593 in-drivable-lane_max 11.250000000000046 in-drivable-lane_mean 10.325000000000047 in-drivable-lane_min 9.40000000000005 per-episodes details {"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}, "loop2-000-ego1": {"driven_any": 0.38151746985876434, "survival_time": 12.700000000000044, "driven_lanedir": 0.1596957357877593, "in-drivable-lane": 11.250000000000046, "deviation-heading": 0.7478094709473364, "distance-from-start": 0.3815105142573241, "deviation-center-line": 0.13562464756084422, "driven_lanedir_consec": 0.1596957357877593}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 15499
1435
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 05:10:51+00:00 2022-11-25 05:12:34+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.850000000000003 in-drivable-lane_median 8.100000000000005 driven_lanedir_consec_median 0.19955231542410212 deviation-center-line_median 0.12567533372192938
other stats deviation-center-line_max 0.12567533372192938 deviation-center-line_mean 0.12567533372192938 deviation-center-line_min 0.12567533372192938 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 1.4547842507789297 distance-from-start_mean 1.4547842507789297 distance-from-start_median 1.4547842507789297 distance-from-start_min 1.4547842507789297 driven_any_max 1.4548913237462744 driven_any_mean 1.4548913237462744 driven_any_median 1.4548913237462744 driven_any_min 1.4548913237462744 driven_lanedir_consec_max 0.19955231542410212 driven_lanedir_consec_mean 0.19955231542410212 driven_lanedir_consec_min 0.19955231542410212 driven_lanedir_max 0.19955231542410212 driven_lanedir_mean 0.19955231542410212 driven_lanedir_median 0.19955231542410212 driven_lanedir_min 0.19955231542410212 in-drivable-lane_max 8.100000000000005 in-drivable-lane_mean 8.100000000000005 in-drivable-lane_min 8.100000000000005 per-episodes details {"loop-000-ego0": {"driven_any": 1.4548913237462744, "survival_time": 9.850000000000003, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 8.100000000000005, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.4547842507789297, "deviation-center-line": 0.12567533372192938, "driven_lanedir_consec": 0.19955231542410212}}simulation-passed 1 survival_time_max 9.850000000000003 survival_time_mean 9.850000000000003 survival_time_min 9.850000000000003
No reset possible 15492
1440
Bea Baselines 🐤minimal-agent lx22-BV1
sim-3of5 success no davinci-stage-05-6.2.51
2022-11-25 05:05:35+00:00 2022-11-25 05:10:37+00:00 0:05:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.437496092106819
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.437496092106819 distance-from-start_median 5.437496092106819 distance-from-start_min 5.437496092106819 driven_any_max 5.441098752040818 driven_any_mean 5.441098752040818 driven_any_median 5.441098752040818 driven_any_min 5.441098752040818 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 34.000000000000206 in-drivable-lane_mean 34.000000000000206 in-drivable-lane_median 34.000000000000206 in-drivable-lane_min 34.000000000000206 per-episodes details {"d50-ego0": {"driven_any": 5.441098752040818, "survival_time": 34.000000000000206, "driven_lanedir": 0.0, "in-drivable-lane": 34.000000000000206, "deviation-heading": 0.0, "distance-from-start": 5.437496092106819, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 34.000000000000206 survival_time_mean 34.000000000000206 survival_time_median 34.000000000000206 survival_time_min 34.000000000000206
No reset possible 15485
1447
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 05:02:20+00:00 2022-11-25 05:05:21+00:00 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666265914899656 deviation-center-line_median 0.1078383533310603
other stats deviation-center-line_max 0.1078383533310603 deviation-center-line_mean 0.1078383533310603 deviation-center-line_min 0.1078383533310603 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 1.6182798682575184 distance-from-start_mean 1.6182798682575184 distance-from-start_median 1.6182798682575184 distance-from-start_min 1.6182798682575184 driven_any_max 1.618389277101389 driven_any_mean 1.618389277101389 driven_any_median 1.618389277101389 driven_any_min 1.618389277101389 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"loop-000-ego0": {"driven_any": 1.618389277101389, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 15480
1449
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 04:59:42+00:00 2022-11-25 05:01:50+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.149999999999993 in-drivable-lane_median 2.749999999999993 driven_lanedir_consec_median 0.13666480491623578 deviation-center-line_median 0.10783802485851966
other stats deviation-center-line_max 0.10783802485851966 deviation-center-line_mean 0.10783802485851966 deviation-center-line_min 0.10783802485851966 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.5146479428595191 distance-from-start_mean 0.5146479428595191 distance-from-start_median 0.5146479428595191 distance-from-start_min 0.5146479428595191 driven_any_max 0.5146585239872693 driven_any_mean 0.5146585239872693 driven_any_median 0.5146585239872693 driven_any_min 0.5146585239872693 driven_lanedir_consec_max 0.13666480491623578 driven_lanedir_consec_mean 0.13666480491623578 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.13666480491623578 driven_lanedir_mean 0.13666480491623578 driven_lanedir_median 0.13666480491623578 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 2.749999999999993 in-drivable-lane_mean 2.749999999999993 in-drivable-lane_min 2.749999999999993 per-episodes details {"4way-000-ego0": {"driven_any": 0.5146585239872693, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.5146479428595191, "deviation-center-line": 0.10783802485851966, "driven_lanedir_consec": 0.13666480491623578}}simulation-passed 1 survival_time_max 4.149999999999993 survival_time_mean 4.149999999999993 survival_time_min 4.149999999999993
No reset possible 15472
1451
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 04:55:38+00:00 2022-11-25 04:59:28+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.050000000000022 in-drivable-lane_median 9.425000000000022 driven_lanedir_consec_median 0.18712269938788828 deviation-center-line_median 0.15973050554702342
other stats deviation-center-line_max 0.21472209870657577 deviation-center-line_mean 0.16050533162691244 deviation-center-line_min 0.10783821670702712 deviation-heading_max 1.3047652579244493 deviation-heading_mean 0.8970980849375731 deviation-heading_median 0.8549948818349844 deviation-heading_min 0.5736373181558745 distance-from-start_max 1.6510147598674252 distance-from-start_mean 0.6888645402096076 distance-from-start_median 0.439724395200456 distance-from-start_min 0.2249946105700932 driven_any_max 1.6511245063698194 driven_any_mean 0.6888969972348484 driven_any_median 0.43973285777181176 driven_any_min 0.2249977670259511 driven_lanedir_consec_max 0.6611934212369679 driven_lanedir_consec_mean 0.2874529754105062 driven_lanedir_consec_min 0.11437308162928028 driven_lanedir_max 0.6611934212369679 driven_lanedir_mean 0.2874529754105062 driven_lanedir_median 0.18712269938788828 driven_lanedir_min 0.11437308162928028 in-drivable-lane_max 9.850000000000025 in-drivable-lane_mean 8.750000000000025 in-drivable-lane_min 6.300000000000031 per-episodes details {"udem-000-ego0": {"driven_any": 0.5146585239873331, "survival_time": 11.050000000000022, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 9.650000000000022, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595168, "deviation-center-line": 0.10783821670702712, "driven_lanedir_consec": 0.13666480491620847}, "udem-000-ego1": {"driven_any": 0.3648071915562904, "survival_time": 11.050000000000022, "driven_lanedir": 0.2375805938595681, "in-drivable-lane": 9.20000000000002, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.3648008475413953, "deviation-center-line": 0.20320962418622543, "driven_lanedir_consec": 0.2375805938595681}, "udem-000-ego2": {"driven_any": 1.6511245063698194, "survival_time": 11.050000000000022, "driven_lanedir": 0.6611934212369679, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3047652579244493, "distance-from-start": 1.6510147598674252, "deviation-center-line": 0.21472209870657577, "driven_lanedir_consec": 0.6611934212369679}, "udem-000-ego3": {"driven_any": 0.2249977670259511, "survival_time": 11.050000000000022, "driven_lanedir": 0.11437308162928028, "in-drivable-lane": 9.850000000000025, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.2249946105700932, "deviation-center-line": 0.1162513869078214, "driven_lanedir_consec": 0.11437308162928028}}simulation-passed 1 survival_time_max 11.050000000000022 survival_time_mean 11.050000000000022 survival_time_min 11.050000000000022
No reset possible 15457
1454
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 04:36:34+00:00 2022-11-25 04:55:26+00:00 0:18:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 55.59999999999873 driven_lanedir_consec_median 0.21409656252063725 deviation-center-line_median 0.3366393305242464
other stats deviation-center-line_max 0.3366393305242464 deviation-center-line_mean 0.3366393305242464 deviation-center-line_min 0.3366393305242464 deviation-heading_max 3.3298911551738435 deviation-heading_mean 3.3298911551738435 deviation-heading_median 3.3298911551738435 deviation-heading_min 3.3298911551738435 distance-from-start_max 0.6984776730169185 distance-from-start_mean 0.6984776730169185 distance-from-start_median 0.6984776730169185 distance-from-start_min 0.6984776730169185 driven_any_max 5.899911270408711 driven_any_mean 5.899911270408711 driven_any_median 5.899911270408711 driven_any_min 5.899911270408711 driven_lanedir_consec_max 0.21409656252063725 driven_lanedir_consec_mean 0.21409656252063725 driven_lanedir_consec_min 0.21409656252063725 driven_lanedir_max 0.21409656252063725 driven_lanedir_mean 0.21409656252063725 driven_lanedir_median 0.21409656252063725 driven_lanedir_min 0.21409656252063725 in-drivable-lane_max 55.59999999999873 in-drivable-lane_mean 55.59999999999873 in-drivable-lane_min 55.59999999999873 per-episodes details {"autolab-000-ego0": {"driven_any": 5.899911270408711, "survival_time": 59.99999999999873, "driven_lanedir": 0.21409656252063725, "in-drivable-lane": 55.59999999999873, "deviation-heading": 3.3298911551738435, "distance-from-start": 0.6984776730169185, "deviation-center-line": 0.3366393305242464, "driven_lanedir_consec": 0.21409656252063725}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15453
1456
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 04:34:23+00:00 2022-11-25 04:36:18+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15444
1554
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-05-6.2.51
2022-11-25 04:24:57+00:00 2022-11-25 04:34:08+00:00 0:09:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15436
1458
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 04:04:01+00:00 2022-11-25 04:24:38+00:00 0:20:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 58.37499999999873 driven_lanedir_consec_median 0.1442805696663663 deviation-center-line_median 0.08448210333541714
other stats deviation-center-line_max 2.880126769318907 deviation-center-line_mean 0.7767008477532074 deviation-center-line_min 0.05771241502308823 deviation-heading_max 20.184072583686056 deviation-heading_mean 5.724333622056737 deviation-heading_median 0.98271339677328 deviation-heading_min 0.7478351109943341 distance-from-start_max 0.3252165674923969 distance-from-start_mean 0.2184447520417018 distance-from-start_median 0.2030345177344693 distance-from-start_min 0.1424934052054717 driven_any_max 2.3626060948661793 driven_any_mean 0.8299003305246706 driven_any_median 0.39326716623996 driven_any_min 0.17046089475258358 driven_lanedir_consec_max 0.659905851451092 driven_lanedir_consec_mean 0.25048629282457446 driven_lanedir_consec_min 0.05347818051447328 driven_lanedir_max 0.659905851451092 driven_lanedir_mean 0.25048629282457446 driven_lanedir_median 0.1442805696663663 driven_lanedir_min 0.05347818051447328 in-drivable-lane_max 59.09999999999873 in-drivable-lane_mean 52.54999999999882 in-drivable-lane_min 34.349999999999085 per-episodes details {"udem-000-ego0": {"driven_any": 2.3626060948661793, "survival_time": 59.99999999999873, "driven_lanedir": 0.659905851451092, "in-drivable-lane": 34.349999999999085, "deviation-heading": 20.184072583686056, "distance-from-start": 0.1424934052054717, "deviation-center-line": 2.880126769318907, "driven_lanedir_consec": 0.659905851451092}, "udem-000-ego1": {"driven_any": 0.17046089475258358, "survival_time": 59.99999999999873, "driven_lanedir": 0.05347818051447328, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.7478351109943341, "distance-from-start": 0.15699714534713718, "deviation-center-line": 0.0684103641543038, "driven_lanedir_consec": 0.05347818051447328}, "udem-000-ego2": {"driven_any": 0.4120565489571183, "survival_time": 59.99999999999873, "driven_lanedir": 0.15827656302204485, "in-drivable-lane": 58.24999999999873, "deviation-heading": 1.1214036967901688, "distance-from-start": 0.3252165674923969, "deviation-center-line": 0.10055384251653048, "driven_lanedir_consec": 0.15827656302204485}, "udem-000-ego3": {"driven_any": 0.3744777835228017, "survival_time": 59.99999999999873, "driven_lanedir": 0.13028457631068768, "in-drivable-lane": 58.49999999999873, "deviation-heading": 0.8440230967563911, "distance-from-start": 0.24907189012180145, "deviation-center-line": 0.05771241502308823, "driven_lanedir_consec": 0.13028457631068768}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15435
1458
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 04:02:25+00:00 2022-11-25 04:03:53+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15430
1460
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 03:52:40+00:00 2022-11-25 04:02:01+00:00 0:09:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 50.84999999999925 in-drivable-lane_median 29.74999999999945 driven_lanedir_consec_median 1.0415751007488625 deviation-center-line_median 1.0863802520682069
other stats deviation-center-line_max 1.0863802520682069 deviation-center-line_mean 1.0863802520682069 deviation-center-line_min 1.0863802520682069 deviation-heading_max 16.714892615476757 deviation-heading_mean 16.714892615476757 deviation-heading_median 16.714892615476757 deviation-heading_min 16.714892615476757 distance-from-start_max 0.8707808921340584 distance-from-start_mean 0.8707808921340584 distance-from-start_median 0.8707808921340584 distance-from-start_min 0.8707808921340584 driven_any_max 4.969683539841385 driven_any_mean 4.969683539841385 driven_any_median 4.969683539841385 driven_any_min 4.969683539841385 driven_lanedir_consec_max 1.0415751007488625 driven_lanedir_consec_mean 1.0415751007488625 driven_lanedir_consec_min 1.0415751007488625 driven_lanedir_max 1.0415751007488625 driven_lanedir_mean 1.0415751007488625 driven_lanedir_median 1.0415751007488625 driven_lanedir_min 1.0415751007488625 in-drivable-lane_max 29.74999999999945 in-drivable-lane_mean 29.74999999999945 in-drivable-lane_min 29.74999999999945 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.969683539841385, "survival_time": 50.84999999999925, "driven_lanedir": 1.0415751007488625, "in-drivable-lane": 29.74999999999945, "deviation-heading": 16.714892615476757, "distance-from-start": 0.8707808921340584, "deviation-center-line": 1.0863802520682069, "driven_lanedir_consec": 1.0415751007488625}}simulation-passed 1 survival_time_max 50.84999999999925 survival_time_mean 50.84999999999925 survival_time_min 50.84999999999925
No reset possible 15422
1464
Bea Baselines 🐤template-pytorch lx22-state-estimation
sim success yes davinci-stage-05-6.2.51
2022-11-25 03:37:48+00:00 2022-11-25 03:52:15+00:00 0:14:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5367459853075975 survival_time_median 59.99999999999873 deviation-center-line_median 1.508144498037477 in-drivable-lane_median 44.24999999999877
other stats deviation-center-line_max 2.0694190113867585 deviation-center-line_mean 1.4989635370278571 deviation-center-line_min 0.919327101659336 deviation-heading_max 22.771406238670515 deviation-heading_mean 14.72481128878568 deviation-heading_median 11.450881498520928 deviation-heading_min 9.952146129165587 distance-from-start_max 0.30778864017973856 distance-from-start_mean 0.29011997239463944 distance-from-start_median 0.30521395633923987 distance-from-start_min 0.2573573206649398 driven_any_max 3.4508741742762097 driven_any_mean 3.416248628509342 driven_any_median 3.4190931801531748 driven_any_min 3.3787785310986407 driven_lanedir_consec_max 1.0430461512094171 driven_lanedir_consec_mean 0.6827608284972309 driven_lanedir_consec_min 0.4684903489746779 driven_lanedir_max 1.0430461512094171 driven_lanedir_mean 0.6827608284972309 driven_lanedir_median 0.5367459853075975 driven_lanedir_min 0.4684903489746779 in-drivable-lane_max 46.999999999998614 in-drivable-lane_mean 40.56666666666558 in-drivable-lane_min 30.44999999999937 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 3.4508741742762097, "survival_time": 59.99999999999873, "driven_lanedir": 0.4684903489746779, "in-drivable-lane": 46.999999999998614, "deviation-heading": 9.952146129165587, "distance-from-start": 0.30778864017973856, "deviation-center-line": 0.919327101659336, "driven_lanedir_consec": 0.4684903489746779}, "LF-zig-zag-001-ego0": {"driven_any": 3.4190931801531748, "survival_time": 59.99999999999873, "driven_lanedir": 1.0430461512094171, "in-drivable-lane": 30.44999999999937, "deviation-heading": 22.771406238670515, "distance-from-start": 0.2573573206649398, "deviation-center-line": 1.508144498037477, "driven_lanedir_consec": 1.0430461512094171}, "LF-zig-zag-002-ego0": {"driven_any": 3.3787785310986407, "survival_time": 59.99999999999873, "driven_lanedir": 0.5367459853075975, "in-drivable-lane": 44.24999999999877, "deviation-heading": 11.450881498520928, "distance-from-start": 0.30521395633923987, "deviation-center-line": 2.0694190113867585, "driven_lanedir_consec": 0.5367459853075975}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15420
1465
Bea Baselines 🐤template-pytorch lx22-BV1
sim-0of5 success no davinci-stage-05-6.2.51
2022-11-25 03:36:09+00:00 2022-11-25 03:37:35+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.21588295399109747
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.21588295399109747 distance-from-start_median 0.21588295399109747 distance-from-start_min 0.21588295399109747 driven_any_max 0.29141700709783724 driven_any_mean 0.29141700709783724 driven_any_median 0.29141700709783724 driven_any_min 0.29141700709783724 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.049999999999997 in-drivable-lane_mean 3.049999999999997 in-drivable-lane_median 3.049999999999997 in-drivable-lane_min 3.049999999999997 per-episodes details {"d30-ego0": {"driven_any": 0.29141700709783724, "survival_time": 3.049999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 3.049999999999997, "deviation-heading": 0.0, "distance-from-start": 0.21588295399109747, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 3.049999999999997 survival_time_median 3.049999999999997 survival_time_min 3.049999999999997
No reset possible 15413
1472
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 03:24:29+00:00 2022-11-25 03:35:34+00:00 0:11:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.75000000000028 in-drivable-lane_median 19.10000000000016 driven_lanedir_consec_median 0.7966266648743163 deviation-center-line_median 1.218292713061094
other stats deviation-center-line_max 1.218292713061094 deviation-center-line_mean 1.218292713061094 deviation-center-line_min 1.218292713061094 deviation-heading_max 11.006880994558433 deviation-heading_mean 11.006880994558433 deviation-heading_median 11.006880994558433 deviation-heading_min 11.006880994558433 distance-from-start_max 0.4881862472224101 distance-from-start_mean 0.4881862472224101 distance-from-start_median 0.4881862472224101 distance-from-start_min 0.4881862472224101 driven_any_max 4.09713497044351 driven_any_mean 4.09713497044351 driven_any_median 4.09713497044351 driven_any_min 4.09713497044351 driven_lanedir_consec_max 0.7966266648743163 driven_lanedir_consec_mean 0.7966266648743163 driven_lanedir_consec_min 0.7966266648743163 driven_lanedir_max 0.9626652345051812 driven_lanedir_mean 0.9626652345051812 driven_lanedir_median 0.9626652345051812 driven_lanedir_min 0.9626652345051812 in-drivable-lane_max 19.10000000000016 in-drivable-lane_mean 19.10000000000016 in-drivable-lane_min 19.10000000000016 per-episodes details {"autolab-000-ego0": {"driven_any": 4.09713497044351, "survival_time": 32.75000000000028, "driven_lanedir": 0.9626652345051812, "in-drivable-lane": 19.10000000000016, "deviation-heading": 11.006880994558433, "distance-from-start": 0.4881862472224101, "deviation-center-line": 1.218292713061094, "driven_lanedir_consec": 0.7966266648743163}}simulation-passed 1 survival_time_max 32.75000000000028 survival_time_mean 32.75000000000028 survival_time_min 32.75000000000028
No reset possible 15406
1474
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 03:13:19+00:00 2022-11-25 03:23:53+00:00 0:10:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 39.39999999999887 driven_lanedir_consec_median 2.1747823280684413 deviation-center-line_median 1.2126228260132723
other stats deviation-center-line_max 1.2126228260132723 deviation-center-line_mean 1.2126228260132723 deviation-center-line_min 1.2126228260132723 deviation-heading_max 15.266442536774752 deviation-heading_mean 15.266442536774752 deviation-heading_median 15.266442536774752 deviation-heading_min 15.266442536774752 distance-from-start_max 0.726305639097185 distance-from-start_mean 0.726305639097185 distance-from-start_median 0.726305639097185 distance-from-start_min 0.726305639097185 driven_any_max 10.349263495195968 driven_any_mean 10.349263495195968 driven_any_median 10.349263495195968 driven_any_min 10.349263495195968 driven_lanedir_consec_max 2.1747823280684413 driven_lanedir_consec_mean 2.1747823280684413 driven_lanedir_consec_min 2.1747823280684413 driven_lanedir_max 2.1747823280684413 driven_lanedir_mean 2.1747823280684413 driven_lanedir_median 2.1747823280684413 driven_lanedir_min 2.1747823280684413 in-drivable-lane_max 39.39999999999887 in-drivable-lane_mean 39.39999999999887 in-drivable-lane_min 39.39999999999887 per-episodes details {"udem1-000-ego0": {"driven_any": 10.349263495195968, "survival_time": 59.99999999999873, "driven_lanedir": 2.1747823280684413, "in-drivable-lane": 39.39999999999887, "deviation-heading": 15.266442536774752, "distance-from-start": 0.726305639097185, "deviation-center-line": 1.2126228260132723, "driven_lanedir_consec": 2.1747823280684413}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15405
1474
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 03:11:22+00:00 2022-11-25 03:12:52+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15404
1475
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 03:09:29+00:00 2022-11-25 03:11:15+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2709260457714351 survival_time_median 7.049999999999983 deviation-center-line_median 0.18504252477769811 in-drivable-lane_median 4.6499999999999835
other stats deviation-center-line_max 0.18504252477769811 deviation-center-line_mean 0.18504252477769811 deviation-center-line_min 0.18504252477769811 deviation-heading_max 1.5999314688457134 deviation-heading_mean 1.5999314688457134 deviation-heading_median 1.5999314688457134 deviation-heading_min 1.5999314688457134 distance-from-start_max 0.5445897288589188 distance-from-start_mean 0.5445897288589188 distance-from-start_median 0.5445897288589188 distance-from-start_min 0.5445897288589188 driven_any_max 1.372981956971246 driven_any_mean 1.372981956971246 driven_any_median 1.372981956971246 driven_any_min 1.372981956971246 driven_lanedir_consec_max 0.2709260457714351 driven_lanedir_consec_mean 0.2709260457714351 driven_lanedir_consec_min 0.2709260457714351 driven_lanedir_max 0.2709260457714351 driven_lanedir_mean 0.2709260457714351 driven_lanedir_median 0.2709260457714351 driven_lanedir_min 0.2709260457714351 in-drivable-lane_max 4.6499999999999835 in-drivable-lane_mean 4.6499999999999835 in-drivable-lane_min 4.6499999999999835 per-episodes details {"loop-000-ego0": {"driven_any": 1.372981956971246, "survival_time": 7.049999999999983, "driven_lanedir": 0.2709260457714351, "in-drivable-lane": 4.6499999999999835, "deviation-heading": 1.5999314688457134, "distance-from-start": 0.5445897288589188, "deviation-center-line": 0.18504252477769811, "driven_lanedir_consec": 0.2709260457714351}}simulation-passed 1 survival_time_max 7.049999999999983 survival_time_mean 7.049999999999983 survival_time_min 7.049999999999983
No reset possible 15393
1477
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 02:44:17+00:00 2022-11-25 03:09:09+00:00 0:24:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 54.94999999999872 driven_lanedir_consec_median 0.29724750301628233 deviation-center-line_median 0.5250621456660077
other stats deviation-center-line_max 0.9177533234605212 deviation-center-line_mean 0.5087265733621757 deviation-center-line_min 0.0670286786561663 deviation-heading_max 12.215788852212208 deviation-heading_mean 4.960834997326044 deviation-heading_median 3.5368356649422363 deviation-heading_min 0.5538798072074983 distance-from-start_max 0.6091994138052578 distance-from-start_mean 0.4424464173959681 distance-from-start_median 0.45608660535446544 distance-from-start_min 0.2484130450696836 driven_any_max 5.812497367160109 driven_any_mean 2.8053715208334573 driven_any_median 2.4972405475805974 driven_any_min 0.4145076210125253 driven_lanedir_consec_max 1.1998588912105714 driven_lanedir_consec_mean 0.47035088580021167 driven_lanedir_consec_min 0.08704964595771059 driven_lanedir_max 1.1998588912105714 driven_lanedir_mean 0.47035088580021167 driven_lanedir_median 0.29724750301628233 driven_lanedir_min 0.08704964595771059 in-drivable-lane_max 59.24999999999873 in-drivable-lane_mean 53.3624999999987 in-drivable-lane_min 44.29999999999861 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.3917397140005985, "survival_time": 59.99999999999873, "driven_lanedir": 1.1998588912105714, "in-drivable-lane": 44.29999999999861, "deviation-heading": 12.215788852212208, "distance-from-start": 0.5348435661125194, "deviation-center-line": 0.9177533234605212, "driven_lanedir_consec": 1.1998588912105714}, "zigzag-000-ego1": {"driven_any": 5.812497367160109, "survival_time": 59.99999999999873, "driven_lanedir": 0.40759786081934535, "in-drivable-lane": 52.8999999999987, "deviation-heading": 5.0405602353064465, "distance-from-start": 0.6091994138052578, "deviation-center-line": 0.815130021757521, "driven_lanedir_consec": 0.40759786081934535}, "zigzag-000-ego2": {"driven_any": 0.6027413811605961, "survival_time": 59.99999999999873, "driven_lanedir": 0.18689714521321937, "in-drivable-lane": 56.999999999998735, "deviation-heading": 2.033111094578026, "distance-from-start": 0.2484130450696836, "deviation-center-line": 0.23499426957449435, "driven_lanedir_consec": 0.18689714521321937}, "zigzag-000-ego3": {"driven_any": 0.4145076210125253, "survival_time": 59.99999999999873, "driven_lanedir": 0.08704964595771059, "in-drivable-lane": 59.24999999999873, "deviation-heading": 0.5538798072074983, "distance-from-start": 0.3773296445964115, "deviation-center-line": 0.0670286786561663, "driven_lanedir_consec": 0.08704964595771059}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15389
1478
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 02:36:56+00:00 2022-11-25 02:44:08+00:00 0:07:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 39.349999999998886 driven_lanedir_consec_median 1.0482113373051227 deviation-center-line_median 2.177126478328354
other stats deviation-center-line_max 2.177126478328354 deviation-center-line_mean 2.177126478328354 deviation-center-line_min 2.177126478328354 deviation-heading_max 14.933377257213133 deviation-heading_mean 14.933377257213133 deviation-heading_median 14.933377257213133 deviation-heading_min 14.933377257213133 distance-from-start_max 0.3024054778907333 distance-from-start_mean 0.3024054778907333 distance-from-start_median 0.3024054778907333 distance-from-start_min 0.3024054778907333 driven_any_max 4.243216919877116 driven_any_mean 4.243216919877116 driven_any_median 4.243216919877116 driven_any_min 4.243216919877116 driven_lanedir_consec_max 1.0482113373051227 driven_lanedir_consec_mean 1.0482113373051227 driven_lanedir_consec_min 1.0482113373051227 driven_lanedir_max 1.0482113373051227 driven_lanedir_mean 1.0482113373051227 driven_lanedir_median 1.0482113373051227 driven_lanedir_min 1.0482113373051227 in-drivable-lane_max 39.349999999998886 in-drivable-lane_mean 39.349999999998886 in-drivable-lane_min 39.349999999998886 per-episodes details {"loop2-000-ego0": {"driven_any": 4.243216919877116, "survival_time": 59.99999999999873, "driven_lanedir": 1.0482113373051227, "in-drivable-lane": 39.349999999998886, "deviation-heading": 14.933377257213133, "distance-from-start": 0.3024054778907333, "deviation-center-line": 2.177126478328354, "driven_lanedir_consec": 1.0482113373051227}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15387
1479
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 02:33:38+00:00 2022-11-25 02:36:26+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.699999999999995 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.364506838392066 deviation-center-line_median 0.14696541332404583
other stats deviation-center-line_max 0.14696541332404583 deviation-center-line_mean 0.14696541332404583 deviation-center-line_min 0.14696541332404583 deviation-heading_max 1.6699264400950062 deviation-heading_mean 1.6699264400950062 deviation-heading_median 1.6699264400950062 deviation-heading_min 1.6699264400950062 distance-from-start_max 0.3743806210373658 distance-from-start_mean 0.3743806210373658 distance-from-start_median 0.3743806210373658 distance-from-start_min 0.3743806210373658 driven_any_max 0.3944302398862539 driven_any_mean 0.3944302398862539 driven_any_median 0.3944302398862539 driven_any_min 0.3944302398862539 driven_lanedir_consec_max 0.364506838392066 driven_lanedir_consec_mean 0.364506838392066 driven_lanedir_consec_min 0.364506838392066 driven_lanedir_max 0.364506838392066 driven_lanedir_mean 0.364506838392066 driven_lanedir_median 0.364506838392066 driven_lanedir_min 0.364506838392066 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}simulation-passed 1 survival_time_max 3.699999999999995 survival_time_mean 3.699999999999995 survival_time_min 3.699999999999995
No reset possible 15384
1479
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 02:28:57+00:00 2022-11-25 02:33:30+00:00 0:04:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.750000000000217 in-drivable-lane_median 16.200000000000195 driven_lanedir_consec_median 0.2676465159268615 deviation-center-line_median 0.7555297758130887
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.0666647982270385 driven_any_mean 6.0666647982270385 driven_any_median 6.0666647982270385 driven_any_min 6.0666647982270385 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.200000000000195 in-drivable-lane_mean 16.200000000000195 in-drivable-lane_min 16.200000000000195 per-episodes details {"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 24.750000000000217 survival_time_mean 24.750000000000217 survival_time_min 24.750000000000217
No reset possible 15380
1480
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 02:27:12+00:00 2022-11-25 02:28:44+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15378
1481
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 02:25:18+00:00 2022-11-25 02:26:51+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15366
1484
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 02:02:45+00:00 2022-11-25 02:24:48+00:00 0:22:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 54.674999999998704 driven_lanedir_consec_median 0.12251247869641724 deviation-center-line_median 0.4433920965103467
other stats deviation-center-line_max 1.2038527288241243 deviation-center-line_mean 0.5423174087533363 deviation-center-line_min 0.07863271316852748 deviation-heading_max 14.288552729590728 deviation-heading_mean 5.627247694260051 deviation-heading_median 3.416903566880354 deviation-heading_min 1.38663091368877 distance-from-start_max 1.4108418329398955 distance-from-start_mean 0.8799981600642298 distance-from-start_median 0.7992095848737366 distance-from-start_min 0.5107316375695505 driven_any_max 15.326310847370582 driven_any_mean 7.171771192512803 driven_any_median 6.412570219301883 driven_any_min 0.5356334840768605 driven_lanedir_consec_max 0.4413235258740946 driven_lanedir_consec_mean 0.1898162935783138 driven_lanedir_consec_min 0.07291669104632614 driven_lanedir_max 0.4413235258740946 driven_lanedir_mean 0.1804353170531879 driven_lanedir_median 0.1104128284063164 driven_lanedir_min 0.05959208552602435 in-drivable-lane_max 57.749999999998735 in-drivable-lane_mean 52.93749999999879 in-drivable-lane_min 44.649999999999025 per-episodes details {"autolab-000-ego0": {"driven_any": 0.5356334840768605, "survival_time": 59.99999999999873, "driven_lanedir": 0.4413235258740946, "in-drivable-lane": 57.749999999998735, "deviation-heading": 1.38663091368877, "distance-from-start": 0.5107316375695505, "deviation-center-line": 0.07863271316852748, "driven_lanedir_consec": 0.4413235258740946}, "autolab-000-ego1": {"driven_any": 15.326310847370582, "survival_time": 59.99999999999873, "driven_lanedir": 0.05959208552602435, "in-drivable-lane": 44.649999999999025, "deviation-heading": 14.288552729590728, "distance-from-start": 1.4108418329398955, "deviation-center-line": 1.2038527288241243, "driven_lanedir_consec": 0.07291669104632614}, "autolab-000-ego2": {"driven_any": 7.342290201921084, "survival_time": 59.99999999999873, "driven_lanedir": 0.1334588763696649, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.0294981006515846, "distance-from-start": 0.8626308120701035, "deviation-center-line": 0.4429996774431571, "driven_lanedir_consec": 0.14670729988336562}, "autolab-000-ego3": {"driven_any": 5.482850236682682, "survival_time": 59.99999999999873, "driven_lanedir": 0.08736678044296786, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109123, "distance-from-start": 0.7357883576773698, "deviation-center-line": 0.44378451557753634, "driven_lanedir_consec": 0.09831765750946886}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15363
1485
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 01:59:07+00:00 2022-11-25 02:02:31+00:00 0:03:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.150000000000137 in-drivable-lane_median 10.600000000000112 driven_lanedir_consec_median 0.2737818968396458 deviation-center-line_median 0.7687309631535428
other stats deviation-center-line_max 0.7687309631535428 deviation-center-line_mean 0.7687309631535428 deviation-center-line_min 0.7687309631535428 deviation-heading_max 5.758343079064915 deviation-heading_mean 5.758343079064915 deviation-heading_median 5.758343079064915 deviation-heading_min 5.758343079064915 distance-from-start_max 0.6736010379604951 distance-from-start_mean 0.6736010379604951 distance-from-start_median 0.6736010379604951 distance-from-start_min 0.6736010379604951 driven_any_max 4.258760700432588 driven_any_mean 4.258760700432588 driven_any_median 4.258760700432588 driven_any_min 4.258760700432588 driven_lanedir_consec_max 0.2737818968396458 driven_lanedir_consec_mean 0.2737818968396458 driven_lanedir_consec_min 0.2737818968396458 driven_lanedir_max 0.25577241289552777 driven_lanedir_mean 0.25577241289552777 driven_lanedir_median 0.25577241289552777 driven_lanedir_min 0.25577241289552777 in-drivable-lane_max 10.600000000000112 in-drivable-lane_mean 10.600000000000112 in-drivable-lane_min 10.600000000000112 per-episodes details {"loop-000-ego0": {"driven_any": 4.258760700432588, "survival_time": 19.150000000000137, "driven_lanedir": 0.25577241289552777, "in-drivable-lane": 10.600000000000112, "deviation-heading": 5.758343079064915, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.7687309631535428, "driven_lanedir_consec": 0.2737818968396458}}simulation-passed 1 survival_time_max 19.150000000000137 survival_time_mean 19.150000000000137 survival_time_min 19.150000000000137
No reset possible 15361
1485
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 01:56:19+00:00 2022-11-25 01:58:42+00:00 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.700000000000088 in-drivable-lane_median 8.100000000000078 driven_lanedir_consec_median 0.27378153863999577 deviation-center-line_median 0.6226670229639317
other stats deviation-center-line_max 0.6226670229639317 deviation-center-line_mean 0.6226670229639317 deviation-center-line_min 0.6226670229639317 deviation-heading_max 4.9776949056766355 deviation-heading_mean 4.9776949056766355 deviation-heading_median 4.9776949056766355 deviation-heading_min 4.9776949056766355 distance-from-start_max 0.6297514211538986 distance-from-start_mean 0.6297514211538986 distance-from-start_median 0.6297514211538986 distance-from-start_min 0.6297514211538986 driven_any_max 3.532822332695487 driven_any_mean 3.532822332695487 driven_any_median 3.532822332695487 driven_any_min 3.532822332695487 driven_lanedir_consec_max 0.27378153863999577 driven_lanedir_consec_mean 0.27378153863999577 driven_lanedir_consec_min 0.27378153863999577 driven_lanedir_max 0.2627748326499355 driven_lanedir_mean 0.2627748326499355 driven_lanedir_median 0.2627748326499355 driven_lanedir_min 0.2627748326499355 in-drivable-lane_max 8.100000000000078 in-drivable-lane_mean 8.100000000000078 in-drivable-lane_min 8.100000000000078 per-episodes details {"loop2-000-ego0": {"driven_any": 3.532822332695487, "survival_time": 15.700000000000088, "driven_lanedir": 0.2627748326499355, "in-drivable-lane": 8.100000000000078, "deviation-heading": 4.9776949056766355, "distance-from-start": 0.6297514211538986, "deviation-center-line": 0.6226670229639317, "driven_lanedir_consec": 0.27378153863999577}}simulation-passed 1 survival_time_max 15.700000000000088 survival_time_mean 15.700000000000088 survival_time_min 15.700000000000088
No reset possible 15359
1486
Bea Baselines 🐤template-random lx22-modcon
sim success yes davinci-stage-05-6.2.51
2022-11-25 01:52:16+00:00 2022-11-25 01:55:50+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 5.975000000000012 deviation-center-line_median 0.11301514542099378 driven_lanedir_consec_median -0.0018954959261547888 survival_time_median 7.35000000000001
other stats deviation-center-line_max 0.1446772460243307 deviation-center-line_mean 0.11301514542099378 deviation-center-line_min 0.08135304481765684 deviation-heading_max 1.386814265924231 deviation-heading_mean 1.07792007492562 deviation-heading_median 1.07792007492562 deviation-heading_min 0.7690258839270088 distance-from-start_max 0.5461575079396507 distance-from-start_mean 0.4044333226818525 distance-from-start_median 0.4044333226818525 distance-from-start_min 0.2627091374240543 driven_any_max 2.2158554268274218 driven_any_mean 1.246529558046526 driven_any_median 1.246529558046526 driven_any_min 0.2772036892656306 driven_lanedir_consec_max 0.003586872133226393 driven_lanedir_consec_mean -0.0018954959261547888 driven_lanedir_consec_min -0.007377863985535971 driven_lanedir_max 0.003586872133226393 driven_lanedir_mean -0.0018954959261547888 driven_lanedir_median -0.0018954959261547888 driven_lanedir_min -0.007377863985535971 in-drivable-lane_max 9.400000000000029 in-drivable-lane_mean 5.975000000000012 in-drivable-lane_min 2.5499999999999963 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 2.2158554268274218, "survival_time": 11.200000000000024, "driven_lanedir": -0.007377863985535971, "in-drivable-lane": 9.400000000000029, "deviation-heading": 1.386814265924231, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.1446772460243307, "driven_lanedir_consec": -0.007377863985535971}, "LF-full-loop-001-ego0": {"driven_any": 0.2772036892656306, "survival_time": 3.4999999999999956, "driven_lanedir": 0.003586872133226393, "in-drivable-lane": 2.5499999999999963, "deviation-heading": 0.7690258839270088, "distance-from-start": 0.2627091374240543, "deviation-center-line": 0.08135304481765684, "driven_lanedir_consec": 0.003586872133226393}}simulation-passed 1 survival_time_max 11.200000000000024 survival_time_mean 7.35000000000001 survival_time_min 3.4999999999999956
No reset possible 15355
1490
Bea Baselines 🐤template-random lx22-BV1
sim-2of5 success no davinci-stage-05-6.2.51
2022-11-25 01:49:20+00:00 2022-11-25 01:52:03+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d40-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 15351
1490
Bea Baselines 🐤template-random lx22-BV1
sim-3of5 success no davinci-stage-05-6.2.51
2022-11-25 01:45:59+00:00 2022-11-25 01:48:59+00:00 0:03:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d50-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 15347
1497
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 01:38:44+00:00 2022-11-25 01:45:44+00:00 0:07:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.74999999999937 in-drivable-lane_median 34.749999999999275 driven_lanedir_consec_median 0.24555746228952957 deviation-center-line_median 1.3919847015555793
other stats deviation-center-line_max 1.3919847015555793 deviation-center-line_mean 1.3919847015555793 deviation-center-line_min 1.3919847015555793 deviation-heading_max 9.906601177812297 deviation-heading_mean 9.906601177812297 deviation-heading_median 9.906601177812297 deviation-heading_min 9.906601177812297 distance-from-start_max 1.1351054760255683 distance-from-start_mean 1.1351054760255683 distance-from-start_median 1.1351054760255683 distance-from-start_min 1.1351054760255683 driven_any_max 12.250926783811016 driven_any_mean 12.250926783811016 driven_any_median 12.250926783811016 driven_any_min 12.250926783811016 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.24555746228952957 driven_lanedir_consec_min 0.24555746228952957 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.2358197494342854 driven_lanedir_median 0.2358197494342854 driven_lanedir_min 0.2358197494342854 in-drivable-lane_max 34.749999999999275 in-drivable-lane_mean 34.749999999999275 in-drivable-lane_min 34.749999999999275 per-episodes details {"loop2-000-ego0": {"driven_any": 12.250926783811016, "survival_time": 48.74999999999937, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 34.749999999999275, "deviation-heading": 9.906601177812297, "distance-from-start": 1.1351054760255683, "deviation-center-line": 1.3919847015555793, "driven_lanedir_consec": 0.24555746228952957}}simulation-passed 1 survival_time_max 48.74999999999937 survival_time_mean 48.74999999999937 survival_time_min 48.74999999999937
No reset possible 15344
1498
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 01:36:56+00:00 2022-11-25 01:38:29+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15341
1499
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 01:35:07+00:00 2022-11-25 01:36:48+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15338
1499
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 01:33:02+00:00 2022-11-25 01:35:00+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15336
1500
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 01:29:57+00:00 2022-11-25 01:32:55+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.15869649764514326 survival_time_median 15.900000000000093 deviation-center-line_median 0.4544941711289141 in-drivable-lane_median 11.05000000000006
other stats deviation-center-line_max 0.4544941711289141 deviation-center-line_mean 0.4544941711289141 deviation-center-line_min 0.4544941711289141 deviation-heading_max 3.664036561158003 deviation-heading_mean 3.664036561158003 deviation-heading_median 3.664036561158003 deviation-heading_min 3.664036561158003 distance-from-start_max 0.6653201232297334 distance-from-start_mean 0.6653201232297334 distance-from-start_median 0.6653201232297334 distance-from-start_min 0.6653201232297334 driven_any_max 3.642720741594881 driven_any_mean 3.642720741594881 driven_any_median 3.642720741594881 driven_any_min 3.642720741594881 driven_lanedir_consec_max 0.15869649764514326 driven_lanedir_consec_mean 0.15869649764514326 driven_lanedir_consec_min 0.15869649764514326 driven_lanedir_max 0.1620428397437772 driven_lanedir_mean 0.1620428397437772 driven_lanedir_median 0.1620428397437772 driven_lanedir_min 0.1620428397437772 in-drivable-lane_max 11.05000000000006 in-drivable-lane_mean 11.05000000000006 in-drivable-lane_min 11.05000000000006 per-episodes details {"loop2-000-ego0": {"driven_any": 3.642720741594881, "survival_time": 15.900000000000093, "driven_lanedir": 0.1620428397437772, "in-drivable-lane": 11.05000000000006, "deviation-heading": 3.664036561158003, "distance-from-start": 0.6653201232297334, "deviation-center-line": 0.4544941711289141, "driven_lanedir_consec": 0.15869649764514326}}simulation-passed 1 survival_time_max 15.900000000000093 survival_time_mean 15.900000000000093 survival_time_min 15.900000000000093
No reset possible 15330
1501
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 01:15:37+00:00 2022-11-25 01:29:38+00:00 0:14:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.650000000000315 in-drivable-lane_median 25.07500000000031 driven_lanedir_consec_median 0.19631883983708276 deviation-center-line_median 0.5303169595499431
other stats deviation-center-line_max 0.6346587556337292 deviation-center-line_mean 0.4498294317662554 deviation-center-line_min 0.10402505233140616 deviation-heading_max 5.9042352469363495 deviation-heading_mean 3.531571794786276 deviation-heading_median 3.404936745672125 deviation-heading_min 1.4121784408645055 distance-from-start_max 0.8626308120701025 distance-from-start_mean 0.621002716979991 distance-from-start_median 0.6516762295571965 distance-from-start_min 0.318027596735469 driven_any_max 7.64129018112013 driven_any_mean 3.877106290822701 driven_any_median 3.7658309486532184 driven_any_min 0.335473084864234 driven_lanedir_consec_max 0.30624803336021755 driven_lanedir_consec_mean 0.18830365526398113 driven_lanedir_consec_min 0.05432890802154144 driven_lanedir_max 0.30624803336021755 driven_lanedir_mean 0.1907956986975728 driven_lanedir_median 0.19962933842245056 driven_lanedir_min 0.05767608458517248 in-drivable-lane_max 29.60000000000032 in-drivable-lane_mean 25.962500000000293 in-drivable-lane_min 24.100000000000243 per-episodes details {"udem-000-ego0": {"driven_any": 7.64129018112013, "survival_time": 31.650000000000315, "driven_lanedir": 0.05767608458517248, "in-drivable-lane": 24.100000000000243, "deviation-heading": 5.9042352469363495, "distance-from-start": 0.8626308120701025, "deviation-center-line": 0.6346587556337292, "driven_lanedir_consec": 0.05432890802154144}, "udem-000-ego1": {"driven_any": 3.4738391388470204, "survival_time": 31.650000000000315, "driven_lanedir": 0.26180184701004805, "in-drivable-lane": 24.50000000000032, "deviation-heading": 3.4753443866524747, "distance-from-start": 0.6297514211538991, "deviation-center-line": 0.5182786416817282, "driven_lanedir_consec": 0.2397963333994584}, "udem-000-ego2": {"driven_any": 4.057822758459417, "survival_time": 31.650000000000315, "driven_lanedir": 0.13745682983485308, "in-drivable-lane": 25.650000000000297, "deviation-heading": 3.3345291046917755, "distance-from-start": 0.6736010379604938, "deviation-center-line": 0.5423552774181579, "driven_lanedir_consec": 0.1528413462747071}, "udem-000-ego3": {"driven_any": 0.335473084864234, "survival_time": 31.650000000000315, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 29.60000000000032, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.318027596735469, "deviation-center-line": 0.10402505233140616, "driven_lanedir_consec": 0.30624803336021755}}simulation-passed 1 survival_time_max 31.650000000000315 survival_time_mean 31.650000000000315 survival_time_min 31.650000000000315
No reset possible 15324
1503
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 01:06:46+00:00 2022-11-25 01:15:24+00:00 0:08:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.34999999999917 driven_lanedir_consec_median 0.23799216289173675 deviation-center-line_median 2.122382603135255
other stats deviation-center-line_max 2.122382603135255 deviation-center-line_mean 2.122382603135255 deviation-center-line_min 2.122382603135255 deviation-heading_max 20.52214487263099 deviation-heading_mean 20.52214487263099 deviation-heading_median 20.52214487263099 deviation-heading_min 20.52214487263099 distance-from-start_max 1.4108418329398902 distance-from-start_mean 1.4108418329398902 distance-from-start_median 1.4108418329398902 distance-from-start_min 1.4108418329398902 driven_any_max 15.326310847370609 driven_any_mean 15.326310847370609 driven_any_median 15.326310847370609 driven_any_min 15.326310847370609 driven_lanedir_consec_max 0.23799216289173675 driven_lanedir_consec_mean 0.23799216289173675 driven_lanedir_consec_min 0.23799216289173675 driven_lanedir_max 0.2454177542370326 driven_lanedir_mean 0.2454177542370326 driven_lanedir_median 0.2454177542370326 driven_lanedir_min 0.2454177542370326 in-drivable-lane_max 36.34999999999917 in-drivable-lane_mean 36.34999999999917 in-drivable-lane_min 36.34999999999917 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15319
1504
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 01:04:31+00:00 2022-11-25 01:06:27+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.5500000000000007 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.18147393457180128 deviation-center-line_median 0.13106440606880482
other stats deviation-center-line_max 0.13106440606880482 deviation-center-line_mean 0.13106440606880482 deviation-center-line_min 0.13106440606880482 deviation-heading_max 0.6730366870643232 deviation-heading_mean 0.6730366870643232 deviation-heading_median 0.6730366870643232 deviation-heading_min 0.6730366870643232 distance-from-start_max 0.2010711417666237 distance-from-start_mean 0.2010711417666237 distance-from-start_median 0.2010711417666237 distance-from-start_min 0.2010711417666237 driven_any_max 0.20127215801730344 driven_any_mean 0.20127215801730344 driven_any_median 0.20127215801730344 driven_any_min 0.20127215801730344 driven_lanedir_consec_max 0.18147393457180128 driven_lanedir_consec_mean 0.18147393457180128 driven_lanedir_consec_min 0.18147393457180128 driven_lanedir_max 0.18147393457180128 driven_lanedir_mean 0.18147393457180128 driven_lanedir_median 0.18147393457180128 driven_lanedir_min 0.18147393457180128 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.20127215801730344, "survival_time": 1.5500000000000007, "driven_lanedir": 0.18147393457180128, "in-drivable-lane": 0.0, "deviation-heading": 0.6730366870643232, "distance-from-start": 0.2010711417666237, "deviation-center-line": 0.13106440606880482, "driven_lanedir_consec": 0.18147393457180128}}simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.5500000000000007 survival_time_min 1.5500000000000007
No reset possible 15314
1505
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 01:02:00+00:00 2022-11-25 01:04:18+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.7499999999999982 in-drivable-lane_median 1.699999999999998 driven_lanedir_consec_median 0.2067558775655458 deviation-center-line_median 0.06654838760049953
other stats deviation-center-line_max 0.06654838760049953 deviation-center-line_mean 0.06654838760049953 deviation-center-line_min 0.06654838760049953 deviation-heading_max 0.5539207166945355 deviation-heading_mean 0.5539207166945355 deviation-heading_median 0.5539207166945355 deviation-heading_min 0.5539207166945355 distance-from-start_max 0.5340991417960359 distance-from-start_mean 0.5340991417960359 distance-from-start_median 0.5340991417960359 distance-from-start_min 0.5340991417960359 driven_any_max 0.5369741833252716 driven_any_mean 0.5369741833252716 driven_any_median 0.5369741833252716 driven_any_min 0.5369741833252716 driven_lanedir_consec_max 0.2067558775655458 driven_lanedir_consec_mean 0.2067558775655458 driven_lanedir_consec_min 0.2067558775655458 driven_lanedir_max 0.2067558775655458 driven_lanedir_mean 0.2067558775655458 driven_lanedir_median 0.2067558775655458 driven_lanedir_min 0.2067558775655458 in-drivable-lane_max 1.699999999999998 in-drivable-lane_mean 1.699999999999998 in-drivable-lane_min 1.699999999999998 per-episodes details {"udem-000-ego0": {"driven_any": 0.5369741833252716, "survival_time": 2.7499999999999982, "driven_lanedir": 0.2067558775655458, "in-drivable-lane": 1.699999999999998, "deviation-heading": 0.5539207166945355, "distance-from-start": 0.5340991417960359, "deviation-center-line": 0.06654838760049953, "driven_lanedir_consec": 0.2067558775655458}}simulation-passed 1 survival_time_max 2.7499999999999982 survival_time_mean 2.7499999999999982 survival_time_min 2.7499999999999982
No reset possible 15309
1507
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:59:42+00:00 2022-11-25 01:01:33+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.33943565996961245 survival_time_median 7.099999999999983 deviation-center-line_median 0.15703896543371784 in-drivable-lane_median 5.049999999999986
other stats deviation-center-line_max 0.15703896543371784 deviation-center-line_mean 0.15703896543371784 deviation-center-line_min 0.15703896543371784 deviation-heading_max 1.5279450459601938 deviation-heading_mean 1.5279450459601938 deviation-heading_median 1.5279450459601938 deviation-heading_min 1.5279450459601938 distance-from-start_max 1.774926201400825 distance-from-start_mean 1.774926201400825 distance-from-start_median 1.774926201400825 distance-from-start_min 1.774926201400825 driven_any_max 1.8819336431438405 driven_any_mean 1.8819336431438405 driven_any_median 1.8819336431438405 driven_any_min 1.8819336431438405 driven_lanedir_consec_max 0.33943565996961245 driven_lanedir_consec_mean 0.33943565996961245 driven_lanedir_consec_min 0.33943565996961245 driven_lanedir_max 0.33943565996961245 driven_lanedir_mean 0.33943565996961245 driven_lanedir_median 0.33943565996961245 driven_lanedir_min 0.33943565996961245 in-drivable-lane_max 5.049999999999986 in-drivable-lane_mean 5.049999999999986 in-drivable-lane_min 5.049999999999986 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.8819336431438405, "survival_time": 7.099999999999983, "driven_lanedir": 0.33943565996961245, "in-drivable-lane": 5.049999999999986, "deviation-heading": 1.5279450459601938, "distance-from-start": 1.774926201400825, "deviation-center-line": 0.15703896543371784, "driven_lanedir_consec": 0.33943565996961245}}simulation-passed 1 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 15306
1507
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 00:57:50+00:00 2022-11-25 00:59:15+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7998821087001067 survival_time_median 4.6499999999999915 deviation-center-line_median 0.1573509931654838 in-drivable-lane_median 1.5499999999999945
other stats deviation-center-line_max 0.1573509931654838 deviation-center-line_mean 0.1573509931654838 deviation-center-line_min 0.1573509931654838 deviation-heading_max 1.10086470458419 deviation-heading_mean 1.10086470458419 deviation-heading_median 1.10086470458419 deviation-heading_min 1.10086470458419 distance-from-start_max 1.0907570227659726 distance-from-start_mean 1.0907570227659726 distance-from-start_median 1.0907570227659726 distance-from-start_min 1.0907570227659726 driven_any_max 1.1055834649413523 driven_any_mean 1.1055834649413523 driven_any_median 1.1055834649413523 driven_any_min 1.1055834649413523 driven_lanedir_consec_max 0.7998821087001067 driven_lanedir_consec_mean 0.7998821087001067 driven_lanedir_consec_min 0.7998821087001067 driven_lanedir_max 0.7998821087001067 driven_lanedir_mean 0.7998821087001067 driven_lanedir_median 0.7998821087001067 driven_lanedir_min 0.7998821087001067 in-drivable-lane_max 1.5499999999999945 in-drivable-lane_mean 1.5499999999999945 in-drivable-lane_min 1.5499999999999945 per-episodes details {"loop2-000-ego0": {"driven_any": 1.1055834649413523, "survival_time": 4.6499999999999915, "driven_lanedir": 0.7998821087001067, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.10086470458419, "distance-from-start": 1.0907570227659726, "deviation-center-line": 0.1573509931654838, "driven_lanedir_consec": 0.7998821087001067}}simulation-passed 1 survival_time_max 4.6499999999999915 survival_time_mean 4.6499999999999915 survival_time_min 4.6499999999999915
No reset possible 15301
1509
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:54:08+00:00 2022-11-25 00:57:43+00:00 0:03:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.399999999999982 in-drivable-lane_median 6.249999999999981 driven_lanedir_consec_median 0.20454594580601737 deviation-center-line_median 0.0745965456027824
other stats deviation-center-line_max 0.3431546084417781 deviation-center-line_mean 0.13635672278704297 deviation-center-line_min 0.05307919150082894 deviation-heading_max 1.4152574891544172 deviation-heading_mean 0.7360026361033114 deviation-heading_median 0.5578134884989099 deviation-heading_min 0.4131260782610091 distance-from-start_max 1.9241564264639617 distance-from-start_mean 1.112044289066898 distance-from-start_median 0.9474916251610044 distance-from-start_min 0.629037479481622 driven_any_max 1.980616679426353 driven_any_mean 1.199451555771684 driven_any_median 1.0928635043072323 driven_any_min 0.6314625350459185 driven_lanedir_consec_max 1.0749661853862684 driven_lanedir_consec_mean 0.40792338214190527 driven_lanedir_consec_min 0.14763545156931782 driven_lanedir_max 1.0749661853862684 driven_lanedir_mean 0.40792338214190527 driven_lanedir_median 0.20454594580601737 driven_lanedir_min 0.14763545156931782 in-drivable-lane_max 6.499999999999981 in-drivable-lane_mean 5.574999999999983 in-drivable-lane_min 3.2999999999999883 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6314625350459185, "survival_time": 7.399999999999982, "driven_lanedir": 0.1717802719037298, "in-drivable-lane": 6.299999999999981, "deviation-heading": 0.643573371249809, "distance-from-start": 0.629037479481622, "deviation-center-line": 0.0651975915596023, "driven_lanedir_consec": 0.1717802719037298}, "zigzag-000-ego1": {"driven_any": 1.980616679426353, "survival_time": 7.399999999999982, "driven_lanedir": 1.0749661853862684, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 1.4152574891544172, "distance-from-start": 1.9241564264639617, "deviation-center-line": 0.3431546084417781, "driven_lanedir_consec": 1.0749661853862684}, "zigzag-000-ego2": {"driven_any": 1.3323214728447377, "survival_time": 7.399999999999982, "driven_lanedir": 0.23731161970830497, "in-drivable-lane": 6.1999999999999815, "deviation-heading": 0.4131260782610091, "distance-from-start": 1.0540157476737095, "deviation-center-line": 0.08399549964596251, "driven_lanedir_consec": 0.23731161970830497}, "zigzag-000-ego3": {"driven_any": 0.8534055357697272, "survival_time": 7.399999999999982, "driven_lanedir": 0.14763545156931782, "in-drivable-lane": 6.499999999999981, "deviation-heading": 0.47205360574801086, "distance-from-start": 0.8409675026482992, "deviation-center-line": 0.05307919150082894, "driven_lanedir_consec": 0.14763545156931782}}simulation-passed 1 survival_time_max 7.399999999999982 survival_time_mean 7.399999999999982 survival_time_min 7.399999999999982
No reset possible 15296
1510
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 00:52:36+00:00 2022-11-25 00:54:01+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.599999999999995 in-drivable-lane_median 2.4999999999999947 driven_lanedir_consec_median 0.1977777008410806 deviation-center-line_median 0.0711086135859866
other stats deviation-center-line_max 0.0711086135859866 deviation-center-line_mean 0.0711086135859866 deviation-center-line_min 0.0711086135859866 deviation-heading_max 0.6059867780479837 deviation-heading_mean 0.6059867780479837 deviation-heading_median 0.6059867780479837 deviation-heading_min 0.6059867780479837 distance-from-start_max 0.7091282106306765 distance-from-start_mean 0.7091282106306765 distance-from-start_median 0.7091282106306765 distance-from-start_min 0.7091282106306765 driven_any_max 0.7122800873955788 driven_any_mean 0.7122800873955788 driven_any_median 0.7122800873955788 driven_any_min 0.7122800873955788 driven_lanedir_consec_max 0.1977777008410806 driven_lanedir_consec_mean 0.1977777008410806 driven_lanedir_consec_min 0.1977777008410806 driven_lanedir_max 0.1977777008410806 driven_lanedir_mean 0.1977777008410806 driven_lanedir_median 0.1977777008410806 driven_lanedir_min 0.1977777008410806 in-drivable-lane_max 2.4999999999999947 in-drivable-lane_mean 2.4999999999999947 in-drivable-lane_min 2.4999999999999947 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7122800873955788, "survival_time": 3.599999999999995, "driven_lanedir": 0.1977777008410806, "in-drivable-lane": 2.4999999999999947, "deviation-heading": 0.6059867780479837, "distance-from-start": 0.7091282106306765, "deviation-center-line": 0.0711086135859866, "driven_lanedir_consec": 0.1977777008410806}}simulation-passed 1 survival_time_max 3.599999999999995 survival_time_mean 3.599999999999995 survival_time_min 3.599999999999995
No reset possible 15293
1511
Bea Baselines 🐤template-ros lx22-modcon
sim success yes davinci-stage-05-6.2.51
2022-11-25 00:50:15+00:00 2022-11-25 00:52:28+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 4.82499999999999 deviation-center-line_median 0.0 driven_lanedir_consec_median 0.0 survival_time_median 4.82499999999999
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.8842139637351591 distance-from-start_mean 1.1019933961050092 distance-from-start_median 1.1019933961050092 distance-from-start_min 0.31977282847485905 driven_any_max 2.009555036570348 driven_any_mean 1.1669939074508824 driven_any_median 1.1669939074508824 driven_any_min 0.32443277833141704 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 7.549999999999981 in-drivable-lane_mean 4.82499999999999 in-drivable-lane_min 2.1000000000000005 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 2.009555036570348, "survival_time": 7.549999999999981, "driven_lanedir": 0.0, "in-drivable-lane": 7.549999999999981, "deviation-heading": 0.0, "distance-from-start": 1.8842139637351591, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.32443277833141704, "survival_time": 2.1000000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 2.1000000000000005, "deviation-heading": 0.0, "distance-from-start": 0.31977282847485905, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 7.549999999999981 survival_time_mean 4.82499999999999 survival_time_min 2.1000000000000005
No reset possible 15289
1515
Bea Baselines 🐤template-ros lx22-BV1
sim-2of5 success no davinci-stage-05-6.2.51
2022-11-25 00:48:29+00:00 2022-11-25 00:49:54+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.33787244263301824
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.33787244263301824 distance-from-start_median 0.33787244263301824 distance-from-start_min 0.33787244263301824 driven_any_max 0.3380260623850816 driven_any_mean 0.3380260623850816 driven_any_median 0.3380260623850816 driven_any_min 0.3380260623850816 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.1000000000000005 in-drivable-lane_mean 2.1000000000000005 in-drivable-lane_median 2.1000000000000005 in-drivable-lane_min 2.1000000000000005 per-episodes details {"d40-ego0": {"driven_any": 0.3380260623850816, "survival_time": 2.1000000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 2.1000000000000005, "deviation-heading": 0.0, "distance-from-start": 0.33787244263301824, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.1000000000000005 survival_time_mean 2.1000000000000005 survival_time_median 2.1000000000000005 survival_time_min 2.1000000000000005
No reset possible 15282
1522
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:44:40+00:00 2022-11-25 00:48:22+00:00 0:03:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.050000000000008 in-drivable-lane_median 8.950000000000006 driven_lanedir_consec_median 0.19086906590839536 deviation-center-line_median 0.09096590312983743
other stats deviation-center-line_max 0.09096590312983743 deviation-center-line_mean 0.09096590312983743 deviation-center-line_min 0.09096590312983743 deviation-heading_max 0.6435241043289046 deviation-heading_mean 0.6435241043289046 deviation-heading_median 0.6435241043289046 deviation-heading_min 0.6435241043289046 distance-from-start_max 2.275278278419515 distance-from-start_mean 2.275278278419515 distance-from-start_median 2.275278278419515 distance-from-start_min 2.275278278419515 driven_any_max 2.829409255614462 driven_any_mean 2.829409255614462 driven_any_median 2.829409255614462 driven_any_min 2.829409255614462 driven_lanedir_consec_max 0.19086906590839536 driven_lanedir_consec_mean 0.19086906590839536 driven_lanedir_consec_min 0.19086906590839536 driven_lanedir_max 0.19086906590839536 driven_lanedir_mean 0.19086906590839536 driven_lanedir_median 0.19086906590839536 driven_lanedir_min 0.19086906590839536 in-drivable-lane_max 8.950000000000006 in-drivable-lane_mean 8.950000000000006 in-drivable-lane_min 8.950000000000006 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.829409255614462, "survival_time": 10.050000000000008, "driven_lanedir": 0.19086906590839536, "in-drivable-lane": 8.950000000000006, "deviation-heading": 0.6435241043289046, "distance-from-start": 2.275278278419515, "deviation-center-line": 0.09096590312983743, "driven_lanedir_consec": 0.19086906590839536}}simulation-passed 1 survival_time_max 10.050000000000008 survival_time_mean 10.050000000000008 survival_time_min 10.050000000000008
No reset possible 15278
1523
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 00:42:47+00:00 2022-11-25 00:44:18+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15273
1524
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:40:41+00:00 2022-11-25 00:42:22+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15268
1525
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-25 00:38:28+00:00 2022-11-25 00:40:26+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.23146440687369071 survival_time_median 12.700000000000044 deviation-center-line_median 0.1938745669946813 in-drivable-lane_median 10.500000000000028
other stats deviation-center-line_max 0.1938745669946813 deviation-center-line_mean 0.1938745669946813 deviation-center-line_min 0.1938745669946813 deviation-heading_max 2.12394170432465 deviation-heading_mean 2.12394170432465 deviation-heading_median 2.12394170432465 deviation-heading_min 2.12394170432465 distance-from-start_max 3.284071316660886 distance-from-start_mean 3.284071316660886 distance-from-start_median 3.284071316660886 distance-from-start_min 3.284071316660886 driven_any_max 3.511866454509424 driven_any_mean 3.511866454509424 driven_any_median 3.511866454509424 driven_any_min 3.511866454509424 driven_lanedir_consec_max 0.23146440687369071 driven_lanedir_consec_mean 0.23146440687369071 driven_lanedir_consec_min 0.23146440687369071 driven_lanedir_max 0.23146440687369071 driven_lanedir_mean 0.23146440687369071 driven_lanedir_median 0.23146440687369071 driven_lanedir_min 0.23146440687369071 in-drivable-lane_max 10.500000000000028 in-drivable-lane_mean 10.500000000000028 in-drivable-lane_min 10.500000000000028 per-episodes details {"loop-000-ego0": {"driven_any": 3.511866454509424, "survival_time": 12.700000000000044, "driven_lanedir": 0.23146440687369071, "in-drivable-lane": 10.500000000000028, "deviation-heading": 2.12394170432465, "distance-from-start": 3.284071316660886, "deviation-center-line": 0.1938745669946813, "driven_lanedir_consec": 0.23146440687369071}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 15261
1527
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:33:19+00:00 2022-11-25 00:37:51+00:00 0:04:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.600000000000016 in-drivable-lane_median 9.475000000000016 driven_lanedir_consec_median 0.17600201867120266 deviation-center-line_median 0.08830243411376154
other stats deviation-center-line_max 0.220871026197841 deviation-center-line_mean 0.11562279700549172 deviation-center-line_min 0.0650152935966028 deviation-heading_max 0.6546855466883621 deviation-heading_mean 0.5245825382621234 deviation-heading_median 0.49310407263979794 deviation-heading_min 0.4574364610805356 distance-from-start_max 2.7477401500789607 distance-from-start_mean 1.6372737121919116 distance-from-start_median 1.592022586791436 distance-from-start_min 0.6173095251058138 driven_any_max 2.8387457590042446 driven_any_mean 1.7021429903865162 driven_any_median 1.6714639163141158 driven_any_min 0.626898369913588 driven_lanedir_consec_max 0.43149538806310606 driven_lanedir_consec_mean 0.22678846219440868 driven_lanedir_consec_min 0.12365442337212328 driven_lanedir_max 0.43149538806310606 driven_lanedir_mean 0.22678846219440868 driven_lanedir_median 0.17600201867120266 driven_lanedir_min 0.12365442337212328 in-drivable-lane_max 9.750000000000014 in-drivable-lane_mean 9.362500000000017 in-drivable-lane_min 8.750000000000016 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.8387457590042446, "survival_time": 10.600000000000016, "driven_lanedir": 0.43149538806310606, "in-drivable-lane": 8.750000000000016, "deviation-heading": 0.6546855466883621, "distance-from-start": 2.7477401500789607, "deviation-center-line": 0.220871026197841, "driven_lanedir_consec": 0.43149538806310606}, "zigzag-000-ego1": {"driven_any": 1.8683794485303684, "survival_time": 10.600000000000016, "driven_lanedir": 0.12365442337212328, "in-drivable-lane": 9.650000000000016, "deviation-heading": 0.4574364610805356, "distance-from-start": 1.8357783746641732, "deviation-center-line": 0.0975581027386686, "driven_lanedir_consec": 0.12365442337212328}, "zigzag-000-ego2": {"driven_any": 1.474548384097863, "survival_time": 10.600000000000016, "driven_lanedir": 0.2254451585261341, "in-drivable-lane": 9.300000000000017, "deviation-heading": 0.4804867728044763, "distance-from-start": 1.3482667989186985, "deviation-center-line": 0.0650152935966028, "driven_lanedir_consec": 0.2254451585261341}, "zigzag-000-ego3": {"driven_any": 0.626898369913588, "survival_time": 10.600000000000016, "driven_lanedir": 0.12655887881627126, "in-drivable-lane": 9.750000000000014, "deviation-heading": 0.5057213724751195, "distance-from-start": 0.6173095251058138, "deviation-center-line": 0.07904676548885446, "driven_lanedir_consec": 0.12655887881627126}}simulation-passed 1 survival_time_max 10.600000000000016 survival_time_mean 10.600000000000016 survival_time_min 10.600000000000016
No reset possible 15256
1528
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-25 00:31:19+00:00 2022-11-25 00:32:59+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2999999999999963 in-drivable-lane_median 2.249999999999996 driven_lanedir_consec_median 0.12531269319597227 deviation-center-line_median 0.0689307786579473
other stats deviation-center-line_max 0.0689307786579473 deviation-center-line_mean 0.0689307786579473 deviation-center-line_min 0.0689307786579473 deviation-heading_max 0.7452713708707442 deviation-heading_mean 0.7452713708707442 deviation-heading_median 0.7452713708707442 deviation-heading_min 0.7452713708707442 distance-from-start_max 0.5662205735223954 distance-from-start_mean 0.5662205735223954 distance-from-start_median 0.5662205735223954 distance-from-start_min 0.5662205735223954 driven_any_max 0.5819864111331232 driven_any_mean 0.5819864111331232 driven_any_median 0.5819864111331232 driven_any_min 0.5819864111331232 driven_lanedir_consec_max 0.12531269319597227 driven_lanedir_consec_mean 0.12531269319597227 driven_lanedir_consec_min 0.12531269319597227 driven_lanedir_max 0.12531269319597227 driven_lanedir_mean 0.12531269319597227 driven_lanedir_median 0.12531269319597227 driven_lanedir_min 0.12531269319597227 in-drivable-lane_max 2.249999999999996 in-drivable-lane_mean 2.249999999999996 in-drivable-lane_min 2.249999999999996 per-episodes details {"autolab-000-ego0": {"driven_any": 0.5819864111331232, "survival_time": 3.2999999999999963, "driven_lanedir": 0.12531269319597227, "in-drivable-lane": 2.249999999999996, "deviation-heading": 0.7452713708707442, "distance-from-start": 0.5662205735223954, "deviation-center-line": 0.0689307786579473, "driven_lanedir_consec": 0.12531269319597227}}simulation-passed 1 survival_time_max 3.2999999999999963 survival_time_mean 3.2999999999999963 survival_time_min 3.2999999999999963
No reset possible 15251
1529
Bea Baselines 🐤template-tensorflow aido-LFV-sim-validation
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:29:20+00:00 2022-11-25 00:31:00+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15246
1531
Bea Baselines 🐤template-tensorflow aido-LFI-sim-validation
sim-0of4 host-error no davinci-stage-05-6.2.51
2022-11-25 00:27:28+00:00 2022-11-25 00:29:05+00:00 0:01:37 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15241
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-2of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:25:53+00:00 2022-11-25 00:26:54+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15236
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:24:13+00:00 2022-11-25 00:25:40+00:00 0:01:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15230
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:22:29+00:00 2022-11-25 00:23:54+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15226
1537
Bea Baselines 🐤template-tensorflow lx22-objdet
sim failed yes davinci-stage-05-6.2.51
2022-11-25 00:21:22+00:00 2022-11-25 00:22:22+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15222
1538
Bea Baselines 🐤template-tensorflow lx22-visservoing
sim failed yes davinci-stage-05-6.2.51
2022-11-25 00:20:18+00:00 2022-11-25 00:21:16+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15219
1540
Bea Baselines 🐤template-tensorflow lx22-BV1
sim-2of5 failed no davinci-stage-05-6.2.51
2022-11-25 00:19:00+00:00 2022-11-25 00:19:58+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15214
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:16:56+00:00 2022-11-25 00:18:34+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15208
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-25 00:15:14+00:00 2022-11-25 00:16:48+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15204
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:14:09+00:00 2022-11-25 00:15:08+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15200
1551
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 00:12:26+00:00 2022-11-25 00:14:02+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15195
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-3of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:10:37+00:00 2022-11-25 00:12:06+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15189
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-0of4 failed no davinci-stage-05-6.2.51
2022-11-25 00:08:32+00:00 2022-11-25 00:10:31+00:00 0:01:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15188
1369
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-testing
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-25 00:04:20+00:00 2022-11-25 00:08:18+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15178
1294
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-3of4 aborted no davinci-stage-05-6.2.51
2022-11-24 23:52:44+00:00 2022-11-25 00:04:07+00:00 0:11:23 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15176
1295
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-24 23:49:43+00:00 2022-11-24 23:52:08+00:00 0:02:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.94999999999998 in-drivable-lane_median 5.549999999999983 driven_lanedir_consec_median 0.020891462039611675 deviation-center-line_median 0.16974575483481455
other stats deviation-center-line_max 0.16974575483481455 deviation-center-line_mean 0.16974575483481455 deviation-center-line_min 0.16974575483481455 deviation-heading_max 1.6654350665682798 deviation-heading_mean 1.6654350665682798 deviation-heading_median 1.6654350665682798 deviation-heading_min 1.6654350665682798 distance-from-start_max 0.5351951936475464 distance-from-start_mean 0.5351951936475464 distance-from-start_median 0.5351951936475464 distance-from-start_min 0.5351951936475464 driven_any_max 1.5709859611218706 driven_any_mean 1.5709859611218706 driven_any_median 1.5709859611218706 driven_any_min 1.5709859611218706 driven_lanedir_consec_max 0.020891462039611675 driven_lanedir_consec_mean 0.020891462039611675 driven_lanedir_consec_min 0.020891462039611675 driven_lanedir_max 0.020891462039611675 driven_lanedir_mean 0.020891462039611675 driven_lanedir_median 0.020891462039611675 driven_lanedir_min 0.020891462039611675 in-drivable-lane_max 5.549999999999983 in-drivable-lane_mean 5.549999999999983 in-drivable-lane_min 5.549999999999983 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}simulation-passed 1 survival_time_max 7.94999999999998 survival_time_mean 7.94999999999998 survival_time_min 7.94999999999998
No reset possible 15168
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-24 23:40:45+00:00 2022-11-24 23:49:23+00:00 0:08:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.9674241172530733 survival_time_median 59.99999999999873 deviation-center-line_median 2.267728428908457 in-drivable-lane_median 33.24999999999919
other stats deviation-center-line_max 2.267728428908457 deviation-center-line_mean 2.267728428908457 deviation-center-line_min 2.267728428908457 deviation-heading_max 23.99415387278068 deviation-heading_mean 23.99415387278068 deviation-heading_median 23.99415387278068 deviation-heading_min 23.99415387278068 distance-from-start_max 0.16236286247775594 distance-from-start_mean 0.16236286247775594 distance-from-start_median 0.16236286247775594 distance-from-start_min 0.16236286247775594 driven_any_max 11.842711896475464 driven_any_mean 11.842711896475464 driven_any_median 11.842711896475464 driven_any_min 11.842711896475464 driven_lanedir_consec_max -2.9674241172530733 driven_lanedir_consec_mean -2.9674241172530733 driven_lanedir_consec_min -2.9674241172530733 driven_lanedir_max -2.9674241172530733 driven_lanedir_mean -2.9674241172530733 driven_lanedir_median -2.9674241172530733 driven_lanedir_min -2.9674241172530733 in-drivable-lane_max 33.24999999999919 in-drivable-lane_mean 33.24999999999919 in-drivable-lane_min 33.24999999999919 per-episodes details {"zigzag-000-ego0": {"driven_any": 11.842711896475464, "survival_time": 59.99999999999873, "driven_lanedir": -2.9674241172530733, "in-drivable-lane": 33.24999999999919, "deviation-heading": 23.99415387278068, "distance-from-start": 0.16236286247775594, "deviation-center-line": 2.267728428908457, "driven_lanedir_consec": -2.9674241172530733}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15166
1268
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-24 23:38:23+00:00 2022-11-24 23:40:08+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15157
1271
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-24 23:26:20+00:00 2022-11-24 23:38:01+00:00 0:11:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 22.925000000000257 driven_lanedir_consec_median 0.1842700338005553 deviation-center-line_median 0.4627381849764669
other stats deviation-center-line_max 4.099655310425073 deviation-center-line_mean 1.3331675709092048 deviation-center-line_min 0.3075386032588124 deviation-heading_max 14.96173668874226 deviation-heading_mean 6.250128407006366 deviation-heading_median 3.9170785755528663 deviation-heading_min 2.204619788177472 distance-from-start_max 0.8626308120701165 distance-from-start_mean 0.6103488428669119 distance-from-start_median 0.5879544645467749 distance-from-start_min 0.4028556303039817 driven_any_max 7.1610713584054295 driven_any_mean 3.3142682447917635 driven_any_median 2.835962585238713 driven_any_min 0.4240764502841981 driven_lanedir_consec_max 0.3901369682576328 driven_lanedir_consec_mean 0.21562824323701707 driven_lanedir_consec_min 0.10383593708932493 driven_lanedir_max 0.3901369682576328 driven_lanedir_mean 0.2054725659587014 driven_lanedir_median 0.16943030307989526 driven_lanedir_min 0.09289268941738228 in-drivable-lane_max 24.45000000000027 in-drivable-lane_mean 17.800000000000196 in-drivable-lane_min 0.9 per-episodes details {"udem-000-ego0": {"driven_any": 0.4240764502841981, "survival_time": 28.850000000000275, "driven_lanedir": 0.3901369682576328, "in-drivable-lane": 0.9, "deviation-heading": 14.96173668874226, "distance-from-start": 0.4028556303039817, "deviation-center-line": 4.099655310425073, "driven_lanedir_consec": 0.3901369682576328}, "udem-000-ego1": {"driven_any": 7.1610713584054295, "survival_time": 28.850000000000275, "driven_lanedir": 0.1969626852808437, "in-drivable-lane": 21.40000000000026, "deviation-heading": 4.716518246290203, "distance-from-start": 0.8626308120701165, "deviation-center-line": 0.5494202956548411, "driven_lanedir_consec": 0.21028967498696935}, "udem-000-ego2": {"driven_any": 2.4684338587868724, "survival_time": 28.850000000000275, "driven_lanedir": 0.1418979208789468, "in-drivable-lane": 24.45000000000027, "deviation-heading": 2.204619788177472, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.37605607429809274, "driven_lanedir_consec": 0.1582503926141412}, "udem-000-ego3": {"driven_any": 3.2034913116905535, "survival_time": 28.850000000000275, "driven_lanedir": 0.09289268941738228, "in-drivable-lane": 24.45000000000025, "deviation-heading": 3.1176389048155295, "distance-from-start": 0.6297514211538984, "deviation-center-line": 0.3075386032588124, "driven_lanedir_consec": 0.10383593708932493}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 15156
1269
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-24 23:24:10+00:00 2022-11-24 23:25:57+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15155
1269
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-24 23:21:39+00:00 2022-11-24 23:23:48+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.3901743521234762 deviation-center-line_median 0.17124897035562428
other stats deviation-center-line_max 0.17124897035562428 deviation-center-line_mean 0.17124897035562428 deviation-center-line_min 0.17124897035562428 deviation-heading_max 1.70314180472416 deviation-heading_mean 1.70314180472416 deviation-heading_median 1.70314180472416 deviation-heading_min 1.70314180472416 distance-from-start_max 0.4028556303039793 distance-from-start_mean 0.4028556303039793 distance-from-start_median 0.4028556303039793 distance-from-start_min 0.4028556303039793 driven_any_max 0.42407645028397256 driven_any_mean 0.42407645028397256 driven_any_median 0.42407645028397256 driven_any_min 0.42407645028397256 driven_lanedir_consec_max 0.3901743521234762 driven_lanedir_consec_mean 0.3901743521234762 driven_lanedir_consec_min 0.3901743521234762 driven_lanedir_max 0.3901743521234762 driven_lanedir_mean 0.3901743521234762 driven_lanedir_median 0.3901743521234762 driven_lanedir_min 0.3901743521234762 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.42407645028397256, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3901743521234762, "in-drivable-lane": 0.9, "deviation-heading": 1.70314180472416, "distance-from-start": 0.4028556303039793, "deviation-center-line": 0.17124897035562428, "driven_lanedir_consec": 0.3901743521234762}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 15151
1272
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-24 23:13:18+00:00 2022-11-24 23:21:26+00:00 0:08:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 37.09999999999956 driven_lanedir_consec_median 0.23705557260553295 deviation-center-line_median 0.6463758558852182
other stats deviation-center-line_max 0.7555292890833561 deviation-center-line_mean 0.6463758558852182 deviation-center-line_min 0.5372224226870801 deviation-heading_max 5.523299123594233 deviation-heading_mean 5.0377292657796975 deviation-heading_median 5.0377292657796975 deviation-heading_min 4.552159407965162 distance-from-start_max 1.0442247976691843 distance-from-start_mean 0.9534278048696496 distance-from-start_median 0.9534278048696496 distance-from-start_min 0.8626308120701148 driven_any_max 11.376062002465083 driven_any_mean 9.15341861992026 driven_any_median 9.15341861992026 driven_any_min 6.9307752373754345 driven_lanedir_consec_max 0.26764947507969805 driven_lanedir_consec_mean 0.23705557260553295 driven_lanedir_consec_min 0.20646167013136785 driven_lanedir_max 0.2496387990426845 driven_lanedir_mean 0.2213862628967403 driven_lanedir_median 0.2213862628967403 driven_lanedir_min 0.1931337267507961 in-drivable-lane_max 37.649999999999565 in-drivable-lane_mean 37.09999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 15149
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-1of4 failed no davinci-stage-05-6.2.51
2022-11-24 23:11:49+00:00 2022-11-24 23:12:46+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15138
1273
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-3of4 success no davinci-stage-05-6.2.51
2022-11-24 23:02:32+00:00 2022-11-24 23:11:26+00:00 0:08:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.099999999999135 driven_lanedir_consec_median 0.33349329950959106 deviation-center-line_median 2.107688838912731
other stats deviation-center-line_max 2.107688838912731 deviation-center-line_mean 2.107688838912731 deviation-center-line_min 2.107688838912731 deviation-heading_max 23.30238865255163 deviation-heading_mean 23.30238865255163 deviation-heading_median 23.30238865255163 deviation-heading_min 23.30238865255163 distance-from-start_max 1.4108418329398933 distance-from-start_mean 1.4108418329398933 distance-from-start_median 1.4108418329398933 distance-from-start_min 1.4108418329398933 driven_any_max 15.326310847370516 driven_any_mean 15.326310847370516 driven_any_median 15.326310847370516 driven_any_min 15.326310847370516 driven_lanedir_consec_max 0.33349329950959106 driven_lanedir_consec_mean 0.33349329950959106 driven_lanedir_consec_min 0.33349329950959106 driven_lanedir_max 0.2728719387129268 driven_lanedir_mean 0.2728719387129268 driven_lanedir_median 0.2728719387129268 driven_lanedir_min 0.2728719387129268 in-drivable-lane_max 36.099999999999135 in-drivable-lane_mean 36.099999999999135 in-drivable-lane_min 36.099999999999135 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370516, "survival_time": 59.99999999999873, "driven_lanedir": 0.2728719387129268, "in-drivable-lane": 36.099999999999135, "deviation-heading": 23.30238865255163, "distance-from-start": 1.4108418329398933, "deviation-center-line": 2.107688838912731, "driven_lanedir_consec": 0.33349329950959106}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15134
785
Andrea Daniele template-ros aido-LF-sim-validation
sim-0of4 success no davinci-stage-05-6.2.51
2022-11-24 23:00:33+00:00 2022-11-24 23:02:11+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1658320766964141 survival_time_median 2.1000000000000005 deviation-center-line_median 0.05664179042750084 in-drivable-lane_median 1.1500000000000004
other stats deviation-center-line_max 0.05664179042750084 deviation-center-line_mean 0.05664179042750084 deviation-center-line_min 0.05664179042750084 deviation-heading_max 0.5836312340756689 deviation-heading_mean 0.5836312340756689 deviation-heading_median 0.5836312340756689 deviation-heading_min 0.5836312340756689 distance-from-start_max 0.35284208420360713 distance-from-start_mean 0.35284208420360713 distance-from-start_median 0.35284208420360713 distance-from-start_min 0.35284208420360713 driven_any_max 0.3549570907210586 driven_any_mean 0.3549570907210586 driven_any_median 0.3549570907210586 driven_any_min 0.3549570907210586 driven_lanedir_consec_max 0.1658320766964141 driven_lanedir_consec_mean 0.1658320766964141 driven_lanedir_consec_min 0.1658320766964141 driven_lanedir_max 0.1658320766964141 driven_lanedir_mean 0.1658320766964141 driven_lanedir_median 0.1658320766964141 driven_lanedir_min 0.1658320766964141 in-drivable-lane_max 1.1500000000000004 in-drivable-lane_mean 1.1500000000000004 in-drivable-lane_min 1.1500000000000004 per-episodes details {"autolab-000-ego0": {"driven_any": 0.3549570907210586, "survival_time": 2.1000000000000005, "driven_lanedir": 0.1658320766964141, "in-drivable-lane": 1.1500000000000004, "deviation-heading": 0.5836312340756689, "distance-from-start": 0.35284208420360713, "deviation-center-line": 0.05664179042750084, "driven_lanedir_consec": 0.1658320766964141}}simulation-passed 1 survival_time_max 2.1000000000000005 survival_time_mean 2.1000000000000005 survival_time_min 2.1000000000000005
No reset possible 15130
789
Andrea Daniele template-pytorch aido-LF-sim-validation
sim-1of4 success no davinci-stage-05-6.2.51
2022-11-24 22:58:41+00:00 2022-11-24 23:00:03+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.17862283611679142 survival_time_median 4.3499999999999925 deviation-center-line_median 0.0787888210821117 in-drivable-lane_median 3.1499999999999924
other stats deviation-center-line_max 0.0787888210821117 deviation-center-line_mean 0.0787888210821117 deviation-center-line_min 0.0787888210821117 deviation-heading_max 0.7046940345501161 deviation-heading_mean 0.7046940345501161 deviation-heading_median 0.7046940345501161 deviation-heading_min 0.7046940345501161 distance-from-start_max 0.8279211729167666 distance-from-start_mean 0.8279211729167666 distance-from-start_median 0.8279211729167666 distance-from-start_min 0.8279211729167666 driven_any_max 0.9078792644938912 driven_any_mean 0.9078792644938912 driven_any_median 0.9078792644938912 driven_any_min 0.9078792644938912 driven_lanedir_consec_max 0.17862283611679142 driven_lanedir_consec_mean 0.17862283611679142 driven_lanedir_consec_min 0.17862283611679142 driven_lanedir_max 0.17862283611679142 driven_lanedir_mean 0.17862283611679142 driven_lanedir_median 0.17862283611679142 driven_lanedir_min 0.17862283611679142 in-drivable-lane_max 3.1499999999999924 in-drivable-lane_mean 3.1499999999999924 in-drivable-lane_min 3.1499999999999924 per-episodes details {"loop-000-ego0": {"driven_any": 0.9078792644938912, "survival_time": 4.3499999999999925, "driven_lanedir": 0.17862283611679142, "in-drivable-lane": 3.1499999999999924, "deviation-heading": 0.7046940345501161, "distance-from-start": 0.8279211729167666, "deviation-center-line": 0.0787888210821117, "driven_lanedir_consec": 0.17862283611679142}}simulation-passed 1 survival_time_max 4.3499999999999925 survival_time_mean 4.3499999999999925 survival_time_min 4.3499999999999925
No reset possible 15128
1270
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-2of4 success no davinci-stage-05-6.2.51
2022-11-24 22:54:08+00:00 2022-11-24 22:58:12+00:00 0:04:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27378584101885495 survival_time_median 20.550000000000157 deviation-center-line_median 0.7687309613328539 in-drivable-lane_median 12.000000000000131
other stats deviation-center-line_max 0.7687309613328539 deviation-center-line_mean 0.7687309613328539 deviation-center-line_min 0.7687309613328539 deviation-heading_max 5.7583430601860695 deviation-heading_mean 5.7583430601860695 deviation-heading_median 5.7583430601860695 deviation-heading_min 5.7583430601860695 distance-from-start_max 0.7357883576773772 distance-from-start_mean 0.7357883576773772 distance-from-start_median 0.7357883576773772 distance-from-start_min 0.7357883576773772 driven_any_max 4.915576034387011 driven_any_mean 4.915576034387011 driven_any_median 4.915576034387011 driven_any_min 4.915576034387011 driven_lanedir_consec_max 0.27378584101885495 driven_lanedir_consec_mean 0.27378584101885495 driven_lanedir_consec_min 0.27378584101885495 driven_lanedir_max 0.2557751649818414 driven_lanedir_mean 0.2557751649818414 driven_lanedir_median 0.2557751649818414 driven_lanedir_min 0.2557751649818414 in-drivable-lane_max 12.000000000000131 in-drivable-lane_mean 12.000000000000131 in-drivable-lane_min 12.000000000000131 per-episodes details {"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}simulation-passed 1 survival_time_max 20.550000000000157 survival_time_mean 20.550000000000157 survival_time_min 20.550000000000157
No reset possible 15049
1297
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 host-error yes davinci-stage-05-6.2.51
2022-11-24 19:36:48+00:00 2022-11-24 19:37:31+00:00 0:00:43 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d tag 2022_11_24_17_26_06
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible