Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 16664
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 host-error yes davinci-stage-03-6.2.51
2022-11-28 17:05:33+00:00 2022-11-28 17:05:33+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16662
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-0of3 host-error yes davinci-stage-03-6.2.51
2022-11-28 17:05:13+00:00 2022-11-28 17:05:14+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16658
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-1of3 host-error yes davinci-stage-03-6.2.51
2022-11-28 17:04:58+00:00 2022-11-28 17:04:59+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16653
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-1of3 host-error yes davinci-stage-03-6.2.51
2022-11-28 17:04:23+00:00 2022-11-28 17:04:24+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16645
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 timeout yes davinci-stage-03-6.2.51
2022-11-28 03:07:37+00:00 - - - - No reset possible 16643
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 03:05:33+00:00 2022-11-28 03:07:18+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.09999999999998 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.41885674395418215 deviation-center-line_median 0.2592734099538108
other stats deviation-center-line_max 0.2592734099538108 deviation-center-line_mean 0.2592734099538108 deviation-center-line_min 0.2592734099538108 deviation-heading_max 0.7151194489559713 deviation-heading_mean 0.7151194489559713 deviation-heading_median 0.7151194489559713 deviation-heading_min 0.7151194489559713 distance-from-start_max 0.4199960454985642 distance-from-start_mean 0.4199960454985642 distance-from-start_median 0.4199960454985642 distance-from-start_min 0.4199960454985642 driven_any_max 0.42359927688869903 driven_any_mean 0.42359927688869903 driven_any_median 0.42359927688869903 driven_any_min 0.42359927688869903 driven_lanedir_consec_max 0.41885674395418215 driven_lanedir_consec_mean 0.41885674395418215 driven_lanedir_consec_min 0.41885674395418215 driven_lanedir_max 0.41885674395418215 driven_lanedir_mean 0.41885674395418215 driven_lanedir_median 0.41885674395418215 driven_lanedir_min 0.41885674395418215 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}simulation-passed 1 survival_time_max 8.09999999999998 survival_time_mean 8.09999999999998 survival_time_min 8.09999999999998
No reset possible 16638
1703
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:56:53+00:00 2022-11-28 03:05:16+00:00 0:08:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.292103748604663 deviation-center-line_median 4.949281369491427
other stats deviation-center-line_max 4.949281369491427 deviation-center-line_mean 4.949281369491427 deviation-center-line_min 4.949281369491427 deviation-heading_max 5.605546349563034 deviation-heading_mean 5.605546349563034 deviation-heading_median 5.605546349563034 deviation-heading_min 5.605546349563034 distance-from-start_max 2.278496107947562 distance-from-start_mean 2.278496107947562 distance-from-start_median 2.278496107947562 distance-from-start_min 2.278496107947562 driven_any_max 3.5795858026067657 driven_any_mean 3.5795858026067657 driven_any_median 3.5795858026067657 driven_any_min 3.5795858026067657 driven_lanedir_consec_max 3.292103748604663 driven_lanedir_consec_mean 3.292103748604663 driven_lanedir_consec_min 3.292103748604663 driven_lanedir_max 3.53367274833897 driven_lanedir_mean 3.53367274833897 driven_lanedir_median 3.53367274833897 driven_lanedir_min 3.53367274833897 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795858026067657, "survival_time": 59.99999999999873, "driven_lanedir": 3.53367274833897, "in-drivable-lane": 0.0, "deviation-heading": 5.605546349563034, "distance-from-start": 2.278496107947562, "deviation-center-line": 4.949281369491427, "driven_lanedir_consec": 3.292103748604663}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16630
1704
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:38:55+00:00 2022-11-28 02:56:45+00:00 0:17:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.1749999999998764 driven_lanedir_consec_median 3.3248172596190684 deviation-center-line_median 5.75716887821971
other stats deviation-center-line_max 6.627907079134618 deviation-center-line_mean 5.497801828136498 deviation-center-line_min 3.848962476971951 deviation-heading_max 11.413636489405157 deviation-heading_mean 7.6893062297262045 deviation-heading_median 7.06163724081356 deviation-heading_min 5.220313947872544 distance-from-start_max 3.071318609975737 distance-from-start_mean 2.3992593598839593 distance-from-start_median 2.4470384918328207 distance-from-start_min 1.6316418458944593 driven_any_max 3.579587562679039 driven_any_mean 3.521088411159384 driven_any_median 3.51433972593214 driven_any_min 3.476086630094217 driven_lanedir_consec_max 3.4776012543896866 driven_lanedir_consec_mean 3.338894985703014 driven_lanedir_consec_min 3.2283441691842336 driven_lanedir_max 3.4776012543896866 driven_lanedir_mean 3.377098944667144 driven_lanedir_median 3.3812666483317493 driven_lanedir_min 3.2682612276153913 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 1.9499999999999087 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.509092316575898, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813732916227455, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222638225493, "distance-from-start": 1.6316418458944593, "deviation-center-line": 6.627907079134618, "driven_lanedir_consec": 3.3813732916227455}, "autolab-000-ego1": {"driven_any": 3.5195871352883814, "survival_time": 59.99999999999873, "driven_lanedir": 3.381160005040753, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.220313947872544, "distance-from-start": 2.830245940398582, "deviation-center-line": 6.258804535671791, "driven_lanedir_consec": 3.2283441691842336}, "autolab-000-ego2": {"driven_any": 3.476086630094217, "survival_time": 59.99999999999873, "driven_lanedir": 3.2682612276153913, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.691051843401628, "distance-from-start": 2.063831043267061, "deviation-center-line": 5.25553322076763, "driven_lanedir_consec": 3.2682612276153913}, "autolab-000-ego3": {"driven_any": 3.579587562679039, "survival_time": 59.99999999999873, "driven_lanedir": 3.4776012543896866, "in-drivable-lane": 0.0, "deviation-heading": 11.413636489405157, "distance-from-start": 3.071318609975737, "deviation-center-line": 3.848962476971951, "driven_lanedir_consec": 3.4776012543896866}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16629
1705
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:36:57+00:00 2022-11-28 02:38:35+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16625
1706
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:31:00+00:00 2022-11-28 02:36:22+00:00 0:05:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1999999999999318 driven_lanedir_consec_median 3.4359165318271345 deviation-center-line_median 4.892013423501352
other stats deviation-center-line_max 4.892013423501352 deviation-center-line_mean 4.892013423501352 deviation-center-line_min 4.892013423501352 deviation-heading_max 7.875545669467039 deviation-heading_mean 7.875545669467039 deviation-heading_median 7.875545669467039 deviation-heading_min 7.875545669467039 distance-from-start_max 2.786057442773228 distance-from-start_mean 2.786057442773228 distance-from-start_median 2.786057442773228 distance-from-start_min 2.786057442773228 driven_any_max 3.5436077823063186 driven_any_mean 3.5436077823063186 driven_any_median 3.5436077823063186 driven_any_min 3.5436077823063186 driven_lanedir_consec_max 3.4359165318271345 driven_lanedir_consec_mean 3.4359165318271345 driven_lanedir_consec_min 3.4359165318271345 driven_lanedir_max 3.4359165318271345 driven_lanedir_mean 3.4359165318271345 driven_lanedir_median 3.4359165318271345 driven_lanedir_min 3.4359165318271345 in-drivable-lane_max 1.1999999999999318 in-drivable-lane_mean 1.1999999999999318 in-drivable-lane_min 1.1999999999999318 per-episodes details {"loop-000-ego0": {"driven_any": 3.5436077823063186, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359165318271345, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.875545669467039, "distance-from-start": 2.786057442773228, "deviation-center-line": 4.892013423501352, "driven_lanedir_consec": 3.4359165318271345}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16618
1708
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:26:22+00:00 2022-11-28 02:30:28+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 3.4856553091076994 deviation-center-line_median 7.514935466498128
other stats deviation-center-line_max 7.514935466498128 deviation-center-line_mean 7.514935466498128 deviation-center-line_min 7.514935466498128 deviation-heading_max 2.919831926025915 deviation-heading_mean 2.919831926025915 deviation-heading_median 2.919831926025915 deviation-heading_min 2.919831926025915 distance-from-start_max 2.8766441843618256 distance-from-start_mean 2.8766441843618256 distance-from-start_median 2.8766441843618256 distance-from-start_min 2.8766441843618256 driven_any_max 3.5465963271067142 driven_any_mean 3.5465963271067142 driven_any_median 3.5465963271067142 driven_any_min 3.5465963271067142 driven_lanedir_consec_max 3.4856553091076994 driven_lanedir_consec_mean 3.4856553091076994 driven_lanedir_consec_min 3.4856553091076994 driven_lanedir_max 3.4856553091076994 driven_lanedir_mean 3.4856553091076994 driven_lanedir_median 3.4856553091076994 driven_lanedir_min 3.4856553091076994 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16615
1709
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:20:53+00:00 2022-11-28 02:26:08+00:00 0:05:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3284423748962833 deviation-center-line_median 2.2080698436648767
other stats deviation-center-line_max 2.2080698436648767 deviation-center-line_mean 2.2080698436648767 deviation-center-line_min 2.2080698436648767 deviation-heading_max 3.646079460993991 deviation-heading_mean 3.646079460993991 deviation-heading_median 3.646079460993991 deviation-heading_min 3.646079460993991 distance-from-start_max 2.0667500720956693 distance-from-start_mean 2.0667500720956693 distance-from-start_median 2.0667500720956693 distance-from-start_min 2.0667500720956693 driven_any_max 3.579583385567372 driven_any_mean 3.579583385567372 driven_any_median 3.579583385567372 driven_any_min 3.579583385567372 driven_lanedir_consec_max 3.3284423748962833 driven_lanedir_consec_mean 3.3284423748962833 driven_lanedir_consec_min 3.3284423748962833 driven_lanedir_max 3.558841603983183 driven_lanedir_mean 3.558841603983183 driven_lanedir_median 3.558841603983183 driven_lanedir_min 3.558841603983183 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.579583385567372, "survival_time": 59.99999999999873, "driven_lanedir": 3.558841603983183, "in-drivable-lane": 0.0, "deviation-heading": 3.646079460993991, "distance-from-start": 2.0667500720956693, "deviation-center-line": 2.2080698436648767, "driven_lanedir_consec": 3.3284423748962833}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16613
1709
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:18:42+00:00 2022-11-28 02:20:24+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16608
1710
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:09:07+00:00 2022-11-28 02:18:35+00:00 0:09:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.200000000000017 driven_lanedir_consec_median 2.4146675176310586 deviation-center-line_median 3.947705796799454
other stats deviation-center-line_max 6.091229568413222 deviation-center-line_mean 4.214852861011506 deviation-center-line_min 2.872770282033897 deviation-heading_max 6.386481527905395 deviation-heading_mean 5.35354556440471 deviation-heading_median 5.451360814369008 deviation-heading_min 4.1249791009754295 distance-from-start_max 2.281674511474288 distance-from-start_mean 1.714053337572477 distance-from-start_median 1.836882099225881 distance-from-start_min 0.900774640363858 driven_any_max 3.579588827869872 driven_any_mean 3.2555873758340863 driven_any_median 3.5015869259609413 driven_any_min 2.4395868235445906 driven_lanedir_consec_max 3.4224970151785294 driven_lanedir_consec_mean 2.2942753407245777 driven_lanedir_consec_min 0.9252693124576647 driven_lanedir_max 3.5575561401701146 driven_lanedir_mean 3.1699347353913017 driven_lanedir_median 3.415152633778211 driven_lanedir_min 2.2918775338386688 in-drivable-lane_max 2.5000000000000355 in-drivable-lane_mean 1.2250000000000174 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 2.4395868235445906, "survival_time": 59.99999999999873, "driven_lanedir": 2.2918775338386688, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 6.080254254951424, "distance-from-start": 0.900774640363858, "deviation-center-line": 6.091229568413222, "driven_lanedir_consec": 0.9252693124576647}, "udem-001-ego1": {"driven_any": 3.5795872366067147, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575561401701146, "in-drivable-lane": 0.0, "deviation-heading": 4.1249791009754295, "distance-from-start": 2.227888326915521, "deviation-center-line": 2.872770282033897, "driven_lanedir_consec": 3.4083694793883828}, "udem-001-ego2": {"driven_any": 3.579588827869872, "survival_time": 59.99999999999873, "driven_lanedir": 3.554406946632496, "in-drivable-lane": 0.0, "deviation-heading": 4.822467373786592, "distance-from-start": 2.281674511474288, "deviation-center-line": 2.9756165082921022, "driven_lanedir_consec": 3.4224970151785294}, "udem-001-ego3": {"driven_any": 3.4235866153151684, "survival_time": 59.99999999999873, "driven_lanedir": 3.2758983209239267, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.386481527905395, "distance-from-start": 1.4458758715362408, "deviation-center-line": 4.919795085306806, "driven_lanedir_consec": 1.420965555873734}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16599
1713
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:03:58+00:00 2022-11-28 02:08:46+00:00 0:04:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 52.74999999999914 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.049495028380312 deviation-center-line_median 4.252786905257612
other stats deviation-center-line_max 4.252786905257612 deviation-center-line_mean 4.252786905257612 deviation-center-line_min 4.252786905257612 deviation-heading_max 7.335832537624176 deviation-heading_mean 7.335832537624176 deviation-heading_median 7.335832537624176 deviation-heading_min 7.335832537624176 distance-from-start_max 2.5590901305577565 distance-from-start_mean 2.5590901305577565 distance-from-start_median 2.5590901305577565 distance-from-start_min 2.5590901305577565 driven_any_max 3.10259355659584 driven_any_mean 3.10259355659584 driven_any_median 3.10259355659584 driven_any_min 3.10259355659584 driven_lanedir_consec_max 3.049495028380312 driven_lanedir_consec_mean 3.049495028380312 driven_lanedir_consec_min 3.049495028380312 driven_lanedir_max 3.049495028380312 driven_lanedir_mean 3.049495028380312 driven_lanedir_median 3.049495028380312 driven_lanedir_min 3.049495028380312 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.10259355659584, "survival_time": 52.74999999999914, "driven_lanedir": 3.049495028380312, "in-drivable-lane": 0.0, "deviation-heading": 7.335832537624176, "distance-from-start": 2.5590901305577565, "deviation-center-line": 4.252786905257612, "driven_lanedir_consec": 3.049495028380312}}simulation-passed 1 survival_time_max 52.74999999999914 survival_time_mean 52.74999999999914 survival_time_min 52.74999999999914
No reset possible 16595
1714
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 02:00:07+00:00 2022-11-28 02:03:52+00:00 0:03:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.04999999999878 in-drivable-lane_median 3.549999999999798 driven_lanedir_consec_median 3.250910080242586 deviation-center-line_median 6.40909921931243
other stats deviation-center-line_max 6.40909921931243 deviation-center-line_mean 6.40909921931243 deviation-center-line_min 6.40909921931243 deviation-heading_max 5.86874944154476 deviation-heading_mean 5.86874944154476 deviation-heading_median 5.86874944154476 deviation-heading_min 5.86874944154476 distance-from-start_max 1.63145897748322 distance-from-start_mean 1.63145897748322 distance-from-start_median 1.63145897748322 distance-from-start_min 1.63145897748322 driven_any_max 3.4043224992272147 driven_any_mean 3.4043224992272147 driven_any_median 3.4043224992272147 driven_any_min 3.4043224992272147 driven_lanedir_consec_max 3.250910080242586 driven_lanedir_consec_mean 3.250910080242586 driven_lanedir_consec_min 3.250910080242586 driven_lanedir_max 3.250910080242586 driven_lanedir_mean 3.250910080242586 driven_lanedir_median 3.250910080242586 driven_lanedir_min 3.250910080242586 in-drivable-lane_max 3.549999999999798 in-drivable-lane_mean 3.549999999999798 in-drivable-lane_min 3.549999999999798 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4043224992272147, "survival_time": 59.04999999999878, "driven_lanedir": 3.250910080242586, "in-drivable-lane": 3.549999999999798, "deviation-heading": 5.86874944154476, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.40909921931243, "driven_lanedir_consec": 3.250910080242586}}simulation-passed 1 survival_time_max 59.04999999999878 survival_time_mean 59.04999999999878 survival_time_min 59.04999999999878
No reset possible 16591
1715
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:57:14+00:00 2022-11-28 01:59:33+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16589
1715
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:52:31+00:00 2022-11-28 01:57:01+00:00 0:04:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9499999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.9030524638411164 deviation-center-line_median 3.789617561777741
other stats deviation-center-line_max 3.789617561777741 deviation-center-line_mean 3.789617561777741 deviation-center-line_min 3.789617561777741 deviation-heading_max 4.33452755283993 deviation-heading_mean 4.33452755283993 deviation-heading_median 4.33452755283993 deviation-heading_min 4.33452755283993 distance-from-start_max 1.573887224004309 distance-from-start_mean 1.573887224004309 distance-from-start_median 1.573887224004309 distance-from-start_min 1.573887224004309 driven_any_max 2.934594724979699 driven_any_mean 2.934594724979699 driven_any_median 2.934594724979699 driven_any_min 2.934594724979699 driven_lanedir_consec_max 2.9030524638411164 driven_lanedir_consec_mean 2.9030524638411164 driven_lanedir_consec_min 2.9030524638411164 driven_lanedir_max 2.9099692680363995 driven_lanedir_mean 2.9099692680363995 driven_lanedir_median 2.9099692680363995 driven_lanedir_min 2.9099692680363995 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.934594724979699, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099692680363995, "in-drivable-lane": 0.0, "deviation-heading": 4.33452755283993, "distance-from-start": 1.573887224004309, "deviation-center-line": 3.789617561777741, "driven_lanedir_consec": 2.9030524638411164}}simulation-passed 1 survival_time_max 49.9499999999993 survival_time_mean 49.9499999999993 survival_time_min 49.9499999999993
No reset possible 16582
1717
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:41:59+00:00 2022-11-28 01:52:25+00:00 0:10:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3736117232564378 deviation-center-line_median 3.737280565079689
other stats deviation-center-line_max 3.737280565079689 deviation-center-line_mean 3.737280565079689 deviation-center-line_min 3.737280565079689 deviation-heading_max 4.891434118207675 deviation-heading_mean 4.891434118207675 deviation-heading_median 4.891434118207675 deviation-heading_min 4.891434118207675 distance-from-start_max 2.2750369053700705 distance-from-start_mean 2.2750369053700705 distance-from-start_median 2.2750369053700705 distance-from-start_min 2.2750369053700705 driven_any_max 3.5795882003110293 driven_any_mean 3.5795882003110293 driven_any_median 3.5795882003110293 driven_any_min 3.5795882003110293 driven_lanedir_consec_max 3.3736117232564378 driven_lanedir_consec_mean 3.3736117232564378 driven_lanedir_consec_min 3.3736117232564378 driven_lanedir_max 3.5508258394155683 driven_lanedir_mean 3.5508258394155683 driven_lanedir_median 3.5508258394155683 driven_lanedir_min 3.5508258394155683 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795882003110293, "survival_time": 59.99999999999873, "driven_lanedir": 3.5508258394155683, "in-drivable-lane": 0.0, "deviation-heading": 4.891434118207675, "distance-from-start": 2.2750369053700705, "deviation-center-line": 3.737280565079689, "driven_lanedir_consec": 3.3736117232564378}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16578
1718
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:34:21+00:00 2022-11-28 01:41:52+00:00 0:07:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.7499999999999003 driven_lanedir_consec_median 3.413654775946143 deviation-center-line_median 5.825136539085346
other stats deviation-center-line_max 7.271389663591529 deviation-center-line_mean 5.643680285819743 deviation-center-line_min 3.653058401516753 deviation-heading_max 7.874648432322972 deviation-heading_mean 6.124556829055049 deviation-heading_median 6.375210937656442 deviation-heading_min 3.873157008584335 distance-from-start_max 2.9910037406399708 distance-from-start_mean 2.647919639528748 distance-from-start_median 2.691628549092109 distance-from-start_min 2.2174177192908053 driven_any_max 3.546591928181605 driven_any_mean 3.512845634385255 driven_any_median 3.527100534458862 driven_any_min 3.4505895404416917 driven_lanedir_consec_max 3.4489608990054887 driven_lanedir_consec_mean 3.3789582924454376 driven_lanedir_consec_min 3.2395627188839757 driven_lanedir_max 3.4489608990054887 driven_lanedir_mean 3.3789582924454376 driven_lanedir_median 3.413654775946143 driven_lanedir_min 3.2395627188839757 in-drivable-lane_max 4.299999999999894 in-drivable-lane_mean 2.2249999999999277 in-drivable-lane_min 1.1000000000000156 per-episodes details {"loop-000-ego0": {"driven_any": 3.543607782867822, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359237462525183, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.874648432322972, "distance-from-start": 2.7860421196308716, "deviation-center-line": 4.889961247945737, "driven_lanedir_consec": 3.4359237462525183}, "loop-000-ego1": {"driven_any": 3.4505895404416917, "survival_time": 59.99999999999873, "driven_lanedir": 3.2395627188839757, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.05385337048463, "distance-from-start": 2.2174177192908053, "deviation-center-line": 7.271389663591529, "driven_lanedir_consec": 3.2395627188839757}, "loop-000-ego2": {"driven_any": 3.546591928181605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4489608990054887, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 6.696568504828256, "distance-from-start": 2.9910037406399708, "deviation-center-line": 3.653058401516753, "driven_lanedir_consec": 3.4489608990054887}, "loop-000-ego3": {"driven_any": 3.5105932860499025, "survival_time": 59.99999999999873, "driven_lanedir": 3.391385805639767, "in-drivable-lane": 2.2999999999998693, "deviation-heading": 3.873157008584335, "distance-from-start": 2.597214978553346, "deviation-center-line": 6.760311830224953, "driven_lanedir_consec": 3.391385805639767}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16569
1720
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:22:58+00:00 2022-11-28 01:34:14+00:00 0:11:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4692997359006403 deviation-center-line_median 3.623644320092078
other stats deviation-center-line_max 3.623644320092078 deviation-center-line_mean 3.623644320092078 deviation-center-line_min 3.623644320092078 deviation-heading_max 11.947232259174388 deviation-heading_mean 11.947232259174388 deviation-heading_median 11.947232259174388 deviation-heading_min 11.947232259174388 distance-from-start_max 3.168925231786075 distance-from-start_mean 3.168925231786075 distance-from-start_median 3.168925231786075 distance-from-start_min 3.168925231786075 driven_any_max 3.5795865108076983 driven_any_mean 3.5795865108076983 driven_any_median 3.5795865108076983 driven_any_min 3.5795865108076983 driven_lanedir_consec_max 3.4692997359006403 driven_lanedir_consec_mean 3.4692997359006403 driven_lanedir_consec_min 3.4692997359006403 driven_lanedir_max 3.4692997359006403 driven_lanedir_mean 3.4692997359006403 driven_lanedir_median 3.4692997359006403 driven_lanedir_min 3.4692997359006403 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5795865108076983, "survival_time": 59.99999999999873, "driven_lanedir": 3.4692997359006403, "in-drivable-lane": 0.0, "deviation-heading": 11.947232259174388, "distance-from-start": 3.168925231786075, "deviation-center-line": 3.623644320092078, "driven_lanedir_consec": 3.4692997359006403}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16564
1723
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:19:19+00:00 2022-11-28 01:22:39+00:00 0:03:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 10.950000000000044 driven_lanedir_consec_median 0.19955171937759708 deviation-center-line_median 0.12567511082985278
other stats deviation-center-line_max 0.12567511082985278 deviation-center-line_mean 0.12567511082985278 deviation-center-line_min 0.12567511082985278 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 1.924049384083022 distance-from-start_mean 1.924049384083022 distance-from-start_median 1.924049384083022 distance-from-start_min 1.924049384083022 driven_any_max 1.924195440713655 driven_any_mean 1.924195440713655 driven_any_median 1.924195440713655 driven_any_min 1.924195440713655 driven_lanedir_consec_max 0.19955171937759708 driven_lanedir_consec_mean 0.19955171937759708 driven_lanedir_consec_min 0.19955171937759708 driven_lanedir_max 0.19955171937759708 driven_lanedir_mean 0.19955171937759708 driven_lanedir_median 0.19955171937759708 driven_lanedir_min 0.19955171937759708 in-drivable-lane_max 10.950000000000044 in-drivable-lane_mean 10.950000000000044 in-drivable-lane_min 10.950000000000044 per-episodes details {"loop-000-ego0": {"driven_any": 1.924195440713655, "survival_time": 12.700000000000044, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 10.950000000000044, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.924049384083022, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.19955171937759708}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 16560
1723
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:17:14+00:00 2022-11-28 01:19:12+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.2 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.16440570511787245 deviation-center-line_median 0.19162140900760455
other stats deviation-center-line_max 0.19162140900760455 deviation-center-line_mean 0.19162140900760455 deviation-center-line_min 0.19162140900760455 deviation-heading_max 1.1939422489088862 deviation-heading_mean 1.1939422489088862 deviation-heading_median 1.1939422489088862 deviation-heading_min 1.1939422489088862 distance-from-start_max 0.19201183050647508 distance-from-start_mean 0.19201183050647508 distance-from-start_median 0.19201183050647508 distance-from-start_min 0.19201183050647508 driven_any_max 0.19201481064322065 driven_any_mean 0.19201481064322065 driven_any_median 0.19201481064322065 driven_any_min 0.19201481064322065 driven_lanedir_consec_max 0.16440570511787245 driven_lanedir_consec_mean 0.16440570511787245 driven_lanedir_consec_min 0.16440570511787245 driven_lanedir_max 0.16440570511787245 driven_lanedir_mean 0.16440570511787245 driven_lanedir_median 0.16440570511787245 driven_lanedir_min 0.16440570511787245 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}simulation-passed 1 survival_time_max 2.2 survival_time_mean 2.2 survival_time_min 2.2
No reset possible 16555
1725
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:14:54+00:00 2022-11-28 01:17:00+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 4.949999999999983 driven_lanedir_consec_median 0.19955565328420843 deviation-center-line_median 0.12567493837705537
other stats deviation-center-line_max 0.12567493837705537 deviation-center-line_mean 0.12567493837705537 deviation-center-line_min 0.12567493837705537 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.9347143740566054 distance-from-start_mean 0.9347143740566054 distance-from-start_median 0.9347143740566054 distance-from-start_min 0.9347143740566054 driven_any_max 0.9347451682894398 driven_any_mean 0.9347451682894398 driven_any_median 0.9347451682894398 driven_any_min 0.9347451682894398 driven_lanedir_consec_max 0.19955565328420843 driven_lanedir_consec_mean 0.19955565328420843 driven_lanedir_consec_min 0.19955565328420843 driven_lanedir_max 0.19955565328420843 driven_lanedir_mean 0.19955565328420843 driven_lanedir_median 0.19955565328420843 driven_lanedir_min 0.19955565328420843 in-drivable-lane_max 4.949999999999983 in-drivable-lane_mean 4.949999999999983 in-drivable-lane_min 4.949999999999983 per-episodes details {"udem1-000-ego0": {"driven_any": 0.9347451682894398, "survival_time": 6.699999999999984, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 4.949999999999983, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566054, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.19955565328420843}}simulation-passed 1 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 16549
1726
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 01:12:57+00:00 2022-11-28 01:14:47+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.31872576909325967 survival_time_median 12.40000000000004 deviation-center-line_median 0.2634611971893196 in-drivable-lane_median 9.150000000000045
other stats deviation-center-line_max 0.2634611971893196 deviation-center-line_mean 0.2634611971893196 deviation-center-line_min 0.2634611971893196 deviation-heading_max 2.539741615834614 deviation-heading_mean 2.539741615834614 deviation-heading_median 2.539741615834614 deviation-heading_min 2.539741615834614 distance-from-start_max 1.8751243016635968 distance-from-start_mean 1.8751243016635968 distance-from-start_median 1.8751243016635968 distance-from-start_min 1.8751243016635968 driven_any_max 1.875978020012028 driven_any_mean 1.875978020012028 driven_any_median 1.875978020012028 driven_any_min 1.875978020012028 driven_lanedir_consec_max 0.31872576909325967 driven_lanedir_consec_mean 0.31872576909325967 driven_lanedir_consec_min 0.31872576909325967 driven_lanedir_max 0.31872576909325967 driven_lanedir_mean 0.31872576909325967 driven_lanedir_median 0.31872576909325967 driven_lanedir_min 0.31872576909325967 in-drivable-lane_max 9.150000000000045 in-drivable-lane_mean 9.150000000000045 in-drivable-lane_min 9.150000000000045 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.875978020012028, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872576909325967, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635968, "deviation-center-line": 0.2634611971893196, "driven_lanedir_consec": 0.31872576909325967}}simulation-passed 1 survival_time_max 12.40000000000004 survival_time_mean 12.40000000000004 survival_time_min 12.40000000000004
No reset possible 16534
1731
Bea Baselines 🐤minimal-agent lx22-objdet
sim success yes davinci-stage-03-6.2.51
2022-11-28 01:00:40+00:00 2022-11-28 01:12:44+00:00 0:12:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 driven_lanedir_consec_median 3.766385412387078
other stats deviation-center-line_max 1.326684653251739 deviation-center-line_mean 1.1145360814864316 deviation-center-line_median 1.1145360814864316 deviation-center-line_min 0.9023875097211244 deviation-heading_max 0.9653478875423056 deviation-heading_mean 0.8614808538844678 deviation-heading_median 0.8614808538844678 deviation-heading_min 0.75761382022663 distance-from-start_max 9.8511235402485 distance-from-start_mean 9.83680867234296 distance-from-start_median 9.83680867234296 distance-from-start_min 9.822493804437425 driven_any_max 9.857519753799252 driven_any_mean 9.843192862723654 driven_any_median 9.843192862723654 driven_any_min 9.828865971648057 driven_lanedir_consec_max 5.116504350759583 driven_lanedir_consec_mean 3.766385412387078 driven_lanedir_consec_min 2.416266474014573 driven_lanedir_max 5.116504350759583 driven_lanedir_mean 3.766385412387078 driven_lanedir_median 3.766385412387078 driven_lanedir_min 2.416266474014573 in-drivable-lane_max 44.99999999999865 in-drivable-lane_mean 36.82499999999853 in-drivable-lane_median 36.82499999999853 in-drivable-lane_min 28.649999999998418 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16529
1734
Bea Baselines 🐤minimal-agent lx22-BV1
sim-4of5 success yes davinci-stage-03-6.2.51
2022-11-28 00:58:41+00:00 2022-11-28 01:00:18+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4895714408351146
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4895714408351146 distance-from-start_median 0.4895714408351146 distance-from-start_min 0.4895714408351146 driven_any_max 0.4895812966985538 driven_any_mean 0.4895812966985538 driven_any_median 0.4895812966985538 driven_any_min 0.4895812966985538 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.999999999999994 in-drivable-lane_mean 3.999999999999994 in-drivable-lane_median 3.999999999999994 in-drivable-lane_min 3.999999999999994 per-episodes details {"d60-ego0": {"driven_any": 0.4895812966985538, "survival_time": 3.999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 3.999999999999994, "deviation-heading": 0.0, "distance-from-start": 0.4895714408351146, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 3.999999999999994 survival_time_median 3.999999999999994 survival_time_min 3.999999999999994
No reset possible 16526
1737
Bea Baselines 🐤minimal-agent aido-hello-sim-validation
sanity-check success yes davinci-stage-03-6.2.51
2022-11-28 00:57:04+00:00 2022-11-28 00:58:26+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.027182527438338155 deviation-center-line_median 0.005231420846612685
other stats deviation-center-line_max 0.005231420846612685 deviation-center-line_mean 0.005231420846612685 deviation-center-line_min 0.005231420846612685 deviation-heading_max 0.26820132194453994 deviation-heading_mean 0.26820132194453994 deviation-heading_median 0.26820132194453994 deviation-heading_min 0.26820132194453994 distance-from-start_max 0.03160072536398472 distance-from-start_mean 0.03160072536398472 distance-from-start_median 0.03160072536398472 distance-from-start_min 0.03160072536398472 driven_any_max 0.03160074670807487 driven_any_mean 0.03160074670807487 driven_any_median 0.03160074670807487 driven_any_min 0.03160074670807487 driven_lanedir_consec_max 0.027182527438338155 driven_lanedir_consec_mean 0.027182527438338155 driven_lanedir_consec_min 0.027182527438338155 driven_lanedir_max 0.027182527438338155 driven_lanedir_mean 0.027182527438338155 driven_lanedir_median 0.027182527438338155 driven_lanedir_min 0.027182527438338155 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03160074670807487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027182527438338155, "in-drivable-lane": 0.0, "deviation-heading": 0.26820132194453994, "distance-from-start": 0.03160072536398472, "deviation-center-line": 0.005231420846612685, "driven_lanedir_consec": 0.027182527438338155}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16521
1742
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:53:41+00:00 2022-11-28 00:56:22+00:00 0:02:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.549999999999985 in-drivable-lane_median 5.149999999999984 driven_lanedir_consec_median 0.1366674275206068 deviation-center-line_median 0.10783868180360472
other stats deviation-center-line_max 0.10783868180360472 deviation-center-line_mean 0.10783868180360472 deviation-center-line_min 0.10783868180360472 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 0.9098858043373246 distance-from-start_mean 0.9098858043373246 distance-from-start_median 0.9098858043373246 distance-from-start_min 0.9098858043373246 driven_any_max 0.9099105248203296 driven_any_mean 0.9099105248203296 driven_any_median 0.9099105248203296 driven_any_min 0.9099105248203296 driven_lanedir_consec_max 0.1366674275206068 driven_lanedir_consec_mean 0.1366674275206068 driven_lanedir_consec_min 0.1366674275206068 driven_lanedir_max 0.1366674275206068 driven_lanedir_mean 0.1366674275206068 driven_lanedir_median 0.1366674275206068 driven_lanedir_min 0.1366674275206068 in-drivable-lane_max 5.149999999999984 in-drivable-lane_mean 5.149999999999984 in-drivable-lane_min 5.149999999999984 per-episodes details {"udem-000-ego0": {"driven_any": 0.9099105248203296, "survival_time": 6.549999999999985, "driven_lanedir": 0.1366674275206068, "in-drivable-lane": 5.149999999999984, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.9098858043373246, "deviation-center-line": 0.10783868180360472, "driven_lanedir_consec": 0.1366674275206068}}simulation-passed 1 survival_time_max 6.549999999999985 survival_time_mean 6.549999999999985 survival_time_min 6.549999999999985
No reset possible 16516
1743
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:51:54+00:00 2022-11-28 00:53:25+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16512
1744
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:50:17+00:00 2022-11-28 00:51:47+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1366657585905522 survival_time_median 7.549999999999981 deviation-center-line_median 0.10783809919009872 in-drivable-lane_median 6.149999999999981
other stats deviation-center-line_max 0.10783809919009872 deviation-center-line_mean 0.10783809919009872 deviation-center-line_min 0.10783809919009872 deviation-heading_max 0.9508048428349384 deviation-heading_mean 0.9508048428349384 deviation-heading_median 0.9508048428349384 deviation-heading_min 0.9508048428349384 distance-from-start_max 1.076322287151137 distance-from-start_mean 1.076322287151137 distance-from-start_median 1.076322287151137 distance-from-start_min 1.076322287151137 driven_any_max 1.0763767010128955 driven_any_mean 1.0763767010128955 driven_any_median 1.0763767010128955 driven_any_min 1.0763767010128955 driven_lanedir_consec_max 0.1366657585905522 driven_lanedir_consec_mean 0.1366657585905522 driven_lanedir_consec_min 0.1366657585905522 driven_lanedir_max 0.1366657585905522 driven_lanedir_mean 0.1366657585905522 driven_lanedir_median 0.1366657585905522 driven_lanedir_min 0.1366657585905522 in-drivable-lane_max 6.149999999999981 in-drivable-lane_mean 6.149999999999981 in-drivable-lane_min 6.149999999999981 per-episodes details {"loop-000-ego0": {"driven_any": 1.0763767010128955, "survival_time": 7.549999999999981, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.149999999999981, "deviation-heading": 0.9508048428349384, "distance-from-start": 1.076322287151137, "deviation-center-line": 0.10783809919009872, "driven_lanedir_consec": 0.1366657585905522}}simulation-passed 1 survival_time_max 7.549999999999981 survival_time_mean 7.549999999999981 survival_time_min 7.549999999999981
No reset possible 16508
1745
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:48:31+00:00 2022-11-28 00:49:58+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16505
1745
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:45:08+00:00 2022-11-28 00:48:23+00:00 0:03:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.79999999999998 in-drivable-lane_median 6.174999999999979 driven_lanedir_consec_median 0.18712389148079245 deviation-center-line_median 0.15973064632096934
other stats deviation-center-line_max 0.25956483782942774 deviation-center-line_mean 0.17171613953350223 deviation-center-line_min 0.1078384276626425 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.7378303653221978 deviation-heading_median 0.7134396501489888 deviation-heading_min 0.5736373181558746 distance-from-start_max 1.1174703819521252 distance-from-start_mean 0.5801993351597357 distance-from-start_median 0.4397243952004576 distance-from-start_min 0.323878168285902 driven_any_max 1.1175260347648366 driven_any_mean 0.5802187299655663 driven_any_median 0.4397328577718137 driven_any_min 0.3238831695538013 driven_lanedir_consec_max 0.6843001798814146 driven_lanedir_consec_mean 0.2932298736878741 driven_lanedir_consec_min 0.11437153190849704 driven_lanedir_max 0.6843001798814146 driven_lanedir_mean 0.2932298736878741 driven_lanedir_median 0.18712389148079245 driven_lanedir_min 0.11437153190849704 in-drivable-lane_max 6.59999999999998 in-drivable-lane_mean 5.549999999999982 in-drivable-lane_min 3.2499999999999885 per-episodes details {"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}simulation-passed 1 survival_time_max 7.79999999999998 survival_time_mean 7.79999999999998 survival_time_min 7.79999999999998
No reset possible 16496
1748
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:37:38+00:00 2022-11-28 00:44:54+00:00 0:07:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.500000000000114 in-drivable-lane_median 12.500000000000089 driven_lanedir_consec_median 0.5183011872925802 deviation-center-line_median 0.6005682519449633
other stats deviation-center-line_max 0.6005682519449633 deviation-center-line_mean 0.6005682519449633 deviation-center-line_min 0.6005682519449633 deviation-heading_max 3.450714881057225 deviation-heading_mean 3.450714881057225 deviation-heading_median 3.450714881057225 deviation-heading_min 3.450714881057225 distance-from-start_max 0.39470454950972034 distance-from-start_mean 0.39470454950972034 distance-from-start_median 0.39470454950972034 distance-from-start_min 0.39470454950972034 driven_any_max 2.7697042769336004 driven_any_mean 2.7697042769336004 driven_any_median 2.7697042769336004 driven_any_min 2.7697042769336004 driven_lanedir_consec_max 0.5183011872925802 driven_lanedir_consec_mean 0.5183011872925802 driven_lanedir_consec_min 0.5183011872925802 driven_lanedir_max 0.5183011872925802 driven_lanedir_mean 0.5183011872925802 driven_lanedir_median 0.5183011872925802 driven_lanedir_min 0.5183011872925802 in-drivable-lane_max 12.500000000000089 in-drivable-lane_mean 12.500000000000089 in-drivable-lane_min 12.500000000000089 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.7697042769336004, "survival_time": 17.500000000000114, "driven_lanedir": 0.5183011872925802, "in-drivable-lane": 12.500000000000089, "deviation-heading": 3.450714881057225, "distance-from-start": 0.39470454950972034, "deviation-center-line": 0.6005682519449633, "driven_lanedir_consec": 0.5183011872925802}}simulation-passed 1 survival_time_max 17.500000000000114 survival_time_mean 17.500000000000114 survival_time_min 17.500000000000114
No reset possible 16495
1748
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:35:11+00:00 2022-11-28 00:37:18+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.850000000000001 in-drivable-lane_median 0.8000000000000007 driven_lanedir_consec_median 0.10976112723874376 deviation-center-line_median 0.05858204157622809
other stats deviation-center-line_max 0.05858204157622809 deviation-center-line_mean 0.05858204157622809 deviation-center-line_min 0.05858204157622809 deviation-heading_max 0.7734206499356491 deviation-heading_mean 0.7734206499356491 deviation-heading_median 0.7734206499356491 deviation-heading_min 0.7734206499356491 distance-from-start_max 0.18464904812645264 distance-from-start_mean 0.18464904812645264 distance-from-start_median 0.18464904812645264 distance-from-start_min 0.18464904812645264 driven_any_max 0.1880204845392568 driven_any_mean 0.1880204845392568 driven_any_median 0.1880204845392568 driven_any_min 0.1880204845392568 driven_lanedir_consec_max 0.10976112723874376 driven_lanedir_consec_mean 0.10976112723874376 driven_lanedir_consec_min 0.10976112723874376 driven_lanedir_max 0.10976112723874376 driven_lanedir_mean 0.10976112723874376 driven_lanedir_median 0.10976112723874376 driven_lanedir_min 0.10976112723874376 in-drivable-lane_max 0.8000000000000007 in-drivable-lane_mean 0.8000000000000007 in-drivable-lane_min 0.8000000000000007 per-episodes details {"autolab-000-ego0": {"driven_any": 0.1880204845392568, "survival_time": 1.850000000000001, "driven_lanedir": 0.10976112723874376, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 0.7734206499356491, "distance-from-start": 0.18464904812645264, "deviation-center-line": 0.05858204157622809, "driven_lanedir_consec": 0.10976112723874376}}simulation-passed 1 survival_time_max 1.850000000000001 survival_time_mean 1.850000000000001 survival_time_min 1.850000000000001
No reset possible 16493
1749
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:33:33+00:00 2022-11-28 00:35:05+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16490
1749
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:31:01+00:00 2022-11-28 00:33:26+00:00 0:02:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.4499999999999993 in-drivable-lane_median 1.6999999999999993 driven_lanedir_consec_median 0.02289027196978033 deviation-center-line_median 0.012951349896566097
other stats deviation-center-line_max 0.012951349896566097 deviation-center-line_mean 0.012951349896566097 deviation-center-line_min 0.012951349896566097 deviation-heading_max 0.6305528241681043 deviation-heading_mean 0.6305528241681043 deviation-heading_median 0.6305528241681043 deviation-heading_min 0.6305528241681043 distance-from-start_max 0.06944335541211777 distance-from-start_mean 0.06944335541211777 distance-from-start_median 0.06944335541211777 distance-from-start_min 0.06944335541211777 driven_any_max 0.1250737696464561 driven_any_mean 0.1250737696464561 driven_any_median 0.1250737696464561 driven_any_min 0.1250737696464561 driven_lanedir_consec_max 0.02289027196978033 driven_lanedir_consec_mean 0.02289027196978033 driven_lanedir_consec_min 0.02289027196978033 driven_lanedir_max 0.02289027196978033 driven_lanedir_mean 0.02289027196978033 driven_lanedir_median 0.02289027196978033 driven_lanedir_min 0.02289027196978033 in-drivable-lane_max 1.6999999999999993 in-drivable-lane_mean 1.6999999999999993 in-drivable-lane_min 1.6999999999999993 per-episodes details {"4way-000-ego0": {"driven_any": 0.1250737696464561, "survival_time": 2.4499999999999993, "driven_lanedir": 0.02289027196978033, "in-drivable-lane": 1.6999999999999993, "deviation-heading": 0.6305528241681043, "distance-from-start": 0.06944335541211777, "deviation-center-line": 0.012951349896566097, "driven_lanedir_consec": 0.02289027196978033}}simulation-passed 1 survival_time_max 2.4499999999999993 survival_time_mean 2.4499999999999993 survival_time_min 2.4499999999999993
No reset possible 16488
1750
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:29:15+00:00 2022-11-28 00:30:47+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16484
1751
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:22:24+00:00 2022-11-28 00:29:02+00:00 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.4703271325767604 survival_time_median 59.99999999999873 deviation-center-line_median 2.318260405698643 in-drivable-lane_median 40.04999999999903
other stats deviation-center-line_max 2.318260405698643 deviation-center-line_mean 2.318260405698643 deviation-center-line_min 2.318260405698643 deviation-heading_max 13.079182116644208 deviation-heading_mean 13.079182116644208 deviation-heading_median 13.079182116644208 deviation-heading_min 13.079182116644208 distance-from-start_max 0.6335574831861017 distance-from-start_mean 0.6335574831861017 distance-from-start_median 0.6335574831861017 distance-from-start_min 0.6335574831861017 driven_any_max 9.906275376446514 driven_any_mean 9.906275376446514 driven_any_median 9.906275376446514 driven_any_min 9.906275376446514 driven_lanedir_consec_max 1.4703271325767604 driven_lanedir_consec_mean 1.4703271325767604 driven_lanedir_consec_min 1.4703271325767604 driven_lanedir_max 2.3479253699295164 driven_lanedir_mean 2.3479253699295164 driven_lanedir_median 2.3479253699295164 driven_lanedir_min 2.3479253699295164 in-drivable-lane_max 40.04999999999903 in-drivable-lane_mean 40.04999999999903 in-drivable-lane_min 40.04999999999903 per-episodes details {"loop2-000-ego0": {"driven_any": 9.906275376446514, "survival_time": 59.99999999999873, "driven_lanedir": 2.3479253699295164, "in-drivable-lane": 40.04999999999903, "deviation-heading": 13.079182116644208, "distance-from-start": 0.6335574831861017, "deviation-center-line": 2.318260405698643, "driven_lanedir_consec": 1.4703271325767604}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16481
1751
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:13:28+00:00 2022-11-28 00:22:16+00:00 0:08:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.286360184626066 survival_time_median 59.99999999999873 deviation-center-line_median 1.339924215500536 in-drivable-lane_median 46.84999999999887
other stats deviation-center-line_max 1.339924215500536 deviation-center-line_mean 1.339924215500536 deviation-center-line_min 1.339924215500536 deviation-heading_max 13.167088996044969 deviation-heading_mean 13.167088996044969 deviation-heading_median 13.167088996044969 deviation-heading_min 13.167088996044969 distance-from-start_max 0.29610542301688025 distance-from-start_mean 0.29610542301688025 distance-from-start_median 0.29610542301688025 distance-from-start_min 0.29610542301688025 driven_any_max 12.03350498596885 driven_any_mean 12.03350498596885 driven_any_median 12.03350498596885 driven_any_min 12.03350498596885 driven_lanedir_consec_max 1.286360184626066 driven_lanedir_consec_mean 1.286360184626066 driven_lanedir_consec_min 1.286360184626066 driven_lanedir_max 1.286476747069294 driven_lanedir_mean 1.286476747069294 driven_lanedir_median 1.286476747069294 driven_lanedir_min 1.286476747069294 in-drivable-lane_max 46.84999999999887 in-drivable-lane_mean 46.84999999999887 in-drivable-lane_min 46.84999999999887 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.03350498596885, "survival_time": 59.99999999999873, "driven_lanedir": 1.286476747069294, "in-drivable-lane": 46.84999999999887, "deviation-heading": 13.167088996044969, "distance-from-start": 0.29610542301688025, "deviation-center-line": 1.339924215500536, "driven_lanedir_consec": 1.286360184626066}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16480
1752
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-1of4 host-error yes davinci-stage-03-6.2.51
2022-11-28 00:11:10+00:00 2022-11-28 00:12:54+00:00 0:01:44 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16479
1752
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:09:07+00:00 2022-11-28 00:10:35+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16478
1752
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-28 00:07:33+00:00 2022-11-28 00:09:00+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16473
1753
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 23:53:44+00:00 2022-11-28 00:07:01+00:00 0:13:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 37.84999999999917 driven_lanedir_consec_median 1.3762361510311725 deviation-center-line_median 1.8205624711389827
other stats deviation-center-line_max 1.973064862863822 deviation-center-line_mean 1.8205624711389827 deviation-center-line_min 1.6680600794141438 deviation-heading_max 20.702420070250856 deviation-heading_mean 18.621047753290753 deviation-heading_median 18.621047753290753 deviation-heading_min 16.53967543633065 distance-from-start_max 0.8448827929496168 distance-from-start_mean 0.6750369650826796 distance-from-start_median 0.6750369650826796 distance-from-start_min 0.5051911372157425 driven_any_max 9.245219449146989 driven_any_mean 8.182596266133014 driven_any_median 8.182596266133014 driven_any_min 7.119973083119043 driven_lanedir_consec_max 1.4993746970046178 driven_lanedir_consec_mean 1.3762361510311725 driven_lanedir_consec_min 1.2530976050577267 driven_lanedir_max 1.7053755754744249 driven_lanedir_mean 1.6865103475684171 driven_lanedir_median 1.6865103475684171 driven_lanedir_min 1.66764511966241 in-drivable-lane_max 41.04999999999902 in-drivable-lane_mean 37.84999999999917 in-drivable-lane_min 34.64999999999932 per-episodes details {"loop2-000-ego0": {"driven_any": 7.119973083119043, "survival_time": 59.99999999999873, "driven_lanedir": 1.7053755754744249, "in-drivable-lane": 34.64999999999932, "deviation-heading": 20.702420070250856, "distance-from-start": 0.8448827929496168, "deviation-center-line": 1.6680600794141438, "driven_lanedir_consec": 1.2530976050577267}, "loop2-000-ego1": {"driven_any": 9.245219449146989, "survival_time": 59.99999999999873, "driven_lanedir": 1.66764511966241, "in-drivable-lane": 41.04999999999902, "deviation-heading": 16.53967543633065, "distance-from-start": 0.5051911372157425, "deviation-center-line": 1.973064862863822, "driven_lanedir_consec": 1.4993746970046178}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16468
1755
Bea Baselines 🐤template-pytorch lx22-modcon
sim success yes davinci-stage-03-6.2.51
2022-11-27 23:43:15+00:00 2022-11-27 23:53:11+00:00 0:09:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 35.92499999999954 deviation-center-line_median 0.7208995785009187 driven_lanedir_consec_median 0.5545885087526398 survival_time_median 42.67499999999948
other stats deviation-center-line_max 1.268906908783161 deviation-center-line_mean 0.7208995785009187 deviation-center-line_min 0.1728922482186763 deviation-heading_max 13.144757066494028 deviation-heading_mean 7.462371105585805 deviation-heading_median 7.462371105585805 deviation-heading_min 1.7799851446775818 distance-from-start_max 1.3237555022448242 distance-from-start_mean 0.8648356783550832 distance-from-start_median 0.8648356783550832 distance-from-start_min 0.4059158544653423 driven_any_max 13.853228376912709 driven_any_mean 9.78266586843668 driven_any_median 9.78266586843668 driven_any_min 5.712103359960654 driven_lanedir_consec_max 1.0465714633039496 driven_lanedir_consec_mean 0.5545885087526398 driven_lanedir_consec_min 0.06260555420132996 driven_lanedir_max 1.2617769841693822 driven_lanedir_mean 0.6621912691853561 driven_lanedir_median 0.6621912691853561 driven_lanedir_min 0.06260555420132996 in-drivable-lane_max 47.799999999998875 in-drivable-lane_mean 35.92499999999954 in-drivable-lane_min 24.05000000000021 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 13.853228376912709, "survival_time": 59.99999999999873, "driven_lanedir": 1.2617769841693822, "in-drivable-lane": 47.799999999998875, "deviation-heading": 13.144757066494028, "distance-from-start": 1.3237555022448242, "deviation-center-line": 1.268906908783161, "driven_lanedir_consec": 1.0465714633039496}, "LF-full-loop-001-ego0": {"driven_any": 5.712103359960654, "survival_time": 25.350000000000225, "driven_lanedir": 0.06260555420132996, "in-drivable-lane": 24.05000000000021, "deviation-heading": 1.7799851446775818, "distance-from-start": 0.4059158544653423, "deviation-center-line": 0.1728922482186763, "driven_lanedir_consec": 0.06260555420132996}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 42.67499999999948 survival_time_min 25.350000000000225
No reset possible 16466
1757
Bea Baselines 🐤template-pytorch lx22-visservoing
sim success yes davinci-stage-03-6.2.51
2022-11-27 23:38:01+00:00 2022-11-27 23:43:00+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 21.024999999999515 deviation-center-line_median 0.8310203673386801 driven_lanedir_consec_median 0.8309444052725339 survival_time_median 31.299999999999365
other stats deviation-center-line_max 1.5812284102141847 deviation-center-line_mean 0.8310203673386801 deviation-center-line_min 0.0808123244631756 deviation-heading_max 14.251526584793622 deviation-heading_mean 7.570463917970621 deviation-heading_median 7.570463917970621 deviation-heading_min 0.8894012511476214 distance-from-start_max 0.5995430559332351 distance-from-start_mean 0.4032808357521209 distance-from-start_median 0.4032808357521209 distance-from-start_min 0.20701861557100676 driven_any_max 10.700701043756853 driven_any_mean 5.474973891901727 driven_any_median 5.474973891901727 driven_any_min 0.24924674004660147 driven_lanedir_consec_max 1.5335981165439203 driven_lanedir_consec_mean 0.8309444052725339 driven_lanedir_consec_min 0.12829069400114734 driven_lanedir_max 2.266182255585174 driven_lanedir_mean 1.1972364747931608 driven_lanedir_median 1.1972364747931608 driven_lanedir_min 0.12829069400114734 in-drivable-lane_max 40.999999999999034 in-drivable-lane_mean 21.024999999999515 in-drivable-lane_min 1.049999999999998 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 10.700701043756853, "survival_time": 59.99999999999873, "driven_lanedir": 2.266182255585174, "in-drivable-lane": 40.999999999999034, "deviation-heading": 14.251526584793622, "distance-from-start": 0.5995430559332351, "deviation-center-line": 1.5812284102141847, "driven_lanedir_consec": 1.5335981165439203}, "LF-small-loop-001-ego0": {"driven_any": 0.24924674004660147, "survival_time": 2.5999999999999988, "driven_lanedir": 0.12829069400114734, "in-drivable-lane": 1.049999999999998, "deviation-heading": 0.8894012511476214, "distance-from-start": 0.20701861557100676, "deviation-center-line": 0.0808123244631756, "driven_lanedir_consec": 0.12829069400114734}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 31.299999999999365 survival_time_min 2.5999999999999988
No reset possible 16462
1759
Bea Baselines 🐤template-pytorch lx22-BV1
sim-0of5 success yes davinci-stage-03-6.2.51
2022-11-27 23:36:06+00:00 2022-11-27 23:37:55+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6083865225799603
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6083865225799603 distance-from-start_median 0.6083865225799603 distance-from-start_min 0.6083865225799603 driven_any_max 0.7088457777499292 driven_any_mean 0.7088457777499292 driven_any_median 0.7088457777499292 driven_any_min 0.7088457777499292 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 4.399999999999992 in-drivable-lane_mean 4.399999999999992 in-drivable-lane_median 4.399999999999992 in-drivable-lane_min 4.399999999999992 per-episodes details {"d30-ego0": {"driven_any": 0.7088457777499292, "survival_time": 4.399999999999992, "driven_lanedir": 0.0, "in-drivable-lane": 4.399999999999992, "deviation-heading": 0.0, "distance-from-start": 0.6083865225799603, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 4.399999999999992 survival_time_mean 4.399999999999992 survival_time_median 4.399999999999992 survival_time_min 4.399999999999992
No reset possible 16456
1766
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 23:27:45+00:00 2022-11-27 23:36:00+00:00 0:08:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.35000000000017 in-drivable-lane_median 15.00000000000014 driven_lanedir_consec_median 0.8700823110614846 deviation-center-line_median 0.562932922307127
other stats deviation-center-line_max 0.562932922307127 deviation-center-line_mean 0.562932922307127 deviation-center-line_min 0.562932922307127 deviation-heading_max 4.3098760896757335 deviation-heading_mean 4.3098760896757335 deviation-heading_median 4.3098760896757335 deviation-heading_min 4.3098760896757335 distance-from-start_max 0.34554112896050165 distance-from-start_mean 0.34554112896050165 distance-from-start_median 0.34554112896050165 distance-from-start_min 0.34554112896050165 driven_any_max 4.015833978904281 driven_any_mean 4.015833978904281 driven_any_median 4.015833978904281 driven_any_min 4.015833978904281 driven_lanedir_consec_max 0.8700823110614846 driven_lanedir_consec_mean 0.8700823110614846 driven_lanedir_consec_min 0.8700823110614846 driven_lanedir_max 0.8700823110614846 driven_lanedir_mean 0.8700823110614846 driven_lanedir_median 0.8700823110614846 driven_lanedir_min 0.8700823110614846 in-drivable-lane_max 15.00000000000014 in-drivable-lane_mean 15.00000000000014 in-drivable-lane_min 15.00000000000014 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.015833978904281, "survival_time": 21.35000000000017, "driven_lanedir": 0.8700823110614846, "in-drivable-lane": 15.00000000000014, "deviation-heading": 4.3098760896757335, "distance-from-start": 0.34554112896050165, "deviation-center-line": 0.562932922307127, "driven_lanedir_consec": 0.8700823110614846}}simulation-passed 1 survival_time_max 21.35000000000017 survival_time_mean 21.35000000000017 survival_time_min 21.35000000000017
No reset possible 16453
1767
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 23:25:59+00:00 2022-11-27 23:27:31+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16447
1768
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 23:22:34+00:00 2022-11-27 23:25:46+00:00 0:03:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.699999999999991 in-drivable-lane_median 2.3499999999999917 driven_lanedir_consec_median 0.284751493232718 deviation-center-line_median 0.09989043228450473
other stats deviation-center-line_max 0.09989043228450473 deviation-center-line_mean 0.09989043228450473 deviation-center-line_min 0.09989043228450473 deviation-heading_max 1.3021829538792178 deviation-heading_mean 1.3021829538792178 deviation-heading_median 1.3021829538792178 deviation-heading_min 1.3021829538792178 distance-from-start_max 0.3024306801578253 distance-from-start_mean 0.3024306801578253 distance-from-start_median 0.3024306801578253 distance-from-start_min 0.3024306801578253 driven_any_max 0.6273094125029657 driven_any_mean 0.6273094125029657 driven_any_median 0.6273094125029657 driven_any_min 0.6273094125029657 driven_lanedir_consec_max 0.284751493232718 driven_lanedir_consec_mean 0.284751493232718 driven_lanedir_consec_min 0.284751493232718 driven_lanedir_max 0.284751493232718 driven_lanedir_mean 0.284751493232718 driven_lanedir_median 0.284751493232718 driven_lanedir_min 0.284751493232718 in-drivable-lane_max 2.3499999999999917 in-drivable-lane_mean 2.3499999999999917 in-drivable-lane_min 2.3499999999999917 per-episodes details {"udem1-000-ego0": {"driven_any": 0.6273094125029657, "survival_time": 4.699999999999991, "driven_lanedir": 0.284751493232718, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.3021829538792178, "distance-from-start": 0.3024306801578253, "deviation-center-line": 0.09989043228450473, "driven_lanedir_consec": 0.284751493232718}}simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 4.699999999999991 survival_time_min 4.699999999999991
No reset possible 16444
1769
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 23:12:52+00:00 2022-11-27 23:22:18+00:00 0:09:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1115127327115393 survival_time_median 59.99999999999873 deviation-center-line_median 1.3798716288371509 in-drivable-lane_median 45.09999999999887
other stats deviation-center-line_max 1.3798716288371509 deviation-center-line_mean 1.3798716288371509 deviation-center-line_min 1.3798716288371509 deviation-heading_max 11.661195687864248 deviation-heading_mean 11.661195687864248 deviation-heading_median 11.661195687864248 deviation-heading_min 11.661195687864248 distance-from-start_max 0.7156700270164421 distance-from-start_mean 0.7156700270164421 distance-from-start_median 0.7156700270164421 distance-from-start_min 0.7156700270164421 driven_any_max 9.825993609550258 driven_any_mean 9.825993609550258 driven_any_median 9.825993609550258 driven_any_min 9.825993609550258 driven_lanedir_consec_max 1.1115127327115393 driven_lanedir_consec_mean 1.1115127327115393 driven_lanedir_consec_min 1.1115127327115393 driven_lanedir_max 1.5141982349323304 driven_lanedir_mean 1.5141982349323304 driven_lanedir_median 1.5141982349323304 driven_lanedir_min 1.5141982349323304 in-drivable-lane_max 45.09999999999887 in-drivable-lane_mean 45.09999999999887 in-drivable-lane_min 45.09999999999887 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.825993609550258, "survival_time": 59.99999999999873, "driven_lanedir": 1.5141982349323304, "in-drivable-lane": 45.09999999999887, "deviation-heading": 11.661195687864248, "distance-from-start": 0.7156700270164421, "deviation-center-line": 1.3798716288371509, "driven_lanedir_consec": 1.1115127327115393}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16443
1850
Andrea Daniele lx22-visservoing lx22-visservoing
sim failed yes davinci-stage-03-6.2.51
2022-11-27 23:10:12+00:00 2022-11-27 23:12:45+00:00 0:02:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
length_s = await run_episode(
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
msg = await loop.run_in_executor(executor, f)
File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:
error in ego0 |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
|| raise Exception(msg)
|| Exception: I have been waiting for commands from the ROS part since 60 s
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16436
1771
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:53:53+00:00 2022-11-27 23:09:59+00:00 0:16:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 40.79999999999982 in-drivable-lane_median 34.649999999999814 driven_lanedir_consec_median 0.5201778335215335 deviation-center-line_median 0.5033983244535749
other stats deviation-center-line_max 0.8091889962960607 deviation-center-line_mean 0.473695219513447 deviation-center-line_min 0.07879523285057742 deviation-heading_max 8.826955184088073 deviation-heading_mean 4.52880939310061 deviation-heading_median 4.43299018341178 deviation-heading_min 0.4223020214908056 distance-from-start_max 0.5670452882835323 distance-from-start_mean 0.389037812148862 distance-from-start_median 0.4019432918468391 distance-from-start_min 0.1852193766182376 driven_any_max 7.210987597390302 driven_any_mean 2.699233463724466 driven_any_median 1.5268782790043518 driven_any_min 0.5321896994988577 driven_lanedir_consec_max 1.4619927474008945 driven_lanedir_consec_mean 0.6535540991632546 driven_lanedir_consec_min 0.11186798220905692 driven_lanedir_max 1.4619927474008945 driven_lanedir_mean 0.6535540991632546 driven_lanedir_median 0.5201778335215335 driven_lanedir_min 0.11186798220905692 in-drivable-lane_max 39.94999999999982 in-drivable-lane_mean 34.412499999999795 in-drivable-lane_min 28.39999999999971 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.210987597390302, "survival_time": 40.79999999999982, "driven_lanedir": 1.4619927474008945, "in-drivable-lane": 28.39999999999971, "deviation-heading": 8.826955184088073, "distance-from-start": 0.5670452882835323, "deviation-center-line": 0.8091889962960607, "driven_lanedir_consec": 1.4619927474008945}, "zigzag-000-ego1": {"driven_any": 0.5321896994988577, "survival_time": 40.79999999999982, "driven_lanedir": 0.11186798220905692, "in-drivable-lane": 39.94999999999982, "deviation-heading": 0.4223020214908056, "distance-from-start": 0.4757396962419171, "deviation-center-line": 0.07879523285057742, "driven_lanedir_consec": 0.11186798220905692}, "zigzag-000-ego2": {"driven_any": 2.066026288700556, "survival_time": 40.79999999999982, "driven_lanedir": 0.8098012840229142, "in-drivable-lane": 33.04999999999981, "deviation-heading": 5.423814646503306, "distance-from-start": 0.3281468874517611, "deviation-center-line": 0.4526197809221165, "driven_lanedir_consec": 0.8098012840229142}, "zigzag-000-ego3": {"driven_any": 0.9877302693081476, "survival_time": 40.79999999999982, "driven_lanedir": 0.23055438302015263, "in-drivable-lane": 36.249999999999815, "deviation-heading": 3.4421657203202543, "distance-from-start": 0.1852193766182376, "deviation-center-line": 0.5541768679850334, "driven_lanedir_consec": 0.23055438302015263}}simulation-passed 1 survival_time_max 40.79999999999982 survival_time_mean 40.79999999999982 survival_time_min 40.79999999999982
No reset possible 16432
1772
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:47:45+00:00 2022-11-27 22:53:25+00:00 0:05:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.750000000000316 in-drivable-lane_median 17.25000000000018 driven_lanedir_consec_median 1.0844125893287762 deviation-center-line_median 0.8467735465972205
other stats deviation-center-line_max 0.8467735465972205 deviation-center-line_mean 0.8467735465972205 deviation-center-line_min 0.8467735465972205 deviation-heading_max 11.08585646013653 deviation-heading_mean 11.08585646013653 deviation-heading_median 11.08585646013653 deviation-heading_min 11.08585646013653 distance-from-start_max 0.40003972636641727 distance-from-start_mean 0.40003972636641727 distance-from-start_median 0.40003972636641727 distance-from-start_min 0.40003972636641727 driven_any_max 3.4249297680058475 driven_any_mean 3.4249297680058475 driven_any_median 3.4249297680058475 driven_any_min 3.4249297680058475 driven_lanedir_consec_max 1.0844125893287762 driven_lanedir_consec_mean 1.0844125893287762 driven_lanedir_consec_min 1.0844125893287762 driven_lanedir_max 1.0844125893287762 driven_lanedir_mean 1.0844125893287762 driven_lanedir_median 1.0844125893287762 driven_lanedir_min 1.0844125893287762 in-drivable-lane_max 17.25000000000018 in-drivable-lane_mean 17.25000000000018 in-drivable-lane_min 17.25000000000018 per-episodes details {"loop-000-ego0": {"driven_any": 3.4249297680058475, "survival_time": 31.750000000000316, "driven_lanedir": 1.0844125893287762, "in-drivable-lane": 17.25000000000018, "deviation-heading": 11.08585646013653, "distance-from-start": 0.40003972636641727, "deviation-center-line": 0.8467735465972205, "driven_lanedir_consec": 1.0844125893287762}}simulation-passed 1 survival_time_max 31.750000000000316 survival_time_mean 31.750000000000316 survival_time_min 31.750000000000316
No reset possible 16429
1773
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:43:07+00:00 2022-11-27 22:47:36+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.750000000000217 in-drivable-lane_median 16.200000000000195 driven_lanedir_consec_median 0.2676465159268615 deviation-center-line_median 0.7555297758130887
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.0666647982270385 driven_any_mean 6.0666647982270385 driven_any_median 6.0666647982270385 driven_any_min 6.0666647982270385 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.200000000000195 in-drivable-lane_mean 16.200000000000195 in-drivable-lane_min 16.200000000000195 per-episodes details {"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 24.750000000000217 survival_time_mean 24.750000000000217 survival_time_min 24.750000000000217
No reset possible 16428
1773
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:39:59+00:00 2022-11-27 22:42:34+00:00 0:02:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.699999999999995 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.364506838392066 deviation-center-line_median 0.14696541332404583
other stats deviation-center-line_max 0.14696541332404583 deviation-center-line_mean 0.14696541332404583 deviation-center-line_min 0.14696541332404583 deviation-heading_max 1.6699264400950062 deviation-heading_mean 1.6699264400950062 deviation-heading_median 1.6699264400950062 deviation-heading_min 1.6699264400950062 distance-from-start_max 0.3743806210373658 distance-from-start_mean 0.3743806210373658 distance-from-start_median 0.3743806210373658 distance-from-start_min 0.3743806210373658 driven_any_max 0.3944302398862539 driven_any_mean 0.3944302398862539 driven_any_median 0.3944302398862539 driven_any_min 0.3944302398862539 driven_lanedir_consec_max 0.364506838392066 driven_lanedir_consec_mean 0.364506838392066 driven_lanedir_consec_min 0.364506838392066 driven_lanedir_max 0.364506838392066 driven_lanedir_mean 0.364506838392066 driven_lanedir_median 0.364506838392066 driven_lanedir_min 0.364506838392066 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}simulation-passed 1 survival_time_max 3.699999999999995 survival_time_mean 3.699999999999995 survival_time_min 3.699999999999995
No reset possible 16423
1774
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:37:41+00:00 2022-11-27 22:39:30+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16418
1776
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:33:23+00:00 2022-11-27 22:37:34+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2718401947993705 survival_time_median 27.70000000000026 deviation-center-line_median 0.7655517188189105 in-drivable-lane_median 19.150000000000237
other stats deviation-center-line_max 0.7655517188189105 deviation-center-line_mean 0.7655517188189105 deviation-center-line_min 0.7655517188189105 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7960980578537302 distance-from-start_mean 0.7960980578537302 distance-from-start_median 0.7960980578537302 distance-from-start_min 0.7960980578537302 driven_any_max 6.635455547557208 driven_any_mean 6.635455547557208 driven_any_median 6.635455547557208 driven_any_min 6.635455547557208 driven_lanedir_consec_max 0.2718401947993705 driven_lanedir_consec_mean 0.2718401947993705 driven_lanedir_consec_min 0.2718401947993705 driven_lanedir_max 0.25382904192484634 driven_lanedir_mean 0.25382904192484634 driven_lanedir_median 0.25382904192484634 driven_lanedir_min 0.25382904192484634 in-drivable-lane_max 19.150000000000237 in-drivable-lane_mean 19.150000000000237 in-drivable-lane_min 19.150000000000237 per-episodes details {"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 16412
1777
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:20:34+00:00 2022-11-27 22:33:01+00:00 0:12:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 22.925000000000257 driven_lanedir_consec_median 0.1842700338005553 deviation-center-line_median 0.4627381849764669
other stats deviation-center-line_max 4.099655310425073 deviation-center-line_mean 1.3331675709092048 deviation-center-line_min 0.3075386032588124 deviation-heading_max 14.96173668874226 deviation-heading_mean 6.250128407006366 deviation-heading_median 3.9170785755528663 deviation-heading_min 2.204619788177472 distance-from-start_max 0.8626308120701165 distance-from-start_mean 0.6103488428669119 distance-from-start_median 0.5879544645467749 distance-from-start_min 0.4028556303039817 driven_any_max 7.1610713584054295 driven_any_mean 3.3142682447917635 driven_any_median 2.835962585238713 driven_any_min 0.4240764502841981 driven_lanedir_consec_max 0.3901369682576328 driven_lanedir_consec_mean 0.21562824323701707 driven_lanedir_consec_min 0.10383593708932493 driven_lanedir_max 0.3901369682576328 driven_lanedir_mean 0.2054725659587014 driven_lanedir_median 0.16943030307989526 driven_lanedir_min 0.09289268941738228 in-drivable-lane_max 24.45000000000027 in-drivable-lane_mean 17.800000000000196 in-drivable-lane_min 0.9 per-episodes details {"udem-000-ego0": {"driven_any": 0.4240764502841981, "survival_time": 28.850000000000275, "driven_lanedir": 0.3901369682576328, "in-drivable-lane": 0.9, "deviation-heading": 14.96173668874226, "distance-from-start": 0.4028556303039817, "deviation-center-line": 4.099655310425073, "driven_lanedir_consec": 0.3901369682576328}, "udem-000-ego1": {"driven_any": 7.1610713584054295, "survival_time": 28.850000000000275, "driven_lanedir": 0.1969626852808437, "in-drivable-lane": 21.40000000000026, "deviation-heading": 4.716518246290203, "distance-from-start": 0.8626308120701165, "deviation-center-line": 0.5494202956548411, "driven_lanedir_consec": 0.21028967498696935}, "udem-000-ego2": {"driven_any": 2.4684338587868724, "survival_time": 28.850000000000275, "driven_lanedir": 0.1418979208789468, "in-drivable-lane": 24.45000000000027, "deviation-heading": 2.204619788177472, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.37605607429809274, "driven_lanedir_consec": 0.1582503926141412}, "udem-000-ego3": {"driven_any": 3.2034913116905535, "survival_time": 28.850000000000275, "driven_lanedir": 0.09289268941738228, "in-drivable-lane": 24.45000000000025, "deviation-heading": 3.1176389048155295, "distance-from-start": 0.6297514211538984, "deviation-center-line": 0.3075386032588124, "driven_lanedir_consec": 0.10383593708932493}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 16411
1777
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:18:22+00:00 2022-11-27 22:20:12+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16410
1777
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:16:25+00:00 2022-11-27 22:17:52+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16404
1779
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 22:07:46+00:00 2022-11-27 22:16:18+00:00 0:08:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.099999999999135 driven_lanedir_consec_median 0.33349329950959106 deviation-center-line_median 2.107688838912731
other stats deviation-center-line_max 2.107688838912731 deviation-center-line_mean 2.107688838912731 deviation-center-line_min 2.107688838912731 deviation-heading_max 23.30238865255163 deviation-heading_mean 23.30238865255163 deviation-heading_median 23.30238865255163 deviation-heading_min 23.30238865255163 distance-from-start_max 1.4108418329398933 distance-from-start_mean 1.4108418329398933 distance-from-start_median 1.4108418329398933 distance-from-start_min 1.4108418329398933 driven_any_max 15.326310847370516 driven_any_mean 15.326310847370516 driven_any_median 15.326310847370516 driven_any_min 15.326310847370516 driven_lanedir_consec_max 0.33349329950959106 driven_lanedir_consec_mean 0.33349329950959106 driven_lanedir_consec_min 0.33349329950959106 driven_lanedir_max 0.2728719387129268 driven_lanedir_mean 0.2728719387129268 driven_lanedir_median 0.2728719387129268 driven_lanedir_min 0.2728719387129268 in-drivable-lane_max 36.099999999999135 in-drivable-lane_mean 36.099999999999135 in-drivable-lane_min 36.099999999999135 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370516, "survival_time": 59.99999999999873, "driven_lanedir": 0.2728719387129268, "in-drivable-lane": 36.099999999999135, "deviation-heading": 23.30238865255163, "distance-from-start": 1.4108418329398933, "deviation-center-line": 2.107688838912731, "driven_lanedir_consec": 0.33349329950959106}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16391
1791
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:49:34+00:00 2022-11-27 22:07:26+00:00 0:17:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.69999999999868 driven_lanedir_consec_median 0.035772152071414265 deviation-center-line_median 0.5480591600958397
other stats deviation-center-line_max 0.5480591600958397 deviation-center-line_mean 0.5480591600958397 deviation-center-line_min 0.5480591600958397 deviation-heading_max 5.01528057758804 deviation-heading_mean 5.01528057758804 deviation-heading_median 5.01528057758804 deviation-heading_min 5.01528057758804 distance-from-start_max 1.4108418329398995 distance-from-start_mean 1.4108418329398995 distance-from-start_median 1.4108418329398995 distance-from-start_min 1.4108418329398995 driven_any_max 15.32631084737064 driven_any_mean 15.32631084737064 driven_any_median 15.32631084737064 driven_any_min 15.32631084737064 driven_lanedir_consec_max 0.035772152071414265 driven_lanedir_consec_mean 0.035772152071414265 driven_lanedir_consec_min 0.035772152071414265 driven_lanedir_max 0.035772152071414265 driven_lanedir_mean 0.035772152071414265 driven_lanedir_median 0.035772152071414265 driven_lanedir_min 0.035772152071414265 in-drivable-lane_max 53.69999999999868 in-drivable-lane_mean 53.69999999999868 in-drivable-lane_min 53.69999999999868 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.32631084737064, "survival_time": 59.99999999999873, "driven_lanedir": 0.035772152071414265, "in-drivable-lane": 53.69999999999868, "deviation-heading": 5.01528057758804, "distance-from-start": 1.4108418329398995, "deviation-center-line": 0.5480591600958397, "driven_lanedir_consec": 0.035772152071414265}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16385
1792
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:45:03+00:00 2022-11-27 21:49:13+00:00 0:04:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.02729617395902917 deviation-center-line_median 0.32682195168324285
other stats deviation-center-line_max 0.32682195168324285 deviation-center-line_mean 0.32682195168324285 deviation-center-line_min 0.32682195168324285 deviation-heading_max 2.5540249040512006 deviation-heading_mean 2.5540249040512006 deviation-heading_median 2.5540249040512006 deviation-heading_min 2.5540249040512006 distance-from-start_max 0.5461575079396513 distance-from-start_mean 0.5461575079396513 distance-from-start_median 0.5461575079396513 distance-from-start_min 0.5461575079396513 driven_any_max 2.295525081876515 driven_any_mean 2.295525081876515 driven_any_median 2.295525081876515 driven_any_min 2.295525081876515 driven_lanedir_consec_max 0.02729617395902917 driven_lanedir_consec_mean 0.02729617395902917 driven_lanedir_consec_min 0.02729617395902917 driven_lanedir_max 0.030642516057663105 driven_lanedir_mean 0.030642516057663105 driven_lanedir_median 0.030642516057663105 driven_lanedir_min 0.030642516057663105 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.295525081876515, "survival_time": 11.350000000000026, "driven_lanedir": 0.030642516057663105, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.5540249040512006, "distance-from-start": 0.5461575079396513, "deviation-center-line": 0.32682195168324285, "driven_lanedir_consec": 0.02729617395902917}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 16370
1796
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:19:19+00:00 2022-11-27 21:44:54+00:00 0:25:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 50.29999999999875 driven_lanedir_consec_median 0.2447360136393999 deviation-center-line_median 0.8201377542768524
other stats deviation-center-line_max 1.1069457194070875 deviation-center-line_mean 0.7677403353962817 deviation-center-line_min 0.3237401136243348 deviation-heading_max 12.93145476995294 deviation-heading_mean 8.15077258988621 deviation-heading_median 8.265274464791538 deviation-heading_min 3.141086660008822 distance-from-start_max 1.410841832939908 distance-from-start_mean 1.0363313004962076 distance-from-start_median 1.0345816229075964 distance-from-start_min 0.6653201232297296 driven_any_max 15.326310847370548 driven_any_mean 9.916481674175056 driven_any_median 10.348447553867391 driven_any_min 3.642720741594884 driven_lanedir_consec_max 0.41005402159019166 driven_lanedir_consec_mean 0.2556548579850866 driven_lanedir_consec_min 0.12309338307135484 driven_lanedir_max 0.40636448176148865 driven_lanedir_mean 0.24489136742153575 driven_lanedir_median 0.23207066701918888 driven_lanedir_min 0.10905965388627664 in-drivable-lane_max 55.59999999999871 in-drivable-lane_mean 50.837499999998734 in-drivable-lane_min 47.14999999999874 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.1929529246946, "survival_time": 59.99999999999873, "driven_lanedir": 0.22628350607467773, "in-drivable-lane": 47.999999999998806, "deviation-heading": 10.0526055653766, "distance-from-start": 1.1351054760255626, "deviation-center-line": 0.970368058015948, "driven_lanedir_consec": 0.22628350607467773}, "zigzag-000-ego1": {"driven_any": 15.326310847370548, "survival_time": 59.99999999999873, "driven_lanedir": 0.23785782796370003, "in-drivable-lane": 47.14999999999874, "deviation-heading": 12.93145476995294, "distance-from-start": 1.410841832939908, "deviation-center-line": 1.1069457194070875, "driven_lanedir_consec": 0.26318852120412206}, "zigzag-000-ego2": {"driven_any": 8.503942183040182, "survival_time": 59.99999999999873, "driven_lanedir": 0.10905965388627664, "in-drivable-lane": 55.59999999999871, "deviation-heading": 3.141086660008822, "distance-from-start": 0.9340577697896302, "deviation-center-line": 0.3237401136243348, "driven_lanedir_consec": 0.12309338307135484}, "zigzag-000-ego3": {"driven_any": 3.642720741594884, "survival_time": 59.99999999999873, "driven_lanedir": 0.40636448176148865, "in-drivable-lane": 52.59999999999869, "deviation-heading": 6.477943364206477, "distance-from-start": 0.6653201232297296, "deviation-center-line": 0.6699074505377567, "driven_lanedir_consec": 0.41005402159019166}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16364
1797
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:12:39+00:00 2022-11-27 21:18:47+00:00 0:06:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.7499999999996 driven_lanedir_consec_median 0.054336775833862205 deviation-center-line_median 0.6346586353316823
other stats deviation-center-line_max 0.6346586353316823 deviation-center-line_mean 0.6346586353316823 deviation-center-line_min 0.6346586353316823 deviation-heading_max 5.904235246936354 deviation-heading_mean 5.904235246936354 deviation-heading_median 5.904235246936354 deviation-heading_min 5.904235246936354 distance-from-start_max 1.009340436005913 distance-from-start_mean 1.009340436005913 distance-from-start_median 1.009340436005913 distance-from-start_min 1.009340436005913 driven_any_max 10.522906217249686 driven_any_mean 10.522906217249686 driven_any_median 10.522906217249686 driven_any_min 10.522906217249686 driven_lanedir_consec_max 0.054336775833862205 driven_lanedir_consec_mean 0.054336775833862205 driven_lanedir_consec_min 0.054336775833862205 driven_lanedir_max 0.05768311793249614 driven_lanedir_mean 0.05768311793249614 driven_lanedir_median 0.05768311793249614 driven_lanedir_min 0.05768311793249614 in-drivable-lane_max 35.7499999999996 in-drivable-lane_mean 35.7499999999996 in-drivable-lane_min 35.7499999999996 per-episodes details {"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 16359
1798
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:09:26+00:00 2022-11-27 21:12:25+00:00 0:02:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.649999999999984 in-drivable-lane_median 5.749999999999984 driven_lanedir_consec_median 0.11268899573197944 deviation-center-line_median 0.052704278979125406
other stats deviation-center-line_max 0.052704278979125406 deviation-center-line_mean 0.052704278979125406 deviation-center-line_min 0.052704278979125406 deviation-heading_max 0.6613490281448264 deviation-heading_mean 0.6613490281448264 deviation-heading_median 0.6613490281448264 deviation-heading_min 0.6613490281448264 distance-from-start_max 1.3741336668120083 distance-from-start_mean 1.3741336668120083 distance-from-start_median 1.3741336668120083 distance-from-start_min 1.3741336668120083 driven_any_max 1.7923430404039196 driven_any_mean 1.7923430404039196 driven_any_median 1.7923430404039196 driven_any_min 1.7923430404039196 driven_lanedir_consec_max 0.11268899573197944 driven_lanedir_consec_mean 0.11268899573197944 driven_lanedir_consec_min 0.11268899573197944 driven_lanedir_max 0.11268899573197944 driven_lanedir_mean 0.11268899573197944 driven_lanedir_median 0.11268899573197944 driven_lanedir_min 0.11268899573197944 in-drivable-lane_max 5.749999999999984 in-drivable-lane_mean 5.749999999999984 in-drivable-lane_min 5.749999999999984 per-episodes details {"loop-000-ego0": {"driven_any": 1.7923430404039196, "survival_time": 6.649999999999984, "driven_lanedir": 0.11268899573197944, "in-drivable-lane": 5.749999999999984, "deviation-heading": 0.6613490281448264, "distance-from-start": 1.3741336668120083, "deviation-center-line": 0.052704278979125406, "driven_lanedir_consec": 0.11268899573197944}}simulation-passed 1 survival_time_max 6.649999999999984 survival_time_mean 6.649999999999984 survival_time_min 6.649999999999984
No reset possible 16353
1800
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:07:16+00:00 2022-11-27 21:09:06+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.4499999999999993 in-drivable-lane_median 1.1499999999999988 driven_lanedir_consec_median 0.2273510515122872 deviation-center-line_median 0.08768334603166283
other stats deviation-center-line_max 0.08768334603166283 deviation-center-line_mean 0.08768334603166283 deviation-center-line_min 0.08768334603166283 deviation-heading_max 0.6530006848174887 deviation-heading_mean 0.6530006848174887 deviation-heading_median 0.6530006848174887 deviation-heading_min 0.6530006848174887 distance-from-start_max 0.38313750838276833 distance-from-start_mean 0.38313750838276833 distance-from-start_median 0.38313750838276833 distance-from-start_min 0.38313750838276833 driven_any_max 0.38876556129686257 driven_any_mean 0.38876556129686257 driven_any_median 0.38876556129686257 driven_any_min 0.38876556129686257 driven_lanedir_consec_max 0.2273510515122872 driven_lanedir_consec_mean 0.2273510515122872 driven_lanedir_consec_min 0.2273510515122872 driven_lanedir_max 0.2273510515122872 driven_lanedir_mean 0.2273510515122872 driven_lanedir_median 0.2273510515122872 driven_lanedir_min 0.2273510515122872 in-drivable-lane_max 1.1499999999999988 in-drivable-lane_mean 1.1499999999999988 in-drivable-lane_min 1.1499999999999988 per-episodes details {"4way-000-ego0": {"driven_any": 0.38876556129686257, "survival_time": 2.4499999999999993, "driven_lanedir": 0.2273510515122872, "in-drivable-lane": 1.1499999999999988, "deviation-heading": 0.6530006848174887, "distance-from-start": 0.38313750838276833, "deviation-center-line": 0.08768334603166283, "driven_lanedir_consec": 0.2273510515122872}}simulation-passed 1 survival_time_max 2.4499999999999993 survival_time_mean 2.4499999999999993 survival_time_min 2.4499999999999993
No reset possible 16349
1801
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:05:21+00:00 2022-11-27 21:06:53+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19791074241763673 survival_time_median 5.799999999999987 deviation-center-line_median 0.07408306619697755 in-drivable-lane_median 4.599999999999987
other stats deviation-center-line_max 0.07408306619697755 deviation-center-line_mean 0.07408306619697755 deviation-center-line_min 0.07408306619697755 deviation-heading_max 0.6471009543775244 deviation-heading_mean 0.6471009543775244 deviation-heading_median 0.6471009543775244 deviation-heading_min 0.6471009543775244 distance-from-start_max 1.348999606415863 distance-from-start_mean 1.348999606415863 distance-from-start_median 1.348999606415863 distance-from-start_min 1.348999606415863 driven_any_max 1.4073374059713697 driven_any_mean 1.4073374059713697 driven_any_median 1.4073374059713697 driven_any_min 1.4073374059713697 driven_lanedir_consec_max 0.19791074241763673 driven_lanedir_consec_mean 0.19791074241763673 driven_lanedir_consec_min 0.19791074241763673 driven_lanedir_max 0.19791074241763673 driven_lanedir_mean 0.19791074241763673 driven_lanedir_median 0.19791074241763673 driven_lanedir_min 0.19791074241763673 in-drivable-lane_max 4.599999999999987 in-drivable-lane_mean 4.599999999999987 in-drivable-lane_min 4.599999999999987 per-episodes details {"loop-000-ego0": {"driven_any": 1.4073374059713697, "survival_time": 5.799999999999987, "driven_lanedir": 0.19791074241763673, "in-drivable-lane": 4.599999999999987, "deviation-heading": 0.6471009543775244, "distance-from-start": 1.348999606415863, "deviation-center-line": 0.07408306619697755, "driven_lanedir_consec": 0.19791074241763673}}simulation-passed 1 survival_time_max 5.799999999999987 survival_time_mean 5.799999999999987 survival_time_min 5.799999999999987
No reset possible 16347
1802
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 21:03:22+00:00 2022-11-27 21:05:08+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16341
1803
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:58:33+00:00 2022-11-27 21:03:08+00:00 0:04:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.050000000000036 in-drivable-lane_median 9.900000000000038 driven_lanedir_consec_median 0.4042667278342681 deviation-center-line_median 0.11579597284676424
other stats deviation-center-line_max 1.424256693201336 deviation-center-line_mean 0.43021816826526016 deviation-center-line_min 0.06502403416617625 deviation-heading_max 1.19871368729543 deviation-heading_mean 0.6909464311823174 deviation-heading_median 0.5743835005682044 deviation-heading_min 0.41630503629743065 distance-from-start_max 2.9476898527235793 distance-from-start_mean 1.376707464250793 distance-from-start_median 1.0577120810571223 distance-from-start_min 0.4437158421653478 driven_any_max 3.2694488149196053 driven_any_mean 1.477698516292317 driven_any_median 1.0917116159383944 driven_any_min 0.4579220183728744 driven_lanedir_consec_max 0.6907692811072494 driven_lanedir_consec_mean 0.4361130038388312 driven_lanedir_consec_min 0.24514927857953903 driven_lanedir_max 0.6907692811072494 driven_lanedir_mean 0.4361130038388312 driven_lanedir_median 0.4042667278342681 driven_lanedir_min 0.24514927857953903 in-drivable-lane_max 10.850000000000035 in-drivable-lane_mean 7.662500000000028 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.2694488149196053, "survival_time": 12.050000000000036, "driven_lanedir": 0.34537869941280364, "in-drivable-lane": 10.500000000000036, "deviation-heading": 0.5853611649144193, "distance-from-start": 2.9476898527235793, "deviation-center-line": 0.1186808373567997, "driven_lanedir_consec": 0.34537869941280364}, "loop-000-ego1": {"driven_any": 0.4771472378379757, "survival_time": 12.050000000000036, "driven_lanedir": 0.46315475625573255, "in-drivable-lane": 0.0, "deviation-heading": 1.19871368729543, "distance-from-start": 0.4657833782147857, "deviation-center-line": 1.424256693201336, "driven_lanedir_consec": 0.46315475625573255}, "loop-000-ego2": {"driven_any": 1.7062759940388132, "survival_time": 12.050000000000036, "driven_lanedir": 0.6907692811072494, "in-drivable-lane": 9.300000000000038, "deviation-heading": 0.5634058362219896, "distance-from-start": 1.649640783899459, "deviation-center-line": 0.11291110833672878, "driven_lanedir_consec": 0.6907692811072494}, "loop-000-ego3": {"driven_any": 0.4579220183728744, "survival_time": 12.050000000000036, "driven_lanedir": 0.24514927857953903, "in-drivable-lane": 10.850000000000035, "deviation-heading": 0.41630503629743065, "distance-from-start": 0.4437158421653478, "deviation-center-line": 0.06502403416617625, "driven_lanedir_consec": 0.24514927857953903}}simulation-passed 1 survival_time_max 12.050000000000036 survival_time_mean 12.050000000000036 survival_time_min 12.050000000000036
No reset possible 16338
1804
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:56:26+00:00 2022-11-27 20:58:04+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.850000000000001 in-drivable-lane_median 0.9500000000000008 driven_lanedir_consec_median 0.14019363913470628 deviation-center-line_median 0.05017479887221617
other stats deviation-center-line_max 0.05017479887221617 deviation-center-line_mean 0.05017479887221617 deviation-center-line_min 0.05017479887221617 deviation-heading_max 0.5913791463156683 deviation-heading_mean 0.5913791463156683 deviation-heading_median 0.5913791463156683 deviation-heading_min 0.5913791463156683 distance-from-start_max 0.25848655431862816 distance-from-start_mean 0.25848655431862816 distance-from-start_median 0.25848655431862816 distance-from-start_min 0.25848655431862816 driven_any_max 0.2593367051059751 driven_any_mean 0.2593367051059751 driven_any_median 0.2593367051059751 driven_any_min 0.2593367051059751 driven_lanedir_consec_max 0.14019363913470628 driven_lanedir_consec_mean 0.14019363913470628 driven_lanedir_consec_min 0.14019363913470628 driven_lanedir_max 0.14019363913470628 driven_lanedir_mean 0.14019363913470628 driven_lanedir_median 0.14019363913470628 driven_lanedir_min 0.14019363913470628 in-drivable-lane_max 0.9500000000000008 in-drivable-lane_mean 0.9500000000000008 in-drivable-lane_min 0.9500000000000008 per-episodes details {"loop-000-ego0": {"driven_any": 0.2593367051059751, "survival_time": 1.850000000000001, "driven_lanedir": 0.14019363913470628, "in-drivable-lane": 0.9500000000000008, "deviation-heading": 0.5913791463156683, "distance-from-start": 0.25848655431862816, "deviation-center-line": 0.05017479887221617, "driven_lanedir_consec": 0.14019363913470628}}simulation-passed 1 survival_time_max 1.850000000000001 survival_time_mean 1.850000000000001 survival_time_min 1.850000000000001
No reset possible 16335
1804
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:54:51+00:00 2022-11-27 20:56:19+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.599999999999995 in-drivable-lane_median 2.549999999999995 driven_lanedir_consec_median 0.1458174872267639 deviation-center-line_median 0.059340568830611146
other stats deviation-center-line_max 0.059340568830611146 deviation-center-line_mean 0.059340568830611146 deviation-center-line_min 0.059340568830611146 deviation-heading_max 0.6856080312885067 deviation-heading_mean 0.6856080312885067 deviation-heading_median 0.6856080312885067 deviation-heading_min 0.6856080312885067 distance-from-start_max 0.7234327719880624 distance-from-start_mean 0.7234327719880624 distance-from-start_median 0.7234327719880624 distance-from-start_min 0.7234327719880624 driven_any_max 0.7471869737541152 driven_any_mean 0.7471869737541152 driven_any_median 0.7471869737541152 driven_any_min 0.7471869737541152 driven_lanedir_consec_max 0.1458174872267639 driven_lanedir_consec_mean 0.1458174872267639 driven_lanedir_consec_min 0.1458174872267639 driven_lanedir_max 0.1458174872267639 driven_lanedir_mean 0.1458174872267639 driven_lanedir_median 0.1458174872267639 driven_lanedir_min 0.1458174872267639 in-drivable-lane_max 2.549999999999995 in-drivable-lane_mean 2.549999999999995 in-drivable-lane_min 2.549999999999995 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7471869737541152, "survival_time": 3.599999999999995, "driven_lanedir": 0.1458174872267639, "in-drivable-lane": 2.549999999999995, "deviation-heading": 0.6856080312885067, "distance-from-start": 0.7234327719880624, "deviation-center-line": 0.059340568830611146, "driven_lanedir_consec": 0.1458174872267639}}simulation-passed 1 survival_time_max 3.599999999999995 survival_time_mean 3.599999999999995 survival_time_min 3.599999999999995
No reset possible 16329
1809
Bea Baselines 🐤template-ros lx22-BV1
sim-0of5 success yes davinci-stage-03-6.2.51
2022-11-27 20:52:21+00:00 2022-11-27 20:54:44+00:00 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 3.123611067501419
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 3.123611067501419 distance-from-start_median 3.123611067501419 distance-from-start_min 3.123611067501419 driven_any_max 4.34083946249021 driven_any_mean 4.34083946249021 driven_any_median 4.34083946249021 driven_any_min 4.34083946249021 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 16.100000000000094 in-drivable-lane_mean 16.100000000000094 in-drivable-lane_median 16.100000000000094 in-drivable-lane_min 16.100000000000094 per-episodes details {"d30-ego0": {"driven_any": 4.34083946249021, "survival_time": 16.100000000000094, "driven_lanedir": 0.0, "in-drivable-lane": 16.100000000000094, "deviation-heading": 0.0, "distance-from-start": 3.123611067501419, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 16.100000000000094 survival_time_mean 16.100000000000094 survival_time_median 16.100000000000094 survival_time_min 16.100000000000094
No reset possible 16322
1816
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:48:46+00:00 2022-11-27 20:52:14+00:00 0:03:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.99999999999998 in-drivable-lane_median 7.049999999999979 driven_lanedir_consec_median 0.11740045883179696 deviation-center-line_median 0.05931707423839125
other stats deviation-center-line_max 0.05931707423839125 deviation-center-line_mean 0.05931707423839125 deviation-center-line_min 0.05931707423839125 deviation-heading_max 0.6860846415035129 deviation-heading_mean 0.6860846415035129 deviation-heading_median 0.6860846415035129 deviation-heading_min 0.6860846415035129 distance-from-start_max 2.156127467286299 distance-from-start_mean 2.156127467286299 distance-from-start_median 2.156127467286299 distance-from-start_min 2.156127467286299 driven_any_max 2.197835518274973 driven_any_mean 2.197835518274973 driven_any_median 2.197835518274973 driven_any_min 2.197835518274973 driven_lanedir_consec_max 0.11740045883179696 driven_lanedir_consec_mean 0.11740045883179696 driven_lanedir_consec_min 0.11740045883179696 driven_lanedir_max 0.11740045883179696 driven_lanedir_mean 0.11740045883179696 driven_lanedir_median 0.11740045883179696 driven_lanedir_min 0.11740045883179696 in-drivable-lane_max 7.049999999999979 in-drivable-lane_mean 7.049999999999979 in-drivable-lane_min 7.049999999999979 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.197835518274973, "survival_time": 7.99999999999998, "driven_lanedir": 0.11740045883179696, "in-drivable-lane": 7.049999999999979, "deviation-heading": 0.6860846415035129, "distance-from-start": 2.156127467286299, "deviation-center-line": 0.05931707423839125, "driven_lanedir_consec": 0.11740045883179696}}simulation-passed 1 survival_time_max 7.99999999999998 survival_time_mean 7.99999999999998 survival_time_min 7.99999999999998
No reset possible 16318
1817
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:46:04+00:00 2022-11-27 20:48:26+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.649999999999995 in-drivable-lane_median 2.849999999999995 driven_lanedir_consec_median 0.0958561589992546 deviation-center-line_median 0.0507509574506658
other stats deviation-center-line_max 0.0507509574506658 deviation-center-line_mean 0.0507509574506658 deviation-center-line_min 0.0507509574506658 deviation-heading_max 0.6402488650137794 deviation-heading_mean 0.6402488650137794 deviation-heading_median 0.6402488650137794 deviation-heading_min 0.6402488650137794 distance-from-start_max 0.7714151000309615 distance-from-start_mean 0.7714151000309615 distance-from-start_median 0.7714151000309615 distance-from-start_min 0.7714151000309615 driven_any_max 0.7879630940645415 driven_any_mean 0.7879630940645415 driven_any_median 0.7879630940645415 driven_any_min 0.7879630940645415 driven_lanedir_consec_max 0.0958561589992546 driven_lanedir_consec_mean 0.0958561589992546 driven_lanedir_consec_min 0.0958561589992546 driven_lanedir_max 0.0958561589992546 driven_lanedir_mean 0.0958561589992546 driven_lanedir_median 0.0958561589992546 driven_lanedir_min 0.0958561589992546 in-drivable-lane_max 2.849999999999995 in-drivable-lane_mean 2.849999999999995 in-drivable-lane_min 2.849999999999995 per-episodes details {"4way-000-ego0": {"driven_any": 0.7879630940645415, "survival_time": 3.649999999999995, "driven_lanedir": 0.0958561589992546, "in-drivable-lane": 2.849999999999995, "deviation-heading": 0.6402488650137794, "distance-from-start": 0.7714151000309615, "deviation-center-line": 0.0507509574506658, "driven_lanedir_consec": 0.0958561589992546}}simulation-passed 1 survival_time_max 3.649999999999995 survival_time_mean 3.649999999999995 survival_time_min 3.649999999999995
No reset possible 16313
1818
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:44:13+00:00 2022-11-27 20:45:44+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16310
1819
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:42:16+00:00 2022-11-27 20:44:06+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27836714090946557 survival_time_median 7.649999999999981 deviation-center-line_median 0.14982139443571937 in-drivable-lane_median 5.849999999999984
other stats deviation-center-line_max 0.14982139443571937 deviation-center-line_mean 0.14982139443571937 deviation-center-line_min 0.14982139443571937 deviation-heading_max 1.4772613338579594 deviation-heading_mean 1.4772613338579594 deviation-heading_median 1.4772613338579594 deviation-heading_min 1.4772613338579594 distance-from-start_max 2.00854819342489 distance-from-start_mean 2.00854819342489 distance-from-start_median 2.00854819342489 distance-from-start_min 2.00854819342489 driven_any_max 2.029298256692792 driven_any_mean 2.029298256692792 driven_any_median 2.029298256692792 driven_any_min 2.029298256692792 driven_lanedir_consec_max 0.27836714090946557 driven_lanedir_consec_mean 0.27836714090946557 driven_lanedir_consec_min 0.27836714090946557 driven_lanedir_max 0.27836714090946557 driven_lanedir_mean 0.27836714090946557 driven_lanedir_median 0.27836714090946557 driven_lanedir_min 0.27836714090946557 in-drivable-lane_max 5.849999999999984 in-drivable-lane_mean 5.849999999999984 in-drivable-lane_min 5.849999999999984 per-episodes details {"loop2-000-ego0": {"driven_any": 2.029298256692792, "survival_time": 7.649999999999981, "driven_lanedir": 0.27836714090946557, "in-drivable-lane": 5.849999999999984, "deviation-heading": 1.4772613338579594, "distance-from-start": 2.00854819342489, "deviation-center-line": 0.14982139443571937, "driven_lanedir_consec": 0.27836714090946557}}simulation-passed 1 survival_time_max 7.649999999999981 survival_time_mean 7.649999999999981 survival_time_min 7.649999999999981
No reset possible 16306
1820
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:40:25+00:00 2022-11-27 20:41:54+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16303
1821
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:37:15+00:00 2022-11-27 20:39:53+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.449999999999981 in-drivable-lane_median 5.499999999999982 driven_lanedir_consec_median 0.355186966444504 deviation-center-line_median 0.19359306211762045
other stats deviation-center-line_max 0.3163199861171496 deviation-center-line_mean 0.19359306211762045 deviation-center-line_min 0.07086613811809131 deviation-heading_max 1.2273780778350745 deviation-heading_mean 0.9864382197697412 deviation-heading_median 0.9864382197697412 deviation-heading_min 0.7454983617044082 distance-from-start_max 1.7332480299531736 distance-from-start_mean 1.406535848525058 distance-from-start_median 1.406535848525058 distance-from-start_min 1.0798236670969423 driven_any_max 1.8456007541388375 driven_any_mean 1.474936808055697 driven_any_median 1.474936808055697 driven_any_min 1.1042728619725564 driven_lanedir_consec_max 0.5906997013335109 driven_lanedir_consec_mean 0.355186966444504 driven_lanedir_consec_min 0.11967423155549706 driven_lanedir_max 0.5906997013335109 driven_lanedir_mean 0.355186966444504 driven_lanedir_median 0.355186966444504 driven_lanedir_min 0.11967423155549706 in-drivable-lane_max 6.4499999999999815 in-drivable-lane_mean 5.499999999999982 in-drivable-lane_min 4.549999999999984 per-episodes details {"loop2-000-ego0": {"driven_any": 1.1042728619725564, "survival_time": 7.449999999999981, "driven_lanedir": 0.11967423155549706, "in-drivable-lane": 6.4499999999999815, "deviation-heading": 0.7454983617044082, "distance-from-start": 1.0798236670969423, "deviation-center-line": 0.07086613811809131, "driven_lanedir_consec": 0.11967423155549706}, "loop2-000-ego1": {"driven_any": 1.8456007541388375, "survival_time": 7.449999999999981, "driven_lanedir": 0.5906997013335109, "in-drivable-lane": 4.549999999999984, "deviation-heading": 1.2273780778350745, "distance-from-start": 1.7332480299531736, "deviation-center-line": 0.3163199861171496, "driven_lanedir_consec": 0.5906997013335109}}simulation-passed 1 survival_time_max 7.449999999999981 survival_time_mean 7.449999999999981 survival_time_min 7.449999999999981
No reset possible 16294
1848
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success yes davinci-stage-03-6.2.51
2022-11-27 20:30:38+00:00 2022-11-27 20:36:56+00:00 0:06:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.682286588947275
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.682286588947275 distance-from-start_median 5.682286588947275 distance-from-start_min 5.682286588947275 driven_any_max 5.71549970919627 driven_any_mean 5.71549970919627 driven_any_median 5.71549970919627 driven_any_min 5.71549970919627 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 45.74999999999954 in-drivable-lane_mean 45.74999999999954 in-drivable-lane_median 45.74999999999954 in-drivable-lane_min 45.74999999999954 per-episodes details {"d50-ego0": {"driven_any": 5.71549970919627, "survival_time": 45.74999999999954, "driven_lanedir": 0.0, "in-drivable-lane": 45.74999999999954, "deviation-heading": 0.0, "distance-from-start": 5.682286588947275, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 45.74999999999954 survival_time_mean 45.74999999999954 survival_time_median 45.74999999999954 survival_time_min 45.74999999999954
No reset possible 16289
1843
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:28:52+00:00 2022-11-27 20:30:24+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16285
1844
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-3of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:27:32+00:00 2022-11-27 20:28:30+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16281
1846
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-2of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:24:31+00:00 2022-11-27 20:26:20+00:00 0:01:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16277
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-2of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:22:10+00:00 2022-11-27 20:23:51+00:00 0:01:41 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16271
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-3of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:20:59+00:00 2022-11-27 20:21:57+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16261
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success yes davinci-stage-03-6.2.51
2022-11-27 20:15:54+00:00 2022-11-27 20:20:40+00:00 0:04:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 6.341760000000476
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 6.341760000000476 distance-from-start_median 6.341760000000476 distance-from-start_min 6.341760000000476 driven_any_max 6.3417600000005665 driven_any_mean 6.3417600000005665 driven_any_median 6.3417600000005665 driven_any_min 6.3417600000005665 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 30.400000000000297 in-drivable-lane_mean 30.400000000000297 in-drivable-lane_median 30.400000000000297 in-drivable-lane_min 30.400000000000297 per-episodes details {"d50-ego0": {"driven_any": 6.3417600000005665, "survival_time": 30.400000000000297, "driven_lanedir": 0.0, "in-drivable-lane": 30.400000000000297, "deviation-heading": 0.0, "distance-from-start": 6.341760000000476, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 30.400000000000297 survival_time_mean 30.400000000000297 survival_time_median 30.400000000000297 survival_time_min 30.400000000000297
No reset possible 16258
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 aborted no davinci-stage-03-6.2.51
2022-11-27 20:14:24+00:00 2022-11-27 20:15:08+00:00 0:00:44 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16251
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:12:23+00:00 2022-11-27 20:13:54+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16248
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 20:10:37+00:00 2022-11-27 20:12:10+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16242
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-1of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:09:17+00:00 2022-11-27 20:10:16+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16237
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-3of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:08:08+00:00 2022-11-27 20:09:09+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16232
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-0of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:05:44+00:00 2022-11-27 20:07:37+00:00 0:01:53 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16229
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-0of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:04:17+00:00 2022-11-27 20:05:17+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16223
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-3of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:02:28+00:00 2022-11-27 20:04:05+00:00 0:01:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16222
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-3of4 failed yes davinci-stage-03-6.2.51
2022-11-27 20:01:01+00:00 2022-11-27 20:01:58+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16221
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-2of4 failed yes davinci-stage-03-6.2.51
2022-11-27 19:59:30+00:00 2022-11-27 20:00:51+00:00 0:01:21 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16219
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-1of4 failed yes davinci-stage-03-6.2.51
2022-11-27 19:56:14+00:00 2022-11-27 19:59:05+00:00 0:02:51 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16214
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-0of4 failed yes davinci-stage-03-6.2.51
2022-11-27 19:54:43+00:00 2022-11-27 19:55:41+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16207
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-2of4 timeout yes davinci-stage-03-6.2.51
2022-11-27 19:52:10+00:00 2022-11-27 19:54:11+00:00 0:02:01 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16204
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-03-6.2.51
2022-11-27 07:04:58+00:00 2022-11-27 07:08:04+00:00 0:03:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.094196639731773
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.094196639731773 distance-from-start_median 5.094196639731773 distance-from-start_min 5.094196639731773 driven_any_max 5.709441443209762 driven_any_mean 5.709441443209762 driven_any_median 5.709441443209762 driven_any_min 5.709441443209762 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 16.900000000000105 in-drivable-lane_mean 16.900000000000105 in-drivable-lane_median 16.900000000000105 in-drivable-lane_min 16.900000000000105 per-episodes details {"d50-ego0": {"driven_any": 5.709441443209762, "survival_time": 16.900000000000105, "driven_lanedir": 0.0, "in-drivable-lane": 16.900000000000105, "deviation-heading": 0.0, "distance-from-start": 5.094196639731773, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 16.900000000000105 survival_time_mean 16.900000000000105 survival_time_median 16.900000000000105 survival_time_min 16.900000000000105
No reset possible 16195
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-03-6.2.51
2022-11-27 03:48:08+00:00 2022-11-27 03:55:23+00:00 0:07:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16190
1593
Andrea Daniele planning-exercise lx22-planning-dd-empty-test
step1 success yes davinci-stage-03-6.2.51
2022-11-27 00:47:19+00:00 2022-11-27 01:03:54+00:00 0:16:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.9629629629629628 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16185
1592
Andrea Daniele planning-exercise lx22-planning-dd-static-test
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:42:59+00:00 2022-11-27 00:47:06+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16182
1585
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-vali
step1-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:40:00+00:00 2022-11-27 00:42:40+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16181
1585
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-vali
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:39:25+00:00 2022-11-27 00:39:53+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16177
1594
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-test
step1-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:36:12+00:00 2022-11-27 00:38:52+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16173
1595
Andrea Daniele planning-exercise lx22-planning-cc-static-test
step1-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:33:29+00:00 2022-11-27 00:35:51+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16172
1595
Andrea Daniele planning-exercise lx22-planning-cc-static-test
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:32:35+00:00 2022-11-27 00:33:09+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16171
1595
Andrea Daniele planning-exercise lx22-planning-cc-static-test
step1-1of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:31:39+00:00 2022-11-27 00:32:07+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16164
1588
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-vali
step1-0of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:28:53+00:00 2022-11-27 00:31:31+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16160
1589
Andrea Daniele planning-exercise lx22-planning-cc-static-vali
step1-3of4 success yes davinci-stage-03-6.2.51
2022-11-27 00:27:35+00:00 2022-11-27 00:28:24+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16155
1584
Andrea Censi exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-03-6.2.51
2022-11-26 23:25:56+00:00 2022-11-26 23:35:40+00:00 0:09:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16151
1576
Andrea Censi planning-exercise lx22-planning-dd-dynamic-test
step1-0of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:44:52+00:00 2022-11-26 22:47:46+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16150
1576
Andrea Censi planning-exercise lx22-planning-dd-dynamic-test
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:43:48+00:00 2022-11-26 22:44:35+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16149
1583
Andrea Censi collision-check-exercise lx22-collision-check-test
step1 success yes davinci-stage-03-6.2.51
2022-11-26 22:42:33+00:00 2022-11-26 22:43:34+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate 0.53 false_positive_rate 0.42
other stats No reset possible 16134
1579
Andrea Censi planning-exercise lx22-planning-cc-dynamic-test
step1-2of4 error yes davinci-stage-03-6.2.51
2022-11-26 22:25:05+00:00 2022-11-26 22:42:05+00:00 0:17:00 Waited 1000 seconds [...] Waited 1000 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16131
1579
Andrea Censi planning-exercise lx22-planning-cc-dynamic-test
step1-1of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:23:50+00:00 2022-11-26 22:24:38+00:00 0:00:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16130
1580
Andrea Censi planning-exercise lx22-planning-cc-static-test
step1-1of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:22:40+00:00 2022-11-26 22:23:36+00:00 0:00:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16128
1580
Andrea Censi planning-exercise lx22-planning-cc-static-test
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:21:25+00:00 2022-11-26 22:22:12+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16127
1580
Andrea Censi planning-exercise lx22-planning-cc-static-test
step1-3of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:20:07+00:00 2022-11-26 22:20:55+00:00 0:00:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16125
1573
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-1of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:19:00+00:00 2022-11-26 22:19:48+00:00 0:00:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16122
1573
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-2of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:17:57+00:00 2022-11-26 22:18:46+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16117
1574
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-1of4 success yes davinci-stage-03-6.2.51
2022-11-26 22:14:47+00:00 2022-11-26 22:17:29+00:00 0:02:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16110
1559
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-3of4 failed yes davinci-stage-03-6.2.51
2022-11-26 20:59:41+00:00 2022-11-26 21:00:19+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16105
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-3of4 failed yes davinci-stage-03-6.2.51
2022-11-26 20:58:30+00:00 2022-11-26 20:59:12+00:00 0:00:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16101
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-0of4 failed yes davinci-stage-03-6.2.51
2022-11-26 20:57:45+00:00 2022-11-26 20:58:25+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16095
1562
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-0of4 failed yes davinci-stage-03-6.2.51
2022-11-26 20:54:06+00:00 2022-11-26 20:57:19+00:00 0:03:13 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16092
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-03-6.2.51
2022-11-26 19:41:58+00:00 2022-11-26 19:51:20+00:00 0:09:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16086
1556
Frank (Chude) Qian exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-03-6.2.51
2022-11-26 19:18:06+00:00 2022-11-26 19:26:58+00:00 0:08:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16082
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 host-error no davinci-stage-03-6.2.51
2022-11-25 17:19:02+00:00 2022-11-25 17:20:46+00:00 0:01:44 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-03-6.2.51-job16082-680859, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.51-job16082-680859', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16075
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 16:26:15+00:00 2022-11-25 17:00:32+00:00 0:34:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 25.14999999999937 driven_lanedir_consec_median -3.737936363796966 deviation-center-line_median 2.858609940652501
other stats deviation-center-line_max 6.096434560097759 deviation-center-line_mean 3.511994979674815 deviation-center-line_min 2.234325477296499 deviation-heading_max 35.322943486303124 deviation-heading_mean 29.274472894393472 deviation-heading_median 27.740958705116405 deviation-heading_min 26.29303068103796 distance-from-start_max 0.18876591577595633 distance-from-start_mean 0.1803459748306426 distance-from-start_median 0.18372597034042837 distance-from-start_min 0.16516604286575734 driven_any_max 14.470738268243862 driven_any_mean 12.539467981626954 driven_any_median 12.304531656727342 driven_any_min 11.078070344809271 driven_lanedir_consec_max -3.0119939024918416 driven_lanedir_consec_mean -3.7239506292148024 driven_lanedir_consec_min -4.407935886773436 driven_lanedir_max -3.0119939024918416 driven_lanedir_mean -4.94226517242592 driven_lanedir_median -4.018656293106822 driven_lanedir_min -8.71975420099819 in-drivable-lane_max 28.29999999999935 in-drivable-lane_mean 21.662499999999476 in-drivable-lane_min 8.04999999999982 per-episodes details {"autolab-000-ego0": {"driven_any": 11.900860712247868, "survival_time": 59.99999999999873, "driven_lanedir": -3.877620876267077, "in-drivable-lane": 25.149999999999352, "deviation-heading": 28.450539616263, "distance-from-start": 0.1786902754096685, "deviation-center-line": 2.5643261674917945, "driven_lanedir_consec": -3.5130189200623496}, "autolab-000-ego1": {"driven_any": 11.078070344809271, "survival_time": 59.99999999999873, "driven_lanedir": -3.0119939024918416, "in-drivable-lane": 25.14999999999938, "deviation-heading": 27.03137779396981, "distance-from-start": 0.18876166527118823, "deviation-center-line": 3.1528937138132074, "driven_lanedir_consec": -3.0119939024918416}, "autolab-000-ego2": {"driven_any": 14.470738268243862, "survival_time": 59.99999999999873, "driven_lanedir": -8.71975420099819, "in-drivable-lane": 8.04999999999982, "deviation-heading": 35.322943486303124, "distance-from-start": 0.18876591577595633, "deviation-center-line": 6.096434560097759, "driven_lanedir_consec": -4.407935886773436}, "autolab-000-ego3": {"driven_any": 12.708202601206814, "survival_time": 59.99999999999873, "driven_lanedir": -4.159691709946569, "in-drivable-lane": 28.29999999999935, "deviation-heading": 26.29303068103796, "distance-from-start": 0.16516604286575734, "deviation-center-line": 2.234325477296499, "driven_lanedir_consec": -3.962853807531582}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16071
386
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 16:18:17+00:00 2022-11-25 16:25:51+00:00 0:07:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 21.699999999999513 driven_lanedir_consec_median -2.3582709483885766 deviation-center-line_median 3.065511986747849
other stats deviation-center-line_max 3.065511986747849 deviation-center-line_mean 3.065511986747849 deviation-center-line_min 3.065511986747849 deviation-heading_max 28.45705063837741 deviation-heading_mean 28.45705063837741 deviation-heading_median 28.45705063837741 deviation-heading_min 28.45705063837741 distance-from-start_max 0.2035327852024029 distance-from-start_mean 0.2035327852024029 distance-from-start_median 0.2035327852024029 distance-from-start_min 0.2035327852024029 driven_any_max 10.213750370739987 driven_any_mean 10.213750370739987 driven_any_median 10.213750370739987 driven_any_min 10.213750370739987 driven_lanedir_consec_max -2.3582709483885766 driven_lanedir_consec_mean -2.3582709483885766 driven_lanedir_consec_min -2.3582709483885766 driven_lanedir_max -2.3582709483885766 driven_lanedir_mean -2.3582709483885766 driven_lanedir_median -2.3582709483885766 driven_lanedir_min -2.3582709483885766 in-drivable-lane_max 21.699999999999513 in-drivable-lane_mean 21.699999999999513 in-drivable-lane_min 21.699999999999513 per-episodes details {"loop2-000-ego0": {"driven_any": 10.213750370739987, "survival_time": 59.99999999999873, "driven_lanedir": -2.3582709483885766, "in-drivable-lane": 21.699999999999513, "deviation-heading": 28.45705063837741, "distance-from-start": 0.2035327852024029, "deviation-center-line": 3.065511986747849, "driven_lanedir_consec": -2.3582709483885766}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16066
388
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 15:59:57+00:00 2022-11-25 16:17:45+00:00 0:17:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 25.099999999999465 driven_lanedir_consec_median -4.1358578290560235 deviation-center-line_median 2.534905247462591
other stats deviation-center-line_max 2.534905247462591 deviation-center-line_mean 2.534905247462591 deviation-center-line_min 2.534905247462591 deviation-heading_max 28.344907365725245 deviation-heading_mean 28.344907365725245 deviation-heading_median 28.344907365725245 deviation-heading_min 28.344907365725245 distance-from-start_max 0.25624319293874853 distance-from-start_mean 0.25624319293874853 distance-from-start_median 0.25624319293874853 distance-from-start_min 0.25624319293874853 driven_any_max 14.17917291524884 driven_any_mean 14.17917291524884 driven_any_median 14.17917291524884 driven_any_min 14.17917291524884 driven_lanedir_consec_max -4.1358578290560235 driven_lanedir_consec_mean -4.1358578290560235 driven_lanedir_consec_min -4.1358578290560235 driven_lanedir_max -4.629994795757691 driven_lanedir_mean -4.629994795757691 driven_lanedir_median -4.629994795757691 driven_lanedir_min -4.629994795757691 in-drivable-lane_max 25.099999999999465 in-drivable-lane_mean 25.099999999999465 in-drivable-lane_min 25.099999999999465 per-episodes details {"4way-000-ego0": {"driven_any": 14.17917291524884, "survival_time": 59.99999999999873, "driven_lanedir": -4.629994795757691, "in-drivable-lane": 25.099999999999465, "deviation-heading": 28.344907365725245, "distance-from-start": 0.25624319293874853, "deviation-center-line": 2.534905247462591, "driven_lanedir_consec": -4.1358578290560235}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16060
389
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 15:50:08+00:00 2022-11-25 15:59:50+00:00 0:09:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 25.34999999999936 driven_lanedir_consec_median -3.820982336600986 deviation-center-line_median 2.9643585896922726
other stats deviation-center-line_max 2.9643585896922726 deviation-center-line_mean 2.9643585896922726 deviation-center-line_min 2.9643585896922726 deviation-heading_max 28.40386938632571 deviation-heading_mean 28.40386938632571 deviation-heading_median 28.40386938632571 deviation-heading_min 28.40386938632571 distance-from-start_max 0.2291652144664277 distance-from-start_mean 0.2291652144664277 distance-from-start_median 0.2291652144664277 distance-from-start_min 0.2291652144664277 driven_any_max 12.813171569980552 driven_any_mean 12.813171569980552 driven_any_median 12.813171569980552 driven_any_min 12.813171569980552 driven_lanedir_consec_max -3.820982336600986 driven_lanedir_consec_mean -3.820982336600986 driven_lanedir_consec_min -3.820982336600986 driven_lanedir_max -4.172829879310328 driven_lanedir_mean -4.172829879310328 driven_lanedir_median -4.172829879310328 driven_lanedir_min -4.172829879310328 in-drivable-lane_max 25.34999999999936 in-drivable-lane_mean 25.34999999999936 in-drivable-lane_min 25.34999999999936 per-episodes details {"udem1-000-ego0": {"driven_any": 12.813171569980552, "survival_time": 59.99999999999873, "driven_lanedir": -4.172829879310328, "in-drivable-lane": 25.34999999999936, "deviation-heading": 28.40386938632571, "distance-from-start": 0.2291652144664277, "deviation-center-line": 2.9643585896922726, "driven_lanedir_consec": -3.820982336600986}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16058
389
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 15:48:02+00:00 2022-11-25 15:49:45+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16048
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 15:13:01+00:00 2022-11-25 15:47:54+00:00 0:34:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 34.249999999999105 driven_lanedir_consec_median -2.6694944678338226 deviation-center-line_median 2.405521775635835
other stats deviation-center-line_max 2.7286615302082686 deviation-center-line_mean 2.349466205404397 deviation-center-line_min 1.8581597401376504 deviation-heading_max 27.82149612644852 deviation-heading_mean 24.044289748631087 deviation-heading_median 23.528260963666785 deviation-heading_min 21.29914094074225 distance-from-start_max 0.17646020416603256 distance-from-start_mean 0.16137983321585173 distance-from-start_median 0.16041062562411618 distance-from-start_min 0.148237877449142 driven_any_max 12.491889690813045 driven_any_mean 11.59554920776644 driven_any_median 11.891874649942444 driven_any_min 10.106557840367833 driven_lanedir_consec_max -1.7400107870114063 driven_lanedir_consec_mean -2.703603662186848 driven_lanedir_consec_min -3.7354149260683407 driven_lanedir_max -1.7400107870114063 driven_lanedir_mean -2.78766530700623 driven_lanedir_median -2.6694944678338226 driven_lanedir_min -4.071661505345869 in-drivable-lane_max 37.649999999999025 in-drivable-lane_mean 33.26249999999915 in-drivable-lane_min 26.899999999999352 per-episodes details {"autolab-000-ego0": {"driven_any": 11.930500466585732, "survival_time": 59.99999999999873, "driven_lanedir": -3.1960961406335837, "in-drivable-lane": 31.749999999999297, "deviation-heading": 25.550365203018, "distance-from-start": 0.15856447905993465, "deviation-center-line": 2.7286615302082686, "driven_lanedir_consec": -3.1960961406335837}, "autolab-000-ego1": {"driven_any": 10.106557840367833, "survival_time": 59.99999999999873, "driven_lanedir": -1.7400107870114063, "in-drivable-lane": 37.649999999999025, "deviation-heading": 21.29914094074225, "distance-from-start": 0.148237877449142, "deviation-center-line": 2.3417381068749075, "driven_lanedir_consec": -1.7400107870114063}, "autolab-000-ego2": {"driven_any": 12.491889690813045, "survival_time": 59.99999999999873, "driven_lanedir": -4.071661505345869, "in-drivable-lane": 26.899999999999352, "deviation-heading": 27.82149612644852, "distance-from-start": 0.17646020416603256, "deviation-center-line": 1.8581597401376504, "driven_lanedir_consec": -3.7354149260683407}, "autolab-000-ego3": {"driven_any": 11.853248833299151, "survival_time": 59.99999999999873, "driven_lanedir": -2.142892795034061, "in-drivable-lane": 36.74999999999891, "deviation-heading": 21.50615672431557, "distance-from-start": 0.16225677218829768, "deviation-center-line": 2.469305444396762, "driven_lanedir_consec": -2.142892795034061}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16040
394
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 14:52:32+00:00 2022-11-25 15:12:45+00:00 0:20:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 25.749999999999456 driven_lanedir_consec_median -3.8187352764530975 deviation-center-line_median 2.645349763598596
other stats deviation-center-line_max 2.645349763598596 deviation-center-line_mean 2.645349763598596 deviation-center-line_min 2.645349763598596 deviation-heading_max 28.986151177948987 deviation-heading_mean 28.986151177948987 deviation-heading_median 28.986151177948987 deviation-heading_min 28.986151177948987 distance-from-start_max 0.16303424924766313 distance-from-start_mean 0.16303424924766313 distance-from-start_median 0.16303424924766313 distance-from-start_min 0.16303424924766313 driven_any_max 11.210489845224918 driven_any_mean 11.210489845224918 driven_any_median 11.210489845224918 driven_any_min 11.210489845224918 driven_lanedir_consec_max -3.8187352764530975 driven_lanedir_consec_mean -3.8187352764530975 driven_lanedir_consec_min -3.8187352764530975 driven_lanedir_max -3.8187352764530975 driven_lanedir_mean -3.8187352764530975 driven_lanedir_median -3.8187352764530975 driven_lanedir_min -3.8187352764530975 in-drivable-lane_max 25.749999999999456 in-drivable-lane_mean 25.749999999999456 in-drivable-lane_min 25.749999999999456 per-episodes details {"zigzag-000-ego0": {"driven_any": 11.210489845224918, "survival_time": 59.99999999999873, "driven_lanedir": -3.8187352764530975, "in-drivable-lane": 25.749999999999456, "deviation-heading": 28.986151177948987, "distance-from-start": 0.16303424924766313, "deviation-center-line": 2.645349763598596, "driven_lanedir_consec": -3.8187352764530975}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16038
394
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 14:48:22+00:00 2022-11-25 14:52:18+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.199999999999996 in-drivable-lane_median 4.399999999999987 driven_lanedir_consec_median -0.5762860121358497 deviation-center-line_median 0.1891075292075373
other stats deviation-center-line_max 0.1891075292075373 deviation-center-line_mean 0.1891075292075373 deviation-center-line_min 0.1891075292075373 deviation-heading_max 3.731673308920557 deviation-heading_mean 3.731673308920557 deviation-heading_median 3.731673308920557 deviation-heading_min 3.731673308920557 distance-from-start_max 0.14768153616305996 distance-from-start_mean 0.14768153616305996 distance-from-start_median 0.14768153616305996 distance-from-start_min 0.14768153616305996 driven_any_max 1.699534586140817 driven_any_mean 1.699534586140817 driven_any_median 1.699534586140817 driven_any_min 1.699534586140817 driven_lanedir_consec_max -0.5762860121358497 driven_lanedir_consec_mean -0.5762860121358497 driven_lanedir_consec_min -0.5762860121358497 driven_lanedir_max -0.5762860121358497 driven_lanedir_mean -0.5762860121358497 driven_lanedir_median -0.5762860121358497 driven_lanedir_min -0.5762860121358497 in-drivable-lane_max 4.399999999999987 in-drivable-lane_mean 4.399999999999987 in-drivable-lane_min 4.399999999999987 per-episodes details {"loop-000-ego0": {"driven_any": 1.699534586140817, "survival_time": 9.199999999999996, "driven_lanedir": -0.5762860121358497, "in-drivable-lane": 4.399999999999987, "deviation-heading": 3.731673308920557, "distance-from-start": 0.14768153616305996, "deviation-center-line": 0.1891075292075373, "driven_lanedir_consec": -0.5762860121358497}}simulation-passed 1 survival_time_max 9.199999999999996 survival_time_mean 9.199999999999996 survival_time_min 9.199999999999996
No reset possible 16033
396
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 14:38:15+00:00 2022-11-25 14:48:04+00:00 0:09:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 33.84999999999915 driven_lanedir_consec_median -2.7075699907715687 deviation-center-line_median 2.516226315024263
other stats deviation-center-line_max 2.516226315024263 deviation-center-line_mean 2.516226315024263 deviation-center-line_min 2.516226315024263 deviation-heading_max 24.784036788727068 deviation-heading_mean 24.784036788727068 deviation-heading_median 24.784036788727068 deviation-heading_min 24.784036788727068 distance-from-start_max 0.18149308035837972 distance-from-start_mean 0.18149308035837972 distance-from-start_median 0.18149308035837972 distance-from-start_min 0.18149308035837972 driven_any_max 11.8562856538058 driven_any_mean 11.8562856538058 driven_any_median 11.8562856538058 driven_any_min 11.8562856538058 driven_lanedir_consec_max -2.7075699907715687 driven_lanedir_consec_mean -2.7075699907715687 driven_lanedir_consec_min -2.7075699907715687 driven_lanedir_max -2.7075699907715687 driven_lanedir_mean -2.7075699907715687 driven_lanedir_median -2.7075699907715687 driven_lanedir_min -2.7075699907715687 in-drivable-lane_max 33.84999999999915 in-drivable-lane_mean 33.84999999999915 in-drivable-lane_min 33.84999999999915 per-episodes details {"udem1-000-ego0": {"driven_any": 11.8562856538058, "survival_time": 59.99999999999873, "driven_lanedir": -2.7075699907715687, "in-drivable-lane": 33.84999999999915, "deviation-heading": 24.784036788727068, "distance-from-start": 0.18149308035837972, "deviation-center-line": 2.516226315024263, "driven_lanedir_consec": -2.7075699907715687}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16031
396
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 14:36:27+00:00 2022-11-25 14:37:56+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16028
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 14:34:54+00:00 2022-11-25 14:36:08+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16023
514
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:33:34+00:00 2022-11-25 14:34:47+00:00 0:01:13 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16019
515
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:32:25+00:00 2022-11-25 14:33:21+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16015
516
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:30:36+00:00 2022-11-25 14:32:05+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16010
518
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:28:50+00:00 2022-11-25 14:30:16+00:00 0:01:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16005
519
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-validation
sim-2of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:27:38+00:00 2022-11-25 14:28:36+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16001
519
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:26:27+00:00 2022-11-25 14:27:22+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15998
520
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:25:02+00:00 2022-11-25 14:26:13+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15994
521
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-testing
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:23:37+00:00 2022-11-25 14:24:54+00:00 0:01:17 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15989
523
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-testing
sim-2of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:21:42+00:00 2022-11-25 14:23:29+00:00 0:01:47 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15986
523
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-testing
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:19:58+00:00 2022-11-25 14:21:33+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15983
524
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 14:18:05+00:00 2022-11-25 14:19:36+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15980
525
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:16:29+00:00 2022-11-25 14:17:59+00:00 0:01:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15978
525
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-testing
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:14:34+00:00 2022-11-25 14:16:09+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15976
527
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 14:13:05+00:00 2022-11-25 14:14:21+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15975
527
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:11:01+00:00 2022-11-25 14:12:35+00:00 0:01:34 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15974
527
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 14:09:16+00:00 2022-11-25 14:10:32+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15973
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 14:07:36+00:00 2022-11-25 14:08:46+00:00 0:01:10 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15968
529
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 14:03:00+00:00 2022-11-25 14:07:20+00:00 0:04:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.499999999999666 in-drivable-lane_median 16.04999999999949 driven_lanedir_consec_median 4.3285758645895624 deviation-center-line_median 2.1396096627710643
other stats deviation-center-line_max 2.1396096627710643 deviation-center-line_mean 2.1396096627710643 deviation-center-line_min 2.1396096627710643 deviation-heading_max 12.224935652990435 deviation-heading_mean 12.224935652990435 deviation-heading_median 12.224935652990435 deviation-heading_min 12.224935652990435 distance-from-start_max 1.599720056942492 distance-from-start_mean 1.599720056942492 distance-from-start_median 1.599720056942492 distance-from-start_min 1.599720056942492 driven_any_max 8.10718952484514 driven_any_mean 8.10718952484514 driven_any_median 8.10718952484514 driven_any_min 8.10718952484514 driven_lanedir_consec_max 4.3285758645895624 driven_lanedir_consec_mean 4.3285758645895624 driven_lanedir_consec_min 4.3285758645895624 driven_lanedir_max 4.3285758645895624 driven_lanedir_mean 4.3285758645895624 driven_lanedir_median 4.3285758645895624 driven_lanedir_min 4.3285758645895624 in-drivable-lane_max 16.04999999999949 in-drivable-lane_mean 16.04999999999949 in-drivable-lane_min 16.04999999999949 per-episodes details {"loop2-000-ego0": {"driven_any": 8.10718952484514, "survival_time": 43.499999999999666, "driven_lanedir": 4.3285758645895624, "in-drivable-lane": 16.04999999999949, "deviation-heading": 12.224935652990435, "distance-from-start": 1.599720056942492, "deviation-center-line": 2.1396096627710643, "driven_lanedir_consec": 4.3285758645895624}}simulation-passed 1 survival_time_max 43.499999999999666 survival_time_mean 43.499999999999666 survival_time_min 43.499999999999666
No reset possible 15962
530
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 13:55:59+00:00 2022-11-25 14:02:32+00:00 0:06:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.450000000000284 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.76106227195214 deviation-center-line_median 1.2962217143154684
other stats deviation-center-line_max 1.2962217143154684 deviation-center-line_mean 1.2962217143154684 deviation-center-line_min 1.2962217143154684 deviation-heading_max 6.444222046936028 deviation-heading_mean 6.444222046936028 deviation-heading_median 6.444222046936028 deviation-heading_min 6.444222046936028 distance-from-start_max 2.3431398413938047 distance-from-start_mean 2.3431398413938047 distance-from-start_median 2.3431398413938047 distance-from-start_min 2.3431398413938047 driven_any_max 4.994067872410223 driven_any_mean 4.994067872410223 driven_any_median 4.994067872410223 driven_any_min 4.994067872410223 driven_lanedir_consec_max 4.76106227195214 driven_lanedir_consec_mean 4.76106227195214 driven_lanedir_consec_min 4.76106227195214 driven_lanedir_max 4.76106227195214 driven_lanedir_mean 4.76106227195214 driven_lanedir_median 4.76106227195214 driven_lanedir_min 4.76106227195214 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 4.994067872410223, "survival_time": 29.450000000000284, "driven_lanedir": 4.76106227195214, "in-drivable-lane": 0.0, "deviation-heading": 6.444222046936028, "distance-from-start": 2.3431398413938047, "deviation-center-line": 1.2962217143154684, "driven_lanedir_consec": 4.76106227195214}}simulation-passed 1 survival_time_max 29.450000000000284 survival_time_mean 29.450000000000284 survival_time_min 29.450000000000284
No reset possible 15958
531
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 13:54:01+00:00 2022-11-25 13:55:52+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15944
535
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 13:34:21+00:00 2022-11-25 13:53:46+00:00 0:19:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.549999999999998 driven_lanedir_consec_median 9.327434968144065 deviation-center-line_median 2.817941526172745
other stats deviation-center-line_max 2.9777619577802956 deviation-center-line_mean 2.8076844045299363 deviation-center-line_min 2.61709260799396 deviation-heading_max 17.17772001050437 deviation-heading_mean 14.994471443185558 deviation-heading_median 14.46648990256414 deviation-heading_min 13.867185957109584 distance-from-start_max 3.2515347840230957 distance-from-start_mean 2.5107132200489857 distance-from-start_median 2.448949982858853 distance-from-start_min 1.8934181304551416 driven_any_max 10.193737678489445 driven_any_mean 9.94055539689568 driven_any_median 9.962664674882811 driven_any_min 9.643154559327646 driven_lanedir_consec_max 9.497126320841865 driven_lanedir_consec_mean 9.210410515967157 driven_lanedir_consec_min 8.689645806738632 driven_lanedir_max 9.497126320841865 driven_lanedir_mean 9.210410515967157 driven_lanedir_median 9.327434968144065 driven_lanedir_min 8.689645806738632 in-drivable-lane_max 5.249999999999801 in-drivable-lane_mean 1.5874999999999493 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 10.1517675557512, "survival_time": 59.99999999999873, "driven_lanedir": 8.689645806738632, "in-drivable-lane": 5.249999999999801, "deviation-heading": 17.17772001050437, "distance-from-start": 3.2515347840230957, "deviation-center-line": 2.9295656995716297, "driven_lanedir_consec": 8.689645806738632}, "loop-000-ego1": {"driven_any": 9.643154559327646, "survival_time": 59.99999999999873, "driven_lanedir": 9.262887147012671, "in-drivable-lane": 0.0, "deviation-heading": 13.867185957109584, "distance-from-start": 2.4398223787655917, "deviation-center-line": 2.61709260799396, "driven_lanedir_consec": 9.262887147012671}, "loop-000-ego2": {"driven_any": 9.773561794014428, "survival_time": 59.99999999999873, "driven_lanedir": 9.391982789275454, "in-drivable-lane": 0.0, "deviation-heading": 13.993365840109693, "distance-from-start": 2.4580775869521134, "deviation-center-line": 2.7063173527738607, "driven_lanedir_consec": 9.391982789275454}, "loop-000-ego3": {"driven_any": 10.193737678489445, "survival_time": 59.99999999999873, "driven_lanedir": 9.497126320841865, "in-drivable-lane": 1.099999999999996, "deviation-heading": 14.939613965018587, "distance-from-start": 1.8934181304551416, "deviation-center-line": 2.9777619577802956, "driven_lanedir_consec": 9.497126320841865}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15941
536
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 13:29:53+00:00 2022-11-25 13:34:00+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.800000000000217 in-drivable-lane_median 0.350000000000005 driven_lanedir_consec_median 3.277651687755331 deviation-center-line_median 0.9642151946696348
other stats deviation-center-line_max 0.9642151946696348 deviation-center-line_mean 0.9642151946696348 deviation-center-line_min 0.9642151946696348 deviation-heading_max 5.9424099793768645 deviation-heading_mean 5.9424099793768645 deviation-heading_median 5.9424099793768645 deviation-heading_min 5.9424099793768645 distance-from-start_max 2.225673550019025 distance-from-start_mean 2.225673550019025 distance-from-start_median 2.225673550019025 distance-from-start_min 2.225673550019025 driven_any_max 3.490435690551515 driven_any_mean 3.490435690551515 driven_any_median 3.490435690551515 driven_any_min 3.490435690551515 driven_lanedir_consec_max 3.277651687755331 driven_lanedir_consec_mean 3.277651687755331 driven_lanedir_consec_min 3.277651687755331 driven_lanedir_max 3.277651687755331 driven_lanedir_mean 3.277651687755331 driven_lanedir_median 3.277651687755331 driven_lanedir_min 3.277651687755331 in-drivable-lane_max 0.350000000000005 in-drivable-lane_mean 0.350000000000005 in-drivable-lane_min 0.350000000000005 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.490435690551515, "survival_time": 24.800000000000217, "driven_lanedir": 3.277651687755331, "in-drivable-lane": 0.350000000000005, "deviation-heading": 5.9424099793768645, "distance-from-start": 2.225673550019025, "deviation-center-line": 0.9642151946696348, "driven_lanedir_consec": 3.277651687755331}}simulation-passed 1 survival_time_max 24.800000000000217 survival_time_mean 24.800000000000217 survival_time_min 24.800000000000217
No reset possible 15936
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 13:20:25+00:00 2022-11-25 13:29:13+00:00 0:08:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.349999999999675 in-drivable-lane_median 0.0 driven_lanedir_consec_median 7.34781630595053 deviation-center-line_median 1.9379298604619957
other stats deviation-center-line_max 1.9379298604619957 deviation-center-line_mean 1.9379298604619957 deviation-center-line_min 1.9379298604619957 deviation-heading_max 10.123344575186158 deviation-heading_mean 10.123344575186158 deviation-heading_median 10.123344575186158 deviation-heading_min 10.123344575186158 distance-from-start_max 2.9347469640206505 distance-from-start_mean 2.9347469640206505 distance-from-start_median 2.9347469640206505 distance-from-start_min 2.9347469640206505 driven_any_max 7.636068913955206 driven_any_mean 7.636068913955206 driven_any_median 7.636068913955206 driven_any_min 7.636068913955206 driven_lanedir_consec_max 7.34781630595053 driven_lanedir_consec_mean 7.34781630595053 driven_lanedir_consec_min 7.34781630595053 driven_lanedir_max 7.34781630595053 driven_lanedir_mean 7.34781630595053 driven_lanedir_median 7.34781630595053 driven_lanedir_min 7.34781630595053 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 7.636068913955206, "survival_time": 43.349999999999675, "driven_lanedir": 7.34781630595053, "in-drivable-lane": 0.0, "deviation-heading": 10.123344575186158, "distance-from-start": 2.9347469640206505, "deviation-center-line": 1.9379298604619957, "driven_lanedir_consec": 7.34781630595053}}simulation-passed 1 survival_time_max 43.349999999999675 survival_time_mean 43.349999999999675 survival_time_min 43.349999999999675
No reset possible 15921
542
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 13:03:24+00:00 2022-11-25 13:20:08+00:00 0:16:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.12500000000000178 driven_lanedir_consec_median 1.5464274188828693 deviation-center-line_median 3.88834571803374
other stats deviation-center-line_max 5.995298609068646 deviation-center-line_mean 3.5478165269827704 deviation-center-line_min 0.4192760627949571 deviation-heading_max 29.305482154495444 deviation-heading_mean 18.130496641203436 deviation-heading_median 20.350561502939556 deviation-heading_min 2.5153814044391813 distance-from-start_max 3.2467912652463076 distance-from-start_mean 1.7341174593477984 distance-from-start_median 1.3928032994319903 distance-from-start_min 0.9040719732809048 driven_any_max 9.786393679394576 driven_any_mean 3.594881927408283 driven_any_median 1.6569576809611193 driven_any_min 1.2792186683163185 driven_lanedir_consec_max 8.404094934578325 driven_lanedir_consec_mean 3.182119562199702 driven_lanedir_consec_min 1.231528476454744 driven_lanedir_max 9.26732996620705 driven_lanedir_mean 3.400988916565156 driven_lanedir_median 1.5525486117994147 driven_lanedir_min 1.231528476454744 in-drivable-lane_max 49.89999999999872 in-drivable-lane_mean 12.537499999999682 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 9.786393679394576, "survival_time": 59.99999999999873, "driven_lanedir": 9.26732996620705, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 13.442052170002745, "distance-from-start": 3.2467912652463076, "deviation-center-line": 3.0040417567289825, "driven_lanedir_consec": 8.404094934578325}, "udem-000-ego1": {"driven_any": 1.2792186683163185, "survival_time": 59.99999999999873, "driven_lanedir": 1.231528476454744, "in-drivable-lane": 0.0, "deviation-heading": 29.305482154495444, "distance-from-start": 0.9040719732809048, "deviation-center-line": 5.995298609068646, "driven_lanedir_consec": 1.231528476454744}, "udem-000-ego2": {"driven_any": 1.6352488715529498, "survival_time": 59.99999999999873, "driven_lanedir": 1.5018498794210051, "in-drivable-lane": 49.89999999999872, "deviation-heading": 2.5153814044391813, "distance-from-start": 1.1836507602679311, "deviation-center-line": 0.4192760627949571, "driven_lanedir_consec": 1.4909740024266485}, "udem-000-ego3": {"driven_any": 1.6786664903692887, "survival_time": 59.99999999999873, "driven_lanedir": 1.6032473441778243, "in-drivable-lane": 0.0, "deviation-heading": 27.25907083587637, "distance-from-start": 1.6019558385960495, "deviation-center-line": 4.772649679338497, "driven_lanedir_consec": 1.60188083533909}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15914
763
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035 aido-hello-sim-validation
sanity-check success no davinci-stage-03-6.2.51
2022-11-25 13:01:48+00:00 2022-11-25 13:02:57+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.041386855198155104 deviation-center-line_median 0.006494610833933571
other stats deviation-center-line_max 0.006494610833933571 deviation-center-line_mean 0.006494610833933571 deviation-center-line_min 0.006494610833933571 deviation-heading_max 0.293581787588131 deviation-heading_mean 0.293581787588131 deviation-heading_median 0.293581787588131 deviation-heading_min 0.293581787588131 distance-from-start_max 0.051680541900992145 distance-from-start_mean 0.051680541900992145 distance-from-start_median 0.051680541900992145 distance-from-start_min 0.051680541900992145 driven_any_max 0.05173433573782145 driven_any_mean 0.05173433573782145 driven_any_median 0.05173433573782145 driven_any_min 0.05173433573782145 driven_lanedir_consec_max 0.041386855198155104 driven_lanedir_consec_mean 0.041386855198155104 driven_lanedir_consec_min 0.041386855198155104 driven_lanedir_max 0.041386855198155104 driven_lanedir_mean 0.041386855198155104 driven_lanedir_median 0.041386855198155104 driven_lanedir_min 0.041386855198155104 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.05173433573782145, "survival_time": 0.49999999999999994, "driven_lanedir": 0.041386855198155104, "in-drivable-lane": 0.0, "deviation-heading": 0.293581787588131, "distance-from-start": 0.051680541900992145, "deviation-center-line": 0.006494610833933571, "driven_lanedir_consec": 0.041386855198155104}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15908
791
Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71d aido-hello-sim-validation
sanity-check success no davinci-stage-03-6.2.51
2022-11-25 13:00:19+00:00 2022-11-25 13:01:34+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.009295559539588494 deviation-center-line_median 0.007006772765454841
other stats deviation-center-line_max 0.007006772765454841 deviation-center-line_mean 0.007006772765454841 deviation-center-line_min 0.007006772765454841 deviation-heading_max 0.26302297782027906 deviation-heading_mean 0.26302297782027906 deviation-heading_median 0.26302297782027906 deviation-heading_min 0.26302297782027906 distance-from-start_max 0.010491969616325947 distance-from-start_mean 0.010491969616325947 distance-from-start_median 0.010491969616325947 distance-from-start_min 0.010491969616325947 driven_any_max 0.010496600675557183 driven_any_mean 0.010496600675557183 driven_any_median 0.010496600675557183 driven_any_min 0.010496600675557183 driven_lanedir_consec_max 0.009295559539588494 driven_lanedir_consec_mean 0.009295559539588494 driven_lanedir_consec_min 0.009295559539588494 driven_lanedir_max 0.009295559539588494 driven_lanedir_mean 0.009295559539588494 driven_lanedir_median 0.009295559539588494 driven_lanedir_min 0.009295559539588494 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.010496600675557183, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009295559539588494, "in-drivable-lane": 0.0, "deviation-heading": 0.26302297782027906, "distance-from-start": 0.010491969616325947, "deviation-center-line": 0.007006772765454841, "driven_lanedir_consec": 0.009295559539588494}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15902
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 12:56:15+00:00 2022-11-25 13:00:13+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.692768953399423 deviation-center-line_median 0.22838243511519724
other stats deviation-center-line_max 0.22838243511519724 deviation-center-line_mean 0.22838243511519724 deviation-center-line_min 0.22838243511519724 deviation-heading_max 2.327018578184933 deviation-heading_mean 2.327018578184933 deviation-heading_median 2.327018578184933 deviation-heading_min 2.327018578184933 distance-from-start_max 1.517284045125221 distance-from-start_mean 1.517284045125221 distance-from-start_median 1.517284045125221 distance-from-start_min 1.517284045125221 driven_any_max 5.702917901484924 driven_any_mean 5.702917901484924 driven_any_median 5.702917901484924 driven_any_min 5.702917901484924 driven_lanedir_consec_max 5.692768953399423 driven_lanedir_consec_mean 5.692768953399423 driven_lanedir_consec_min 5.692768953399423 driven_lanedir_max 5.692768953399423 driven_lanedir_mean 5.692768953399423 driven_lanedir_median 5.692768953399423 driven_lanedir_min 5.692768953399423 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.702917901484924, "survival_time": 59.99999999999873, "driven_lanedir": 5.692768953399423, "in-drivable-lane": 0.0, "deviation-heading": 2.327018578184933, "distance-from-start": 1.517284045125221, "deviation-center-line": 0.22838243511519724, "driven_lanedir_consec": 5.692768953399423}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15892
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 12:44:33+00:00 2022-11-25 12:55:55+00:00 0:11:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.496299828477744 deviation-center-line_median 0.17183898904941014
other stats deviation-center-line_max 0.21132079357626976 deviation-center-line_mean 0.1743653873253979 deviation-center-line_min 0.1424627776265016 deviation-heading_max 1.5868854715733702 deviation-heading_mean 1.4512616339961206 deviation-heading_median 1.4728924991747463 deviation-heading_min 1.2723760660616197 distance-from-start_max 3.152836469048969 distance-from-start_mean 2.690530320315596 distance-from-start_median 2.641239810973879 distance-from-start_min 2.3268051902656572 driven_any_max 5.831435519999375 driven_any_mean 5.567123575605065 driven_any_median 5.707730195058858 driven_any_min 5.021598392303173 driven_lanedir_consec_max 5.704845460644086 driven_lanedir_consec_mean 5.327153206008904 driven_lanedir_consec_min 4.611167706436042 driven_lanedir_max 5.8223962690688085 driven_lanedir_mean 5.560890784650249 driven_lanedir_median 5.703499571898595 driven_lanedir_min 5.014167725734996 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.021598392303173, "survival_time": 59.99999999999873, "driven_lanedir": 5.014167725734996, "in-drivable-lane": 0.0, "deviation-heading": 1.5868854715733702, "distance-from-start": 2.339170523946391, "deviation-center-line": 0.1827495883978732, "driven_lanedir_consec": 4.611167706436042}, "4way-000-ego1": {"driven_any": 5.831435519999375, "survival_time": 59.99999999999873, "driven_lanedir": 5.8223962690688085, "in-drivable-lane": 0.0, "deviation-heading": 1.537638141336496, "distance-from-start": 3.152836469048969, "deviation-center-line": 0.21132079357626976, "driven_lanedir_consec": 5.584035348945523}, "4way-000-ego2": {"driven_any": 5.707095572773834, "survival_time": 59.99999999999873, "driven_lanedir": 5.702153535639253, "in-drivable-lane": 0.0, "deviation-heading": 1.408146857012997, "distance-from-start": 2.3268051902656572, "deviation-center-line": 0.16092838970094706, "driven_lanedir_consec": 5.408564308009964}, "4way-000-ego3": {"driven_any": 5.708364817343881, "survival_time": 59.99999999999873, "driven_lanedir": 5.704845608157938, "in-drivable-lane": 0.0, "deviation-heading": 1.2723760660616197, "distance-from-start": 2.943309098001367, "deviation-center-line": 0.1424627776265016, "driven_lanedir_consec": 5.704845460644086}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15887
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 12:34:02+00:00 2022-11-25 12:44:11+00:00 0:10:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4477076357371352 deviation-center-line_median 0.0719572483263306
other stats deviation-center-line_max 0.0719572483263306 deviation-center-line_mean 0.0719572483263306 deviation-center-line_min 0.0719572483263306 deviation-heading_max 1.9197947517405864 deviation-heading_mean 1.9197947517405864 deviation-heading_median 1.9197947517405864 deviation-heading_min 1.9197947517405864 distance-from-start_max 0.4476854412517205 distance-from-start_mean 0.4476854412517205 distance-from-start_median 0.4476854412517205 distance-from-start_min 0.4476854412517205 driven_any_max 0.4483014753438006 driven_any_mean 0.4483014753438006 driven_any_median 0.4483014753438006 driven_any_min 0.4483014753438006 driven_lanedir_consec_max 0.4477076357371352 driven_lanedir_consec_mean 0.4477076357371352 driven_lanedir_consec_min 0.4477076357371352 driven_lanedir_max 0.4477076357371352 driven_lanedir_mean 0.4477076357371352 driven_lanedir_median 0.4477076357371352 driven_lanedir_min 0.4477076357371352 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 0.4483014753438006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4477076357371352, "in-drivable-lane": 0.0, "deviation-heading": 1.9197947517405864, "distance-from-start": 0.4476854412517205, "deviation-center-line": 0.0719572483263306, "driven_lanedir_consec": 0.4477076357371352}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15884
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
467 error yes davinci-stage-03-6.2.51
2022-11-25 12:32:05+00:00 2022-11-25 12:33:34+00:00 0:01:29 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fad82468e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fad82468e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15879
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 12:27:07+00:00 2022-11-25 12:31:48+00:00 0:04:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.6173794793891885 deviation-center-line_median 0.3790863571459804
other stats deviation-center-line_max 0.3790863571459804 deviation-center-line_mean 0.3790863571459804 deviation-center-line_min 0.3790863571459804 deviation-heading_max 2.844192295741865 deviation-heading_mean 2.844192295741865 deviation-heading_median 2.844192295741865 deviation-heading_min 2.844192295741865 distance-from-start_max 2.723986924723346 distance-from-start_mean 2.723986924723346 distance-from-start_median 2.723986924723346 distance-from-start_min 2.723986924723346 driven_any_max 5.636243490208466 driven_any_mean 5.636243490208466 driven_any_median 5.636243490208466 driven_any_min 5.636243490208466 driven_lanedir_consec_max 5.6173794793891885 driven_lanedir_consec_mean 5.6173794793891885 driven_lanedir_consec_min 5.6173794793891885 driven_lanedir_max 5.6173794793891885 driven_lanedir_mean 5.6173794793891885 driven_lanedir_median 5.6173794793891885 driven_lanedir_min 5.6173794793891885 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15875
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 12:25:14+00:00 2022-11-25 12:26:48+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15870
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 12:13:25+00:00 2022-11-25 12:24:47+00:00 0:11:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.237107191226386 deviation-center-line_median 0.23759334910349403
other stats deviation-center-line_max 2.1326977700633005 deviation-center-line_mean 0.6838879528223635 deviation-center-line_min 0.1276673430191657 deviation-heading_max 13.12196147454032 deviation-heading_mean 4.364557637939925 deviation-heading_median 1.584486276774531 deviation-heading_min 1.1672965236703177 distance-from-start_max 3.1342802968590027 distance-from-start_mean 1.8729192379232904 distance-from-start_median 2.1786983274170795 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.758579747198662 driven_any_mean 4.134329883566824 driven_any_median 5.389369893534051 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 5.458898880219736 driven_lanedir_consec_mean 3.983314078454992 driven_lanedir_consec_min 0.0001430511474609375 driven_lanedir_max 5.755160319127538 driven_lanedir_mean 4.130829489397701 driven_lanedir_median 5.384007293657903 driven_lanedir_min 0.0001430511474609375 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.12196147454032, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.1326977700633005, "driven_lanedir_consec": 0.0001430511474609375}, "udem-001-ego1": {"driven_any": 5.250523118831771, "survival_time": 59.99999999999873, "driven_lanedir": 5.244914558422043, "in-drivable-lane": 0.0, "deviation-heading": 1.5492135672194798, "distance-from-start": 2.858024790062626, "deviation-center-line": 0.24799702258050904, "driven_lanedir_consec": 5.244914558422043}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 5.52821666823633, "survival_time": 59.99999999999873, "driven_lanedir": 5.523100028893762, "in-drivable-lane": 0.0, "deviation-heading": 1.6197589863295825, "distance-from-start": 1.4993718647715328, "deviation-center-line": 0.22718967562647904, "driven_lanedir_consec": 5.229299824030728}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15865
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 12:02:40+00:00 2022-11-25 12:13:18+00:00 0:10:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.2100199545198067 deviation-center-line_median 1.272693831894064
other stats deviation-center-line_max 1.272693831894064 deviation-center-line_mean 1.272693831894064 deviation-center-line_min 1.272693831894064 deviation-heading_max 5.855606525916092 deviation-heading_mean 5.855606525916092 deviation-heading_median 5.855606525916092 deviation-heading_min 5.855606525916092 distance-from-start_max 1.194075152462886 distance-from-start_mean 1.194075152462886 distance-from-start_median 1.194075152462886 distance-from-start_min 1.194075152462886 driven_any_max 1.2141472555607715 driven_any_mean 1.2141472555607715 driven_any_median 1.2141472555607715 driven_any_min 1.2141472555607715 driven_lanedir_consec_max 1.2100199545198067 driven_lanedir_consec_mean 1.2100199545198067 driven_lanedir_consec_min 1.2100199545198067 driven_lanedir_max 1.2100199545198067 driven_lanedir_mean 1.2100199545198067 driven_lanedir_median 1.2100199545198067 driven_lanedir_min 1.2100199545198067 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 1.2141472555607715, "survival_time": 59.99999999999873, "driven_lanedir": 1.2100199545198067, "in-drivable-lane": 0.0, "deviation-heading": 5.855606525916092, "distance-from-start": 1.194075152462886, "deviation-center-line": 1.272693831894064, "driven_lanedir_consec": 1.2100199545198067}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15858
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 11:50:03+00:00 2022-11-25 12:02:03+00:00 0:12:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.829863345092516 deviation-center-line_median 0.7452453730558963
other stats deviation-center-line_max 0.7452453730558963 deviation-center-line_mean 0.7452453730558963 deviation-center-line_min 0.7452453730558963 deviation-heading_max 2.253920939651482 deviation-heading_mean 2.253920939651482 deviation-heading_median 2.253920939651482 deviation-heading_min 2.253920939651482 distance-from-start_max 1.4208404655961004 distance-from-start_mean 1.4208404655961004 distance-from-start_median 1.4208404655961004 distance-from-start_min 1.4208404655961004 driven_any_max 1.8373653561570753 driven_any_mean 1.8373653561570753 driven_any_median 1.8373653561570753 driven_any_min 1.8373653561570753 driven_lanedir_consec_max 1.829863345092516 driven_lanedir_consec_mean 1.829863345092516 driven_lanedir_consec_min 1.829863345092516 driven_lanedir_max 1.829863345092516 driven_lanedir_mean 1.829863345092516 driven_lanedir_median 1.829863345092516 driven_lanedir_min 1.829863345092516 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.8373653561570753, "survival_time": 59.99999999999873, "driven_lanedir": 1.829863345092516, "in-drivable-lane": 0.0, "deviation-heading": 2.253920939651482, "distance-from-start": 1.4208404655961004, "deviation-center-line": 0.7452453730558963, "driven_lanedir_consec": 1.829863345092516}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15851
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 11:43:46+00:00 2022-11-25 11:49:29+00:00 0:05:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.8922261091347536e-06 deviation-center-line_median 0.4065255308886839
other stats deviation-center-line_max 0.4065255308886839 deviation-center-line_mean 0.4065255308886839 deviation-center-line_min 0.4065255308886839 deviation-heading_max 40.96731053008268 deviation-heading_mean 40.96731053008268 deviation-heading_median 40.96731053008268 deviation-heading_min 40.96731053008268 distance-from-start_max 9.930136612989092e-16 distance-from-start_mean 9.930136612989092e-16 distance-from-start_median 9.930136612989092e-16 distance-from-start_min 9.930136612989092e-16 driven_any_max 1.19161639355867e-12 driven_any_mean 1.19161639355867e-12 driven_any_median 1.19161639355867e-12 driven_any_min 1.19161639355867e-12 driven_lanedir_consec_max 1.8922261091347536e-06 driven_lanedir_consec_mean 1.8922261091347536e-06 driven_lanedir_consec_min 1.8922261091347536e-06 driven_lanedir_max 1.8922261091347536e-06 driven_lanedir_mean 1.8922261091347536e-06 driven_lanedir_median 1.8922261091347536e-06 driven_lanedir_min 1.8922261091347536e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 1.8922261091347536e-06, "in-drivable-lane": 0.0, "deviation-heading": 40.96731053008268, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 0.4065255308886839, "driven_lanedir_consec": 1.8922261091347536e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15846
1324
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:42:26+00:00 2022-11-25 11:43:39+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15841
1325
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:40:55+00:00 2022-11-25 11:42:06+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15834
1326
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:39:11+00:00 2022-11-25 11:40:23+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15832
1327
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:38:04+00:00 2022-11-25 11:39:04+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15825
1328
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:36:38+00:00 2022-11-25 11:37:50+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15822
1330
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-2of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:35:22+00:00 2022-11-25 11:36:19+00:00 0:00:57 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15815
1332
Bea Baselines 🐤baseline-RPL-ros lx22-objdet
sim failed yes davinci-stage-03-6.2.51
2022-11-25 11:34:08+00:00 2022-11-25 11:35:06+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15812
1335
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-3of5 failed no davinci-stage-03-6.2.51
2022-11-25 11:33:02+00:00 2022-11-25 11:33:59+00:00 0:00:57 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15807
1338
Bea Baselines 🐤baseline-RPL-ros aido-hello-sim-validation
sanity-check failed no davinci-stage-03-6.2.51
2022-11-25 11:31:24+00:00 2022-11-25 11:32:28+00:00 0:01:04 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15805
1342
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:30:03+00:00 2022-11-25 11:31:15+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15801
1343
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:28:43+00:00 2022-11-25 11:29:54+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15794
1344
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:27:05+00:00 2022-11-25 11:28:17+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15791
1346
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-2of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:25:26+00:00 2022-11-25 11:26:36+00:00 0:01:10 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15786
1347
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 11:23:57+00:00 2022-11-25 11:25:11+00:00 0:01:14 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15774
1350
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 11:09:58+00:00 2022-11-25 11:23:50+00:00 0:13:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 16.34999999999967 driven_lanedir_consec_median 3.5078485452922403 deviation-center-line_median 3.3066478739156993
other stats deviation-center-line_max 3.3066478739156993 deviation-center-line_mean 3.3066478739156993 deviation-center-line_min 3.3066478739156993 deviation-heading_max 14.91185401409574 deviation-heading_mean 14.91185401409574 deviation-heading_median 14.91185401409574 deviation-heading_min 14.91185401409574 distance-from-start_max 1.35129958167935 distance-from-start_mean 1.35129958167935 distance-from-start_median 1.35129958167935 distance-from-start_min 1.35129958167935 driven_any_max 7.91363492566989 driven_any_mean 7.91363492566989 driven_any_median 7.91363492566989 driven_any_min 7.91363492566989 driven_lanedir_consec_max 3.5078485452922403 driven_lanedir_consec_mean 3.5078485452922403 driven_lanedir_consec_min 3.5078485452922403 driven_lanedir_max 5.078178720170576 driven_lanedir_mean 5.078178720170576 driven_lanedir_median 5.078178720170576 driven_lanedir_min 5.078178720170576 in-drivable-lane_max 16.34999999999967 in-drivable-lane_mean 16.34999999999967 in-drivable-lane_min 16.34999999999967 per-episodes details {"udem-000-ego0": {"driven_any": 7.91363492566989, "survival_time": 59.99999999999873, "driven_lanedir": 5.078178720170576, "in-drivable-lane": 16.34999999999967, "deviation-heading": 14.91185401409574, "distance-from-start": 1.35129958167935, "deviation-center-line": 3.3066478739156993, "driven_lanedir_consec": 3.5078485452922403}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15771
1351
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 11:07:41+00:00 2022-11-25 11:09:32+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15766
1352
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 11:00:44+00:00 2022-11-25 11:07:12+00:00 0:06:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 7.139809103770904 survival_time_median 59.99999999999873 deviation-center-line_median 4.687415779147404 in-drivable-lane_median 3.499999999999958
other stats deviation-center-line_max 4.687415779147404 deviation-center-line_mean 4.687415779147404 deviation-center-line_min 4.687415779147404 deviation-heading_max 11.248632063374732 deviation-heading_mean 11.248632063374732 deviation-heading_median 11.248632063374732 deviation-heading_min 11.248632063374732 distance-from-start_max 4.071203490701128 distance-from-start_mean 4.071203490701128 distance-from-start_median 4.071203490701128 distance-from-start_min 4.071203490701128 driven_any_max 7.907796148383485 driven_any_mean 7.907796148383485 driven_any_median 7.907796148383485 driven_any_min 7.907796148383485 driven_lanedir_consec_max 7.139809103770904 driven_lanedir_consec_mean 7.139809103770904 driven_lanedir_consec_min 7.139809103770904 driven_lanedir_max 7.139809103770904 driven_lanedir_mean 7.139809103770904 driven_lanedir_median 7.139809103770904 driven_lanedir_min 7.139809103770904 in-drivable-lane_max 3.499999999999958 in-drivable-lane_mean 3.499999999999958 in-drivable-lane_min 3.499999999999958 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.907796148383485, "survival_time": 59.99999999999873, "driven_lanedir": 7.139809103770904, "in-drivable-lane": 3.499999999999958, "deviation-heading": 11.248632063374732, "distance-from-start": 4.071203490701128, "deviation-center-line": 4.687415779147404, "driven_lanedir_consec": 7.139809103770904}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15762
1353
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 10:52:54+00:00 2022-11-25 11:00:36+00:00 0:07:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 22.000000000000178 in-drivable-lane_median 0.8000000000000114 driven_lanedir_consec_median 0.5688806638334413 deviation-center-line_median 1.6822574705515425
other stats deviation-center-line_max 2.049265470744686 deviation-center-line_mean 1.4453336612912322 deviation-center-line_min 0.36755423331715814 deviation-heading_max 14.508969885441632 deviation-heading_mean 8.405725617441043 deviation-heading_median 8.673095944504501 deviation-heading_min 1.7677406953135364 distance-from-start_max 1.8869551000402565 distance-from-start_mean 0.8878657754951976 distance-from-start_median 0.6203704024957694 distance-from-start_min 0.42376719694899545 driven_any_max 2.7761900249417457 driven_any_mean 1.1381481789473131 driven_any_median 0.6485642350318642 driven_any_min 0.4792742207837793 driven_lanedir_consec_max 1.6742666977452674 driven_lanedir_consec_mean 0.8076443097336166 driven_lanedir_consec_min 0.41854921352231633 driven_lanedir_max 2.4861614949264506 driven_lanedir_mean 1.0106180090289123 driven_lanedir_median 0.5688806638334413 driven_lanedir_min 0.41854921352231633 in-drivable-lane_max 16.20000000000019 in-drivable-lane_mean 4.4500000000000535 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.4792742207837793, "survival_time": 22.000000000000178, "driven_lanedir": 0.41854921352231633, "in-drivable-lane": 0.0, "deviation-heading": 14.508969885441632, "distance-from-start": 0.42376719694899545, "deviation-center-line": 1.9083638780381125, "driven_lanedir_consec": 0.41854921352231633}, "udem-000-ego1": {"driven_any": 0.8178325059137013, "survival_time": 22.000000000000178, "driven_lanedir": 0.674250579942909, "in-drivable-lane": 16.20000000000019, "deviation-heading": 1.7677406953135364, "distance-from-start": 0.7726779035883197, "deviation-center-line": 0.36755423331715814, "driven_lanedir_consec": 0.674250579942909}, "udem-000-ego2": {"driven_any": 2.7761900249417457, "survival_time": 22.000000000000178, "driven_lanedir": 2.4861614949264506, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 2.9556618630809797, "distance-from-start": 1.8869551000402565, "deviation-center-line": 1.4561510630649723, "driven_lanedir_consec": 1.6742666977452674}, "udem-000-ego3": {"driven_any": 0.4792959641500272, "survival_time": 22.000000000000178, "driven_lanedir": 0.4635107477239735, "in-drivable-lane": 0.0, "deviation-heading": 14.390530025928022, "distance-from-start": 0.4680629014032191, "deviation-center-line": 2.049265470744686, "driven_lanedir_consec": 0.4635107477239735}}simulation-passed 1 survival_time_max 22.000000000000178 survival_time_mean 22.000000000000178 survival_time_min 22.000000000000178
No reset possible 15757
1354
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 10:47:52+00:00 2022-11-25 10:52:22+00:00 0:04:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.250000000000167 in-drivable-lane_median 0.8000000000000014 driven_lanedir_consec_median 1.8713044420566496 deviation-center-line_median 1.561445869092485
other stats deviation-center-line_max 1.654933802801375 deviation-center-line_mean 1.561445869092485 deviation-center-line_min 1.4679579353835954 deviation-heading_max 6.622491906042299 deviation-heading_mean 5.358065957051593 deviation-heading_median 5.358065957051593 deviation-heading_min 4.093640008060887 distance-from-start_max 1.0171000672390342 distance-from-start_mean 0.8121051864342014 distance-from-start_median 0.8121051864342014 distance-from-start_min 0.6071103056293685 driven_any_max 2.669885351609403 driven_any_mean 2.523893874391863 driven_any_median 2.523893874391863 driven_any_min 2.3779023971743234 driven_lanedir_consec_max 2.3202404563129795 driven_lanedir_consec_mean 1.8713044420566496 driven_lanedir_consec_min 1.42236842780032 driven_lanedir_max 2.3202404563129795 driven_lanedir_mean 2.252489836942958 driven_lanedir_median 2.252489836942958 driven_lanedir_min 2.184739217572936 in-drivable-lane_max 1.6000000000000028 in-drivable-lane_mean 0.8000000000000014 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 2.3779023971743234, "survival_time": 21.250000000000167, "driven_lanedir": 2.3202404563129795, "in-drivable-lane": 0.0, "deviation-heading": 4.093640008060887, "distance-from-start": 1.0171000672390342, "deviation-center-line": 1.654933802801375, "driven_lanedir_consec": 2.3202404563129795}, "loop2-000-ego1": {"driven_any": 2.669885351609403, "survival_time": 21.250000000000167, "driven_lanedir": 2.184739217572936, "in-drivable-lane": 1.6000000000000028, "deviation-heading": 6.622491906042299, "distance-from-start": 0.6071103056293685, "deviation-center-line": 1.4679579353835954, "driven_lanedir_consec": 1.42236842780032}}simulation-passed 1 survival_time_max 21.250000000000167 survival_time_mean 21.250000000000167 survival_time_min 21.250000000000167
No reset possible 15756
1355
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 10:45:19+00:00 2022-11-25 10:47:40+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.400000000000029 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3117039680638425 deviation-center-line_median 0.7134659612145099
other stats deviation-center-line_max 0.7134659612145099 deviation-center-line_mean 0.7134659612145099 deviation-center-line_min 0.7134659612145099 deviation-heading_max 2.7890490867024056 deviation-heading_mean 2.7890490867024056 deviation-heading_median 2.7890490867024056 deviation-heading_min 2.7890490867024056 distance-from-start_max 1.1463604247213914 distance-from-start_mean 1.1463604247213914 distance-from-start_median 1.1463604247213914 distance-from-start_min 1.1463604247213914 driven_any_max 1.3622284035488876 driven_any_mean 1.3622284035488876 driven_any_median 1.3622284035488876 driven_any_min 1.3622284035488876 driven_lanedir_consec_max 1.3117039680638425 driven_lanedir_consec_mean 1.3117039680638425 driven_lanedir_consec_min 1.3117039680638425 driven_lanedir_max 1.3117039680638425 driven_lanedir_mean 1.3117039680638425 driven_lanedir_median 1.3117039680638425 driven_lanedir_min 1.3117039680638425 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.3622284035488876, "survival_time": 11.400000000000029, "driven_lanedir": 1.3117039680638425, "in-drivable-lane": 0.0, "deviation-heading": 2.7890490867024056, "distance-from-start": 1.1463604247213914, "deviation-center-line": 0.7134659612145099, "driven_lanedir_consec": 1.3117039680638425}}simulation-passed 1 survival_time_max 11.400000000000029 survival_time_mean 11.400000000000029 survival_time_min 11.400000000000029
No reset possible 15751
1357
Bea Baselines 🐤baseline-duckietown-ml lx22-objdet
sim success yes davinci-stage-03-6.2.51
2022-11-25 10:35:23+00:00 2022-11-25 10:45:00+00:00 0:09:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 42.14999999999974 driven_lanedir_consec_median 4.744071096042223
other stats deviation-center-line_max 1.8909340338453744 deviation-center-line_mean 1.256572277427619 deviation-center-line_median 1.256572277427619 deviation-center-line_min 0.6222105210098633 deviation-heading_max 2.3650655366577964 deviation-heading_mean 2.203522095523688 deviation-heading_median 2.203522095523688 deviation-heading_min 2.04197865438958 distance-from-start_max 6.778598354686377 distance-from-start_mean 5.161644938461317 distance-from-start_median 5.161644938461317 distance-from-start_min 3.5446915222362554 driven_any_max 6.786087279352217 driven_any_mean 5.451688058845778 driven_any_median 5.451688058845778 driven_any_min 4.117288838339339 driven_lanedir_consec_max 6.77868650317204 driven_lanedir_consec_mean 4.744071096042223 driven_lanedir_consec_min 2.7094556889124073 driven_lanedir_max 6.77868650317204 driven_lanedir_mean 4.744071096042223 driven_lanedir_median 4.744071096042223 driven_lanedir_min 2.7094556889124073 in-drivable-lane_max 10.950000000000152 in-drivable-lane_mean 5.475000000000076 in-drivable-lane_median 5.475000000000076 in-drivable-lane_min 0.0 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.786087279352217, "survival_time": 52.24999999999917, "driven_lanedir": 6.77868650317204, "in-drivable-lane": 0.0, "deviation-heading": 2.04197865438958, "distance-from-start": 6.778598354686377, "deviation-center-line": 1.8909340338453744, "driven_lanedir_consec": 6.77868650317204}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 4.117288838339339, "survival_time": 32.05000000000032, "driven_lanedir": 2.7094556889124073, "in-drivable-lane": 10.950000000000152, "deviation-heading": 2.3650655366577964, "distance-from-start": 3.5446915222362554, "deviation-center-line": 0.6222105210098633, "driven_lanedir_consec": 2.7094556889124073}}simulation-passed 1 survival_time_max 52.24999999999917 survival_time_mean 42.14999999999974 survival_time_min 32.05000000000032
No reset possible 15742
1367
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 10:23:51+00:00 2022-11-25 10:35:03+00:00 0:11:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 56.04999999999895 in-drivable-lane_median 5.949999999999854 driven_lanedir_consec_median 3.6113200930157023 deviation-center-line_median 4.3160617489699
other stats deviation-center-line_max 4.3160617489699 deviation-center-line_mean 4.3160617489699 deviation-center-line_min 4.3160617489699 deviation-heading_max 10.580165655732747 deviation-heading_mean 10.580165655732747 deviation-heading_median 10.580165655732747 deviation-heading_min 10.580165655732747 distance-from-start_max 2.921506528684634 distance-from-start_mean 2.921506528684634 distance-from-start_median 2.921506528684634 distance-from-start_min 2.921506528684634 driven_any_max 7.296741488521007 driven_any_mean 7.296741488521007 driven_any_median 7.296741488521007 driven_any_min 7.296741488521007 driven_lanedir_consec_max 3.6113200930157023 driven_lanedir_consec_mean 3.6113200930157023 driven_lanedir_consec_min 3.6113200930157023 driven_lanedir_max 6.245464485871592 driven_lanedir_mean 6.245464485871592 driven_lanedir_median 6.245464485871592 driven_lanedir_min 6.245464485871592 in-drivable-lane_max 5.949999999999854 in-drivable-lane_mean 5.949999999999854 in-drivable-lane_min 5.949999999999854 per-episodes details {"loop-000-ego0": {"driven_any": 7.296741488521007, "survival_time": 56.04999999999895, "driven_lanedir": 6.245464485871592, "in-drivable-lane": 5.949999999999854, "deviation-heading": 10.580165655732747, "distance-from-start": 2.921506528684634, "deviation-center-line": 4.3160617489699, "driven_lanedir_consec": 3.6113200930157023}}simulation-passed 1 survival_time_max 56.04999999999895 survival_time_mean 56.04999999999895 survival_time_min 56.04999999999895
No reset possible 15741
1367
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 10:20:01+00:00 2022-11-25 10:23:45+00:00 0:03:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.050000000000107 in-drivable-lane_median 7.500000000000092 driven_lanedir_consec_median 1.0147627580140095 deviation-center-line_median 0.5248522438271236
other stats deviation-center-line_max 0.5248522438271236 deviation-center-line_mean 0.5248522438271236 deviation-center-line_min 0.5248522438271236 deviation-heading_max 3.1362578899097784 deviation-heading_mean 3.1362578899097784 deviation-heading_median 3.1362578899097784 deviation-heading_min 3.1362578899097784 distance-from-start_max 1.413248350458319 distance-from-start_mean 1.413248350458319 distance-from-start_median 1.413248350458319 distance-from-start_min 1.413248350458319 driven_any_max 2.112331225942567 driven_any_mean 2.112331225942567 driven_any_median 2.112331225942567 driven_any_min 2.112331225942567 driven_lanedir_consec_max 1.0147627580140095 driven_lanedir_consec_mean 1.0147627580140095 driven_lanedir_consec_min 1.0147627580140095 driven_lanedir_max 1.0286932620094282 driven_lanedir_mean 1.0286932620094282 driven_lanedir_median 1.0286932620094282 driven_lanedir_min 1.0286932620094282 in-drivable-lane_max 7.500000000000092 in-drivable-lane_mean 7.500000000000092 in-drivable-lane_min 7.500000000000092 per-episodes details {"loop2-000-ego0": {"driven_any": 2.112331225942567, "survival_time": 17.050000000000107, "driven_lanedir": 1.0286932620094282, "in-drivable-lane": 7.500000000000092, "deviation-heading": 3.1362578899097784, "distance-from-start": 1.413248350458319, "deviation-center-line": 0.5248522438271236, "driven_lanedir_consec": 1.0147627580140095}}simulation-passed 1 survival_time_max 17.050000000000107 survival_time_mean 17.050000000000107 survival_time_min 17.050000000000107
No reset possible 15739
1368
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 10:17:53+00:00 2022-11-25 10:19:35+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15726
1372
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 09:53:12+00:00 2022-11-25 10:17:33+00:00 0:24:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 16.09999999999954 driven_lanedir_consec_median 5.174928224192271 deviation-center-line_median 4.172934490443127
other stats deviation-center-line_max 4.812958302467858 deviation-center-line_mean 4.165292297397421 deviation-center-line_min 3.5023419062355745 deviation-heading_max 16.517134929383097 deviation-heading_mean 14.573327489680548 deviation-heading_median 14.850582912588854 deviation-heading_min 12.075009204161388 distance-from-start_max 2.9030722590434275 distance-from-start_mean 2.391093349024953 distance-from-start_median 2.39571086304923 distance-from-start_min 1.8698794109579244 driven_any_max 7.913986192645288 driven_any_mean 7.913778245101669 driven_any_median 7.913771485265453 driven_any_min 7.913583817230483 driven_lanedir_consec_max 5.509512170857265 driven_lanedir_consec_mean 5.037213036762299 driven_lanedir_consec_min 4.289483527807388 driven_lanedir_max 5.509512170857265 driven_lanedir_mean 5.105042948595948 driven_lanedir_median 5.174928224192271 driven_lanedir_min 4.560803175141983 in-drivable-lane_max 21.499999999999694 in-drivable-lane_mean 16.987499999999596 in-drivable-lane_min 14.249999999999613 per-episodes details {"loop-000-ego0": {"driven_any": 7.9138288572279825, "survival_time": 59.99999999999873, "driven_lanedir": 4.560803175141983, "in-drivable-lane": 21.499999999999694, "deviation-heading": 12.075009204161388, "distance-from-start": 2.9030722590434275, "deviation-center-line": 3.742307283951056, "driven_lanedir_consec": 4.289483527807388}, "loop-000-ego1": {"driven_any": 7.913986192645288, "survival_time": 59.99999999999873, "driven_lanedir": 5.509512170857265, "in-drivable-lane": 14.249999999999613, "deviation-heading": 13.86547611508628, "distance-from-start": 2.3335218580657124, "deviation-center-line": 4.603561696935198, "driven_lanedir_consec": 5.509512170857265}, "loop-000-ego2": {"driven_any": 7.913583817230483, "survival_time": 59.99999999999873, "driven_lanedir": 4.958355158862108, "in-drivable-lane": 17.04999999999952, "deviation-heading": 16.517134929383097, "distance-from-start": 2.4578998680327477, "deviation-center-line": 3.5023419062355745, "driven_lanedir_consec": 4.958355158862108}, "loop-000-ego3": {"driven_any": 7.913714113302923, "survival_time": 59.99999999999873, "driven_lanedir": 5.391501289522434, "in-drivable-lane": 15.149999999999554, "deviation-heading": 15.835689710091426, "distance-from-start": 1.8698794109579244, "deviation-center-line": 4.812958302467858, "driven_lanedir_consec": 5.391501289522434}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15721
1373
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 09:48:48+00:00 2022-11-25 09:52:57+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.05000000000026 in-drivable-lane_median 3.5000000000000444 driven_lanedir_consec_median 3.6435756386590343 deviation-center-line_median 2.1976133138119676
other stats deviation-center-line_max 2.1976133138119676 deviation-center-line_mean 2.1976133138119676 deviation-center-line_min 2.1976133138119676 deviation-heading_max 6.170617312179055 deviation-heading_mean 6.170617312179055 deviation-heading_median 6.170617312179055 deviation-heading_min 6.170617312179055 distance-from-start_max 3.3808929413138733 distance-from-start_mean 3.3808929413138733 distance-from-start_median 3.3808929413138733 distance-from-start_min 3.3808929413138733 driven_any_max 4.23670468468535 driven_any_mean 4.23670468468535 driven_any_median 4.23670468468535 driven_any_min 4.23670468468535 driven_lanedir_consec_max 3.6435756386590343 driven_lanedir_consec_mean 3.6435756386590343 driven_lanedir_consec_min 3.6435756386590343 driven_lanedir_max 3.6435756386590343 driven_lanedir_mean 3.6435756386590343 driven_lanedir_median 3.6435756386590343 driven_lanedir_min 3.6435756386590343 in-drivable-lane_max 3.5000000000000444 in-drivable-lane_mean 3.5000000000000444 in-drivable-lane_min 3.5000000000000444 per-episodes details {"autolab-000-ego0": {"driven_any": 4.23670468468535, "survival_time": 33.05000000000026, "driven_lanedir": 3.6435756386590343, "in-drivable-lane": 3.5000000000000444, "deviation-heading": 6.170617312179055, "distance-from-start": 3.3808929413138733, "deviation-center-line": 2.1976133138119676, "driven_lanedir_consec": 3.6435756386590343}}simulation-passed 1 survival_time_max 33.05000000000026 survival_time_mean 33.05000000000026 survival_time_min 33.05000000000026
No reset possible 15717
1374
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 09:42:18+00:00 2022-11-25 09:48:12+00:00 0:05:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 2.450000000000035 driven_lanedir_consec_median 1.3365651749146346 deviation-center-line_median 1.0721450874498766
other stats deviation-center-line_max 1.0721450874498766 deviation-center-line_mean 1.0721450874498766 deviation-center-line_min 1.0721450874498766 deviation-heading_max 5.600882649809179 deviation-heading_mean 5.600882649809179 deviation-heading_median 5.600882649809179 deviation-heading_min 5.600882649809179 distance-from-start_max 1.1795381270516747 distance-from-start_mean 1.1795381270516747 distance-from-start_median 1.1795381270516747 distance-from-start_min 1.1795381270516747 driven_any_max 1.820029381259532 driven_any_mean 1.820029381259532 driven_any_median 1.820029381259532 driven_any_min 1.820029381259532 driven_lanedir_consec_max 1.3365651749146346 driven_lanedir_consec_mean 1.3365651749146346 driven_lanedir_consec_min 1.3365651749146346 driven_lanedir_max 1.3365651749146346 driven_lanedir_mean 1.3365651749146346 driven_lanedir_median 1.3365651749146346 driven_lanedir_min 1.3365651749146346 in-drivable-lane_max 2.450000000000035 in-drivable-lane_mean 2.450000000000035 in-drivable-lane_min 2.450000000000035 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.820029381259532, "survival_time": 14.800000000000075, "driven_lanedir": 1.3365651749146346, "in-drivable-lane": 2.450000000000035, "deviation-heading": 5.600882649809179, "distance-from-start": 1.1795381270516747, "deviation-center-line": 1.0721450874498766, "driven_lanedir_consec": 1.3365651749146346}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 15699
1379
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 09:16:59+00:00 2022-11-25 09:42:13+00:00 0:25:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.174999999998988 driven_lanedir_consec_median 2.2578558508568527 deviation-center-line_median 2.471431538715348
other stats deviation-center-line_max 3.530873467765855 deviation-center-line_mean 2.3246251398796343 deviation-center-line_min 0.8247640143219854 deviation-heading_max 23.112836538213585 deviation-heading_mean 14.362308296991158 deviation-heading_median 15.025916196253448 deviation-heading_min 4.2845642572441465 distance-from-start_max 2.092632590834022 distance-from-start_mean 1.3907765851539973 distance-from-start_median 1.2800636678267785 distance-from-start_min 0.9103464141284096 driven_any_max 7.912645704179486 driven_any_mean 5.349100935959909 driven_any_median 5.682547751787265 driven_any_min 2.1186625360856204 driven_lanedir_consec_max 3.525436875021678 driven_lanedir_consec_mean 2.3224114684298405 driven_lanedir_consec_min 1.2484972969839785 driven_lanedir_max 4.640199464179554 driven_lanedir_mean 3.0625237671018883 driven_lanedir_median 3.180699153622011 driven_lanedir_min 1.2484972969839785 in-drivable-lane_max 48.4999999999987 in-drivable-lane_mean 31.137499999999065 in-drivable-lane_min 15.699999999999587 per-episodes details {"autolab-000-ego0": {"driven_any": 4.554267777405633, "survival_time": 59.99999999999873, "driven_lanedir": 2.478830115178725, "in-drivable-lane": 36.19999999999855, "deviation-heading": 12.603512704857405, "distance-from-start": 1.058889268020124, "deviation-center-line": 1.9966268939671068, "driven_lanedir_consec": 1.253406740325247}, "autolab-000-ego1": {"driven_any": 6.810827726168896, "survival_time": 59.99999999999873, "driven_lanedir": 3.882568192065297, "in-drivable-lane": 24.149999999999423, "deviation-heading": 17.44831968764949, "distance-from-start": 2.092632590834022, "deviation-center-line": 2.9462361834635886, "driven_lanedir_consec": 3.262304961388459}, "autolab-000-ego2": {"driven_any": 7.912645704179486, "survival_time": 59.99999999999873, "driven_lanedir": 4.640199464179554, "in-drivable-lane": 15.699999999999587, "deviation-heading": 23.112836538213585, "distance-from-start": 1.5012380676334331, "deviation-center-line": 3.530873467765855, "driven_lanedir_consec": 3.525436875021678}, "autolab-000-ego3": {"driven_any": 2.1186625360856204, "survival_time": 59.99999999999873, "driven_lanedir": 1.2484972969839785, "in-drivable-lane": 48.4999999999987, "deviation-heading": 4.2845642572441465, "distance-from-start": 0.9103464141284096, "deviation-center-line": 0.8247640143219854, "driven_lanedir_consec": 1.2484972969839785}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15695
1380
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 09:13:40+00:00 2022-11-25 09:16:34+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.55000000000003 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3390006419605616 deviation-center-line_median 0.642980851039363
other stats deviation-center-line_max 0.642980851039363 deviation-center-line_mean 0.642980851039363 deviation-center-line_min 0.642980851039363 deviation-heading_max 2.4512027299150017 deviation-heading_mean 2.4512027299150017 deviation-heading_median 2.4512027299150017 deviation-heading_min 2.4512027299150017 distance-from-start_max 1.1714524549442908 distance-from-start_mean 1.1714524549442908 distance-from-start_median 1.1714524549442908 distance-from-start_min 1.1714524549442908 driven_any_max 1.3821353851969258 driven_any_mean 1.3821353851969258 driven_any_median 1.3821353851969258 driven_any_min 1.3821353851969258 driven_lanedir_consec_max 1.3390006419605616 driven_lanedir_consec_mean 1.3390006419605616 driven_lanedir_consec_min 1.3390006419605616 driven_lanedir_max 1.3390006419605616 driven_lanedir_mean 1.3390006419605616 driven_lanedir_median 1.3390006419605616 driven_lanedir_min 1.3390006419605616 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.3821353851969258, "survival_time": 11.55000000000003, "driven_lanedir": 1.3390006419605616, "in-drivable-lane": 0.0, "deviation-heading": 2.4512027299150017, "distance-from-start": 1.1714524549442908, "deviation-center-line": 0.642980851039363, "driven_lanedir_consec": 1.3390006419605616}}simulation-passed 1 survival_time_max 11.55000000000003 survival_time_mean 11.55000000000003 survival_time_min 11.55000000000003
No reset possible 15690
1382
Bea Baselines 🐤baseline-duckietown lx22-objdet
sim success yes davinci-stage-03-6.2.51
2022-11-25 09:03:57+00:00 2022-11-25 09:13:09+00:00 0:09:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 37.42499999999968 driven_lanedir_consec_median 4.810256234229755
other stats deviation-center-line_max 2.0801499813387525 deviation-center-line_mean 1.4988953117850456 deviation-center-line_median 1.4988953117850456 deviation-center-line_min 0.9176406422313388 deviation-heading_max 2.6355613595226632 deviation-heading_mean 2.3858020128711033 deviation-heading_median 2.3858020128711033 deviation-heading_min 2.136042666219544 distance-from-start_max 6.777712756828244 distance-from-start_mean 4.810504081297905 distance-from-start_median 4.810504081297905 distance-from-start_min 2.843295405767566 driven_any_max 6.786087669203676 driven_any_mean 4.827653313168814 driven_any_median 4.827653313168814 driven_any_min 2.869218957133953 driven_lanedir_consec_max 6.777819443300092 driven_lanedir_consec_mean 4.810256234229755 driven_lanedir_consec_min 2.8426930251594165 driven_lanedir_max 6.777819443300092 driven_lanedir_mean 4.810256234229755 driven_lanedir_median 4.810256234229755 driven_lanedir_min 2.8426930251594165 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_median 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.786087669203676, "survival_time": 52.19999999999917, "driven_lanedir": 6.777819443300092, "in-drivable-lane": 0.0, "deviation-heading": 2.136042666219544, "distance-from-start": 6.777712756828244, "deviation-center-line": 2.0801499813387525, "driven_lanedir_consec": 6.777819443300092}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.869218957133953, "survival_time": 22.650000000000187, "driven_lanedir": 2.8426930251594165, "in-drivable-lane": 0.0, "deviation-heading": 2.6355613595226632, "distance-from-start": 2.843295405767566, "deviation-center-line": 0.9176406422313388, "driven_lanedir_consec": 2.8426930251594165}}simulation-passed 1 survival_time_max 52.19999999999917 survival_time_mean 37.42499999999968 survival_time_min 22.650000000000187
No reset possible 15681
1392
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 08:51:46+00:00 2022-11-25 09:03:29+00:00 0:11:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.3499999999999 in-drivable-lane_median 11.949999999999836 driven_lanedir_consec_median 2.2747745648918865 deviation-center-line_median 2.4205088879408643
other stats deviation-center-line_max 2.4205088879408643 deviation-center-line_mean 2.4205088879408643 deviation-center-line_min 2.4205088879408643 deviation-heading_max 13.979216186872474 deviation-heading_mean 13.979216186872474 deviation-heading_median 13.979216186872474 deviation-heading_min 13.979216186872474 distance-from-start_max 2.3080675572639566 distance-from-start_mean 2.3080675572639566 distance-from-start_median 2.3080675572639566 distance-from-start_min 2.3080675572639566 driven_any_max 5.078896789981636 driven_any_mean 5.078896789981636 driven_any_median 5.078896789981636 driven_any_min 5.078896789981636 driven_lanedir_consec_max 2.2747745648918865 driven_lanedir_consec_mean 2.2747745648918865 driven_lanedir_consec_min 2.2747745648918865 driven_lanedir_max 2.94446435914208 driven_lanedir_mean 2.94446435914208 driven_lanedir_median 2.94446435914208 driven_lanedir_min 2.94446435914208 in-drivable-lane_max 11.949999999999836 in-drivable-lane_mean 11.949999999999836 in-drivable-lane_min 11.949999999999836 per-episodes details {"autolab-000-ego0": {"driven_any": 5.078896789981636, "survival_time": 39.3499999999999, "driven_lanedir": 2.94446435914208, "in-drivable-lane": 11.949999999999836, "deviation-heading": 13.979216186872474, "distance-from-start": 2.3080675572639566, "deviation-center-line": 2.4205088879408643, "driven_lanedir_consec": 2.2747745648918865}}simulation-passed 1 survival_time_max 39.3499999999999 survival_time_mean 39.3499999999999 survival_time_min 39.3499999999999
No reset possible 15677
1392
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 08:44:17+00:00 2022-11-25 08:51:29+00:00 0:07:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 30.200000000000298 in-drivable-lane_median 28.700000000000298 driven_lanedir_consec_median 0.09792271509533768 deviation-center-line_median 0.1083212681828197
other stats deviation-center-line_max 0.1083212681828197 deviation-center-line_mean 0.1083212681828197 deviation-center-line_min 0.1083212681828197 deviation-heading_max 1.1995882026050435 deviation-heading_mean 1.1995882026050435 deviation-heading_median 1.1995882026050435 deviation-heading_min 1.1995882026050435 distance-from-start_max 2.4093498394525112 distance-from-start_mean 2.4093498394525112 distance-from-start_median 2.4093498394525112 distance-from-start_min 2.4093498394525112 driven_any_max 3.865033412199443 driven_any_mean 3.865033412199443 driven_any_median 3.865033412199443 driven_any_min 3.865033412199443 driven_lanedir_consec_max 0.09792271509533768 driven_lanedir_consec_mean 0.09792271509533768 driven_lanedir_consec_min 0.09792271509533768 driven_lanedir_max 0.09792271509533768 driven_lanedir_mean 0.09792271509533768 driven_lanedir_median 0.09792271509533768 driven_lanedir_min 0.09792271509533768 in-drivable-lane_max 28.700000000000298 in-drivable-lane_mean 28.700000000000298 in-drivable-lane_min 28.700000000000298 per-episodes details {"loop-000-ego0": {"driven_any": 3.865033412199443, "survival_time": 30.200000000000298, "driven_lanedir": 0.09792271509533768, "in-drivable-lane": 28.700000000000298, "deviation-heading": 1.1995882026050435, "distance-from-start": 2.4093498394525112, "deviation-center-line": 0.1083212681828197, "driven_lanedir_consec": 0.09792271509533768}}simulation-passed 1 survival_time_max 30.200000000000298 survival_time_mean 30.200000000000298 survival_time_min 30.200000000000298
No reset possible 15660
1397
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 08:17:20+00:00 2022-11-25 08:43:55+00:00 0:26:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 25.92499999999906 driven_lanedir_consec_median 2.3646115229120306 deviation-center-line_median 3.2486271161130515
other stats deviation-center-line_max 3.640286242439263 deviation-center-line_mean 2.639349009741065 deviation-center-line_min 0.4198555642988931 deviation-heading_max 23.03106841353319 deviation-heading_mean 16.93494422753877 deviation-heading_median 21.056198959480756 deviation-heading_min 2.596310577660389 distance-from-start_max 2.5952869931157303 distance-from-start_mean 1.7421869948350328 distance-from-start_median 1.6470230450654624 distance-from-start_min 1.0794148960934755 driven_any_max 7.912918824497923 driven_any_mean 6.215267233134213 driven_any_median 7.457866847311441 driven_any_min 2.0324164134160494 driven_lanedir_consec_max 3.636166660257679 driven_lanedir_consec_mean 2.350319858255987 driven_lanedir_consec_min 1.0358897269422067 driven_lanedir_max 4.4223589552784315 driven_lanedir_mean 3.0482839831363693 driven_lanedir_median 3.3674436251624194 driven_lanedir_min 1.0358897269422067 in-drivable-lane_max 50.84999999999873 in-drivable-lane_mean 29.987499999999105 in-drivable-lane_min 17.249999999999567 per-episodes details {"autolab-000-ego0": {"driven_any": 7.905508246506613, "survival_time": 59.99999999999873, "driven_lanedir": 2.981892265467782, "in-drivable-lane": 28.449999999999022, "deviation-heading": 21.56803724399301, "distance-from-start": 1.0794148960934755, "deviation-center-line": 3.488321056377729, "driven_lanedir_consec": 1.7236218948884234}, "autolab-000-ego1": {"driven_any": 7.010225448116269, "survival_time": 59.99999999999873, "driven_lanedir": 3.752994984857057, "in-drivable-lane": 23.399999999999093, "deviation-heading": 20.5443606749685, "distance-from-start": 2.0030067522119337, "deviation-center-line": 3.008933175848374, "driven_lanedir_consec": 3.0056011509356377}, "autolab-000-ego2": {"driven_any": 2.0324164134160494, "survival_time": 59.99999999999873, "driven_lanedir": 1.0358897269422067, "in-drivable-lane": 50.84999999999873, "deviation-heading": 2.596310577660389, "distance-from-start": 1.291039337918991, "deviation-center-line": 0.4198555642988931, "driven_lanedir_consec": 1.0358897269422067}, "autolab-000-ego3": {"driven_any": 7.912918824497923, "survival_time": 59.99999999999873, "driven_lanedir": 4.4223589552784315, "in-drivable-lane": 17.249999999999567, "deviation-heading": 23.03106841353319, "distance-from-start": 2.5952869931157303, "deviation-center-line": 3.640286242439263, "driven_lanedir_consec": 3.636166660257679}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15652
1399
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 08:07:31+00:00 2022-11-25 08:17:11+00:00 0:09:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.699999999999314 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 2.825725124357286 deviation-center-line_median 4.868938294800302
other stats deviation-center-line_max 4.868938294800302 deviation-center-line_mean 4.868938294800302 deviation-center-line_min 4.868938294800302 deviation-heading_max 2.920667575049727 deviation-heading_mean 2.920667575049727 deviation-heading_median 2.920667575049727 deviation-heading_min 2.920667575049727 distance-from-start_max 2.1386574023523237 distance-from-start_mean 2.1386574023523237 distance-from-start_median 2.1386574023523237 distance-from-start_min 2.1386574023523237 driven_any_max 2.8865963267498715 driven_any_mean 2.8865963267498715 driven_any_median 2.8865963267498715 driven_any_min 2.8865963267498715 driven_lanedir_consec_max 2.825725124357286 driven_lanedir_consec_mean 2.825725124357286 driven_lanedir_consec_min 2.825725124357286 driven_lanedir_max 2.825725124357286 driven_lanedir_mean 2.825725124357286 driven_lanedir_median 2.825725124357286 driven_lanedir_min 2.825725124357286 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"udem-000-ego0": {"driven_any": 2.8865963267498715, "survival_time": 49.699999999999314, "driven_lanedir": 2.825725124357286, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920667575049727, "distance-from-start": 2.1386574023523237, "deviation-center-line": 4.868938294800302, "driven_lanedir_consec": 2.825725124357286}}simulation-passed 1 survival_time_max 49.699999999999314 survival_time_mean 49.699999999999314 survival_time_min 49.699999999999314
No reset possible 15647
1400
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 08:02:29+00:00 2022-11-25 08:07:24+00:00 0:04:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4203998040440715 deviation-center-line_median 4.904463356399461
other stats deviation-center-line_max 4.904463356399461 deviation-center-line_mean 4.904463356399461 deviation-center-line_min 4.904463356399461 deviation-heading_max 7.745124858723169 deviation-heading_mean 7.745124858723169 deviation-heading_median 7.745124858723169 deviation-heading_min 7.745124858723169 distance-from-start_max 1.2059816832534165 distance-from-start_mean 1.2059816832534165 distance-from-start_median 1.2059816832534165 distance-from-start_min 1.2059816832534165 driven_any_max 3.485084016236962 driven_any_mean 3.485084016236962 driven_any_median 3.485084016236962 driven_any_min 3.485084016236962 driven_lanedir_consec_max 1.4203998040440715 driven_lanedir_consec_mean 1.4203998040440715 driven_lanedir_consec_min 1.4203998040440715 driven_lanedir_max 3.2905050472289954 driven_lanedir_mean 3.2905050472289954 driven_lanedir_median 3.2905050472289954 driven_lanedir_min 3.2905050472289954 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15637
1403
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 07:43:48+00:00 2022-11-25 08:02:07+00:00 0:18:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999863 driven_lanedir_consec_median 2.2674023788849116 deviation-center-line_median 5.536893088323296
other stats deviation-center-line_max 5.653870952725518 deviation-center-line_mean 5.457974501938994 deviation-center-line_min 5.104240878383868 deviation-heading_max 10.449364417109743 deviation-heading_mean 10.11792868792557 deviation-heading_median 10.098710996708824 deviation-heading_min 9.824928341174887 distance-from-start_max 2.5614095423342453 distance-from-start_mean 2.0332734037963895 distance-from-start_median 2.023972936634097 distance-from-start_min 1.523738199583119 driven_any_max 3.4820813210684833 driven_any_mean 3.4569958269192997 driven_any_median 3.4490866130099316 driven_any_min 3.447728760588852 driven_lanedir_consec_max 3.143458087423762 driven_lanedir_consec_mean 2.322116699583174 driven_lanedir_consec_min 1.610203953139111 driven_lanedir_max 3.2610750728685343 driven_lanedir_mean 3.200371790495466 driven_lanedir_median 3.1833277569609386 driven_lanedir_min 3.173756575191452 in-drivable-lane_max 4.399999999999963 in-drivable-lane_mean 4.0874999999999115 in-drivable-lane_min 3.249999999999958 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4490933302185676, "survival_time": 59.99999999999873, "driven_lanedir": 3.182424665546428, "in-drivable-lane": 4.3499999999998415, "deviation-heading": 10.087643041980582, "distance-from-start": 2.5614095423342453, "deviation-center-line": 5.533862530350289, "driven_lanedir_consec": 3.143458087423762}, "zigzag-000-ego1": {"driven_any": 3.447728760588852, "survival_time": 59.99999999999873, "driven_lanedir": 3.173756575191452, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.449364417109743, "distance-from-start": 1.5342133784714156, "deviation-center-line": 5.653870952725518, "driven_lanedir_consec": 1.6329981415649488}, "zigzag-000-ego2": {"driven_any": 3.4820813210684833, "survival_time": 59.99999999999873, "driven_lanedir": 3.2610750728685343, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778951437065, "distance-from-start": 1.523738199583119, "deviation-center-line": 5.104240878383868, "driven_lanedir_consec": 1.610203953139111}, "zigzag-000-ego3": {"driven_any": 3.4490798958012956, "survival_time": 59.99999999999873, "driven_lanedir": 3.184230848375449, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.824928341174887, "distance-from-start": 2.5137324947967783, "deviation-center-line": 5.5399236462963035, "driven_lanedir_consec": 2.901806616204875}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15636
1403
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 07:37:31+00:00 2022-11-25 07:43:19+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 41.949999999999754 in-drivable-lane_median 2.0999999999999854 driven_lanedir_consec_median 1.6184374408409197 deviation-center-line_median 5.314566823663881
other stats deviation-center-line_max 5.605898707577726 deviation-center-line_mean 5.314566823663881 deviation-center-line_min 5.0232349397500355 deviation-heading_max 12.492151788067773 deviation-heading_mean 8.7311003580401 deviation-heading_median 8.7311003580401 deviation-heading_min 4.970048928012427 distance-from-start_max 1.619836734308344 distance-from-start_mean 1.309141287354286 distance-from-start_median 1.309141287354286 distance-from-start_min 0.998445840400228 driven_any_max 2.3617420337632864 driven_any_mean 1.724083393442756 driven_any_median 1.724083393442756 driven_any_min 1.0864247531222258 driven_lanedir_consec_max 2.2050573724797125 driven_lanedir_consec_mean 1.6184374408409197 driven_lanedir_consec_min 1.031817509202127 driven_lanedir_max 2.2050573724797125 driven_lanedir_mean 1.6184374408409197 driven_lanedir_median 1.6184374408409197 driven_lanedir_min 1.031817509202127 in-drivable-lane_max 3.0999999999999552 in-drivable-lane_mean 2.0999999999999854 in-drivable-lane_min 1.1000000000000156 per-episodes details {"loop2-000-ego0": {"driven_any": 1.0864247531222258, "survival_time": 41.949999999999754, "driven_lanedir": 1.031817509202127, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 12.492151788067773, "distance-from-start": 0.998445840400228, "deviation-center-line": 5.605898707577726, "driven_lanedir_consec": 1.031817509202127}, "loop2-000-ego1": {"driven_any": 2.3617420337632864, "survival_time": 41.949999999999754, "driven_lanedir": 2.2050573724797125, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 4.970048928012427, "distance-from-start": 1.619836734308344, "deviation-center-line": 5.0232349397500355, "driven_lanedir_consec": 2.2050573724797125}}simulation-passed 1 survival_time_max 41.949999999999754 survival_time_mean 41.949999999999754 survival_time_min 41.949999999999754
No reset possible 15623
1406
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 07:26:10+00:00 2022-11-25 07:37:17+00:00 0:11:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3819713089277443 deviation-center-line_median 3.670190139750301
other stats deviation-center-line_max 3.670190139750301 deviation-center-line_mean 3.670190139750301 deviation-center-line_min 3.670190139750301 deviation-heading_max 4.682835183981122 deviation-heading_mean 4.682835183981122 deviation-heading_median 4.682835183981122 deviation-heading_min 4.682835183981122 distance-from-start_max 2.2320761555794064 distance-from-start_mean 2.2320761555794064 distance-from-start_median 2.2320761555794064 distance-from-start_min 2.2320761555794064 driven_any_max 3.5795864361741097 driven_any_mean 3.5795864361741097 driven_any_median 3.5795864361741097 driven_any_min 3.5795864361741097 driven_lanedir_consec_max 3.3819713089277443 driven_lanedir_consec_mean 3.3819713089277443 driven_lanedir_consec_min 3.3819713089277443 driven_lanedir_max 3.551265460849699 driven_lanedir_mean 3.551265460849699 driven_lanedir_median 3.551265460849699 driven_lanedir_min 3.551265460849699 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.5795864361741097, "survival_time": 59.99999999999873, "driven_lanedir": 3.551265460849699, "in-drivable-lane": 0.0, "deviation-heading": 4.682835183981122, "distance-from-start": 2.2320761555794064, "deviation-center-line": 3.670190139750301, "driven_lanedir_consec": 3.3819713089277443}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15620
1407
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 07:23:36+00:00 2022-11-25 07:25:35+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.09999999999998 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.41885674395418215 deviation-center-line_median 0.2592734099538108
other stats deviation-center-line_max 0.2592734099538108 deviation-center-line_mean 0.2592734099538108 deviation-center-line_min 0.2592734099538108 deviation-heading_max 0.7151194489559713 deviation-heading_mean 0.7151194489559713 deviation-heading_median 0.7151194489559713 deviation-heading_min 0.7151194489559713 distance-from-start_max 0.4199960454985642 distance-from-start_mean 0.4199960454985642 distance-from-start_median 0.4199960454985642 distance-from-start_min 0.4199960454985642 driven_any_max 0.42359927688869903 driven_any_mean 0.42359927688869903 driven_any_median 0.42359927688869903 driven_any_min 0.42359927688869903 driven_lanedir_consec_max 0.41885674395418215 driven_lanedir_consec_mean 0.41885674395418215 driven_lanedir_consec_min 0.41885674395418215 driven_lanedir_max 0.41885674395418215 driven_lanedir_mean 0.41885674395418215 driven_lanedir_median 0.41885674395418215 driven_lanedir_min 0.41885674395418215 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}simulation-passed 1 survival_time_max 8.09999999999998 survival_time_mean 8.09999999999998 survival_time_min 8.09999999999998
No reset possible 15613
1408
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 07:13:29+00:00 2022-11-25 07:23:26+00:00 0:09:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.3499999999998664 driven_lanedir_consec_median 3.381630870892481 deviation-center-line_median 6.662994790807998
other stats deviation-center-line_max 6.662994790807998 deviation-center-line_mean 6.662994790807998 deviation-center-line_min 6.662994790807998 deviation-heading_max 5.427561246722322 deviation-heading_mean 5.427561246722322 deviation-heading_median 5.427561246722322 deviation-heading_min 5.427561246722322 distance-from-start_max 2.1860021307337045 distance-from-start_mean 2.1860021307337045 distance-from-start_median 2.1860021307337045 distance-from-start_min 2.1860021307337045 driven_any_max 3.509092323425108 driven_any_mean 3.509092323425108 driven_any_median 3.509092323425108 driven_any_min 3.509092323425108 driven_lanedir_consec_max 3.381630870892481 driven_lanedir_consec_mean 3.381630870892481 driven_lanedir_consec_min 3.381630870892481 driven_lanedir_max 3.381630870892481 driven_lanedir_mean 3.381630870892481 driven_lanedir_median 3.381630870892481 driven_lanedir_min 3.381630870892481 in-drivable-lane_max 2.3499999999998664 in-drivable-lane_mean 2.3499999999998664 in-drivable-lane_min 2.3499999999998664 per-episodes details {"loop-000-ego0": {"driven_any": 3.509092323425108, "survival_time": 59.99999999999873, "driven_lanedir": 3.381630870892481, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.427561246722322, "distance-from-start": 2.1860021307337045, "deviation-center-line": 6.662994790807998, "driven_lanedir_consec": 3.381630870892481}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15606
1410
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 06:53:52+00:00 2022-11-25 07:13:02+00:00 0:19:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.749999999999955 driven_lanedir_consec_median 2.967583630098515 deviation-center-line_median 4.936499581762261
other stats deviation-center-line_max 5.730573072686608 deviation-center-line_mean 4.869852167143673 deviation-center-line_min 3.875836432363564 deviation-heading_max 12.742085043936966 deviation-heading_mean 11.755117428407974 deviation-heading_median 12.00130779644692 deviation-heading_min 10.275769076801083 distance-from-start_max 2.7363667230349455 distance-from-start_mean 2.401179119880523 distance-from-start_median 2.61282418444398 distance-from-start_min 1.6427013875991858 driven_any_max 3.5075798773472937 driven_any_mean 3.403608315922737 driven_any_median 3.4775792335299394 driven_any_min 3.151694919283776 driven_lanedir_consec_max 3.096555837247597 driven_lanedir_consec_mean 2.687260211745085 driven_lanedir_consec_min 1.7173177495357104 driven_lanedir_max 3.302520401483574 driven_lanedir_mean 3.1893582258787174 driven_lanedir_median 3.236776064167141 driven_lanedir_min 2.9813603736970133 in-drivable-lane_max 3.6999999999998785 in-drivable-lane_mean 2.762499999999936 in-drivable-lane_min 1.8499999999999537 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4685801016173095, "survival_time": 59.99999999999873, "driven_lanedir": 3.2300333077609547, "in-drivable-lane": 3.6999999999998785, "deviation-heading": 10.275769076801083, "distance-from-start": 2.544064021687348, "deviation-center-line": 4.350076895892649, "driven_lanedir_consec": 2.9538068865000175}, "zigzag-000-ego1": {"driven_any": 3.4865783654425693, "survival_time": 59.99999999999873, "driven_lanedir": 3.2435188205733265, "in-drivable-lane": 3.099999999999887, "deviation-heading": 11.389215220096572, "distance-from-start": 2.681584347200612, "deviation-center-line": 5.5229222676318726, "driven_lanedir_consec": 3.096555837247597}, "zigzag-000-ego2": {"driven_any": 3.5075798773472937, "survival_time": 59.99999999999873, "driven_lanedir": 3.302520401483574, "in-drivable-lane": 2.400000000000023, "deviation-heading": 12.61340037279727, "distance-from-start": 1.6427013875991858, "deviation-center-line": 3.875836432363564, "driven_lanedir_consec": 1.7173177495357104}, "zigzag-000-ego3": {"driven_any": 3.151694919283776, "survival_time": 59.99999999999873, "driven_lanedir": 2.9813603736970133, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 12.742085043936966, "distance-from-start": 2.7363667230349455, "deviation-center-line": 5.730573072686608, "driven_lanedir_consec": 2.9813603736970133}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15604
1411
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 06:52:09+00:00 2022-11-25 06:53:38+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15600
1412
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 06:47:57+00:00 2022-11-25 06:52:03+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.14999999999957 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.6286605295435175 deviation-center-line_median 4.749421103903259
other stats deviation-center-line_max 4.749421103903259 deviation-center-line_mean 4.749421103903259 deviation-center-line_min 4.749421103903259 deviation-heading_max 3.0022009770680675 deviation-heading_mean 3.0022009770680675 deviation-heading_median 3.0022009770680675 deviation-heading_min 3.0022009770680675 distance-from-start_max 2.133910144488872 distance-from-start_mean 2.133910144488872 distance-from-start_median 2.133910144488872 distance-from-start_min 2.133910144488872 driven_any_max 2.6465975863112976 driven_any_mean 2.6465975863112976 driven_any_median 2.6465975863112976 driven_any_min 2.6465975863112976 driven_lanedir_consec_max 2.6286605295435175 driven_lanedir_consec_mean 2.6286605295435175 driven_lanedir_consec_min 2.6286605295435175 driven_lanedir_max 2.6286605295435175 driven_lanedir_mean 2.6286605295435175 driven_lanedir_median 2.6286605295435175 driven_lanedir_min 2.6286605295435175 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.6465975863112976, "survival_time": 45.14999999999957, "driven_lanedir": 2.6286605295435175, "in-drivable-lane": 0.0, "deviation-heading": 3.0022009770680675, "distance-from-start": 2.133910144488872, "deviation-center-line": 4.749421103903259, "driven_lanedir_consec": 2.6286605295435175}}simulation-passed 1 survival_time_max 45.14999999999957 survival_time_mean 45.14999999999957 survival_time_min 45.14999999999957
No reset possible 15594
1414
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 06:43:04+00:00 2022-11-25 06:47:25+00:00 0:04:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 1.3850760857666788 deviation-center-line_median 5.586765713943565
other stats deviation-center-line_max 5.586765713943565 deviation-center-line_mean 5.586765713943565 deviation-center-line_min 5.586765713943565 deviation-heading_max 8.627279155437556 deviation-heading_mean 8.627279155437556 deviation-heading_median 8.627279155437556 deviation-heading_min 8.627279155437556 distance-from-start_max 1.0494474660975028 distance-from-start_mean 1.0494474660975028 distance-from-start_median 1.0494474660975028 distance-from-start_min 1.0494474660975028 driven_any_max 3.449081931991406 driven_any_mean 3.449081931991406 driven_any_median 3.449081931991406 driven_any_min 3.449081931991406 driven_lanedir_consec_max 1.3850760857666788 driven_lanedir_consec_mean 1.3850760857666788 driven_lanedir_consec_min 1.3850760857666788 driven_lanedir_max 3.20200785319052 driven_lanedir_mean 3.20200785319052 driven_lanedir_median 3.20200785319052 driven_lanedir_min 3.20200785319052 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081931991406, "survival_time": 59.99999999999873, "driven_lanedir": 3.20200785319052, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279155437556, "distance-from-start": 1.0494474660975028, "deviation-center-line": 5.586765713943565, "driven_lanedir_consec": 1.3850760857666788}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15589
1415
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 06:37:30+00:00 2022-11-25 06:42:34+00:00 0:05:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3284423748962833 deviation-center-line_median 2.2080698436648767
other stats deviation-center-line_max 2.2080698436648767 deviation-center-line_mean 2.2080698436648767 deviation-center-line_min 2.2080698436648767 deviation-heading_max 3.646079460993991 deviation-heading_mean 3.646079460993991 deviation-heading_median 3.646079460993991 deviation-heading_min 3.646079460993991 distance-from-start_max 2.0667500720956693 distance-from-start_mean 2.0667500720956693 distance-from-start_median 2.0667500720956693 distance-from-start_min 2.0667500720956693 driven_any_max 3.579583385567372 driven_any_mean 3.579583385567372 driven_any_median 3.579583385567372 driven_any_min 3.579583385567372 driven_lanedir_consec_max 3.3284423748962833 driven_lanedir_consec_mean 3.3284423748962833 driven_lanedir_consec_min 3.3284423748962833 driven_lanedir_max 3.558841603983183 driven_lanedir_mean 3.558841603983183 driven_lanedir_median 3.558841603983183 driven_lanedir_min 3.558841603983183 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.579583385567372, "survival_time": 59.99999999999873, "driven_lanedir": 3.558841603983183, "in-drivable-lane": 0.0, "deviation-heading": 3.646079460993991, "distance-from-start": 2.0667500720956693, "deviation-center-line": 2.2080698436648767, "driven_lanedir_consec": 3.3284423748962833}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15584
1417
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 06:27:50+00:00 2022-11-25 06:37:24+00:00 0:09:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.499999999999858 driven_lanedir_consec_median 2.073568167625771 deviation-center-line_median 5.586339009536689
other stats deviation-center-line_max 5.586339009536689 deviation-center-line_mean 5.586339009536689 deviation-center-line_min 5.586339009536689 deviation-heading_max 4.940364769457971 deviation-heading_mean 4.940364769457971 deviation-heading_median 4.940364769457971 deviation-heading_min 4.940364769457971 distance-from-start_max 1.7409270883034778 distance-from-start_mean 1.7409270883034778 distance-from-start_median 1.7409270883034778 distance-from-start_min 1.7409270883034778 driven_any_max 3.504586985619137 driven_any_mean 3.504586985619137 driven_any_median 3.504586985619137 driven_any_min 3.504586985619137 driven_lanedir_consec_max 2.073568167625771 driven_lanedir_consec_mean 2.073568167625771 driven_lanedir_consec_min 2.073568167625771 driven_lanedir_max 3.360909384451456 driven_lanedir_mean 3.360909384451456 driven_lanedir_median 3.360909384451456 driven_lanedir_min 3.360909384451456 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 2.499999999999858 in-drivable-lane_min 2.499999999999858 per-episodes details {"4way-000-ego0": {"driven_any": 3.504586985619137, "survival_time": 59.99999999999873, "driven_lanedir": 3.360909384451456, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.940364769457971, "distance-from-start": 1.7409270883034778, "deviation-center-line": 5.586339009536689, "driven_lanedir_consec": 2.073568167625771}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15575
1419
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 06:22:34+00:00 2022-11-25 06:27:19+00:00 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 52.74999999999914 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.049495028380312 deviation-center-line_median 4.252786905257612
other stats deviation-center-line_max 4.252786905257612 deviation-center-line_mean 4.252786905257612 deviation-center-line_min 4.252786905257612 deviation-heading_max 7.335832537624176 deviation-heading_mean 7.335832537624176 deviation-heading_median 7.335832537624176 deviation-heading_min 7.335832537624176 distance-from-start_max 2.5590901305577565 distance-from-start_mean 2.5590901305577565 distance-from-start_median 2.5590901305577565 distance-from-start_min 2.5590901305577565 driven_any_max 3.10259355659584 driven_any_mean 3.10259355659584 driven_any_median 3.10259355659584 driven_any_min 3.10259355659584 driven_lanedir_consec_max 3.049495028380312 driven_lanedir_consec_mean 3.049495028380312 driven_lanedir_consec_min 3.049495028380312 driven_lanedir_max 3.049495028380312 driven_lanedir_mean 3.049495028380312 driven_lanedir_median 3.049495028380312 driven_lanedir_min 3.049495028380312 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.10259355659584, "survival_time": 52.74999999999914, "driven_lanedir": 3.049495028380312, "in-drivable-lane": 0.0, "deviation-heading": 7.335832537624176, "distance-from-start": 2.5590901305577565, "deviation-center-line": 4.252786905257612, "driven_lanedir_consec": 3.049495028380312}}simulation-passed 1 survival_time_max 52.74999999999914 survival_time_mean 52.74999999999914 survival_time_min 52.74999999999914
No reset possible 15571
1420
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 06:17:51+00:00 2022-11-25 06:22:20+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.5026609949387937 deviation-center-line_median 4.00803286999595
other stats deviation-center-line_max 4.00803286999595 deviation-center-line_mean 4.00803286999595 deviation-center-line_min 4.00803286999595 deviation-heading_max 9.741722574045852 deviation-heading_mean 9.741722574045852 deviation-heading_median 9.741722574045852 deviation-heading_min 9.741722574045852 distance-from-start_max 3.051215295455992 distance-from-start_mean 3.051215295455992 distance-from-start_median 3.051215295455992 distance-from-start_min 3.051215295455992 driven_any_max 3.579590602174237 driven_any_mean 3.579590602174237 driven_any_median 3.579590602174237 driven_any_min 3.579590602174237 driven_lanedir_consec_max 3.5026609949387937 driven_lanedir_consec_mean 3.5026609949387937 driven_lanedir_consec_min 3.5026609949387937 driven_lanedir_max 3.5026609949387937 driven_lanedir_mean 3.5026609949387937 driven_lanedir_median 3.5026609949387937 driven_lanedir_min 3.5026609949387937 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.579590602174237, "survival_time": 59.99999999999873, "driven_lanedir": 3.5026609949387937, "in-drivable-lane": 0.0, "deviation-heading": 9.741722574045852, "distance-from-start": 3.051215295455992, "deviation-center-line": 4.00803286999595, "driven_lanedir_consec": 3.5026609949387937}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15569
1421
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 06:15:59+00:00 2022-11-25 06:17:40+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15563
1422
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 06:05:49+00:00 2022-11-25 06:15:38+00:00 0:09:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.0050106271821506 deviation-center-line_median 4.908963644722344
other stats deviation-center-line_max 6.01198792060873 deviation-center-line_mean 4.593358939184355 deviation-center-line_min 2.5435205466839994 deviation-heading_max 5.727471290631747 deviation-heading_mean 4.526175130231045 deviation-heading_median 4.686700534848095 deviation-heading_min 3.003828160596244 distance-from-start_max 2.5613241003039633 distance-from-start_mean 1.914912599777095 distance-from-start_median 1.98188247541307 distance-from-start_min 1.134561347978277 driven_any_max 3.579580754957026 driven_any_mean 3.2360870781772753 driven_any_median 3.2450849856660264 driven_any_min 2.8745975864200206 driven_lanedir_consec_max 3.211958001358496 driven_lanedir_consec_mean 3.019665595541482 driven_lanedir_consec_min 2.856683126443131 driven_lanedir_max 3.5310621633486874 driven_lanedir_mean 3.181338396476557 driven_lanedir_median 3.1688041281752737 driven_lanedir_min 2.856683166206994 in-drivable-lane_max 2.2000000000000313 in-drivable-lane_mean 0.5500000000000078 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15556
1424
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 05:56:20+00:00 2022-11-25 06:05:39+00:00 0:09:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.174999999999917 driven_lanedir_consec_median 2.6226225453427174 deviation-center-line_median 5.3031846613240265
other stats deviation-center-line_max 5.816265976116539 deviation-center-line_mean 5.196634927837193 deviation-center-line_min 4.363904412584181 deviation-heading_max 13.510507170954757 deviation-heading_mean 10.821915690706016 deviation-heading_median 10.428621244524829 deviation-heading_min 8.919913102819658 distance-from-start_max 2.9580871089811698 distance-from-start_mean 2.332849013698153 distance-from-start_median 2.410604919303986 distance-from-start_min 1.55209910720347 driven_any_max 3.579590098610528 driven_any_mean 3.3933509000885236 driven_any_median 3.464904539716091 driven_any_min 3.064004422311384 driven_lanedir_consec_max 3.4992371353936753 driven_lanedir_consec_mean 2.597829668578795 driven_lanedir_consec_min 1.64683644823607 driven_lanedir_max 3.4992371353936753 driven_lanedir_mean 3.216224003341642 driven_lanedir_median 3.212923209015736 driven_lanedir_min 2.939812459941421 in-drivable-lane_max 4.299999999999949 in-drivable-lane_mean 2.162499999999946 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.579590098610528, "survival_time": 59.99999999999873, "driven_lanedir": 3.4992371353936753, "in-drivable-lane": 0.0, "deviation-heading": 8.919913102819658, "distance-from-start": 2.9580871089811698, "deviation-center-line": 4.363904412584181, "driven_lanedir_consec": 3.4992371353936753}, "zigzag-000-ego1": {"driven_any": 3.4790808241674496, "survival_time": 59.99999999999873, "driven_lanedir": 3.252574528929212, "in-drivable-lane": 3.3499999999998913, "deviation-heading": 10.055957232850009, "distance-from-start": 2.114012987076784, "deviation-center-line": 5.136572055912668, "driven_lanedir_consec": 2.305432630744014}, "zigzag-000-ego2": {"driven_any": 3.064004422311384, "survival_time": 59.99999999999873, "driven_lanedir": 2.939812459941421, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 13.510507170954757, "distance-from-start": 2.707196851531188, "deviation-center-line": 5.469797266735385, "driven_lanedir_consec": 2.939812459941421}, "zigzag-000-ego3": {"driven_any": 3.4507282552647327, "survival_time": 59.99999999999873, "driven_lanedir": 3.17327188910226, "in-drivable-lane": 4.299999999999949, "deviation-heading": 10.80128525619965, "distance-from-start": 1.55209910720347, "deviation-center-line": 5.816265976116539, "driven_lanedir_consec": 1.64683644823607}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15552
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-03-6.2.51
2022-11-25 05:47:51+00:00 2022-11-25 05:56:12+00:00 0:08:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15549
1424
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 05:42:57+00:00 2022-11-25 05:47:30+00:00 0:04:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.3499999999998806 driven_lanedir_consec_median 2.380746158820441 deviation-center-line_median 6.07518739971563
other stats deviation-center-line_max 6.5629821214913955 deviation-center-line_mean 6.07518739971563 deviation-center-line_min 5.587392677939865 deviation-heading_max 8.266160603781476 deviation-heading_mean 7.316254408081507 deviation-heading_median 7.316254408081507 deviation-heading_min 6.3663482123815385 distance-from-start_max 1.6314589686392718 distance-from-start_mean 1.433307130896814 distance-from-start_median 1.433307130896814 distance-from-start_min 1.235155293154356 driven_any_max 3.4865836169069464 driven_any_mean 3.479150653763286 driven_any_median 3.479150653763286 driven_any_min 3.471717690619625 driven_lanedir_consec_max 3.2882116374610164 driven_lanedir_consec_mean 2.380746158820441 driven_lanedir_consec_min 1.4732806801798657 driven_lanedir_max 3.2882116374610164 driven_lanedir_mean 3.2881134223745017 driven_lanedir_median 3.2881134223745017 driven_lanedir_min 3.2880152072879874 in-drivable-lane_max 3.5999999999997954 in-drivable-lane_mean 3.3499999999998806 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15542
1426
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 05:34:03+00:00 2022-11-25 05:42:35+00:00 0:08:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.249999999999929 driven_lanedir_consec_median 3.4642921416450347 deviation-center-line_median 6.136200161902763
other stats deviation-center-line_max 6.136200161902763 deviation-center-line_mean 6.136200161902763 deviation-center-line_min 6.136200161902763 deviation-heading_max 4.680365944406787 deviation-heading_mean 4.680365944406787 deviation-heading_median 4.680365944406787 deviation-heading_min 4.680365944406787 distance-from-start_max 2.417373767628198 distance-from-start_mean 2.417373767628198 distance-from-start_median 2.417373767628198 distance-from-start_min 2.417373767628198 driven_any_max 3.542094542339661 driven_any_mean 3.542094542339661 driven_any_median 3.542094542339661 driven_any_min 3.542094542339661 driven_lanedir_consec_max 3.4642921416450347 driven_lanedir_consec_mean 3.4642921416450347 driven_lanedir_consec_min 3.4642921416450347 driven_lanedir_max 3.4642921416450347 driven_lanedir_mean 3.4642921416450347 driven_lanedir_median 3.4642921416450347 driven_lanedir_min 3.4642921416450347 in-drivable-lane_max 1.249999999999929 in-drivable-lane_mean 1.249999999999929 in-drivable-lane_min 1.249999999999929 per-episodes details {"loop-000-ego0": {"driven_any": 3.542094542339661, "survival_time": 59.99999999999873, "driven_lanedir": 3.4642921416450347, "in-drivable-lane": 1.249999999999929, "deviation-heading": 4.680365944406787, "distance-from-start": 2.417373767628198, "deviation-center-line": 6.136200161902763, "driven_lanedir_consec": 3.4642921416450347}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15537
1427
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 05:30:05+00:00 2022-11-25 05:33:38+00:00 0:03:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.19999999999991 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 1.303336274368214 deviation-center-line_median 2.900740783049649
other stats deviation-center-line_max 2.900740783049649 deviation-center-line_mean 2.900740783049649 deviation-center-line_min 2.900740783049649 deviation-heading_max 5.3959193297072545 deviation-heading_mean 5.3959193297072545 deviation-heading_median 5.3959193297072545 deviation-heading_min 5.3959193297072545 distance-from-start_max 1.390965508634873 distance-from-start_mean 1.390965508634873 distance-from-start_median 1.390965508634873 distance-from-start_min 1.390965508634873 driven_any_max 2.2295876463781625 driven_any_mean 2.2295876463781625 driven_any_median 2.2295876463781625 driven_any_min 2.2295876463781625 driven_lanedir_consec_max 1.303336274368214 driven_lanedir_consec_mean 1.303336274368214 driven_lanedir_consec_min 1.303336274368214 driven_lanedir_max 2.097514770609055 driven_lanedir_mean 2.097514770609055 driven_lanedir_median 2.097514770609055 driven_lanedir_min 2.097514770609055 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 2.2295876463781625, "survival_time": 39.19999999999991, "driven_lanedir": 2.097514770609055, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.3959193297072545, "distance-from-start": 1.390965508634873, "deviation-center-line": 2.900740783049649, "driven_lanedir_consec": 1.303336274368214}}simulation-passed 1 survival_time_max 39.19999999999991 survival_time_mean 39.19999999999991 survival_time_min 39.19999999999991
No reset possible 15531
1429
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 05:26:33+00:00 2022-11-25 05:29:50+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.099999999999983 in-drivable-lane_median 5.649999999999983 driven_lanedir_consec_median 0.1397956002040246 deviation-center-line_median 0.09390664341773942
other stats deviation-center-line_max 0.09390664341773942 deviation-center-line_mean 0.09390664341773942 deviation-center-line_min 0.09390664341773942 deviation-heading_max 0.9654183287874442 deviation-heading_mean 0.9654183287874442 deviation-heading_median 0.9654183287874442 deviation-heading_min 0.9654183287874442 distance-from-start_max 1.0016247187181055 distance-from-start_mean 1.0016247187181055 distance-from-start_median 1.0016247187181055 distance-from-start_min 1.0016247187181055 driven_any_max 1.0016732136326914 driven_any_mean 1.0016732136326914 driven_any_median 1.0016732136326914 driven_any_min 1.0016732136326914 driven_lanedir_consec_max 0.1397956002040246 driven_lanedir_consec_mean 0.1397956002040246 driven_lanedir_consec_min 0.1397956002040246 driven_lanedir_max 0.1397956002040246 driven_lanedir_mean 0.1397956002040246 driven_lanedir_median 0.1397956002040246 driven_lanedir_min 0.1397956002040246 in-drivable-lane_max 5.649999999999983 in-drivable-lane_mean 5.649999999999983 in-drivable-lane_min 5.649999999999983 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.0016732136326914, "survival_time": 7.099999999999983, "driven_lanedir": 0.1397956002040246, "in-drivable-lane": 5.649999999999983, "deviation-heading": 0.9654183287874442, "distance-from-start": 1.0016247187181055, "deviation-center-line": 0.09390664341773942, "driven_lanedir_consec": 0.1397956002040246}}simulation-passed 1 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 15528
1430
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-1of4 host-error no davinci-stage-03-6.2.51
2022-11-25 05:25:27+00:00 2022-11-25 05:26:19+00:00 0:00:52 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15526
1430
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 05:23:47+00:00 2022-11-25 05:25:20+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15523
1431
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 05:22:01+00:00 2022-11-25 05:23:33+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15519
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 05:20:14+00:00 2022-11-25 05:21:55+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15517
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-0of4 host-error no davinci-stage-03-6.2.51
2022-11-25 05:19:35+00:00 2022-11-25 05:19:52+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15513
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-0of4 host-error no davinci-stage-03-6.2.51
2022-11-25 05:19:04+00:00 2022-11-25 05:19:21+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15510
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-2of4 host-error no davinci-stage-03-6.2.51
2022-11-25 05:18:32+00:00 2022-11-25 05:18:49+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15505
1434
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 05:14:08+00:00 2022-11-25 05:18:09+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.250000000000025 in-drivable-lane_median 8.775000000000027 driven_lanedir_consec_median 0.3301338553680937 deviation-center-line_median 0.20320237015909776
other stats deviation-center-line_max 0.27574141344199116 deviation-center-line_mean 0.2019553718705288 deviation-center-line_min 0.12567533372192854 deviation-heading_max 0.9488219555580462 deviation-heading_mean 0.8390918912315833 deviation-heading_median 0.8356408604491967 deviation-heading_min 0.7362638884698938 distance-from-start_max 1.6837476731392351 distance-from-start_mean 1.1946840199531843 distance-from-start_median 1.3150560032892975 distance-from-start_min 0.46487640009490705 driven_any_max 1.6838575324025415 driven_any_mean 1.194754885742435 driven_any_median 1.3151384084002675 driven_any_min 0.4648851937666637 driven_lanedir_consec_max 0.5392559894853717 driven_lanedir_consec_mean 0.3398044417698246 driven_lanedir_consec_min 0.15969406685773935 driven_lanedir_max 0.5392559894853717 driven_lanedir_mean 0.3398044417698246 driven_lanedir_median 0.3301338553680937 driven_lanedir_min 0.15969406685773935 in-drivable-lane_max 9.800000000000026 in-drivable-lane_mean 8.725000000000026 in-drivable-lane_min 7.55000000000003 per-episodes details {"autolab-000-ego0": {"driven_any": 0.4648851937666637, "survival_time": 11.250000000000025, "driven_lanedir": 0.19955171937759708, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.46487640009490705, "deviation-center-line": 0.12567533372192854, "driven_lanedir_consec": 0.19955171937759708}, "autolab-000-ego1": {"driven_any": 1.463212954741934, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969406685773935, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.4631057991302578, "deviation-center-line": 0.1356249107782703, "driven_lanedir_consec": 0.15969406685773935}, "autolab-000-ego2": {"driven_any": 1.1670638620586014, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392559894853717, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722499510568, "distance-from-start": 1.1670062074483376, "deviation-center-line": 0.2707798295399252, "driven_lanedir_consec": 0.5392559894853717}, "autolab-000-ego3": {"driven_any": 1.6838575324025415, "survival_time": 11.250000000000025, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 8.05000000000003, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 11.250000000000025 survival_time_min 11.250000000000025
No reset possible 15502
1435
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 05:12:32+00:00 2022-11-25 05:13:55+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.499999999999992 in-drivable-lane_median 2.749999999999991 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.12567511082985364
other stats deviation-center-line_max 0.12567511082985364 deviation-center-line_mean 0.12567511082985364 deviation-center-line_min 0.12567511082985364 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.5733789333527137 distance-from-start_mean 0.5733789333527137 distance-from-start_median 0.5733789333527137 distance-from-start_min 0.5733789333527137 driven_any_max 0.5733903362648751 driven_any_mean 0.5733903362648751 driven_any_median 0.5733903362648751 driven_any_min 0.5733903362648751 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 2.749999999999991 in-drivable-lane_mean 2.749999999999991 in-drivable-lane_min 2.749999999999991 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5733903362648751, "survival_time": 4.499999999999992, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 2.749999999999991, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.5733789333527137, "deviation-center-line": 0.12567511082985364, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 4.499999999999992 survival_time_mean 4.499999999999992 survival_time_min 4.499999999999992
No reset possible 15500
1435
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 05:10:52+00:00 2022-11-25 05:12:18+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.299999999999989 in-drivable-lane_median 3.5499999999999883 driven_lanedir_consec_median 0.1995526730519679 deviation-center-line_median 0.12567493837705493
other stats deviation-center-line_max 0.12567493837705493 deviation-center-line_mean 0.12567493837705493 deviation-center-line_min 0.12567493837705493 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.7065171257852313 distance-from-start_mean 0.7065171257852313 distance-from-start_median 0.7065171257852313 distance-from-start_min 0.7065171257852313 driven_any_max 0.7065288976667109 driven_any_mean 0.7065288976667109 driven_any_median 0.7065288976667109 driven_any_min 0.7065288976667109 driven_lanedir_consec_max 0.1995526730519679 driven_lanedir_consec_mean 0.1995526730519679 driven_lanedir_consec_min 0.1995526730519679 driven_lanedir_max 0.1995526730519679 driven_lanedir_mean 0.1995526730519679 driven_lanedir_median 0.1995526730519679 driven_lanedir_min 0.1995526730519679 in-drivable-lane_max 3.5499999999999883 in-drivable-lane_mean 3.5499999999999883 in-drivable-lane_min 3.5499999999999883 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7065288976667109, "survival_time": 5.299999999999989, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 3.5499999999999883, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.7065171257852313, "deviation-center-line": 0.12567493837705493, "driven_lanedir_consec": 0.1995526730519679}}simulation-passed 1 survival_time_max 5.299999999999989 survival_time_mean 5.299999999999989 survival_time_min 5.299999999999989
No reset possible 15496
1438
Bea Baselines 🐤minimal-agent lx22-visservoing
sim success yes davinci-stage-03-6.2.51
2022-11-25 05:08:11+00:00 2022-11-25 05:10:19+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 2.6499999999999924 deviation-center-line_median 0.17493349275674216 driven_lanedir_consec_median 0.8221776345283069 survival_time_median 8.14999999999998
other stats deviation-center-line_max 0.17647811751212122 deviation-center-line_mean 0.17493349275674216 deviation-center-line_min 0.1733888680013631 deviation-heading_max 0.7383278077616701 deviation-heading_mean 0.7099934263375745 deviation-heading_median 0.7099934263375745 deviation-heading_min 0.681659044913479 distance-from-start_max 1.175276406473093 distance-from-start_mean 1.175237634650054 distance-from-start_median 1.175237634650054 distance-from-start_min 1.1751988628270151 driven_any_max 1.1755804280577309 driven_any_mean 1.175457669946736 driven_any_median 1.175457669946736 driven_any_min 1.175334911835741 driven_lanedir_consec_max 0.8828170026503562 driven_lanedir_consec_mean 0.8221776345283069 driven_lanedir_consec_min 0.7615382664062577 driven_lanedir_max 0.8828170026503562 driven_lanedir_mean 0.8221776345283069 driven_lanedir_median 0.8221776345283069 driven_lanedir_min 0.7615382664062577 in-drivable-lane_max 2.999999999999991 in-drivable-lane_mean 2.6499999999999924 in-drivable-lane_min 2.2999999999999936 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 1.1755804280577309, "survival_time": 8.14999999999998, "driven_lanedir": 0.7615382664062577, "in-drivable-lane": 2.999999999999991, "deviation-heading": 0.681659044913479, "distance-from-start": 1.1751988628270151, "deviation-center-line": 0.1733888680013631, "driven_lanedir_consec": 0.7615382664062577}, "LF-small-loop-001-ego0": {"driven_any": 1.175334911835741, "survival_time": 8.14999999999998, "driven_lanedir": 0.8828170026503562, "in-drivable-lane": 2.2999999999999936, "deviation-heading": 0.7383278077616701, "distance-from-start": 1.175276406473093, "deviation-center-line": 0.17647811751212122, "driven_lanedir_consec": 0.8828170026503562}}simulation-passed 1 survival_time_max 8.14999999999998 survival_time_mean 8.14999999999998 survival_time_min 8.14999999999998
No reset possible 15493
1440
Bea Baselines 🐤minimal-agent lx22-BV1
sim-0of5 success no davinci-stage-03-6.2.51
2022-11-25 05:06:40+00:00 2022-11-25 05:08:03+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.38992181148908706
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.38992181148908706 distance-from-start_median 0.38992181148908706 distance-from-start_min 0.38992181148908706 driven_any_max 0.3899290723045018 driven_any_mean 0.3899290723045018 driven_any_median 0.3899290723045018 driven_any_min 0.3899290723045018 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.399999999999996 in-drivable-lane_mean 3.399999999999996 in-drivable-lane_median 3.399999999999996 in-drivable-lane_min 3.399999999999996 per-episodes details {"d30-ego0": {"driven_any": 0.3899290723045018, "survival_time": 3.399999999999996, "driven_lanedir": 0.0, "in-drivable-lane": 3.399999999999996, "deviation-heading": 0.0, "distance-from-start": 0.38992181148908706, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 3.399999999999996 survival_time_median 3.399999999999996 survival_time_min 3.399999999999996
No reset possible 15489
1443
Bea Baselines 🐤minimal-agent aido-hello-sim-validation
sanity-check success no davinci-stage-03-6.2.51
2022-11-25 05:05:11+00:00 2022-11-25 05:06:20+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.027182527438338155 deviation-center-line_median 0.005231420846612685
other stats deviation-center-line_max 0.005231420846612685 deviation-center-line_mean 0.005231420846612685 deviation-center-line_min 0.005231420846612685 deviation-heading_max 0.26820132194453994 deviation-heading_mean 0.26820132194453994 deviation-heading_median 0.26820132194453994 deviation-heading_min 0.26820132194453994 distance-from-start_max 0.03160072536398472 distance-from-start_mean 0.03160072536398472 distance-from-start_median 0.03160072536398472 distance-from-start_min 0.03160072536398472 driven_any_max 0.03160074670807487 driven_any_mean 0.03160074670807487 driven_any_median 0.03160074670807487 driven_any_min 0.03160074670807487 driven_lanedir_consec_max 0.027182527438338155 driven_lanedir_consec_mean 0.027182527438338155 driven_lanedir_consec_min 0.027182527438338155 driven_lanedir_max 0.027182527438338155 driven_lanedir_mean 0.027182527438338155 driven_lanedir_median 0.027182527438338155 driven_lanedir_min 0.027182527438338155 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03160074670807487, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027182527438338155, "in-drivable-lane": 0.0, "deviation-heading": 0.26820132194453994, "distance-from-start": 0.03160072536398472, "deviation-center-line": 0.005231420846612685, "driven_lanedir_consec": 0.027182527438338155}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15486
1447
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 05:02:20+00:00 2022-11-25 05:04:58+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.549999999999988 in-drivable-lane_median 4.149999999999988 driven_lanedir_consec_median 0.1366657585905482 deviation-center-line_median 0.10783820466790534
other stats deviation-center-line_max 0.10783820466790534 deviation-center-line_mean 0.10783820466790534 deviation-center-line_min 0.10783820466790534 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.7476573144701085 distance-from-start_mean 0.7476573144701085 distance-from-start_median 0.7476573144701085 distance-from-start_min 0.7476573144701085 driven_any_max 0.7476698075499906 driven_any_mean 0.7476698075499906 driven_any_median 0.7476698075499906 driven_any_min 0.7476698075499906 driven_lanedir_consec_max 0.1366657585905482 driven_lanedir_consec_mean 0.1366657585905482 driven_lanedir_consec_min 0.1366657585905482 driven_lanedir_max 0.1366657585905482 driven_lanedir_mean 0.1366657585905482 driven_lanedir_median 0.1366657585905482 driven_lanedir_min 0.1366657585905482 in-drivable-lane_max 4.149999999999988 in-drivable-lane_mean 4.149999999999988 in-drivable-lane_min 4.149999999999988 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7476698075499906, "survival_time": 5.549999999999988, "driven_lanedir": 0.1366657585905482, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7476573144701085, "deviation-center-line": 0.10783820466790534, "driven_lanedir_consec": 0.1366657585905482}}simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 5.549999999999988 survival_time_min 5.549999999999988
No reset possible 15479
1449
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 04:59:41+00:00 2022-11-25 05:01:54+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.850000000000003 in-drivable-lane_median 8.450000000000005 driven_lanedir_consec_median 0.13666265914899656 deviation-center-line_median 0.10783777071756002
other stats deviation-center-line_max 0.10783777071756002 deviation-center-line_mean 0.10783777071756002 deviation-center-line_min 0.10783777071756002 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.4547842507789357 distance-from-start_mean 1.4547842507789357 distance-from-start_median 1.4547842507789357 distance-from-start_min 1.4547842507789357 driven_any_max 1.454891323746283 driven_any_mean 1.454891323746283 driven_any_median 1.454891323746283 driven_any_min 1.454891323746283 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 8.450000000000005 in-drivable-lane_mean 8.450000000000005 in-drivable-lane_min 8.450000000000005 per-episodes details {"udem1-000-ego0": {"driven_any": 1.454891323746283, "survival_time": 9.850000000000003, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 8.450000000000005, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.4547842507789357, "deviation-center-line": 0.10783777071756002, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 9.850000000000003 survival_time_mean 9.850000000000003 survival_time_min 9.850000000000003
No reset possible 15475
1450
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 04:57:27+00:00 2022-11-25 04:59:13+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.30902388815479953 survival_time_median 13.80000000000006 deviation-center-line_median 0.26861568883973136 in-drivable-lane_median 10.700000000000069
other stats deviation-center-line_max 0.26861568883973136 deviation-center-line_mean 0.26861568883973136 deviation-center-line_min 0.26861568883973136 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 2.107081087129661 distance-from-start_mean 2.107081087129661 distance-from-start_median 2.107081087129661 distance-from-start_min 2.107081087129661 driven_any_max 2.107326449228953 driven_any_mean 2.107326449228953 driven_any_median 2.107326449228953 driven_any_min 2.107326449228953 driven_lanedir_consec_max 0.30902388815479953 driven_lanedir_consec_mean 0.30902388815479953 driven_lanedir_consec_min 0.30902388815479953 driven_lanedir_max 0.30902388815479953 driven_lanedir_mean 0.30902388815479953 driven_lanedir_median 0.30902388815479953 driven_lanedir_min 0.30902388815479953 in-drivable-lane_max 10.700000000000069 in-drivable-lane_mean 10.700000000000069 in-drivable-lane_min 10.700000000000069 per-episodes details {"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 13.80000000000006 survival_time_min 13.80000000000006
No reset possible 15468
1452
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 04:53:50+00:00 2022-11-25 04:57:20+00:00 0:03:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.650000000000002 in-drivable-lane_median 7.325000000000005 driven_lanedir_consec_median 0.22238961894840312 deviation-center-line_median 0.2217639861515468
other stats deviation-center-line_max 0.3356899474445727 deviation-center-line_mean 0.2217639861515468 deviation-center-line_min 0.10783802485852088 deviation-heading_max 2.3398302467533574 deviation-heading_mean 1.645317544794148 deviation-heading_median 1.645317544794148 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.4215609490996366 distance-from-start_mean 1.232352636856231 distance-from-start_median 1.232352636856231 distance-from-start_min 1.0431443246128251 driven_any_max 1.421667748584305 driven_any_mean 1.2324324663788455 driven_any_median 1.2324324663788455 driven_any_min 1.043197184173386 driven_lanedir_consec_max 0.3081134793062541 driven_lanedir_consec_mean 0.22238961894840312 driven_lanedir_consec_min 0.1366657585905522 driven_lanedir_max 0.3081134793062541 driven_lanedir_mean 0.22238961894840312 driven_lanedir_median 0.22238961894840312 driven_lanedir_min 0.1366657585905522 in-drivable-lane_max 8.250000000000002 in-drivable-lane_mean 7.325000000000005 in-drivable-lane_min 6.400000000000007 per-episodes details {"loop2-000-ego0": {"driven_any": 1.043197184173386, "survival_time": 9.650000000000002, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.250000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128251, "deviation-center-line": 0.10783802485852088, "driven_lanedir_consec": 0.1366657585905522}, "loop2-000-ego1": {"driven_any": 1.421667748584305, "survival_time": 9.650000000000002, "driven_lanedir": 0.3081134793062541, "in-drivable-lane": 6.400000000000007, "deviation-heading": 2.3398302467533574, "distance-from-start": 1.4215609490996366, "deviation-center-line": 0.3356899474445727, "driven_lanedir_consec": 0.3081134793062541}}simulation-passed 1 survival_time_max 9.650000000000002 survival_time_mean 9.650000000000002 survival_time_min 9.650000000000002
No reset possible 15464
1452
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 04:47:03+00:00 2022-11-25 04:53:35+00:00 0:06:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.200000000000166 in-drivable-lane_median 19.625000000000163 driven_lanedir_consec_median 0.17676532608959172 deviation-center-line_median 0.12055883486711412
other stats deviation-center-line_max 0.8045746318533537 deviation-center-line_mean 0.2853942640066456 deviation-center-line_min 0.09588475443900028 deviation-heading_max 5.2482884111975086 deviation-heading_mean 1.8371274357323064 deviation-heading_median 0.7612914460035247 deviation-heading_min 0.5776384397246679 distance-from-start_max 3.3354107982510546 distance-from-start_mean 2.2110865327147784 distance-from-start_median 2.191605904940471 distance-from-start_min 1.1257235227271165 driven_any_max 3.3361297078559655 driven_any_mean 2.2114839832360524 driven_any_median 2.1920133941339253 driven_any_min 1.1257794368203942 driven_lanedir_consec_max 1.1849271720723111 driven_lanedir_consec_mean 0.4079658658358902 driven_lanedir_consec_min 0.09340563909206612 driven_lanedir_max 1.1849271720723111 driven_lanedir_mean 0.4079658658358902 driven_lanedir_median 0.17676532608959172 driven_lanedir_min 0.09340563909206612 in-drivable-lane_max 20.100000000000165 in-drivable-lane_mean 17.837500000000155 in-drivable-lane_min 12.00000000000012 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.3361297078559655, "survival_time": 21.200000000000166, "driven_lanedir": 1.1849271720723111, "in-drivable-lane": 12.00000000000012, "deviation-heading": 5.2482884111975086, "distance-from-start": 3.3354107982510546, "deviation-center-line": 0.8045746318533537, "driven_lanedir_consec": 1.1849271720723111}, "zigzag-000-ego1": {"driven_any": 2.855019965863893, "survival_time": 21.200000000000166, "driven_lanedir": 0.14869325237796405, "in-drivable-lane": 19.850000000000165, "deviation-heading": 0.5776384397246679, "distance-from-start": 2.8543136070620254, "deviation-center-line": 0.1372078405659203, "driven_lanedir_consec": 0.14869325237796405}, "zigzag-000-ego2": {"driven_any": 1.5290068224039577, "survival_time": 21.200000000000166, "driven_lanedir": 0.20483739980121937, "in-drivable-lane": 19.40000000000017, "deviation-heading": 0.7499200019270054, "distance-from-start": 1.5288982028189169, "deviation-center-line": 0.09588475443900028, "driven_lanedir_consec": 0.20483739980121937}, "zigzag-000-ego3": {"driven_any": 1.1257794368203942, "survival_time": 21.200000000000166, "driven_lanedir": 0.09340563909206612, "in-drivable-lane": 20.100000000000165, "deviation-heading": 0.772662890080044, "distance-from-start": 1.1257235227271165, "deviation-center-line": 0.10390982916830796, "driven_lanedir_consec": 0.09340563909206612}}simulation-passed 1 survival_time_max 21.200000000000166 survival_time_mean 21.200000000000166 survival_time_min 21.200000000000166
No reset possible 15462
1453
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 04:45:01+00:00 2022-11-25 04:46:50+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.050000000000036 in-drivable-lane_median 8.950000000000042 driven_lanedir_consec_median 0.30902388815479953 deviation-center-line_median 0.26861568883973136
other stats deviation-center-line_max 0.26861568883973136 deviation-center-line_mean 0.26861568883973136 deviation-center-line_min 0.26861568883973136 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 1.816331806096384 distance-from-start_mean 1.816331806096384 distance-from-start_median 1.816331806096384 distance-from-start_min 1.816331806096384 driven_any_max 1.8164449732417056 driven_any_mean 1.8164449732417056 driven_any_median 1.8164449732417056 driven_any_min 1.8164449732417056 driven_lanedir_consec_max 0.30902388815479953 driven_lanedir_consec_mean 0.30902388815479953 driven_lanedir_consec_min 0.30902388815479953 driven_lanedir_max 0.30902388815479953 driven_lanedir_mean 0.30902388815479953 driven_lanedir_median 0.30902388815479953 driven_lanedir_min 0.30902388815479953 in-drivable-lane_max 8.950000000000042 in-drivable-lane_mean 8.950000000000042 in-drivable-lane_min 8.950000000000042 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8164449732417056, "survival_time": 12.050000000000036, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 8.950000000000042, "deviation-heading": 2.499533756017491, "distance-from-start": 1.816331806096384, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}simulation-passed 1 survival_time_max 12.050000000000036 survival_time_mean 12.050000000000036 survival_time_min 12.050000000000036
No reset possible 15459
1454
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 04:38:49+00:00 2022-11-25 04:44:54+00:00 0:06:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.35000000000024 in-drivable-lane_median 18.3500000000001 driven_lanedir_consec_median 0.8182765847397058 deviation-center-line_median 1.069915688705415
other stats deviation-center-line_max 1.069915688705415 deviation-center-line_mean 1.069915688705415 deviation-center-line_min 1.069915688705415 deviation-heading_max 12.093522225951896 deviation-heading_mean 12.093522225951896 deviation-heading_median 12.093522225951896 deviation-heading_min 12.093522225951896 distance-from-start_max 0.2208837618638317 distance-from-start_mean 0.2208837618638317 distance-from-start_median 0.2208837618638317 distance-from-start_min 0.2208837618638317 driven_any_max 3.1362284537921994 driven_any_mean 3.1362284537921994 driven_any_median 3.1362284537921994 driven_any_min 3.1362284537921994 driven_lanedir_consec_max 0.8182765847397058 driven_lanedir_consec_mean 0.8182765847397058 driven_lanedir_consec_min 0.8182765847397058 driven_lanedir_max 0.8182765847397058 driven_lanedir_mean 0.8182765847397058 driven_lanedir_median 0.8182765847397058 driven_lanedir_min 0.8182765847397058 in-drivable-lane_max 18.3500000000001 in-drivable-lane_mean 18.3500000000001 in-drivable-lane_min 18.3500000000001 per-episodes details {"loop2-000-ego0": {"driven_any": 3.1362284537921994, "survival_time": 33.35000000000024, "driven_lanedir": 0.8182765847397058, "in-drivable-lane": 18.3500000000001, "deviation-heading": 12.093522225951896, "distance-from-start": 0.2208837618638317, "deviation-center-line": 1.069915688705415, "driven_lanedir_consec": 0.8182765847397058}}simulation-passed 1 survival_time_max 33.35000000000024 survival_time_mean 33.35000000000024 survival_time_min 33.35000000000024
No reset possible 15455
1455
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 04:36:14+00:00 2022-11-25 04:38:35+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.3 in-drivable-lane_median 1.3999999999999997 driven_lanedir_consec_median 0.02838676882329283 deviation-center-line_median 0.01435653283195525
other stats deviation-center-line_max 0.01435653283195525 deviation-center-line_mean 0.01435653283195525 deviation-center-line_min 0.01435653283195525 deviation-heading_max 0.7536460917807714 deviation-heading_mean 0.7536460917807714 deviation-heading_median 0.7536460917807714 deviation-heading_min 0.7536460917807714 distance-from-start_max 0.10909798342150127 distance-from-start_mean 0.10909798342150127 distance-from-start_median 0.10909798342150127 distance-from-start_min 0.10909798342150127 driven_any_max 0.1389643424461852 driven_any_mean 0.1389643424461852 driven_any_median 0.1389643424461852 driven_any_min 0.1389643424461852 driven_lanedir_consec_max 0.02838676882329283 driven_lanedir_consec_mean 0.02838676882329283 driven_lanedir_consec_min 0.02838676882329283 driven_lanedir_max 0.02838676882329283 driven_lanedir_mean 0.02838676882329283 driven_lanedir_median 0.02838676882329283 driven_lanedir_min 0.02838676882329283 in-drivable-lane_max 1.3999999999999997 in-drivable-lane_mean 1.3999999999999997 in-drivable-lane_min 1.3999999999999997 per-episodes details {"4way-000-ego0": {"driven_any": 0.1389643424461852, "survival_time": 2.3, "driven_lanedir": 0.02838676882329283, "in-drivable-lane": 1.3999999999999997, "deviation-heading": 0.7536460917807714, "distance-from-start": 0.10909798342150127, "deviation-center-line": 0.01435653283195525, "driven_lanedir_consec": 0.02838676882329283}}simulation-passed 1 survival_time_max 2.3 survival_time_mean 2.3 survival_time_min 2.3
No reset possible 15451
1456
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 04:34:08+00:00 2022-11-25 04:35:56+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.25 in-drivable-lane_median 1.55 driven_lanedir_consec_median 0.010381044464116584 deviation-center-line_median 0.008291031209926327
other stats deviation-center-line_max 0.008291031209926327 deviation-center-line_mean 0.008291031209926327 deviation-center-line_min 0.008291031209926327 deviation-heading_max 0.5934709373330407 deviation-heading_mean 0.5934709373330407 deviation-heading_median 0.5934709373330407 deviation-heading_min 0.5934709373330407 distance-from-start_max 0.08714850093432373 distance-from-start_mean 0.08714850093432373 distance-from-start_median 0.08714850093432373 distance-from-start_min 0.08714850093432373 driven_any_max 0.11424881562409732 driven_any_mean 0.11424881562409732 driven_any_median 0.11424881562409732 driven_any_min 0.11424881562409732 driven_lanedir_consec_max 0.010381044464116584 driven_lanedir_consec_mean 0.010381044464116584 driven_lanedir_consec_min 0.010381044464116584 driven_lanedir_max 0.010381044464116584 driven_lanedir_mean 0.010381044464116584 driven_lanedir_median 0.010381044464116584 driven_lanedir_min 0.010381044464116584 in-drivable-lane_max 1.55 in-drivable-lane_mean 1.55 in-drivable-lane_min 1.55 per-episodes details {"4way-000-ego0": {"driven_any": 0.11424881562409732, "survival_time": 2.25, "driven_lanedir": 0.010381044464116584, "in-drivable-lane": 1.55, "deviation-heading": 0.5934709373330407, "distance-from-start": 0.08714850093432373, "deviation-center-line": 0.008291031209926327, "driven_lanedir_consec": 0.010381044464116584}}simulation-passed 1 survival_time_max 2.25 survival_time_mean 2.25 survival_time_min 2.25
No reset possible 15450
1456
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 04:32:00+00:00 2022-11-25 04:33:38+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15446
1457
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 04:29:31+00:00 2022-11-25 04:31:32+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.13342377802362004 survival_time_median 8.349999999999984 deviation-center-line_median 0.13079257050030013 in-drivable-lane_median 6.499999999999987
other stats deviation-center-line_max 0.13079257050030013 deviation-center-line_mean 0.13079257050030013 deviation-center-line_min 0.13079257050030013 deviation-heading_max 1.930187399509121 deviation-heading_mean 1.930187399509121 deviation-heading_median 1.930187399509121 deviation-heading_min 1.930187399509121 distance-from-start_max 1.0902019401143752 distance-from-start_mean 1.0902019401143752 distance-from-start_median 1.0902019401143752 distance-from-start_min 1.0902019401143752 driven_any_max 1.945582282330358 driven_any_mean 1.945582282330358 driven_any_median 1.945582282330358 driven_any_min 1.945582282330358 driven_lanedir_consec_max 0.13342377802362004 driven_lanedir_consec_mean 0.13342377802362004 driven_lanedir_consec_min 0.13342377802362004 driven_lanedir_max 0.13342377802362004 driven_lanedir_mean 0.13342377802362004 driven_lanedir_median 0.13342377802362004 driven_lanedir_min 0.13342377802362004 in-drivable-lane_max 6.499999999999987 in-drivable-lane_mean 6.499999999999987 in-drivable-lane_min 6.499999999999987 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.945582282330358, "survival_time": 8.349999999999984, "driven_lanedir": 0.13342377802362004, "in-drivable-lane": 6.499999999999987, "deviation-heading": 1.930187399509121, "distance-from-start": 1.0902019401143752, "deviation-center-line": 0.13079257050030013, "driven_lanedir_consec": 0.13342377802362004}}simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 8.349999999999984 survival_time_min 8.349999999999984
No reset possible 15441
1554
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-03-6.2.51
2022-11-25 04:20:10+00:00 2022-11-25 04:29:12+00:00 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15431
1459
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 03:53:40+00:00 2022-11-25 04:19:47+00:00 0:26:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 49.574999999998866 driven_lanedir_consec_median 0.7043389727343972 deviation-center-line_median 0.8766044294841716
other stats deviation-center-line_max 1.6549063043615144 deviation-center-line_mean 0.8743881383646889 deviation-center-line_min 0.08943739012889788 deviation-heading_max 14.780096013788224 deviation-heading_mean 8.313907015159845 deviation-heading_median 8.915753971440461 deviation-heading_min 0.6440241039702355 distance-from-start_max 1.6693557080890575 distance-from-start_mean 0.6676436407933078 distance-from-start_median 0.3941494484249916 distance-from-start_min 0.21291995823419052 driven_any_max 10.967433506856434 driven_any_mean 6.840135945262375 driven_any_median 8.089351199454297 driven_any_min 0.2144078752844724 driven_lanedir_consec_max 1.2305614544349797 driven_lanedir_consec_mean 0.6906511885880383 driven_lanedir_consec_min 0.12336535444837926 driven_lanedir_max 1.2305614544349797 driven_lanedir_mean 0.789477259406133 driven_lanedir_median 0.9019911143705864 driven_lanedir_min 0.12336535444837926 in-drivable-lane_max 58.94999999999872 in-drivable-lane_mean 50.69999999999888 in-drivable-lane_min 44.69999999999906 per-episodes details {"loop-000-ego0": {"driven_any": 8.599897665807923, "survival_time": 59.99999999999873, "driven_lanedir": 0.7986700701781126, "in-drivable-lane": 49.79999999999876, "deviation-heading": 9.672908146620989, "distance-from-start": 1.6693557080890575, "deviation-center-line": 0.8643648380411888, "driven_lanedir_consec": 0.7986700701781126}, "loop-000-ego1": {"driven_any": 0.2144078752844724, "survival_time": 59.99999999999873, "driven_lanedir": 0.12336535444837926, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.6440241039702355, "distance-from-start": 0.21291995823419052, "deviation-center-line": 0.08943739012889788, "driven_lanedir_consec": 0.12336535444837926}, "loop-000-ego2": {"driven_any": 7.578804733100672, "survival_time": 59.99999999999873, "driven_lanedir": 1.0053121585630604, "in-drivable-lane": 44.69999999999906, "deviation-heading": 14.780096013788224, "distance-from-start": 0.28646802938769644, "deviation-center-line": 1.6549063043615144, "driven_lanedir_consec": 0.6100078752906817}, "loop-000-ego3": {"driven_any": 10.967433506856434, "survival_time": 59.99999999999873, "driven_lanedir": 1.2305614544349797, "in-drivable-lane": 49.34999999999898, "deviation-heading": 8.158599796259933, "distance-from-start": 0.5018308674622868, "deviation-center-line": 0.8888440209271544, "driven_lanedir_consec": 1.2305614544349797}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15426
1461
Bea Baselines 🐤template-pytorch lx22-modcon
sim success yes davinci-stage-03-6.2.51
2022-11-25 03:42:22+00:00 2022-11-25 03:53:10+00:00 0:10:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 33.724999999999426 deviation-center-line_median 1.382936419521216 driven_lanedir_consec_median 0.8155460552125413 survival_time_median 48.34999999999939
other stats deviation-center-line_max 1.7113147514623528 deviation-center-line_mean 1.382936419521216 deviation-center-line_min 1.0545580875800789 deviation-heading_max 14.588919807537645 deviation-heading_mean 11.754314715121938 deviation-heading_median 11.754314715121938 deviation-heading_min 8.919709622706232 distance-from-start_max 0.7927154539287221 distance-from-start_mean 0.6523218661962156 distance-from-start_median 0.6523218661962156 distance-from-start_min 0.5119282784637089 driven_any_max 8.247138757043217 driven_any_mean 6.3378248764018235 driven_any_median 6.3378248764018235 driven_any_min 4.428510995760429 driven_lanedir_consec_max 1.615840490921476 driven_lanedir_consec_mean 0.8155460552125413 driven_lanedir_consec_min 0.01525161950360654 driven_lanedir_max 1.615840490921476 driven_lanedir_mean 1.2613053923640551 driven_lanedir_median 1.2613053923640551 driven_lanedir_min 0.9067702938066342 in-drivable-lane_max 42.04999999999896 in-drivable-lane_mean 33.724999999999426 in-drivable-lane_min 25.3999999999999 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 8.247138757043217, "survival_time": 59.99999999999873, "driven_lanedir": 1.615840490921476, "in-drivable-lane": 42.04999999999896, "deviation-heading": 14.588919807537645, "distance-from-start": 0.7927154539287221, "deviation-center-line": 1.7113147514623528, "driven_lanedir_consec": 1.615840490921476}, "LF-full-loop-001-ego0": {"driven_any": 4.428510995760429, "survival_time": 36.70000000000005, "driven_lanedir": 0.9067702938066342, "in-drivable-lane": 25.3999999999999, "deviation-heading": 8.919709622706232, "distance-from-start": 0.5119282784637089, "deviation-center-line": 1.0545580875800789, "driven_lanedir_consec": 0.01525161950360654}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 48.34999999999939 survival_time_min 36.70000000000005
No reset possible 15415
1472
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 03:25:01+00:00 2022-11-25 03:42:02+00:00 0:17:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.89999999999936 in-drivable-lane_median 32.09999999999934 driven_lanedir_consec_median 1.4828439363802803 deviation-center-line_median 1.2166903628404124
other stats deviation-center-line_max 1.2166903628404124 deviation-center-line_mean 1.2166903628404124 deviation-center-line_min 1.2166903628404124 deviation-heading_max 12.9746260239314 deviation-heading_mean 12.9746260239314 deviation-heading_median 12.9746260239314 deviation-heading_min 12.9746260239314 distance-from-start_max 0.32884481874866545 distance-from-start_mean 0.32884481874866545 distance-from-start_median 0.32884481874866545 distance-from-start_min 0.32884481874866545 driven_any_max 6.547558683456682 driven_any_mean 6.547558683456682 driven_any_median 6.547558683456682 driven_any_min 6.547558683456682 driven_lanedir_consec_max 1.4828439363802803 driven_lanedir_consec_mean 1.4828439363802803 driven_lanedir_consec_min 1.4828439363802803 driven_lanedir_max 1.4828439363802803 driven_lanedir_mean 1.4828439363802803 driven_lanedir_median 1.4828439363802803 driven_lanedir_min 1.4828439363802803 in-drivable-lane_max 32.09999999999934 in-drivable-lane_mean 32.09999999999934 in-drivable-lane_min 32.09999999999934 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.547558683456682, "survival_time": 48.89999999999936, "driven_lanedir": 1.4828439363802803, "in-drivable-lane": 32.09999999999934, "deviation-heading": 12.9746260239314, "distance-from-start": 0.32884481874866545, "deviation-center-line": 1.2166903628404124, "driven_lanedir_consec": 1.4828439363802803}}simulation-passed 1 survival_time_max 48.89999999999936 survival_time_mean 48.89999999999936 survival_time_min 48.89999999999936
No reset possible 15412
1473
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 03:21:35+00:00 2022-11-25 03:24:52+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.299999999999993 in-drivable-lane_median 2.4499999999999917 driven_lanedir_consec_median 0.18954164195445977 deviation-center-line_median 0.07927624897761028
other stats deviation-center-line_max 0.07927624897761028 deviation-center-line_mean 0.07927624897761028 deviation-center-line_min 0.07927624897761028 deviation-heading_max 1.2352252536813295 deviation-heading_mean 1.2352252536813295 deviation-heading_median 1.2352252536813295 deviation-heading_min 1.2352252536813295 distance-from-start_max 0.24953616409976687 distance-from-start_mean 0.24953616409976687 distance-from-start_median 0.24953616409976687 distance-from-start_min 0.24953616409976687 driven_any_max 0.5770046412704225 driven_any_mean 0.5770046412704225 driven_any_median 0.5770046412704225 driven_any_min 0.5770046412704225 driven_lanedir_consec_max 0.18954164195445977 driven_lanedir_consec_mean 0.18954164195445977 driven_lanedir_consec_min 0.18954164195445977 driven_lanedir_max 0.18954164195445977 driven_lanedir_mean 0.18954164195445977 driven_lanedir_median 0.18954164195445977 driven_lanedir_min 0.18954164195445977 in-drivable-lane_max 2.4499999999999917 in-drivable-lane_mean 2.4499999999999917 in-drivable-lane_min 2.4499999999999917 per-episodes details {"4way-000-ego0": {"driven_any": 0.5770046412704225, "survival_time": 4.299999999999993, "driven_lanedir": 0.18954164195445977, "in-drivable-lane": 2.4499999999999917, "deviation-heading": 1.2352252536813295, "distance-from-start": 0.24953616409976687, "deviation-center-line": 0.07927624897761028, "driven_lanedir_consec": 0.18954164195445977}}simulation-passed 1 survival_time_max 4.299999999999993 survival_time_mean 4.299999999999993 survival_time_min 4.299999999999993
No reset possible 15410
1473
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 03:19:27+00:00 2022-11-25 03:21:11+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15409
1473
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 03:17:26+00:00 2022-11-25 03:18:58+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15402
1475
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 03:07:58+00:00 2022-11-25 03:17:20+00:00 0:09:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.593239332029309 survival_time_median 59.99999999999873 deviation-center-line_median 1.740203443770885 in-drivable-lane_median 35.199999999999
other stats deviation-center-line_max 1.740203443770885 deviation-center-line_mean 1.740203443770885 deviation-center-line_min 1.740203443770885 deviation-heading_max 18.64910372761524 deviation-heading_mean 18.64910372761524 deviation-heading_median 18.64910372761524 deviation-heading_min 18.64910372761524 distance-from-start_max 0.8193469747481381 distance-from-start_mean 0.8193469747481381 distance-from-start_median 0.8193469747481381 distance-from-start_min 0.8193469747481381 driven_any_max 5.091842316648326 driven_any_mean 5.091842316648326 driven_any_median 5.091842316648326 driven_any_min 5.091842316648326 driven_lanedir_consec_max 1.593239332029309 driven_lanedir_consec_mean 1.593239332029309 driven_lanedir_consec_min 1.593239332029309 driven_lanedir_max 1.593239332029309 driven_lanedir_mean 1.593239332029309 driven_lanedir_median 1.593239332029309 driven_lanedir_min 1.593239332029309 in-drivable-lane_max 35.199999999999 in-drivable-lane_mean 35.199999999999 in-drivable-lane_min 35.199999999999 per-episodes details {"autolab-000-ego0": {"driven_any": 5.091842316648326, "survival_time": 59.99999999999873, "driven_lanedir": 1.593239332029309, "in-drivable-lane": 35.199999999999, "deviation-heading": 18.64910372761524, "distance-from-start": 0.8193469747481381, "deviation-center-line": 1.740203443770885, "driven_lanedir_consec": 1.593239332029309}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15401
1475
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 02:57:53+00:00 2022-11-25 03:07:35+00:00 0:09:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.843553544551521 survival_time_median 59.99999999999873 deviation-center-line_median 1.4456066778159142 in-drivable-lane_median 29.949999999999346
other stats deviation-center-line_max 1.4456066778159142 deviation-center-line_mean 1.4456066778159142 deviation-center-line_min 1.4456066778159142 deviation-heading_max 23.407812689396913 deviation-heading_mean 23.407812689396913 deviation-heading_median 23.407812689396913 deviation-heading_min 23.407812689396913 distance-from-start_max 0.7471908963050212 distance-from-start_mean 0.7471908963050212 distance-from-start_median 0.7471908963050212 distance-from-start_min 0.7471908963050212 driven_any_max 8.371027988271912 driven_any_mean 8.371027988271912 driven_any_median 8.371027988271912 driven_any_min 8.371027988271912 driven_lanedir_consec_max 2.843553544551521 driven_lanedir_consec_mean 2.843553544551521 driven_lanedir_consec_min 2.843553544551521 driven_lanedir_max 2.843553544551521 driven_lanedir_mean 2.843553544551521 driven_lanedir_median 2.843553544551521 driven_lanedir_min 2.843553544551521 in-drivable-lane_max 29.949999999999346 in-drivable-lane_mean 29.949999999999346 in-drivable-lane_min 29.949999999999346 per-episodes details {"zigzag-000-ego0": {"driven_any": 8.371027988271912, "survival_time": 59.99999999999873, "driven_lanedir": 2.843553544551521, "in-drivable-lane": 29.949999999999346, "deviation-heading": 23.407812689396913, "distance-from-start": 0.7471908963050212, "deviation-center-line": 1.4456066778159142, "driven_lanedir_consec": 2.843553544551521}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15400
1475
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 02:55:46+00:00 2022-11-25 02:57:26+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.35256045014061965 survival_time_median 8.09999999999998 deviation-center-line_median 0.14386911473778702 in-drivable-lane_median 6.349999999999984
other stats deviation-center-line_max 0.14386911473778702 deviation-center-line_mean 0.14386911473778702 deviation-center-line_min 0.14386911473778702 deviation-heading_max 1.3308789200196498 deviation-heading_mean 1.3308789200196498 deviation-heading_median 1.3308789200196498 deviation-heading_min 1.3308789200196498 distance-from-start_max 1.3603802754366887 distance-from-start_mean 1.3603802754366887 distance-from-start_median 1.3603802754366887 distance-from-start_min 1.3603802754366887 driven_any_max 2.529090542204486 driven_any_mean 2.529090542204486 driven_any_median 2.529090542204486 driven_any_min 2.529090542204486 driven_lanedir_consec_max 0.35256045014061965 driven_lanedir_consec_mean 0.35256045014061965 driven_lanedir_consec_min 0.35256045014061965 driven_lanedir_max 0.35256045014061965 driven_lanedir_mean 0.35256045014061965 driven_lanedir_median 0.35256045014061965 driven_lanedir_min 0.35256045014061965 in-drivable-lane_max 6.349999999999984 in-drivable-lane_mean 6.349999999999984 in-drivable-lane_min 6.349999999999984 per-episodes details {"loop2-000-ego0": {"driven_any": 2.529090542204486, "survival_time": 8.09999999999998, "driven_lanedir": 0.35256045014061965, "in-drivable-lane": 6.349999999999984, "deviation-heading": 1.3308789200196498, "distance-from-start": 1.3603802754366887, "deviation-center-line": 0.14386911473778702, "driven_lanedir_consec": 0.35256045014061965}}simulation-passed 1 survival_time_max 8.09999999999998 survival_time_mean 8.09999999999998 survival_time_min 8.09999999999998
No reset possible 15399
1476
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-1of4 host-error no davinci-stage-03-6.2.51
2022-11-25 02:53:54+00:00 2022-11-25 02:55:25+00:00 0:01:31 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15392
1477
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 02:42:53+00:00 2022-11-25 02:53:25+00:00 0:10:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.39999999999937 driven_lanedir_consec_median 0.29847398281374315 deviation-center-line_median 5.209591475332532
other stats deviation-center-line_max 9.988449910110443 deviation-center-line_mean 5.209591475332532 deviation-center-line_min 0.4307330405546219 deviation-heading_max 85.5572587325548 deviation-heading_mean 43.90382969178714 deviation-heading_median 43.90382969178714 deviation-heading_min 2.2504006510194743 distance-from-start_max 0.3965363270253792 distance-from-start_mean 0.3742519588759696 distance-from-start_median 0.3742519588759696 distance-from-start_min 0.3519675907265601 driven_any_max 7.418647697779046 driven_any_mean 3.961631032317712 driven_any_median 3.961631032317712 driven_any_min 0.5046143668563786 driven_lanedir_consec_max 0.38283927207553914 driven_lanedir_consec_mean 0.29847398281374315 driven_lanedir_consec_min 0.21410869355194717 driven_lanedir_max 0.38283927207553914 driven_lanedir_mean 0.29847398281374315 driven_lanedir_median 0.29847398281374315 driven_lanedir_min 0.21410869355194717 in-drivable-lane_max 56.79999999999873 in-drivable-lane_mean 28.39999999999937 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5046143668563786, "survival_time": 59.99999999999873, "driven_lanedir": 0.38283927207553914, "in-drivable-lane": 0.0, "deviation-heading": 85.5572587325548, "distance-from-start": 0.3965363270253792, "deviation-center-line": 9.988449910110443, "driven_lanedir_consec": 0.38283927207553914}, "loop2-000-ego1": {"driven_any": 7.418647697779046, "survival_time": 59.99999999999873, "driven_lanedir": 0.21410869355194717, "in-drivable-lane": 56.79999999999873, "deviation-heading": 2.2504006510194743, "distance-from-start": 0.3519675907265601, "deviation-center-line": 0.4307330405546219, "driven_lanedir_consec": 0.21410869355194717}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15390
1478
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 02:36:59+00:00 2022-11-25 02:42:31+00:00 0:05:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.100000000000307 in-drivable-lane_median 23.900000000000276 driven_lanedir_consec_median 0.3811970311605939 deviation-center-line_median 0.5014803365406109
other stats deviation-center-line_max 0.5014803365406109 deviation-center-line_mean 0.5014803365406109 deviation-center-line_min 0.5014803365406109 deviation-heading_max 5.002849625743178 deviation-heading_mean 5.002849625743178 deviation-heading_median 5.002849625743178 deviation-heading_min 5.002849625743178 distance-from-start_max 0.4156151773078378 distance-from-start_mean 0.4156151773078378 distance-from-start_median 0.4156151773078378 distance-from-start_min 0.4156151773078378 driven_any_max 2.4568235598272983 driven_any_mean 2.4568235598272983 driven_any_median 2.4568235598272983 driven_any_min 2.4568235598272983 driven_lanedir_consec_max 0.3811970311605939 driven_lanedir_consec_mean 0.3811970311605939 driven_lanedir_consec_min 0.3811970311605939 driven_lanedir_max 0.3811970311605939 driven_lanedir_mean 0.3811970311605939 driven_lanedir_median 0.3811970311605939 driven_lanedir_min 0.3811970311605939 in-drivable-lane_max 23.900000000000276 in-drivable-lane_mean 23.900000000000276 in-drivable-lane_min 23.900000000000276 per-episodes details {"autolab-000-ego0": {"driven_any": 2.4568235598272983, "survival_time": 31.100000000000307, "driven_lanedir": 0.3811970311605939, "in-drivable-lane": 23.900000000000276, "deviation-heading": 5.002849625743178, "distance-from-start": 0.4156151773078378, "deviation-center-line": 0.5014803365406109, "driven_lanedir_consec": 0.3811970311605939}}simulation-passed 1 survival_time_max 31.100000000000307 survival_time_mean 31.100000000000307 survival_time_min 31.100000000000307
No reset possible 15383
1480
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 02:28:37+00:00 2022-11-25 02:36:34+00:00 0:07:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 18.900000000000233 driven_lanedir_consec_median 0.25774306587044116 deviation-center-line_median 0.8659891122281899
other stats deviation-center-line_max 0.8659891122281899 deviation-center-line_mean 0.8659891122281899 deviation-center-line_min 0.8659891122281899 deviation-heading_max 7.706889663126838 deviation-heading_mean 7.706889663126838 deviation-heading_median 7.706889663126838 deviation-heading_min 7.706889663126838 distance-from-start_max 0.8626308120701125 distance-from-start_mean 0.8626308120701125 distance-from-start_median 0.8626308120701125 distance-from-start_min 0.8626308120701125 driven_any_max 7.161071358405415 driven_any_mean 7.161071358405415 driven_any_median 7.161071358405415 driven_any_min 7.161071358405415 driven_lanedir_consec_max 0.25774306587044116 driven_lanedir_consec_mean 0.25774306587044116 driven_lanedir_consec_min 0.25774306587044116 driven_lanedir_max 0.2397300056472842 driven_lanedir_mean 0.2397300056472842 driven_lanedir_median 0.2397300056472842 driven_lanedir_min 0.2397300056472842 in-drivable-lane_max 18.900000000000233 in-drivable-lane_mean 18.900000000000233 in-drivable-lane_min 18.900000000000233 per-episodes details {"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 15375
1481
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 02:24:19+00:00 2022-11-25 02:28:24+00:00 0:04:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.70000000000016 in-drivable-lane_median 12.150000000000135 driven_lanedir_consec_median 0.2718508044257806 deviation-center-line_median 0.7655525719315331
other stats deviation-center-line_max 0.7655525719315331 deviation-center-line_mean 0.7655525719315331 deviation-center-line_min 0.7655525719315331 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7357883576773756 distance-from-start_mean 0.7357883576773756 distance-from-start_median 0.7357883576773756 distance-from-start_min 0.7357883576773756 driven_any_max 5.001991003394682 driven_any_mean 5.001991003394682 driven_any_median 5.001991003394682 driven_any_min 5.001991003394682 driven_lanedir_consec_max 0.2718508044257806 driven_lanedir_consec_mean 0.2718508044257806 driven_lanedir_consec_min 0.2718508044257806 driven_lanedir_max 0.2538357176450212 driven_lanedir_mean 0.2538357176450212 driven_lanedir_median 0.2538357176450212 driven_lanedir_min 0.2538357176450212 in-drivable-lane_max 12.150000000000135 in-drivable-lane_mean 12.150000000000135 in-drivable-lane_min 12.150000000000135 per-episodes details {"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}simulation-passed 1 survival_time_max 20.70000000000016 survival_time_mean 20.70000000000016 survival_time_min 20.70000000000016
No reset possible 15367
1484
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 02:04:23+00:00 2022-11-25 02:23:55+00:00 0:19:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.64999999999875 in-drivable-lane_median 52.39999999999873 driven_lanedir_consec_median 0.20841941457351276 deviation-center-line_median 0.6235918393283303
other stats deviation-center-line_max 3.9618906351925345 deviation-center-line_mean 1.3480922472158894 deviation-center-line_min 0.18329467501436195 deviation-heading_max 29.06091202107619 deviation-heading_mean 10.086526110865954 deviation-heading_median 4.852439390352202 deviation-heading_min 1.5803136416832215 distance-from-start_max 1.390232809724702 distance-from-start_mean 0.8610879612709739 distance-from-start_median 0.7658648678412762 distance-from-start_min 0.5223892996766412 driven_any_max 14.859731274916312 driven_any_mean 6.788261723046844 driven_any_median 5.402007576921902 driven_any_min 1.4893004634272606 driven_lanedir_consec_max 0.4727232702196713 driven_lanedir_consec_mean 0.24835079061387844 driven_lanedir_consec_min 0.10384106308881692 driven_lanedir_max 0.4727232702196713 driven_lanedir_mean 0.2405349726449092 driven_lanedir_median 0.19278777863557428 driven_lanedir_min 0.10384106308881692 in-drivable-lane_max 57.149999999998755 in-drivable-lane_mean 41.13749999999905 in-drivable-lane_min 2.599999999999994 per-episodes details {"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}simulation-passed 1 survival_time_max 59.64999999999875 survival_time_mean 59.64999999999875 survival_time_min 59.64999999999875
No reset possible 15358
1487
Bea Baselines 🐤template-random lx22-objdet
sim success yes davinci-stage-03-6.2.51
2022-11-25 01:51:26+00:00 2022-11-25 02:03:53+00:00 0:12:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 54.49999999999904 driven_lanedir_consec_median 0.26709798212212443
other stats deviation-center-line_max 1.037569790997506 deviation-center-line_mean 0.8435604085256779 deviation-center-line_median 0.8435604085256779 deviation-center-line_min 0.64955102605385 deviation-heading_max 4.206744090268851 deviation-heading_mean 4.053028283662815 deviation-heading_median 4.053028283662815 deviation-heading_min 3.899312477056781 distance-from-start_max 1.4108418329398793 distance-from-start_mean 1.2742348024332677 distance-from-start_median 1.2742348024332677 distance-from-start_min 1.1376277719266563 driven_any_max 15.326310847370594 driven_any_mean 13.855133975004188 driven_any_median 13.855133975004188 driven_any_min 12.38395710263778 driven_lanedir_consec_max 0.46522399883077714 driven_lanedir_consec_mean 0.26709798212212443 driven_lanedir_consec_min 0.06897196541347173 driven_lanedir_max 0.4443159195617077 driven_lanedir_mean 0.24618990285305495 driven_lanedir_median 0.24618990285305495 driven_lanedir_min 0.04806388614440227 in-drivable-lane_max 53.699999999998695 in-drivable-lane_mean 46.67499999999907 in-drivable-lane_median 46.67499999999907 in-drivable-lane_min 39.64999999999946 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 15.326310847370594, "survival_time": 59.99999999999873, "driven_lanedir": 0.4443159195617077, "in-drivable-lane": 53.699999999998695, "deviation-heading": 3.899312477056781, "distance-from-start": 1.4108418329398793, "deviation-center-line": 0.64955102605385, "driven_lanedir_consec": 0.46522399883077714}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 12.38395710263778, "survival_time": 48.99999999999935, "driven_lanedir": 0.04806388614440227, "in-drivable-lane": 39.64999999999946, "deviation-heading": 4.206744090268851, "distance-from-start": 1.1376277719266563, "deviation-center-line": 1.037569790997506, "driven_lanedir_consec": 0.06897196541347173}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 54.49999999999904 survival_time_min 48.99999999999935
No reset possible 15354
1490
Bea Baselines 🐤template-random lx22-BV1
sim-1of5 success no davinci-stage-03-6.2.51
2022-11-25 01:48:05+00:00 2022-11-25 01:50:59+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d45-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 15352
1490
Bea Baselines 🐤template-random lx22-BV1
sim-0of5 success no davinci-stage-03-6.2.51
2022-11-25 01:46:25+00:00 2022-11-25 01:47:52+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4028556303039808
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4028556303039808 distance-from-start_median 0.4028556303039808 distance-from-start_min 0.4028556303039808 driven_any_max 0.4240764502839582 driven_any_mean 0.4240764502839582 driven_any_median 0.4240764502839582 driven_any_min 0.4240764502839582 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.7499999999999942 in-drivable-lane_mean 3.7499999999999942 in-drivable-lane_median 3.7499999999999942 in-drivable-lane_min 3.7499999999999942 per-episodes details {"d30-ego0": {"driven_any": 0.4240764502839582, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.4028556303039808, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_median 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 15348
1497
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 01:39:22+00:00 2022-11-25 01:46:10+00:00 0:06:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 27.70000000000026 in-drivable-lane_median 21.450000000000205 driven_lanedir_consec_median 0.012425607873532307 deviation-center-line_median 0.5849703367275559
other stats deviation-center-line_max 0.5849703367275559 deviation-center-line_mean 0.5849703367275559 deviation-center-line_min 0.5849703367275559 deviation-heading_max 4.775258728877611 deviation-heading_mean 4.775258728877611 deviation-heading_median 4.775258728877611 deviation-heading_min 4.775258728877611 distance-from-start_max 0.7960980578537297 distance-from-start_mean 0.7960980578537297 distance-from-start_median 0.7960980578537297 distance-from-start_min 0.7960980578537297 driven_any_max 6.63545554755722 driven_any_mean 6.63545554755722 driven_any_median 6.63545554755722 driven_any_min 6.63545554755722 driven_lanedir_consec_max 0.012425607873532307 driven_lanedir_consec_mean 0.012425607873532307 driven_lanedir_consec_min 0.012425607873532307 driven_lanedir_max 0.01577326127428158 driven_lanedir_mean 0.01577326127428158 driven_lanedir_median 0.01577326127428158 driven_lanedir_min 0.01577326127428158 in-drivable-lane_max 21.450000000000205 in-drivable-lane_mean 21.450000000000205 in-drivable-lane_min 21.450000000000205 per-episodes details {"loop-000-ego0": {"driven_any": 6.63545554755722, "survival_time": 27.70000000000026, "driven_lanedir": 0.01577326127428158, "in-drivable-lane": 21.450000000000205, "deviation-heading": 4.775258728877611, "distance-from-start": 0.7960980578537297, "deviation-center-line": 0.5849703367275559, "driven_lanedir_consec": 0.012425607873532307}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 15340
1499
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 01:34:15+00:00 2022-11-25 01:38:47+00:00 0:04:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.450000000000212 in-drivable-lane_median 17.850000000000154 driven_lanedir_consec_median 0.050146904256652025 deviation-center-line_median 0.5014783130439592
other stats deviation-center-line_max 0.5014783130439592 deviation-center-line_mean 0.5014783130439592 deviation-center-line_min 0.5014783130439592 deviation-heading_max 5.174156496722106 deviation-heading_mean 5.174156496722106 deviation-heading_median 5.174156496722106 deviation-heading_min 5.174156496722106 distance-from-start_max 0.796098057853711 distance-from-start_mean 0.796098057853711 distance-from-start_median 0.796098057853711 distance-from-start_min 0.796098057853711 driven_any_max 5.895396370035972 driven_any_mean 5.895396370035972 driven_any_median 5.895396370035972 driven_any_min 5.895396370035972 driven_lanedir_consec_max 0.050146904256652025 driven_lanedir_consec_mean 0.050146904256652025 driven_lanedir_consec_min 0.050146904256652025 driven_lanedir_max 0.053494557657393305 driven_lanedir_mean 0.053494557657393305 driven_lanedir_median 0.053494557657393305 driven_lanedir_min 0.053494557657393305 in-drivable-lane_max 17.850000000000154 in-drivable-lane_mean 17.850000000000154 in-drivable-lane_min 17.850000000000154 per-episodes details {"udem1-000-ego0": {"driven_any": 5.895396370035972, "survival_time": 24.450000000000212, "driven_lanedir": 0.053494557657393305, "in-drivable-lane": 17.850000000000154, "deviation-heading": 5.174156496722106, "distance-from-start": 0.796098057853711, "deviation-center-line": 0.5014783130439592, "driven_lanedir_consec": 0.050146904256652025}}simulation-passed 1 survival_time_max 24.450000000000212 survival_time_mean 24.450000000000212 survival_time_min 24.450000000000212
No reset possible 15337
1500
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 01:31:37+00:00 2022-11-25 01:34:09+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.029483020207996535 survival_time_median 11.450000000000028 deviation-center-line_median 0.32684152243677644 in-drivable-lane_median 8.000000000000016
other stats deviation-center-line_max 0.32684152243677644 deviation-center-line_mean 0.32684152243677644 deviation-center-line_min 0.32684152243677644 deviation-heading_max 2.5488727326530465 deviation-heading_mean 2.5488727326530465 deviation-heading_median 2.5488727326530465 deviation-heading_min 2.5488727326530465 distance-from-start_max 0.5461575079396548 distance-from-start_mean 0.5461575079396548 distance-from-start_median 0.5461575079396548 distance-from-start_min 0.5461575079396548 driven_any_max 2.3519174817467863 driven_any_mean 2.3519174817467863 driven_any_median 2.3519174817467863 driven_any_min 2.3519174817467863 driven_lanedir_consec_max 0.029483020207996535 driven_lanedir_consec_mean 0.029483020207996535 driven_lanedir_consec_min 0.029483020207996535 driven_lanedir_max 0.03283067360874581 driven_lanedir_mean 0.03283067360874581 driven_lanedir_median 0.03283067360874581 driven_lanedir_min 0.03283067360874581 in-drivable-lane_max 8.000000000000016 in-drivable-lane_mean 8.000000000000016 in-drivable-lane_min 8.000000000000016 per-episodes details {"autolab-000-ego0": {"driven_any": 2.3519174817467863, "survival_time": 11.450000000000028, "driven_lanedir": 0.03283067360874581, "in-drivable-lane": 8.000000000000016, "deviation-heading": 2.5488727326530465, "distance-from-start": 0.5461575079396548, "deviation-center-line": 0.32684152243677644, "driven_lanedir_consec": 0.029483020207996535}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 15334
1500
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 01:26:43+00:00 2022-11-25 01:31:23+00:00 0:04:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24555746228952957 survival_time_median 39.24999999999991 deviation-center-line_median 1.3919847015555789 in-drivable-lane_median 25.24999999999981
other stats deviation-center-line_max 1.3919847015555789 deviation-center-line_mean 1.3919847015555789 deviation-center-line_min 1.3919847015555789 deviation-heading_max 9.906601177812297 deviation-heading_mean 9.906601177812297 deviation-heading_median 9.906601177812297 deviation-heading_min 9.906601177812297 distance-from-start_max 1.0093404360059268 distance-from-start_mean 1.0093404360059268 distance-from-start_median 1.0093404360059268 distance-from-start_min 1.0093404360059268 driven_any_max 9.462416332537492 driven_any_mean 9.462416332537492 driven_any_median 9.462416332537492 driven_any_min 9.462416332537492 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.24555746228952957 driven_lanedir_consec_min 0.24555746228952957 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.2358197494342854 driven_lanedir_median 0.2358197494342854 driven_lanedir_min 0.2358197494342854 in-drivable-lane_max 25.24999999999981 in-drivable-lane_mean 25.24999999999981 in-drivable-lane_min 25.24999999999981 per-episodes details {"loop-000-ego0": {"driven_any": 9.462416332537492, "survival_time": 39.24999999999991, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 25.24999999999981, "deviation-heading": 9.906601177812297, "distance-from-start": 1.0093404360059268, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}}simulation-passed 1 survival_time_max 39.24999999999991 survival_time_mean 39.24999999999991 survival_time_min 39.24999999999991
No reset possible 15333
1501
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 01:24:46+00:00 2022-11-25 01:26:14+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15326
1502
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 01:07:34+00:00 2022-11-25 01:24:27+00:00 0:16:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.399999999999615 in-drivable-lane_median 36.89999999999958 driven_lanedir_consec_median 0.16636007500288152 deviation-center-line_median 0.6465381124900755
other stats deviation-center-line_max 3.843921290582837 deviation-center-line_mean 1.365959723489658 deviation-center-line_min 0.3268413783956437 deviation-heading_max 34.73068339720075 deviation-heading_mean 11.863967459268938 deviation-heading_median 5.088156815887916 deviation-heading_min 2.548872808099167 distance-from-start_max 1.0442247976691943 distance-from-start_mean 0.7726084491662092 distance-from-start_median 0.7348495479070991 distance-from-start_min 0.5765099031814445 driven_any_max 11.02110496898546 driven_any_mean 5.960730691438496 driven_any_median 5.132220528138905 driven_any_min 2.5573767404907164 driven_lanedir_consec_max 0.2424977297667874 driven_lanedir_consec_mean 0.1511732098444039 driven_lanedir_consec_min 0.029474959605065187 driven_lanedir_max 0.22840118579828728 driven_lanedir_mean 0.13782421614551926 driven_lanedir_median 0.14503534079604596 driven_lanedir_min 0.03282499719169785 in-drivable-lane_max 40.949999999999605 in-drivable-lane_mean 31.049999999999716 in-drivable-lane_min 9.450000000000106 per-episodes details {"autolab-000-ego0": {"driven_any": 2.5573767404907164, "survival_time": 44.399999999999615, "driven_lanedir": 0.03282499719169785, "in-drivable-lane": 40.949999999999605, "deviation-heading": 2.548872808099167, "distance-from-start": 0.5765099031814445, "deviation-center-line": 0.3268413783956437, "driven_lanedir_consec": 0.029474959605065187}, "autolab-000-ego1": {"driven_any": 4.1683236267102375, "survival_time": 44.399999999999615, "driven_lanedir": 0.22840118579828728, "in-drivable-lane": 9.450000000000106, "deviation-heading": 34.73068339720075, "distance-from-start": 0.6736010379604851, "deviation-center-line": 3.843921290582837, "driven_lanedir_consec": 0.2424977297667874}, "autolab-000-ego2": {"driven_any": 11.02110496898546, "survival_time": 44.399999999999615, "driven_lanedir": 0.13091508050074063, "in-drivable-lane": 37.59999999999958, "deviation-heading": 3.900775995746317, "distance-from-start": 1.0442247976691943, "deviation-center-line": 0.686307068420695, "driven_lanedir_consec": 0.15293047772426194}, "autolab-000-ego3": {"driven_any": 6.096117429567572, "survival_time": 44.399999999999615, "driven_lanedir": 0.1591556010913513, "in-drivable-lane": 36.19999999999958, "deviation-heading": 6.275537636029516, "distance-from-start": 0.7960980578537132, "deviation-center-line": 0.6067691565594562, "driven_lanedir_consec": 0.1797896722815011}}simulation-passed 1 survival_time_max 44.399999999999615 survival_time_mean 44.399999999999615 survival_time_min 44.399999999999615
No reset possible 15321
1503
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 01:05:24+00:00 2022-11-25 01:07:28+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.94999999999998 in-drivable-lane_median 5.549999999999983 driven_lanedir_consec_median 0.020891462039611675 deviation-center-line_median 0.16974575483481455
other stats deviation-center-line_max 0.16974575483481455 deviation-center-line_mean 0.16974575483481455 deviation-center-line_min 0.16974575483481455 deviation-heading_max 1.6654350665682798 deviation-heading_mean 1.6654350665682798 deviation-heading_median 1.6654350665682798 deviation-heading_min 1.6654350665682798 distance-from-start_max 0.5351951936475464 distance-from-start_mean 0.5351951936475464 distance-from-start_median 0.5351951936475464 distance-from-start_min 0.5351951936475464 driven_any_max 1.5709859611218706 driven_any_mean 1.5709859611218706 driven_any_median 1.5709859611218706 driven_any_min 1.5709859611218706 driven_lanedir_consec_max 0.020891462039611675 driven_lanedir_consec_mean 0.020891462039611675 driven_lanedir_consec_min 0.020891462039611675 driven_lanedir_max 0.020891462039611675 driven_lanedir_mean 0.020891462039611675 driven_lanedir_median 0.020891462039611675 driven_lanedir_min 0.020891462039611675 in-drivable-lane_max 5.549999999999983 in-drivable-lane_mean 5.549999999999983 in-drivable-lane_min 5.549999999999983 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5709859611218706, "survival_time": 7.94999999999998, "driven_lanedir": 0.020891462039611675, "in-drivable-lane": 5.549999999999983, "deviation-heading": 1.6654350665682798, "distance-from-start": 0.5351951936475464, "deviation-center-line": 0.16974575483481455, "driven_lanedir_consec": 0.020891462039611675}}simulation-passed 1 survival_time_max 7.94999999999998 survival_time_mean 7.94999999999998 survival_time_min 7.94999999999998
No reset possible 15317
1505
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 01:03:27+00:00 2022-11-25 01:04:59+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15313
1506
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 01:01:27+00:00 2022-11-25 01:03:00+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15304
1508
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 00:56:48+00:00 2022-11-25 01:00:58+00:00 0:04:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.549999999999986 in-drivable-lane_median 6.249999999999989 driven_lanedir_consec_median 0.5260499934418864 deviation-center-line_median 0.20119946559073723
other stats deviation-center-line_max 0.334677994098822 deviation-center-line_mean 0.2046368928519749 deviation-center-line_min 0.08147064612760313 deviation-heading_max 1.390534387876176 deviation-heading_mean 0.859325047941333 deviation-heading_median 0.7495454898319036 deviation-heading_min 0.5476748242253484 distance-from-start_max 2.214860576995327 distance-from-start_mean 1.1275196030945454 distance-from-start_median 0.957909822204885 distance-from-start_min 0.3793981909730845 driven_any_max 2.2683994733864203 driven_any_mean 1.1436306839168675 driven_any_median 0.9629349929649792 driven_any_min 0.3802532763510908 driven_lanedir_consec_max 0.9256153333007432 driven_lanedir_consec_mean 0.5432852393167469 driven_lanedir_consec_min 0.1954256370824714 driven_lanedir_max 0.9256153333007432 driven_lanedir_mean 0.5473175854842066 driven_lanedir_median 0.5341146857768059 driven_lanedir_min 0.1954256370824714 in-drivable-lane_max 7.399999999999986 in-drivable-lane_mean 6.2499999999999885 in-drivable-lane_min 5.099999999999991 per-episodes details {"udem-000-ego0": {"driven_any": 0.3802532763510908, "survival_time": 8.549999999999986, "driven_lanedir": 0.21896239468593404, "in-drivable-lane": 7.399999999999986, "deviation-heading": 0.6059510827797092, "distance-from-start": 0.3793981909730845, "deviation-center-line": 0.08147064612760313, "driven_lanedir_consec": 0.21896239468593404}, "udem-000-ego1": {"driven_any": 0.7125947031469251, "survival_time": 8.549999999999986, "driven_lanedir": 0.1954256370824714, "in-drivable-lane": 7.349999999999986, "deviation-heading": 0.5476748242253484, "distance-from-start": 0.7114127845117173, "deviation-center-line": 0.11642962840947498, "driven_lanedir_consec": 0.1954256370824714}, "udem-000-ego2": {"driven_any": 1.213275282783033, "survival_time": 8.549999999999986, "driven_lanedir": 0.9256153333007432, "in-drivable-lane": 5.099999999999991, "deviation-heading": 0.893139896884098, "distance-from-start": 1.2044068598980526, "deviation-center-line": 0.2859693027719995, "driven_lanedir_consec": 0.9256153333007432}, "udem-000-ego3": {"driven_any": 2.2683994733864203, "survival_time": 8.549999999999986, "driven_lanedir": 0.8492669768676777, "in-drivable-lane": 5.1499999999999915, "deviation-heading": 1.390534387876176, "distance-from-start": 2.214860576995327, "deviation-center-line": 0.334677994098822, "driven_lanedir_consec": 0.8331375921978388}}simulation-passed 1 survival_time_max 8.549999999999986 survival_time_mean 8.549999999999986 survival_time_min 8.549999999999986
No reset possible 15302
1508
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 00:55:02+00:00 2022-11-25 00:56:30+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15297
1510
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 00:52:53+00:00 2022-11-25 00:54:36+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2499999999999964 in-drivable-lane_median 2.349999999999996 driven_lanedir_consec_median 0.12008659740675036 deviation-center-line_median 0.0451209961421012
other stats deviation-center-line_max 0.0451209961421012 deviation-center-line_mean 0.0451209961421012 deviation-center-line_min 0.0451209961421012 deviation-heading_max 0.6306694543776076 deviation-heading_mean 0.6306694543776076 deviation-heading_median 0.6306694543776076 deviation-heading_min 0.6306694543776076 distance-from-start_max 0.5881328049306841 distance-from-start_mean 0.5881328049306841 distance-from-start_median 0.5881328049306841 distance-from-start_min 0.5881328049306841 driven_any_max 0.6193186677043458 driven_any_mean 0.6193186677043458 driven_any_median 0.6193186677043458 driven_any_min 0.6193186677043458 driven_lanedir_consec_max 0.12008659740675036 driven_lanedir_consec_mean 0.12008659740675036 driven_lanedir_consec_min 0.12008659740675036 driven_lanedir_max 0.12008659740675036 driven_lanedir_mean 0.12008659740675036 driven_lanedir_median 0.12008659740675036 driven_lanedir_min 0.12008659740675036 in-drivable-lane_max 2.349999999999996 in-drivable-lane_mean 2.349999999999996 in-drivable-lane_min 2.349999999999996 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6193186677043458, "survival_time": 3.2499999999999964, "driven_lanedir": 0.12008659740675036, "in-drivable-lane": 2.349999999999996, "deviation-heading": 0.6306694543776076, "distance-from-start": 0.5881328049306841, "deviation-center-line": 0.0451209961421012, "driven_lanedir_consec": 0.12008659740675036}}simulation-passed 1 survival_time_max 3.2499999999999964 survival_time_mean 3.2499999999999964 survival_time_min 3.2499999999999964
No reset possible 15294
1510
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 00:51:17+00:00 2022-11-25 00:52:32+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.849999999999998 in-drivable-lane_median 1.8499999999999976 driven_lanedir_consec_median 0.18180388911794895 deviation-center-line_median 0.06203251013273742
other stats deviation-center-line_max 0.06203251013273742 deviation-center-line_mean 0.06203251013273742 deviation-center-line_min 0.06203251013273742 deviation-heading_max 0.5933644354313745 deviation-heading_mean 0.5933644354313745 deviation-heading_median 0.5933644354313745 deviation-heading_min 0.5933644354313745 distance-from-start_max 0.5956048087253367 distance-from-start_mean 0.5956048087253367 distance-from-start_median 0.5956048087253367 distance-from-start_min 0.5956048087253367 driven_any_max 0.5987261431153381 driven_any_mean 0.5987261431153381 driven_any_median 0.5987261431153381 driven_any_min 0.5987261431153381 driven_lanedir_consec_max 0.18180388911794895 driven_lanedir_consec_mean 0.18180388911794895 driven_lanedir_consec_min 0.18180388911794895 driven_lanedir_max 0.18180388911794895 driven_lanedir_mean 0.18180388911794895 driven_lanedir_median 0.18180388911794895 driven_lanedir_min 0.18180388911794895 in-drivable-lane_max 1.8499999999999976 in-drivable-lane_mean 1.8499999999999976 in-drivable-lane_min 1.8499999999999976 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5987261431153381, "survival_time": 2.849999999999998, "driven_lanedir": 0.18180388911794895, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5933644354313745, "distance-from-start": 0.5956048087253367, "deviation-center-line": 0.06203251013273742, "driven_lanedir_consec": 0.18180388911794895}}simulation-passed 1 survival_time_max 2.849999999999998 survival_time_mean 2.849999999999998 survival_time_min 2.849999999999998
No reset possible 15287
1515
Bea Baselines 🐤template-ros lx22-BV1
sim-0of5 success no davinci-stage-03-6.2.51
2022-11-25 00:47:56+00:00 2022-11-25 00:50:54+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 4.997772662320364
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 4.997772662320364 distance-from-start_median 4.997772662320364 distance-from-start_min 4.997772662320364 driven_any_max 6.060703602282261 driven_any_mean 6.060703602282261 driven_any_median 6.060703602282261 driven_any_min 6.060703602282261 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 21.45000000000017 in-drivable-lane_mean 21.45000000000017 in-drivable-lane_median 21.45000000000017 in-drivable-lane_min 21.45000000000017 per-episodes details {"d30-ego0": {"driven_any": 6.060703602282261, "survival_time": 21.45000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 21.45000000000017, "deviation-heading": 0.0, "distance-from-start": 4.997772662320364, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 21.45000000000017 survival_time_mean 21.45000000000017 survival_time_median 21.45000000000017 survival_time_min 21.45000000000017
No reset possible 15283
1522
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 00:45:00+00:00 2022-11-25 00:47:42+00:00 0:02:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.399999999999982 in-drivable-lane_median 6.4499999999999815 driven_lanedir_consec_median 0.16530060974893024 deviation-center-line_median 0.06775994046003851
other stats deviation-center-line_max 0.06775994046003851 deviation-center-line_mean 0.06775994046003851 deviation-center-line_min 0.06775994046003851 deviation-heading_max 0.5761932938947714 deviation-heading_mean 0.5761932938947714 deviation-heading_median 0.5761932938947714 deviation-heading_min 0.5761932938947714 distance-from-start_max 1.871633076081343 distance-from-start_mean 1.871633076081343 distance-from-start_median 1.871633076081343 distance-from-start_min 1.871633076081343 driven_any_max 1.8993577545200295 driven_any_mean 1.8993577545200295 driven_any_median 1.8993577545200295 driven_any_min 1.8993577545200295 driven_lanedir_consec_max 0.16530060974893024 driven_lanedir_consec_mean 0.16530060974893024 driven_lanedir_consec_min 0.16530060974893024 driven_lanedir_max 0.16530060974893024 driven_lanedir_mean 0.16530060974893024 driven_lanedir_median 0.16530060974893024 driven_lanedir_min 0.16530060974893024 in-drivable-lane_max 6.4499999999999815 in-drivable-lane_mean 6.4499999999999815 in-drivable-lane_min 6.4499999999999815 per-episodes details {"loop-000-ego0": {"driven_any": 1.8993577545200295, "survival_time": 7.399999999999982, "driven_lanedir": 0.16530060974893024, "in-drivable-lane": 6.4499999999999815, "deviation-heading": 0.5761932938947714, "distance-from-start": 1.871633076081343, "deviation-center-line": 0.06775994046003851, "driven_lanedir_consec": 0.16530060974893024}}simulation-passed 1 survival_time_max 7.399999999999982 survival_time_mean 7.399999999999982 survival_time_min 7.399999999999982
No reset possible 15276
1523
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-25 00:41:57+00:00 2022-11-25 00:44:53+00:00 0:02:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.849999999999984 in-drivable-lane_median 5.949999999999983 driven_lanedir_consec_median 0.14034309441245463 deviation-center-line_median 0.06233555880741286
other stats deviation-center-line_max 0.06233555880741286 deviation-center-line_mean 0.06233555880741286 deviation-center-line_min 0.06233555880741286 deviation-heading_max 0.6042580044345098 deviation-heading_mean 0.6042580044345098 deviation-heading_median 0.6042580044345098 deviation-heading_min 0.6042580044345098 distance-from-start_max 1.6999539884225772 distance-from-start_mean 1.6999539884225772 distance-from-start_median 1.6999539884225772 distance-from-start_min 1.6999539884225772 driven_any_max 1.7327238267742102 driven_any_mean 1.7327238267742102 driven_any_median 1.7327238267742102 driven_any_min 1.7327238267742102 driven_lanedir_consec_max 0.14034309441245463 driven_lanedir_consec_mean 0.14034309441245463 driven_lanedir_consec_min 0.14034309441245463 driven_lanedir_max 0.14034309441245463 driven_lanedir_mean 0.14034309441245463 driven_lanedir_median 0.14034309441245463 driven_lanedir_min 0.14034309441245463 in-drivable-lane_max 5.949999999999983 in-drivable-lane_mean 5.949999999999983 in-drivable-lane_min 5.949999999999983 per-episodes details {"4way-000-ego0": {"driven_any": 1.7327238267742102, "survival_time": 6.849999999999984, "driven_lanedir": 0.14034309441245463, "in-drivable-lane": 5.949999999999983, "deviation-heading": 0.6042580044345098, "distance-from-start": 1.6999539884225772, "deviation-center-line": 0.06233555880741286, "driven_lanedir_consec": 0.14034309441245463}}simulation-passed 1 survival_time_max 6.849999999999984 survival_time_mean 6.849999999999984 survival_time_min 6.849999999999984
No reset possible 15272
1525
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 00:40:08+00:00 2022-11-25 00:41:43+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.224986742259623 survival_time_median 6.999999999999983 deviation-center-line_median 0.14322886932730303 in-drivable-lane_median 5.299999999999986
other stats deviation-center-line_max 0.14322886932730303 deviation-center-line_mean 0.14322886932730303 deviation-center-line_min 0.14322886932730303 deviation-heading_max 1.5544072913919156 deviation-heading_mean 1.5544072913919156 deviation-heading_median 1.5544072913919156 deviation-heading_min 1.5544072913919156 distance-from-start_max 1.800777859915408 distance-from-start_mean 1.800777859915408 distance-from-start_median 1.800777859915408 distance-from-start_min 1.800777859915408 driven_any_max 1.8167325504447691 driven_any_mean 1.8167325504447691 driven_any_median 1.8167325504447691 driven_any_min 1.8167325504447691 driven_lanedir_consec_max 0.224986742259623 driven_lanedir_consec_mean 0.224986742259623 driven_lanedir_consec_min 0.224986742259623 driven_lanedir_max 0.224986742259623 driven_lanedir_mean 0.224986742259623 driven_lanedir_median 0.224986742259623 driven_lanedir_min 0.224986742259623 in-drivable-lane_max 5.299999999999986 in-drivable-lane_mean 5.299999999999986 in-drivable-lane_min 5.299999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8167325504447691, "survival_time": 6.999999999999983, "driven_lanedir": 0.224986742259623, "in-drivable-lane": 5.299999999999986, "deviation-heading": 1.5544072913919156, "distance-from-start": 1.800777859915408, "deviation-center-line": 0.14322886932730303, "driven_lanedir_consec": 0.224986742259623}}simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 6.999999999999983 survival_time_min 6.999999999999983
No reset possible 15265
1526
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 00:35:37+00:00 2022-11-25 00:39:55+00:00 0:04:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.400000000000013 in-drivable-lane_median 7.325000000000015 driven_lanedir_consec_median 0.5553563311597431 deviation-center-line_median 0.1838731730027661
other stats deviation-center-line_max 1.2258335973675265 deviation-center-line_mean 0.4150455354118808 deviation-center-line_min 0.06660219827446462 deviation-heading_max 6.065343459203177 deviation-heading_mean 2.2656734976932107 deviation-heading_median 1.2901767480401112 deviation-heading_min 0.41699703548944234 distance-from-start_max 2.890924589090496 distance-from-start_mean 1.419074017731938 distance-from-start_median 1.2835284912462364 distance-from-start_min 0.21831449934478248 driven_any_max 3.0144240140143737 driven_any_mean 1.4849479093064677 driven_any_median 1.353123951644537 driven_any_min 0.21911971992242296 driven_lanedir_consec_max 0.906591809656884 driven_lanedir_consec_mean 0.5317213827366949 driven_lanedir_consec_min 0.1095810589704096 driven_lanedir_max 0.906591809656884 driven_lanedir_mean 0.5317213827366949 driven_lanedir_median 0.5553563311597431 driven_lanedir_min 0.1095810589704096 in-drivable-lane_max 9.650000000000013 in-drivable-lane_mean 6.3125000000000115 in-drivable-lane_min 0.9500000000000008 per-episodes details {"udem-000-ego0": {"driven_any": 0.8894928423024814, "survival_time": 10.400000000000013, "driven_lanedir": 0.5461657636765018, "in-drivable-lane": 0.9500000000000008, "deviation-heading": 6.065343459203177, "distance-from-start": 0.8052663318123509, "deviation-center-line": 1.2258335973675265, "driven_lanedir_consec": 0.5461657636765018}, "udem-000-ego1": {"driven_any": 3.0144240140143737, "survival_time": 10.400000000000013, "driven_lanedir": 0.906591809656884, "in-drivable-lane": 6.600000000000018, "deviation-heading": 2.092469905523512, "distance-from-start": 2.890924589090496, "deviation-center-line": 0.2880084404550441, "driven_lanedir_consec": 0.906591809656884}, "udem-000-ego2": {"driven_any": 1.8167550609865928, "survival_time": 10.400000000000013, "driven_lanedir": 0.5645468986429845, "in-drivable-lane": 8.050000000000013, "deviation-heading": 0.41699703548944234, "distance-from-start": 1.761790650680122, "deviation-center-line": 0.07973790555048803, "driven_lanedir_consec": 0.5645468986429845}, "udem-000-ego3": {"driven_any": 0.21911971992242296, "survival_time": 10.400000000000013, "driven_lanedir": 0.1095810589704096, "in-drivable-lane": 9.650000000000013, "deviation-heading": 0.4878835905567104, "distance-from-start": 0.21831449934478248, "deviation-center-line": 0.06660219827446462, "driven_lanedir_consec": 0.1095810589704096}}simulation-passed 1 survival_time_max 10.400000000000013 survival_time_mean 10.400000000000013 survival_time_min 10.400000000000013
No reset possible 15259
1527
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 00:32:26+00:00 2022-11-25 00:35:04+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.349999999999984 in-drivable-lane_median 6.699999999999985 driven_lanedir_consec_median 0.31194351664702125 deviation-center-line_median 0.14815233178588855
other stats deviation-center-line_max 0.18943051157838184 deviation-center-line_mean 0.14815233178588855 deviation-center-line_min 0.10687415199339528 deviation-heading_max 1.2014267664391736 deviation-heading_mean 0.9254469398581257 deviation-heading_median 0.9254469398581257 deviation-heading_min 0.6494671132770777 distance-from-start_max 2.1462992047293024 distance-from-start_mean 1.8989280960128432 distance-from-start_median 1.8989280960128432 distance-from-start_min 1.6515569872963844 driven_any_max 2.234171410023607 driven_any_mean 1.9624970713444672 driven_any_median 1.9624970713444672 driven_any_min 1.6908227326653276 driven_lanedir_consec_max 0.3757429133103321 driven_lanedir_consec_mean 0.31194351664702125 driven_lanedir_consec_min 0.24814411998371044 driven_lanedir_max 0.3757429133103321 driven_lanedir_mean 0.31194351664702125 driven_lanedir_median 0.31194351664702125 driven_lanedir_min 0.24814411998371044 in-drivable-lane_max 6.999999999999983 in-drivable-lane_mean 6.699999999999985 in-drivable-lane_min 6.399999999999987 per-episodes details {"loop2-000-ego0": {"driven_any": 1.6908227326653276, "survival_time": 8.349999999999984, "driven_lanedir": 0.24814411998371044, "in-drivable-lane": 6.999999999999983, "deviation-heading": 0.6494671132770777, "distance-from-start": 1.6515569872963844, "deviation-center-line": 0.10687415199339528, "driven_lanedir_consec": 0.24814411998371044}, "loop2-000-ego1": {"driven_any": 2.234171410023607, "survival_time": 8.349999999999984, "driven_lanedir": 0.3757429133103321, "in-drivable-lane": 6.399999999999987, "deviation-heading": 1.2014267664391736, "distance-from-start": 2.1462992047293024, "deviation-center-line": 0.18943051157838184, "driven_lanedir_consec": 0.3757429133103321}}simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 8.349999999999984 survival_time_min 8.349999999999984
No reset possible 15255
1529
Bea Baselines 🐤template-tensorflow aido-LFV-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:30:41+00:00 2022-11-25 00:32:11+00:00 0:01:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15250
1530
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:28:54+00:00 2022-11-25 00:30:34+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15245
1531
Bea Baselines 🐤template-tensorflow aido-LFI-sim-validation
sim-3of4 success no davinci-stage-03-6.2.51
2022-11-25 00:26:53+00:00 2022-11-25 00:28:23+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15240
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:25:32+00:00 2022-11-25 00:26:32+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15235
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:23:47+00:00 2022-11-25 00:25:12+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15232
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:22:29+00:00 2022-11-25 00:23:28+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15225
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:21:18+00:00 2022-11-25 00:22:17+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15220
1540
Bea Baselines 🐤template-tensorflow lx22-BV1
sim-4of5 failed no davinci-stage-03-6.2.51
2022-11-25 00:19:44+00:00 2022-11-25 00:20:43+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15217
1540
Bea Baselines 🐤template-tensorflow lx22-BV1
sim-1of5 failed no davinci-stage-03-6.2.51
2022-11-25 00:18:34+00:00 2022-11-25 00:19:37+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15212
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:16:53+00:00 2022-11-25 00:18:27+00:00 0:01:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15207
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-25 00:15:14+00:00 2022-11-25 00:16:46+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15203
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:14:08+00:00 2022-11-25 00:15:08+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15199
1551
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-0of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:12:26+00:00 2022-11-25 00:14:02+00:00 0:01:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15194
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-1of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:10:36+00:00 2022-11-25 00:12:06+00:00 0:01:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15192
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-3of4 failed no davinci-stage-03-6.2.51
2022-11-25 00:09:12+00:00 2022-11-25 00:10:29+00:00 0:01:17 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15187
1369
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-25 00:04:19+00:00 2022-11-25 00:08:58+00:00 0:04:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5870086052428155 deviation-center-line_median 0.2666145991209239
other stats deviation-center-line_max 0.2666145991209239 deviation-center-line_mean 0.2666145991209239 deviation-center-line_min 0.2666145991209239 deviation-heading_max 1.6312868879707314 deviation-heading_mean 1.6312868879707314 deviation-heading_median 1.6312868879707314 deviation-heading_min 1.6312868879707314 distance-from-start_max 0.6088681695022287 distance-from-start_mean 0.6088681695022287 distance-from-start_median 0.6088681695022287 distance-from-start_min 0.6088681695022287 driven_any_max 0.7381571900619482 driven_any_mean 0.7381571900619482 driven_any_median 0.7381571900619482 driven_any_min 0.7381571900619482 driven_lanedir_consec_max 0.5870086052428155 driven_lanedir_consec_mean 0.5870086052428155 driven_lanedir_consec_min 0.5870086052428155 driven_lanedir_max 0.7163377349593194 driven_lanedir_mean 0.7163377349593194 driven_lanedir_median 0.7163377349593194 driven_lanedir_min 0.7163377349593194 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.7381571900619482, "survival_time": 6.699999999999984, "driven_lanedir": 0.7163377349593194, "in-drivable-lane": 0.0, "deviation-heading": 1.6312868879707314, "distance-from-start": 0.6088681695022287, "deviation-center-line": 0.2666145991209239, "driven_lanedir_consec": 0.5870086052428155}}simulation-passed 1 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 15183
1293
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-0of4 aborted no davinci-stage-03-6.2.51
2022-11-25 00:02:27+00:00 2022-11-25 00:04:05+00:00 0:01:38 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15179
1294
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-24 23:54:09+00:00 2022-11-25 00:02:02+00:00 0:07:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.99999999999958 in-drivable-lane_median 39.249999999999574 driven_lanedir_consec_median 0.1329316137267978 deviation-center-line_median 0.4769519451920501
other stats deviation-center-line_max 0.627148077892518 deviation-center-line_mean 0.4769519451920501 deviation-center-line_min 0.3267558124915822 deviation-heading_max 4.173256858222429 deviation-heading_mean 3.3650961945019375 deviation-heading_median 3.3650961945019375 deviation-heading_min 2.5569355307814456 distance-from-start_max 1.0442247976691823 distance-from-start_mean 0.7951911528044138 distance-from-start_median 0.7951911528044138 distance-from-start_min 0.5461575079396452 driven_any_max 11.349124250612952 driven_any_mean 6.923556868843365 driven_any_median 6.923556868843365 driven_any_min 2.497989487073778 driven_lanedir_consec_max 0.2397940766790495 driven_lanedir_consec_mean 0.1329316137267978 driven_lanedir_consec_min 0.02606915077454608 driven_lanedir_max 0.2256600500204217 driven_lanedir_mean 0.1275377118421561 driven_lanedir_median 0.1275377118421561 driven_lanedir_min 0.029415373663890465 in-drivable-lane_max 41.54999999999957 in-drivable-lane_mean 39.249999999999574 in-drivable-lane_min 36.94999999999958 per-episodes details {"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}simulation-passed 1 survival_time_max 44.99999999999958 survival_time_mean 44.99999999999958 survival_time_min 44.99999999999958
No reset possible 15171
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-24 23:45:51+00:00 2022-11-24 23:53:35+00:00 0:07:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.980675798258526 survival_time_median 59.99999999999873 deviation-center-line_median 1.6637876864642946 in-drivable-lane_median 22.09999999999952
other stats deviation-center-line_max 1.6637876864642946 deviation-center-line_mean 1.6637876864642946 deviation-center-line_min 1.6637876864642946 deviation-heading_max 30.795731684839257 deviation-heading_mean 30.795731684839257 deviation-heading_median 30.795731684839257 deviation-heading_min 30.795731684839257 distance-from-start_max 0.15168812422450223 distance-from-start_mean 0.15168812422450223 distance-from-start_median 0.15168812422450223 distance-from-start_min 0.15168812422450223 driven_any_max 11.044601005967774 driven_any_mean 11.044601005967774 driven_any_median 11.044601005967774 driven_any_min 11.044601005967774 driven_lanedir_consec_max -2.980675798258526 driven_lanedir_consec_mean -2.980675798258526 driven_lanedir_consec_min -2.980675798258526 driven_lanedir_max -2.980675798258526 driven_lanedir_mean -2.980675798258526 driven_lanedir_median -2.980675798258526 driven_lanedir_min -2.980675798258526 in-drivable-lane_max 22.09999999999952 in-drivable-lane_mean 22.09999999999952 in-drivable-lane_min 22.09999999999952 per-episodes details {"autolab-000-ego0": {"driven_any": 11.044601005967774, "survival_time": 59.99999999999873, "driven_lanedir": -2.980675798258526, "in-drivable-lane": 22.09999999999952, "deviation-heading": 30.795731684839257, "distance-from-start": 0.15168812422450223, "deviation-center-line": 1.6637876864642946, "driven_lanedir_consec": -2.980675798258526}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15165
1268
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-24 23:37:31+00:00 2022-11-24 23:45:45+00:00 0:08:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 18.900000000000233 driven_lanedir_consec_median 0.25774306587044116 deviation-center-line_median 0.8659891122281899
other stats deviation-center-line_max 0.8659891122281899 deviation-center-line_mean 0.8659891122281899 deviation-center-line_min 0.8659891122281899 deviation-heading_max 7.706889663126838 deviation-heading_mean 7.706889663126838 deviation-heading_median 7.706889663126838 deviation-heading_min 7.706889663126838 distance-from-start_max 0.8626308120701125 distance-from-start_mean 0.8626308120701125 distance-from-start_median 0.8626308120701125 distance-from-start_min 0.8626308120701125 driven_any_max 7.161071358405415 driven_any_mean 7.161071358405415 driven_any_median 7.161071358405415 driven_any_min 7.161071358405415 driven_lanedir_consec_max 0.25774306587044116 driven_lanedir_consec_mean 0.25774306587044116 driven_lanedir_consec_min 0.25774306587044116 driven_lanedir_max 0.2397300056472842 driven_lanedir_mean 0.2397300056472842 driven_lanedir_median 0.2397300056472842 driven_lanedir_min 0.2397300056472842 in-drivable-lane_max 18.900000000000233 in-drivable-lane_mean 18.900000000000233 in-drivable-lane_min 18.900000000000233 per-episodes details {"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 15162
1269
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-24 23:33:16+00:00 2022-11-24 23:37:14+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.70000000000016 in-drivable-lane_median 12.150000000000135 driven_lanedir_consec_median 0.2718508044257806 deviation-center-line_median 0.7655525719315331
other stats deviation-center-line_max 0.7655525719315331 deviation-center-line_mean 0.7655525719315331 deviation-center-line_min 0.7655525719315331 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7357883576773756 distance-from-start_mean 0.7357883576773756 distance-from-start_median 0.7357883576773756 distance-from-start_min 0.7357883576773756 driven_any_max 5.001991003394682 driven_any_mean 5.001991003394682 driven_any_median 5.001991003394682 driven_any_min 5.001991003394682 driven_lanedir_consec_max 0.2718508044257806 driven_lanedir_consec_mean 0.2718508044257806 driven_lanedir_consec_min 0.2718508044257806 driven_lanedir_max 0.2538357176450212 driven_lanedir_mean 0.2538357176450212 driven_lanedir_median 0.2538357176450212 driven_lanedir_min 0.2538357176450212 in-drivable-lane_max 12.150000000000135 in-drivable-lane_mean 12.150000000000135 in-drivable-lane_min 12.150000000000135 per-episodes details {"udem1-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2538357176450212, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7357883576773756, "deviation-center-line": 0.7655525719315331, "driven_lanedir_consec": 0.2718508044257806}}simulation-passed 1 survival_time_max 20.70000000000016 survival_time_mean 20.70000000000016 survival_time_min 20.70000000000016
No reset possible 15152
1272
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-03-6.2.51
2022-11-24 23:14:14+00:00 2022-11-24 23:33:01+00:00 0:18:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.64999999999875 in-drivable-lane_median 52.39999999999873 driven_lanedir_consec_median 0.20841941457351276 deviation-center-line_median 0.6235918393283303
other stats deviation-center-line_max 3.9618906351925345 deviation-center-line_mean 1.3480922472158894 deviation-center-line_min 0.18329467501436195 deviation-heading_max 29.06091202107619 deviation-heading_mean 10.086526110865954 deviation-heading_median 4.852439390352202 deviation-heading_min 1.5803136416832215 distance-from-start_max 1.390232809724702 distance-from-start_mean 0.8610879612709739 distance-from-start_median 0.7658648678412762 distance-from-start_min 0.5223892996766412 driven_any_max 14.859731274916312 driven_any_mean 6.788261723046844 driven_any_median 5.402007576921902 driven_any_min 1.4893004634272606 driven_lanedir_consec_max 0.4727232702196713 driven_lanedir_consec_mean 0.24835079061387844 driven_lanedir_consec_min 0.10384106308881692 driven_lanedir_max 0.4727232702196713 driven_lanedir_mean 0.2405349726449092 driven_lanedir_median 0.19278777863557428 driven_lanedir_min 0.10384106308881692 in-drivable-lane_max 57.149999999998755 in-drivable-lane_mean 41.13749999999905 in-drivable-lane_min 2.599999999999994 per-episodes details {"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}simulation-passed 1 survival_time_max 59.64999999999875 survival_time_mean 59.64999999999875 survival_time_min 59.64999999999875
No reset possible 15147
1267
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-24 23:10:39+00:00 2022-11-24 23:13:41+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.699999999999995 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.364506838392066 deviation-center-line_median 0.14696541332404583
other stats deviation-center-line_max 0.14696541332404583 deviation-center-line_mean 0.14696541332404583 deviation-center-line_min 0.14696541332404583 deviation-heading_max 1.6699264400950062 deviation-heading_mean 1.6699264400950062 deviation-heading_median 1.6699264400950062 deviation-heading_min 1.6699264400950062 distance-from-start_max 0.3743806210373658 distance-from-start_mean 0.3743806210373658 distance-from-start_median 0.3743806210373658 distance-from-start_min 0.3743806210373658 driven_any_max 0.3944302398862539 driven_any_mean 0.3944302398862539 driven_any_median 0.3944302398862539 driven_any_min 0.3944302398862539 driven_lanedir_consec_max 0.364506838392066 driven_lanedir_consec_mean 0.364506838392066 driven_lanedir_consec_min 0.364506838392066 driven_lanedir_max 0.364506838392066 driven_lanedir_mean 0.364506838392066 driven_lanedir_median 0.364506838392066 driven_lanedir_min 0.364506838392066 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"autolab-000-ego0": {"driven_any": 0.3944302398862539, "survival_time": 3.699999999999995, "driven_lanedir": 0.364506838392066, "in-drivable-lane": 0.9, "deviation-heading": 1.6699264400950062, "distance-from-start": 0.3743806210373658, "deviation-center-line": 0.14696541332404583, "driven_lanedir_consec": 0.364506838392066}}simulation-passed 1 survival_time_max 3.699999999999995 survival_time_mean 3.699999999999995 survival_time_min 3.699999999999995
No reset possible 15143
783
Andrea Daniele template-random aido-LF-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-24 23:06:42+00:00 2022-11-24 23:10:26+00:00 0:03:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2718401947993705 survival_time_median 27.70000000000026 deviation-center-line_median 0.7655517188189105 in-drivable-lane_median 19.150000000000237
other stats deviation-center-line_max 0.7655517188189105 deviation-center-line_mean 0.7655517188189105 deviation-center-line_min 0.7655517188189105 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7960980578537302 distance-from-start_mean 0.7960980578537302 distance-from-start_median 0.7960980578537302 distance-from-start_min 0.7960980578537302 driven_any_max 6.635455547557208 driven_any_mean 6.635455547557208 driven_any_median 6.635455547557208 driven_any_min 6.635455547557208 driven_lanedir_consec_max 0.2718401947993705 driven_lanedir_consec_mean 0.2718401947993705 driven_lanedir_consec_min 0.2718401947993705 driven_lanedir_max 0.25382904192484634 driven_lanedir_mean 0.25382904192484634 driven_lanedir_median 0.25382904192484634 driven_lanedir_min 0.25382904192484634 in-drivable-lane_max 19.150000000000237 in-drivable-lane_mean 19.150000000000237 in-drivable-lane_min 19.150000000000237 per-episodes details {"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 15133
789
Andrea Daniele template-pytorch aido-LF-sim-validation
sim-2of4 success no davinci-stage-03-6.2.51
2022-11-24 22:59:02+00:00 2022-11-24 23:06:34+00:00 0:07:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2229326785931809 survival_time_median 59.99999999999873 deviation-center-line_median 1.6228660537526909 in-drivable-lane_median 44.149999999998855
other stats deviation-center-line_max 1.6228660537526909 deviation-center-line_mean 1.6228660537526909 deviation-center-line_min 1.6228660537526909 deviation-heading_max 15.083872892584283 deviation-heading_mean 15.083872892584283 deviation-heading_median 15.083872892584283 deviation-heading_min 15.083872892584283 distance-from-start_max 0.38017612525006017 distance-from-start_mean 0.38017612525006017 distance-from-start_median 0.38017612525006017 distance-from-start_min 0.38017612525006017 driven_any_max 10.338707703249035 driven_any_mean 10.338707703249035 driven_any_median 10.338707703249035 driven_any_min 10.338707703249035 driven_lanedir_consec_max 1.2229326785931809 driven_lanedir_consec_mean 1.2229326785931809 driven_lanedir_consec_min 1.2229326785931809 driven_lanedir_max 1.4531324494592168 driven_lanedir_mean 1.4531324494592168 driven_lanedir_median 1.4531324494592168 driven_lanedir_min 1.4531324494592168 in-drivable-lane_max 44.149999999998855 in-drivable-lane_mean 44.149999999998855 in-drivable-lane_min 44.149999999998855 per-episodes details {"loop2-000-ego0": {"driven_any": 10.338707703249035, "survival_time": 59.99999999999873, "driven_lanedir": 1.4531324494592168, "in-drivable-lane": 44.149999999998855, "deviation-heading": 15.083872892584283, "distance-from-start": 0.38017612525006017, "deviation-center-line": 1.6228660537526909, "driven_lanedir_consec": 1.2229326785931809}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15126
1270
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-0of4 success no davinci-stage-03-6.2.51
2022-11-24 22:54:07+00:00 2022-11-24 22:58:49+00:00 0:04:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2718401947993705 survival_time_median 27.70000000000026 deviation-center-line_median 0.7655517188189105 in-drivable-lane_median 19.150000000000237
other stats deviation-center-line_max 0.7655517188189105 deviation-center-line_mean 0.7655517188189105 deviation-center-line_min 0.7655517188189105 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 0.7960980578537302 distance-from-start_mean 0.7960980578537302 distance-from-start_median 0.7960980578537302 distance-from-start_min 0.7960980578537302 driven_any_max 6.635455547557208 driven_any_mean 6.635455547557208 driven_any_median 6.635455547557208 driven_any_min 6.635455547557208 driven_lanedir_consec_max 0.2718401947993705 driven_lanedir_consec_mean 0.2718401947993705 driven_lanedir_consec_min 0.2718401947993705 driven_lanedir_max 0.25382904192484634 driven_lanedir_mean 0.25382904192484634 driven_lanedir_median 0.25382904192484634 driven_lanedir_min 0.25382904192484634 in-drivable-lane_max 19.150000000000237 in-drivable-lane_mean 19.150000000000237 in-drivable-lane_min 19.150000000000237 per-episodes details {"autolab-000-ego0": {"driven_any": 6.635455547557208, "survival_time": 27.70000000000026, "driven_lanedir": 0.25382904192484634, "in-drivable-lane": 19.150000000000237, "deviation-heading": 5.708723015945327, "distance-from-start": 0.7960980578537302, "deviation-center-line": 0.7655517188189105, "driven_lanedir_consec": 0.2718401947993705}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 15062
1297
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 host-error yes davinci-stage-03-6.2.51
2022-11-24 19:39:47+00:00 2022-11-24 19:40:30+00:00 0:00:43 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d tag 2022_11_24_17_26_06
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible