Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 11948
745
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-0of4 timeout no davinci-stage-03-6.2.46
2022-11-18 21:17:20+00:00 - - - - No reset possible 11945
746
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-18 21:15:05+00:00 2022-11-18 21:16:46+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11921
769
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-18 20:45:10+00:00 2022-11-18 21:06:05+00:00 0:20:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 13.924999999999804 driven_lanedir_consec_median 2.2043960704139423 deviation-center-line_median 2.3388459240296555
other stats deviation-center-line_max 3.273402873522062 deviation-center-line_mean 2.239082827561947 deviation-center-line_min 1.005236588666416 deviation-heading_max 35.43427187888054 deviation-heading_mean 15.65397294363615 deviation-heading_median 11.094404191175324 deviation-heading_min 4.992811513313409 distance-from-start_max 2.901443690312408 distance-from-start_mean 1.932611826945339 distance-from-start_median 1.9555060684416783 distance-from-start_min 0.9179914805855902 driven_any_max 7.906589925112896 driven_any_mean 4.710739975420023 driven_any_median 3.785042774615948 driven_any_min 3.3662844273353008 driven_lanedir_consec_max 3.801889626385696 driven_lanedir_consec_mean 2.4459572209658407 driven_lanedir_consec_min 1.573147116649782 driven_lanedir_max 4.676099679623878 driven_lanedir_mean 2.9565258894812523 driven_lanedir_median 2.612215353579382 driven_lanedir_min 1.9255731711423665 in-drivable-lane_max 43.34999999999863 in-drivable-lane_mean 18.937499999999577 in-drivable-lane_min 4.550000000000059 per-episodes details {"loop-000-ego0": {"driven_any": 3.3662844273353008, "survival_time": 59.99999999999873, "driven_lanedir": 1.9255731711423665, "in-drivable-lane": 7.350000000000096, "deviation-heading": 35.43427187888054, "distance-from-start": 0.9179914805855902, "deviation-center-line": 3.273402873522062, "driven_lanedir_consec": 1.573147116649782}, "loop-000-ego1": {"driven_any": 3.3733849137688567, "survival_time": 59.99999999999873, "driven_lanedir": 1.9599281228757537, "in-drivable-lane": 43.34999999999863, "deviation-heading": 4.992811513313409, "distance-from-start": 1.4180166368597558, "deviation-center-line": 1.005236588666416, "driven_lanedir_consec": 1.8909621672795467}, "loop-000-ego2": {"driven_any": 4.196700635463039, "survival_time": 59.99999999999873, "driven_lanedir": 3.2645025842830107, "in-drivable-lane": 4.550000000000059, "deviation-heading": 10.843058444484544, "distance-from-start": 2.492995500023601, "deviation-center-line": 2.7714019927538285, "driven_lanedir_consec": 2.517829973548338}, "loop-000-ego3": {"driven_any": 7.906589925112896, "survival_time": 59.99999999999873, "driven_lanedir": 4.676099679623878, "in-drivable-lane": 20.499999999999513, "deviation-heading": 11.345749937866108, "distance-from-start": 2.901443690312408, "deviation-center-line": 1.9062898553054823, "driven_lanedir_consec": 3.801889626385696}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11914
770
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-18 20:35:50+00:00 2022-11-18 20:45:03+00:00 0:09:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.8000000000000114 driven_lanedir_consec_median 7.646164910618881 deviation-center-line_median 4.2634638407644125
other stats deviation-center-line_max 4.2634638407644125 deviation-center-line_mean 4.2634638407644125 deviation-center-line_min 4.2634638407644125 deviation-heading_max 9.169977778916609 deviation-heading_mean 9.169977778916609 deviation-heading_median 9.169977778916609 deviation-heading_min 9.169977778916609 distance-from-start_max 3.078017347792143 distance-from-start_mean 3.078017347792143 distance-from-start_median 3.078017347792143 distance-from-start_min 3.078017347792143 driven_any_max 7.914519191212025 driven_any_mean 7.914519191212025 driven_any_median 7.914519191212025 driven_any_min 7.914519191212025 driven_lanedir_consec_max 7.646164910618881 driven_lanedir_consec_mean 7.646164910618881 driven_lanedir_consec_min 7.646164910618881 driven_lanedir_max 7.646164910618881 driven_lanedir_mean 7.646164910618881 driven_lanedir_median 7.646164910618881 driven_lanedir_min 7.646164910618881 in-drivable-lane_max 0.8000000000000114 in-drivable-lane_mean 0.8000000000000114 in-drivable-lane_min 0.8000000000000114 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.914519191212025, "survival_time": 59.99999999999873, "driven_lanedir": 7.646164910618881, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 9.169977778916609, "distance-from-start": 3.078017347792143, "deviation-center-line": 4.2634638407644125, "driven_lanedir_consec": 7.646164910618881}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11909
772
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-18 20:26:28+00:00 2022-11-18 20:35:15+00:00 0:08:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.05000000000028 in-drivable-lane_median 4.100000000000058 driven_lanedir_consec_median 2.640443828398648 deviation-center-line_median 1.8434456060123188
other stats deviation-center-line_max 1.8434456060123188 deviation-center-line_mean 1.8434456060123188 deviation-center-line_min 1.8434456060123188 deviation-heading_max 7.060164521184852 deviation-heading_mean 7.060164521184852 deviation-heading_median 7.060164521184852 deviation-heading_min 7.060164521184852 distance-from-start_max 1.2030818863496164 distance-from-start_mean 1.2030818863496164 distance-from-start_median 1.2030818863496164 distance-from-start_min 1.2030818863496164 driven_any_max 3.711939107885216 driven_any_mean 3.711939107885216 driven_any_median 3.711939107885216 driven_any_min 3.711939107885216 driven_lanedir_consec_max 2.640443828398648 driven_lanedir_consec_mean 2.640443828398648 driven_lanedir_consec_min 2.640443828398648 driven_lanedir_max 2.91274098398012 driven_lanedir_mean 2.91274098398012 driven_lanedir_median 2.91274098398012 driven_lanedir_min 2.91274098398012 in-drivable-lane_max 4.100000000000058 in-drivable-lane_mean 4.100000000000058 in-drivable-lane_min 4.100000000000058 per-episodes details {"udem-000-ego0": {"driven_any": 3.711939107885216, "survival_time": 29.05000000000028, "driven_lanedir": 2.91274098398012, "in-drivable-lane": 4.100000000000058, "deviation-heading": 7.060164521184852, "distance-from-start": 1.2030818863496164, "deviation-center-line": 1.8434456060123188, "driven_lanedir_consec": 2.640443828398648}}simulation-passed 1 survival_time_max 29.05000000000028 survival_time_mean 29.05000000000028 survival_time_min 29.05000000000028
No reset possible 11907
772
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-18 20:23:50+00:00 2022-11-18 20:26:23+00:00 0:02:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11904
773
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-18 20:21:38+00:00 2022-11-18 20:23:42+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.649999999999995 in-drivable-lane_median 1.799999999999994 driven_lanedir_consec_median 0.14144208330901795 deviation-center-line_median 0.11707960630312866
other stats deviation-center-line_max 0.11707960630312866 deviation-center-line_mean 0.11707960630312866 deviation-center-line_min 0.11707960630312866 deviation-heading_max 1.2271158946601406 deviation-heading_mean 1.2271158946601406 deviation-heading_median 1.2271158946601406 deviation-heading_min 1.2271158946601406 distance-from-start_max 0.3309181805591834 distance-from-start_mean 0.3309181805591834 distance-from-start_median 0.3309181805591834 distance-from-start_min 0.3309181805591834 driven_any_max 0.3332556544015409 driven_any_mean 0.3332556544015409 driven_any_median 0.3332556544015409 driven_any_min 0.3332556544015409 driven_lanedir_consec_max 0.14144208330901795 driven_lanedir_consec_mean 0.14144208330901795 driven_lanedir_consec_min 0.14144208330901795 driven_lanedir_max 0.14144208330901795 driven_lanedir_mean 0.14144208330901795 driven_lanedir_median 0.14144208330901795 driven_lanedir_min 0.14144208330901795 in-drivable-lane_max 1.799999999999994 in-drivable-lane_mean 1.799999999999994 in-drivable-lane_min 1.799999999999994 per-episodes details {"udem1-000-ego0": {"driven_any": 0.3332556544015409, "survival_time": 3.649999999999995, "driven_lanedir": 0.14144208330901795, "in-drivable-lane": 1.799999999999994, "deviation-heading": 1.2271158946601406, "distance-from-start": 0.3309181805591834, "deviation-center-line": 0.11707960630312866, "driven_lanedir_consec": 0.14144208330901795}}simulation-passed 1 survival_time_max 3.649999999999995 survival_time_mean 3.649999999999995 survival_time_min 3.649999999999995
No reset possible 11896
776
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-18 20:10:13+00:00 2022-11-18 20:21:13+00:00 0:11:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.85000000000027 in-drivable-lane_median 0.6500000000000092 driven_lanedir_consec_median 1.900346624487867 deviation-center-line_median 1.4714189275729024
other stats deviation-center-line_max 2.1246073505610146 deviation-center-line_mean 1.5316845675985773 deviation-center-line_min 1.0592930646874903 deviation-heading_max 20.70805549206232 deviation-heading_mean 9.238283814562967 deviation-heading_median 5.6081502898920474 deviation-heading_min 5.028779186405451 distance-from-start_max 1.9966754190793508 distance-from-start_mean 1.3208905218157376 distance-from-start_median 1.6434433340918 distance-from-start_min 2.482534153247273e-16 driven_any_max 4.216699653992478 driven_any_mean 2.5783401373582695 driven_any_median 3.048330447720218 driven_any_min 1.6310249386834502e-13 driven_lanedir_consec_max 2.582673055971285 driven_lanedir_consec_mean 1.5958415762367548 driven_lanedir_consec_min 0.0 driven_lanedir_max 3.9798650370399535 driven_lanedir_mean 2.3978173297731913 driven_lanedir_median 2.805702141026406 driven_lanedir_min 0.0 in-drivable-lane_max 1.3000000000000052 in-drivable-lane_mean 0.6500000000000059 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 4.216699653992478, "survival_time": 32.85000000000027, "driven_lanedir": 3.9798650370399535, "in-drivable-lane": 0.70000000000001, "deviation-heading": 5.644788168566032, "distance-from-start": 1.890897314747652, "deviation-center-line": 1.4303895702962943, "driven_lanedir_consec": 2.0751875091161054}, "loop-000-ego1": {"driven_any": 4.216663005368858, "survival_time": 32.85000000000027, "driven_lanedir": 3.885898542193183, "in-drivable-lane": 1.3000000000000052, "deviation-heading": 5.5715124112180625, "distance-from-start": 1.9966754190793508, "deviation-center-line": 2.1246073505610146, "driven_lanedir_consec": 2.582673055971285}, "loop-000-ego2": {"driven_any": 1.879997890071578, "survival_time": 32.85000000000027, "driven_lanedir": 1.7255057398596283, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 5.028779186405451, "distance-from-start": 1.3959893534359478, "deviation-center-line": 1.0592930646874903, "driven_lanedir_consec": 1.7255057398596283}, "loop-000-ego3": {"driven_any": 1.6310249386834502e-13, "survival_time": 32.85000000000027, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 20.70805549206232, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 1.51244828484951, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 32.85000000000027 survival_time_mean 32.85000000000027 survival_time_min 32.85000000000027
No reset possible 11886
777
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-18 20:03:46+00:00 2022-11-18 20:07:35+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 37.40000000000001 in-drivable-lane_median 19.600000000000268 driven_lanedir_consec_median 2.113512009135901 deviation-center-line_median 1.537159986874285
other stats deviation-center-line_max 1.537159986874285 deviation-center-line_mean 1.537159986874285 deviation-center-line_min 1.537159986874285 deviation-heading_max 4.256948373614456 deviation-heading_mean 4.256948373614456 deviation-heading_median 4.256948373614456 deviation-heading_min 4.256948373614456 distance-from-start_max 1.3533026458066972 distance-from-start_mean 1.3533026458066972 distance-from-start_median 1.3533026458066972 distance-from-start_min 1.3533026458066972 driven_any_max 4.814206373991258 driven_any_mean 4.814206373991258 driven_any_median 4.814206373991258 driven_any_min 4.814206373991258 driven_lanedir_consec_max 2.113512009135901 driven_lanedir_consec_mean 2.113512009135901 driven_lanedir_consec_min 2.113512009135901 driven_lanedir_max 2.113512009135901 driven_lanedir_mean 2.113512009135901 driven_lanedir_median 2.113512009135901 driven_lanedir_min 2.113512009135901 in-drivable-lane_max 19.600000000000268 in-drivable-lane_mean 19.600000000000268 in-drivable-lane_min 19.600000000000268 per-episodes details {"loop2-000-ego0": {"driven_any": 4.814206373991258, "survival_time": 37.40000000000001, "driven_lanedir": 2.113512009135901, "in-drivable-lane": 19.600000000000268, "deviation-heading": 4.256948373614456, "distance-from-start": 1.3533026458066972, "deviation-center-line": 1.537159986874285, "driven_lanedir_consec": 2.113512009135901}}simulation-passed 1 survival_time_max 37.40000000000001 survival_time_mean 37.40000000000001 survival_time_min 37.40000000000001
No reset possible 11871
778
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-18 19:50:35+00:00 2022-11-18 20:03:36+00:00 0:13:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 14.849999999999364 driven_lanedir_consec_median 5.367588178238168 deviation-center-line_median 2.700131877979071
other stats deviation-center-line_max 2.700131877979071 deviation-center-line_mean 2.700131877979071 deviation-center-line_min 2.700131877979071 deviation-heading_max 9.957963675539286 deviation-heading_mean 9.957963675539286 deviation-heading_median 9.957963675539286 deviation-heading_min 9.957963675539286 distance-from-start_max 2.1781654191413096 distance-from-start_mean 2.1781654191413096 distance-from-start_median 2.1781654191413096 distance-from-start_min 2.1781654191413096 driven_any_max 7.913610621837853 driven_any_mean 7.913610621837853 driven_any_median 7.913610621837853 driven_any_min 7.913610621837853 driven_lanedir_consec_max 5.367588178238168 driven_lanedir_consec_mean 5.367588178238168 driven_lanedir_consec_min 5.367588178238168 driven_lanedir_max 5.573012110479916 driven_lanedir_mean 5.573012110479916 driven_lanedir_median 5.573012110479916 driven_lanedir_min 5.573012110479916 in-drivable-lane_max 14.849999999999364 in-drivable-lane_mean 14.849999999999364 in-drivable-lane_min 14.849999999999364 per-episodes details {"loop-000-ego0": {"driven_any": 7.913610621837853, "survival_time": 59.99999999999873, "driven_lanedir": 5.573012110479916, "in-drivable-lane": 14.849999999999364, "deviation-heading": 9.957963675539286, "distance-from-start": 2.1781654191413096, "deviation-center-line": 2.700131877979071, "driven_lanedir_consec": 5.367588178238168}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11807
780
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 23:01:13+00:00 2022-11-17 23:04:15+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.75000000000006 in-drivable-lane_median 1.3000000000000114 driven_lanedir_consec_median 0.6534657259697335 deviation-center-line_median 0.9670228995511668
other stats deviation-center-line_max 0.9670228995511668 deviation-center-line_mean 0.9670228995511668 deviation-center-line_min 0.9670228995511668 deviation-heading_max 4.657395732209788 deviation-heading_mean 4.657395732209788 deviation-heading_median 4.657395732209788 deviation-heading_min 4.657395732209788 distance-from-start_max 0.6939600904514129 distance-from-start_mean 0.6939600904514129 distance-from-start_median 0.6939600904514129 distance-from-start_min 0.6939600904514129 driven_any_max 1.6741593292491432 driven_any_mean 1.6741593292491432 driven_any_median 1.6741593292491432 driven_any_min 1.6741593292491432 driven_lanedir_consec_max 0.6534657259697335 driven_lanedir_consec_mean 0.6534657259697335 driven_lanedir_consec_min 0.6534657259697335 driven_lanedir_max 1.3410615942480562 driven_lanedir_mean 1.3410615942480562 driven_lanedir_median 1.3410615942480562 driven_lanedir_min 1.3410615942480562 in-drivable-lane_max 1.3000000000000114 in-drivable-lane_mean 1.3000000000000114 in-drivable-lane_min 1.3000000000000114 per-episodes details {"4way-000-ego0": {"driven_any": 1.6741593292491432, "survival_time": 13.75000000000006, "driven_lanedir": 1.3410615942480562, "in-drivable-lane": 1.3000000000000114, "deviation-heading": 4.657395732209788, "distance-from-start": 0.6939600904514129, "deviation-center-line": 0.9670228995511668, "driven_lanedir_consec": 0.6534657259697335}}simulation-passed 1 survival_time_max 13.75000000000006 survival_time_mean 13.75000000000006 survival_time_min 13.75000000000006
No reset possible 11802
781
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 22:54:46+00:00 2022-11-17 23:00:57+00:00 0:06:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.425480434937056 survival_time_median 59.99999999999873 deviation-center-line_median 5.05218684743684 in-drivable-lane_median 5.599999999999941
other stats deviation-center-line_max 5.05218684743684 deviation-center-line_mean 5.05218684743684 deviation-center-line_min 5.05218684743684 deviation-heading_max 10.287363792487852 deviation-heading_mean 10.287363792487852 deviation-heading_median 10.287363792487852 deviation-heading_min 10.287363792487852 distance-from-start_max 3.875125942479051 distance-from-start_mean 3.875125942479051 distance-from-start_median 3.875125942479051 distance-from-start_min 3.875125942479051 driven_any_max 7.907858336865512 driven_any_mean 7.907858336865512 driven_any_median 7.907858336865512 driven_any_min 7.907858336865512 driven_lanedir_consec_max 4.425480434937056 driven_lanedir_consec_mean 4.425480434937056 driven_lanedir_consec_min 4.425480434937056 driven_lanedir_max 6.843012986627834 driven_lanedir_mean 6.843012986627834 driven_lanedir_median 6.843012986627834 driven_lanedir_min 6.843012986627834 in-drivable-lane_max 5.599999999999941 in-drivable-lane_mean 5.599999999999941 in-drivable-lane_min 5.599999999999941 per-episodes details {"autolab-000-ego0": {"driven_any": 7.907858336865512, "survival_time": 59.99999999999873, "driven_lanedir": 6.843012986627834, "in-drivable-lane": 5.599999999999941, "deviation-heading": 10.287363792487852, "distance-from-start": 3.875125942479051, "deviation-center-line": 5.05218684743684, "driven_lanedir_consec": 4.425480434937056}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11794
795
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95 aido-hello-sim-validation
sanity-check success no davinci-stage-03-6.2.46
2022-11-17 22:51:44+00:00 2022-11-17 22:54:32+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0295935315984861 deviation-center-line_median 0.005726611696360948
other stats deviation-center-line_max 0.005726611696360948 deviation-center-line_mean 0.005726611696360948 deviation-center-line_min 0.005726611696360948 deviation-heading_max 0.296212269348275 deviation-heading_mean 0.296212269348275 deviation-heading_median 0.296212269348275 deviation-heading_min 0.296212269348275 distance-from-start_max 0.037562621749778737 distance-from-start_mean 0.037562621749778737 distance-from-start_median 0.037562621749778737 distance-from-start_min 0.037562621749778737 driven_any_max 0.03764710026290609 driven_any_mean 0.03764710026290609 driven_any_median 0.03764710026290609 driven_any_min 0.03764710026290609 driven_lanedir_consec_max 0.0295935315984861 driven_lanedir_consec_mean 0.0295935315984861 driven_lanedir_consec_min 0.0295935315984861 driven_lanedir_max 0.0295935315984861 driven_lanedir_mean 0.0295935315984861 driven_lanedir_median 0.0295935315984861 driven_lanedir_min 0.0295935315984861 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03764710026290609, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0295935315984861, "in-drivable-lane": 0.0, "deviation-heading": 0.296212269348275, "distance-from-start": 0.037562621749778737, "deviation-center-line": 0.005726611696360948, "driven_lanedir_consec": 0.0295935315984861}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11788
800
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.46
2022-11-17 22:46:59+00:00 2022-11-17 22:51:38+00:00 0:04:39 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11784
801
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-3of4 failed no davinci-stage-03-6.2.46
2022-11-17 22:44:50+00:00 2022-11-17 22:46:52+00:00 0:02:02 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11768
808
Andrea Censi template-random aido-LFV-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-17 22:32:00+00:00 2022-11-17 22:43:28+00:00 0:11:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 11763
809
Andrea Censi template-random aido-LFV-sim-validation
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-17 22:28:30+00:00 2022-11-17 22:31:52+00:00 0:03:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.65000000000003 in-drivable-lane_median 4.950000000000033 driven_lanedir_consec_median 0.26764605432234867 deviation-center-line_median 0.6035442792313549
other stats deviation-center-line_max 0.6035442792313549 deviation-center-line_mean 0.6035442792313549 deviation-center-line_min 0.6035442792313549 deviation-heading_max 4.043215735457215 deviation-heading_mean 4.043215735457215 deviation-heading_median 4.043215735457215 deviation-heading_min 4.043215735457215 distance-from-start_max 0.5461575079396498 distance-from-start_mean 0.5461575079396498 distance-from-start_median 0.5461575079396498 distance-from-start_min 0.5461575079396498 driven_any_max 2.4684338587867174 driven_any_mean 2.4684338587867174 driven_any_median 2.4684338587867174 driven_any_min 2.4684338587867174 driven_lanedir_consec_max 0.26764605432234867 driven_lanedir_consec_mean 0.26764605432234867 driven_lanedir_consec_min 0.26764605432234867 driven_lanedir_max 0.262846269745866 driven_lanedir_mean 0.262846269745866 driven_lanedir_median 0.262846269745866 driven_lanedir_min 0.262846269745866 in-drivable-lane_max 4.950000000000033 in-drivable-lane_mean 4.950000000000033 in-drivable-lane_min 4.950000000000033 per-episodes details {"loop2-000-ego0": {"driven_any": 2.4684338587867174, "survival_time": 11.65000000000003, "driven_lanedir": 0.262846269745866, "in-drivable-lane": 4.950000000000033, "deviation-heading": 4.043215735457215, "distance-from-start": 0.5461575079396498, "deviation-center-line": 0.6035442792313549, "driven_lanedir_consec": 0.26764605432234867}}simulation-passed 1 survival_time_max 11.65000000000003 survival_time_mean 11.65000000000003 survival_time_min 11.65000000000003
No reset possible 11758
810
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-0of4 failed no davinci-stage-03-6.2.46
2022-11-17 22:27:17+00:00 2022-11-17 22:28:20+00:00 0:01:03 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11746
811
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-17 22:19:42+00:00 2022-11-17 22:26:58+00:00 0:07:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.000000000000277 in-drivable-lane_median 1.050000000000015 driven_lanedir_consec_median 3.4861709202002245 deviation-center-line_median 1.4899545530616234
other stats deviation-center-line_max 1.4899545530616234 deviation-center-line_mean 1.4899545530616234 deviation-center-line_min 1.4899545530616234 deviation-heading_max 3.7612886634177953 deviation-heading_mean 3.7612886634177953 deviation-heading_median 3.7612886634177953 deviation-heading_min 3.7612886634177953 distance-from-start_max 2.8014328887601883 distance-from-start_mean 2.8014328887601883 distance-from-start_median 2.8014328887601883 distance-from-start_min 2.8014328887601883 driven_any_max 3.705639236507224 driven_any_mean 3.705639236507224 driven_any_median 3.705639236507224 driven_any_min 3.705639236507224 driven_lanedir_consec_max 3.4861709202002245 driven_lanedir_consec_mean 3.4861709202002245 driven_lanedir_consec_min 3.4861709202002245 driven_lanedir_max 3.4861709202002245 driven_lanedir_mean 3.4861709202002245 driven_lanedir_median 3.4861709202002245 driven_lanedir_min 3.4861709202002245 in-drivable-lane_max 1.050000000000015 in-drivable-lane_mean 1.050000000000015 in-drivable-lane_min 1.050000000000015 per-episodes details {"loop-000-ego0": {"driven_any": 3.705639236507224, "survival_time": 29.000000000000277, "driven_lanedir": 3.4861709202002245, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.7612886634177953, "distance-from-start": 2.8014328887601883, "deviation-center-line": 1.4899545530616234, "driven_lanedir_consec": 3.4861709202002245}}simulation-passed 1 survival_time_max 29.000000000000277 survival_time_mean 29.000000000000277 survival_time_min 29.000000000000277
No reset possible 11725
812
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-17 22:01:05+00:00 2022-11-17 22:13:52+00:00 0:12:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949084199908675
other stats deviation-center-line_max 0.8949084199908675 deviation-center-line_mean 0.8949084199908675 deviation-center-line_min 0.8949084199908675 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.220446049250313e-16 distance-from-start_mean 2.220446049250313e-16 distance-from-start_median 2.220446049250313e-16 distance-from-start_min 2.220446049250313e-16 driven_any_max 2.6645352591003757e-13 driven_any_mean 2.6645352591003757e-13 driven_any_median 2.6645352591003757e-13 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11713
814
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-17 21:53:40+00:00 2022-11-17 22:00:38+00:00 0:06:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6017417553703126e-06 survival_time_median 59.99999999999873 deviation-center-line_median 0.8949077950231444 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8949077950231444 deviation-center-line_mean 0.8949077950231444 deviation-center-line_min 0.8949077950231444 deviation-heading_max 32.24912799874442 deviation-heading_mean 32.24912799874442 deviation-heading_median 32.24912799874442 deviation-heading_min 32.24912799874442 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 2.6017417553703126e-06 driven_lanedir_consec_mean 2.6017417553703126e-06 driven_lanedir_consec_min 2.6017417553703126e-06 driven_lanedir_max 2.6017417553703126e-06 driven_lanedir_mean 2.6017417553703126e-06 driven_lanedir_median 2.6017417553703126e-06 driven_lanedir_min 2.6017417553703126e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11707
814
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-17 21:47:23+00:00 2022-11-17 21:53:24+00:00 0:06:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6017417553703126e-06 survival_time_median 59.99999999999873 deviation-center-line_median 0.8949077950231444 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8949077950231444 deviation-center-line_mean 0.8949077950231444 deviation-center-line_min 0.8949077950231444 deviation-heading_max 32.24912799874442 deviation-heading_mean 32.24912799874442 deviation-heading_median 32.24912799874442 deviation-heading_min 32.24912799874442 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 2.6017417553703126e-06 driven_lanedir_consec_mean 2.6017417553703126e-06 driven_lanedir_consec_min 2.6017417553703126e-06 driven_lanedir_max 2.6017417553703126e-06 driven_lanedir_mean 2.6017417553703126e-06 driven_lanedir_median 2.6017417553703126e-06 driven_lanedir_min 2.6017417553703126e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11701
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 21:41:02+00:00 2022-11-17 21:47:00+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.161183222767684 deviation-center-line_median 0.16237308678117102
other stats deviation-center-line_max 0.16237308678117102 deviation-center-line_mean 0.16237308678117102 deviation-center-line_min 0.16237308678117102 deviation-heading_max 1.6697144680274827 deviation-heading_mean 1.6697144680274827 deviation-heading_median 1.6697144680274827 deviation-heading_min 1.6697144680274827 distance-from-start_max 2.3375328751443054 distance-from-start_mean 2.3375328751443054 distance-from-start_median 2.3375328751443054 distance-from-start_min 2.3375328751443054 driven_any_max 5.867610759158524 driven_any_mean 5.867610759158524 driven_any_median 5.867610759158524 driven_any_min 5.867610759158524 driven_lanedir_consec_max 5.161183222767684 driven_lanedir_consec_mean 5.161183222767684 driven_lanedir_consec_min 5.161183222767684 driven_lanedir_max 5.859601719805226 driven_lanedir_mean 5.859601719805226 driven_lanedir_median 5.859601719805226 driven_lanedir_min 5.859601719805226 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.867610759158524, "survival_time": 59.99999999999873, "driven_lanedir": 5.859601719805226, "in-drivable-lane": 0.0, "deviation-heading": 1.6697144680274827, "distance-from-start": 2.3375328751443054, "deviation-center-line": 0.16237308678117102, "driven_lanedir_consec": 5.161183222767684}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11694
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-17 21:32:33+00:00 2022-11-17 21:40:38+00:00 0:08:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.264594837893251 deviation-center-line_median 0.28403774670947396
other stats deviation-center-line_max 0.28403774670947396 deviation-center-line_mean 0.28403774670947396 deviation-center-line_min 0.28403774670947396 deviation-heading_max 2.5503075981833923 deviation-heading_mean 2.5503075981833923 deviation-heading_median 2.5503075981833923 deviation-heading_min 2.5503075981833923 distance-from-start_max 2.335178961035186 distance-from-start_mean 2.335178961035186 distance-from-start_median 2.335178961035186 distance-from-start_min 2.335178961035186 driven_any_max 5.798216571405931 driven_any_mean 5.798216571405931 driven_any_median 5.798216571405931 driven_any_min 5.798216571405931 driven_lanedir_consec_max 5.264594837893251 driven_lanedir_consec_mean 5.264594837893251 driven_lanedir_consec_min 5.264594837893251 driven_lanedir_max 5.785255183788413 driven_lanedir_mean 5.785255183788413 driven_lanedir_median 5.785255183788413 driven_lanedir_min 5.785255183788413 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 5.798216571405931, "survival_time": 59.99999999999873, "driven_lanedir": 5.785255183788413, "in-drivable-lane": 0.0, "deviation-heading": 2.5503075981833923, "distance-from-start": 2.335178961035186, "deviation-center-line": 0.28403774670947396, "driven_lanedir_consec": 5.264594837893251}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11689
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-17 21:21:23+00:00 2022-11-17 21:32:25+00:00 0:11:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949116056299468
other stats deviation-center-line_max 0.8949116056299468 deviation-center-line_mean 0.8949116056299468 deviation-center-line_min 0.8949116056299468 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11683
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
345 success yes davinci-stage-03-6.2.46
2022-11-17 21:10:27+00:00 2022-11-17 21:20:49+00:00 0:10:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.742328706004615 deviation-center-line_median 0.33945456663980716
other stats deviation-center-line_max 0.3908949944505377 deviation-center-line_mean 0.32135416680458384 deviation-center-line_min 0.2156125394881833 deviation-heading_max 3.7646465736418224 deviation-heading_mean 2.8850148728120875 deviation-heading_median 2.9961830476481808 deviation-heading_min 1.783046822310164 distance-from-start_max 3.522061458900184 distance-from-start_mean 2.7436402553448476 distance-from-start_median 2.7369885705970955 distance-from-start_min 1.978522421285015 driven_any_max 5.190284455707655 driven_any_mean 4.751674865015388 driven_any_median 4.75306747748424 driven_any_min 4.310280049385415 driven_lanedir_consec_max 5.178025139788938 driven_lanedir_consec_mean 4.740809849192896 driven_lanedir_consec_min 4.300556844973417 driven_lanedir_max 5.178025139788938 driven_lanedir_mean 4.740809849192896 driven_lanedir_median 4.742328706004615 driven_lanedir_min 4.300556844973417 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 4.310280049385415, "survival_time": 59.99999999999873, "driven_lanedir": 4.300556844973417, "in-drivable-lane": 0.0, "deviation-heading": 3.7646465736418224, "distance-from-start": 1.978522421285015, "deviation-center-line": 0.3085743240153483, "driven_lanedir_consec": 4.300556844973417}, "autolab-000-ego1": {"driven_any": 4.439412618608211, "survival_time": 59.99999999999873, "driven_lanedir": 4.428719111024556, "in-drivable-lane": 0.0, "deviation-heading": 1.783046822310164, "distance-from-start": 2.152738956720156, "deviation-center-line": 0.2156125394881833, "driven_lanedir_consec": 4.428719111024556}, "autolab-000-ego2": {"driven_any": 5.190284455707655, "survival_time": 59.99999999999873, "driven_lanedir": 5.178025139788938, "in-drivable-lane": 0.0, "deviation-heading": 3.020096037621849, "distance-from-start": 3.522061458900184, "deviation-center-line": 0.3908949944505377, "driven_lanedir_consec": 5.178025139788938}, "autolab-000-ego3": {"driven_any": 5.066722336360269, "survival_time": 59.99999999999873, "driven_lanedir": 5.055938300984675, "in-drivable-lane": 0.0, "deviation-heading": 2.972270057674513, "distance-from-start": 3.3212381844740353, "deviation-center-line": 0.3703348092642661, "driven_lanedir_consec": 5.055938300984675}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11682
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-17 21:08:30+00:00 2022-11-17 21:09:58+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.999999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.793469797561154 deviation-center-line_median 0.08003747569423085
other stats deviation-center-line_max 0.08003747569423085 deviation-center-line_mean 0.08003747569423085 deviation-center-line_min 0.08003747569423085 deviation-heading_max 0.913163834671925 deviation-heading_mean 0.913163834671925 deviation-heading_median 0.913163834671925 deviation-heading_min 0.913163834671925 distance-from-start_max 0.6744700135939992 distance-from-start_mean 0.6744700135939992 distance-from-start_median 0.6744700135939992 distance-from-start_min 0.6744700135939992 driven_any_max 0.8000331626182206 driven_any_mean 0.8000331626182206 driven_any_median 0.8000331626182206 driven_any_min 0.8000331626182206 driven_lanedir_consec_max 0.793469797561154 driven_lanedir_consec_mean 0.793469797561154 driven_lanedir_consec_min 0.793469797561154 driven_lanedir_max 0.793469797561154 driven_lanedir_mean 0.793469797561154 driven_lanedir_median 0.793469797561154 driven_lanedir_min 0.793469797561154 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 0.8000331626182206, "survival_time": 8.999999999999993, "driven_lanedir": 0.793469797561154, "in-drivable-lane": 0.0, "deviation-heading": 0.913163834671925, "distance-from-start": 0.6744700135939992, "deviation-center-line": 0.08003747569423085, "driven_lanedir_consec": 0.793469797561154}}simulation-passed 1 survival_time_max 8.999999999999993 survival_time_mean 8.999999999999993 survival_time_min 8.999999999999993
No reset possible 11668
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 20:55:08+00:00 2022-11-17 21:08:09+00:00 0:13:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.49634916578956 deviation-center-line_median 0.19094046425276645
other stats deviation-center-line_max 0.24986042415305248 deviation-center-line_mean 0.18985217391943776 deviation-center-line_min 0.1276673430191657 deviation-heading_max 1.717963512215023 deviation-heading_mean 1.4545462563339835 deviation-heading_median 1.4664624947252969 deviation-heading_min 1.1672965236703177 distance-from-start_max 3.468692663867372 distance-from-start_mean 3.0052111787863516 distance-from-start_median 3.0986320628962627 distance-from-start_min 2.354887925485507 driven_any_max 5.804604986504682 driven_any_mean 5.267122824628235 driven_any_median 5.648531176262696 driven_any_min 3.966823959482864 driven_lanedir_consec_max 5.799353840314662 driven_lanedir_consec_mean 5.187606175229343 driven_lanedir_consec_min 3.9583725290235874 driven_lanedir_max 5.799353840314662 driven_lanedir_mean 5.261671552684617 driven_lanedir_median 5.644479920700109 driven_lanedir_min 3.9583725290235874 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.53848260532673, "survival_time": 59.99999999999873, "driven_lanedir": 5.53379952227268, "in-drivable-lane": 0.0, "deviation-heading": 1.359126757476075, "distance-from-start": 2.354887925485507, "deviation-center-line": 0.18361566006061136, "driven_lanedir_consec": 5.533799451359386}, "udem-001-ego1": {"driven_any": 5.804604986504682, "survival_time": 59.99999999999873, "driven_lanedir": 5.799353840314662, "in-drivable-lane": 0.0, "deviation-heading": 1.717963512215023, "distance-from-start": 3.468692663867372, "deviation-center-line": 0.1982652684449215, "driven_lanedir_consec": 5.799353840314662}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 3.966823959482864, "survival_time": 59.99999999999873, "driven_lanedir": 3.9583725290235874, "in-drivable-lane": 0.0, "deviation-heading": 1.5737982319745187, "distance-from-start": 3.062983828933523, "deviation-center-line": 0.24986042415305248, "driven_lanedir_consec": 3.9583725290235874}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11663
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 20:42:48+00:00 2022-11-17 20:54:52+00:00 0:12:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.336853929439388 deviation-center-line_median 0.1833290916203121
other stats deviation-center-line_max 0.1833290916203121 deviation-center-line_mean 0.1833290916203121 deviation-center-line_min 0.1833290916203121 deviation-heading_max 1.3122340748484589 deviation-heading_mean 1.3122340748484589 deviation-heading_median 1.3122340748484589 deviation-heading_min 1.3122340748484589 distance-from-start_max 3.367405434986393 distance-from-start_mean 3.367405434986393 distance-from-start_median 3.367405434986393 distance-from-start_min 3.367405434986393 driven_any_max 5.634085005948749 driven_any_mean 5.634085005948749 driven_any_median 5.634085005948749 driven_any_min 5.634085005948749 driven_lanedir_consec_max 5.336853929439388 driven_lanedir_consec_mean 5.336853929439388 driven_lanedir_consec_min 5.336853929439388 driven_lanedir_max 5.629595525675495 driven_lanedir_mean 5.629595525675495 driven_lanedir_median 5.629595525675495 driven_lanedir_min 5.629595525675495 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.634085005948749, "survival_time": 59.99999999999873, "driven_lanedir": 5.629595525675495, "in-drivable-lane": 0.0, "deviation-heading": 1.3122340748484589, "distance-from-start": 3.367405434986393, "deviation-center-line": 0.1833290916203121, "driven_lanedir_consec": 5.336853929439388}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11657
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 20:29:42+00:00 2022-11-17 20:42:19+00:00 0:12:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949424300958599
other stats deviation-center-line_max 0.8949424300958599 deviation-center-line_mean 0.8949424300958599 deviation-center-line_min 0.8949424300958599 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 3.3306690738754696e-16 distance-from-start_mean 3.3306690738754696e-16 distance-from-start_median 3.3306690738754696e-16 distance-from-start_min 3.3306690738754696e-16 driven_any_max 3.9968028886505635e-13 driven_any_mean 3.9968028886505635e-13 driven_any_median 3.9968028886505635e-13 driven_any_min 3.9968028886505635e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11635
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 20:08:11+00:00 2022-11-17 20:20:48+00:00 0:12:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.2066560653618428 deviation-center-line_median 0.2023394713538787
other stats deviation-center-line_max 0.2023394713538787 deviation-center-line_mean 0.2023394713538787 deviation-center-line_min 0.2023394713538787 deviation-heading_max 1.3100325783735285 deviation-heading_mean 1.3100325783735285 deviation-heading_median 1.3100325783735285 deviation-heading_min 1.3100325783735285 distance-from-start_max 1.7432818598575894 distance-from-start_mean 1.7432818598575894 distance-from-start_median 1.7432818598575894 distance-from-start_min 1.7432818598575894 driven_any_max 2.2165794083935064 driven_any_mean 2.2165794083935064 driven_any_median 2.2165794083935064 driven_any_min 2.2165794083935064 driven_lanedir_consec_max 2.2066560653618428 driven_lanedir_consec_mean 2.2066560653618428 driven_lanedir_consec_min 2.2066560653618428 driven_lanedir_max 2.2066560653618428 driven_lanedir_mean 2.2066560653618428 driven_lanedir_median 2.2066560653618428 driven_lanedir_min 2.2066560653618428 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.2165794083935064, "survival_time": 59.99999999999873, "driven_lanedir": 2.2066560653618428, "in-drivable-lane": 0.0, "deviation-heading": 1.3100325783735285, "distance-from-start": 1.7432818598575894, "deviation-center-line": 0.2023394713538787, "driven_lanedir_consec": 2.2066560653618428}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11608
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-17 19:56:46+00:00 2022-11-17 20:02:15+00:00 0:05:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.29999999999939 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.5085282514804845 deviation-center-line_median 0.28904483256154256
other stats deviation-center-line_max 0.28904483256154256 deviation-center-line_mean 0.28904483256154256 deviation-center-line_min 0.28904483256154256 deviation-heading_max 2.685722516035787 deviation-heading_mean 2.685722516035787 deviation-heading_median 2.685722516035787 deviation-heading_min 2.685722516035787 distance-from-start_max 2.3176766365568287 distance-from-start_mean 2.3176766365568287 distance-from-start_median 2.3176766365568287 distance-from-start_min 2.3176766365568287 driven_any_max 4.5251448892157695 driven_any_mean 4.5251448892157695 driven_any_median 4.5251448892157695 driven_any_min 4.5251448892157695 driven_lanedir_consec_max 4.5085282514804845 driven_lanedir_consec_mean 4.5085282514804845 driven_lanedir_consec_min 4.5085282514804845 driven_lanedir_max 4.5085282514804845 driven_lanedir_mean 4.5085282514804845 driven_lanedir_median 4.5085282514804845 driven_lanedir_min 4.5085282514804845 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.5251448892157695, "survival_time": 48.29999999999939, "driven_lanedir": 4.5085282514804845, "in-drivable-lane": 0.0, "deviation-heading": 2.685722516035787, "distance-from-start": 2.3176766365568287, "deviation-center-line": 0.28904483256154256, "driven_lanedir_consec": 4.5085282514804845}}simulation-passed 1 survival_time_max 48.29999999999939 survival_time_mean 48.29999999999939 survival_time_min 48.29999999999939
No reset possible 11603
829
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-17 19:54:25+00:00 2022-11-17 19:56:24+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11595
829
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-17 19:51:31+00:00 2022-11-17 19:53:06+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11352
831
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-17 05:55:08+00:00 2022-11-17 06:06:45+00:00 0:11:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0499999999998835 driven_lanedir_consec_median 2.005370976726069 deviation-center-line_median 4.560679878295524
other stats deviation-center-line_max 4.560679878295524 deviation-center-line_mean 4.560679878295524 deviation-center-line_min 4.560679878295524 deviation-heading_max 5.286212973968547 deviation-heading_mean 5.286212973968547 deviation-heading_median 5.286212973968547 deviation-heading_min 5.286212973968547 distance-from-start_max 1.684158125324709 distance-from-start_mean 1.684158125324709 distance-from-start_median 1.684158125324709 distance-from-start_min 1.684158125324709 driven_any_max 3.5180872032668677 driven_any_mean 3.5180872032668677 driven_any_median 3.5180872032668677 driven_any_min 3.5180872032668677 driven_lanedir_consec_max 2.005370976726069 driven_lanedir_consec_mean 2.005370976726069 driven_lanedir_consec_min 2.005370976726069 driven_lanedir_max 3.3812461213263134 driven_lanedir_mean 3.3812461213263134 driven_lanedir_median 3.3812461213263134 driven_lanedir_min 3.3812461213263134 in-drivable-lane_max 2.0499999999998835 in-drivable-lane_mean 2.0499999999998835 in-drivable-lane_min 2.0499999999998835 per-episodes details {"loop-000-ego0": {"driven_any": 3.5180872032668677, "survival_time": 59.99999999999873, "driven_lanedir": 3.3812461213263134, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.286212973968547, "distance-from-start": 1.684158125324709, "deviation-center-line": 4.560679878295524, "driven_lanedir_consec": 2.005370976726069}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11347
832
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-17 02:00:19+00:00 2022-11-17 02:07:28+00:00 0:07:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.3044807262228515 deviation-center-line_median 3.302753458049452
other stats deviation-center-line_max 3.302753458049452 deviation-center-line_mean 3.302753458049452 deviation-center-line_min 3.302753458049452 deviation-heading_max 3.254644240772766 deviation-heading_mean 3.254644240772766 deviation-heading_median 3.254644240772766 deviation-heading_min 3.254644240772766 distance-from-start_max 2.0440638909568793 distance-from-start_mean 2.0440638909568793 distance-from-start_median 2.0440638909568793 distance-from-start_min 2.0440638909568793 driven_any_max 3.5795815550659253 driven_any_mean 3.5795815550659253 driven_any_median 3.5795815550659253 driven_any_min 3.5795815550659253 driven_lanedir_consec_max 3.3044807262228515 driven_lanedir_consec_mean 3.3044807262228515 driven_lanedir_consec_min 3.3044807262228515 driven_lanedir_max 3.561561505552355 driven_lanedir_mean 3.561561505552355 driven_lanedir_median 3.561561505552355 driven_lanedir_min 3.561561505552355 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795815550659253, "survival_time": 59.99999999999873, "driven_lanedir": 3.561561505552355, "in-drivable-lane": 0.0, "deviation-heading": 3.254644240772766, "distance-from-start": 2.0440638909568793, "deviation-center-line": 3.302753458049452, "driven_lanedir_consec": 3.3044807262228515}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11185
833
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-2of4 host-error no davinci-stage-03-6.2.46
2022-11-16 23:18:03+00:00 2022-11-16 23:30:36+00:00 0:12:33 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 291, in upload
aws_object.load()
File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
response = action(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
response = getattr(parent.meta.client, operation_name)(*args, **params)
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 934, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 891, in get_cr
uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 303, in upload
aws_object.upload_file(realfile, ExtraArgs={"ContentType": mime_type})
File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 318, in object_upload_file
return self.meta.client.upload_file(
File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 143, in upload_file
return transfer.upload_file(
File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 288, in upload_file
future.result()
File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
return self._coordinator.result()
File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
raise self._exception
File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 455, in send
urllib_response = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 398, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 239, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/usr/lib/python3.8/http/client.py", line 1256, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 94, in _send_request
rval = super()._send_request(
File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 130, in _send_output
self._handle_expect_response(message_body)
File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 176, in _handle_expect_response
self._send_message_body(message_body)
File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 209, in _send_message_body
self.send(message_body)
File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 218, in send
return super().send(str)
File "/usr/lib/python3.8/http/client.py", line 964, in send
datablock = data.read(self.blocksize)
File "/usr/local/lib/python3.8/dist-packages/s3transfer/utils.py", line 511, in read
data = self._fileobj.read(amount_to_read)
File "/usr/local/lib/python3.8/dist-packages/s3transfer/upload.py", line 90, in read
raise self._transfer_coordinator.exception
File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 139, in __call__
return self._execute_main(kwargs)
File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 162, in _execute_main
return_value = self._main(**kwargs)
File "/usr/local/lib/python3.8/dist-packages/s3transfer/upload.py", line 787, in _main
response = client.upload_part(
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 917, in _make_api_call
http, parsed_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 940, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
return self._send_request(request_dict, operation_model)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
while self._needs_retry(
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
responses = self._event_emitter.emit(
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
return self._emitter.emit(aliased_event_name, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
return self._emit(event_name, kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
response = handler(**kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
if self._checker(**checker_kwargs):
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
should_retry = self._should_retry(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
return self._checker(attempt_number, response, caught_exception)
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
checker_response = checker(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
return self._check_caught_exception(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
raise caught_exception
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
http_response = self._send(request)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
return self.http_session.send(request)
File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/staging/by-value/sha256/1e3e5cf704f318369bd25d723152d72de4046814ccf0f63e5c7d08616e79c4f7?uploadId=wRZChock19aeEV7ot1I3MAXZIzXSW.UPhy4vnxyc7B9R_mY2dm4aeROpLIXFya58PLOde3oCIIVDhNnLd7GZzWG40cPMDM1tpuYqYTrJ0qdxSGqrfnZ.qB4rd_uNsco8&partNumber=2"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11029
834
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 23:05:42+00:00 2022-11-16 23:17:53+00:00 0:12:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.3499999999999 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.5095534275439637 deviation-center-line_median 2.410297264878744
other stats deviation-center-line_max 3.4691291126896275 deviation-center-line_mean 2.301128090928157 deviation-center-line_min 0.9147887212655106 deviation-heading_max 5.655201626434426 deviation-heading_mean 4.27263380508129 deviation-heading_median 4.60755455297762 deviation-heading_min 2.2202244879354964 distance-from-start_max 1.2248575527849868 distance-from-start_mean 1.0826855214682096 distance-from-start_median 1.1264107889656856 distance-from-start_min 0.8530629551564805 driven_any_max 2.298586662486221 driven_any_mean 1.8875908572890625 driven_any_median 1.8260916837184984 driven_any_min 1.599593399233031 driven_lanedir_consec_max 2.065312159324093 driven_lanedir_consec_mean 1.4646616945190911 driven_lanedir_consec_min 0.7742277636643444 driven_lanedir_max 2.286060528087238 driven_lanedir_mean 1.8405617146533453 driven_lanedir_median 1.7564369644764024 driven_lanedir_min 1.5633124015733388 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 0.5000000000000071 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.298586662486221, "survival_time": 39.3499999999999, "driven_lanedir": 2.286060528087238, "in-drivable-lane": 0.0, "deviation-heading": 2.2202244879354964, "distance-from-start": 1.06505257754208, "deviation-center-line": 0.9147887212655106, "driven_lanedir_consec": 2.065312159324093}, "4way-000-ego1": {"driven_any": 1.5995955062116023, "survival_time": 39.3499999999999, "driven_lanedir": 1.5633124015733388, "in-drivable-lane": 0.0, "deviation-heading": 5.615416992272731, "distance-from-start": 1.187769000389291, "deviation-center-line": 2.829676513086962, "driven_lanedir_consec": 1.5626040844405409}, "4way-000-ego2": {"driven_any": 1.599593399233031, "survival_time": 39.3499999999999, "driven_lanedir": 1.592231390229673, "in-drivable-lane": 0.0, "deviation-heading": 3.599692113682508, "distance-from-start": 1.2248575527849868, "deviation-center-line": 1.9909180166705267, "driven_lanedir_consec": 1.4565027706473868}, "4way-000-ego3": {"driven_any": 2.0525878612253945, "survival_time": 39.3499999999999, "driven_lanedir": 1.920642538723132, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.655201626434426, "distance-from-start": 0.8530629551564805, "deviation-center-line": 3.4691291126896275, "driven_lanedir_consec": 0.7742277636643444}}simulation-passed 1 survival_time_max 39.3499999999999 survival_time_mean 39.3499999999999 survival_time_min 39.3499999999999
No reset possible 10940
835
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-16 22:59:50+00:00 2022-11-16 23:05:35+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.899999999999892 driven_lanedir_consec_median 3.4064017085173024 deviation-center-line_median 5.159547195134336
other stats deviation-center-line_max 5.159547195134336 deviation-center-line_mean 5.159547195134336 deviation-center-line_min 5.159547195134336 deviation-heading_max 7.059107453483629 deviation-heading_mean 7.059107453483629 deviation-heading_median 7.059107453483629 deviation-heading_min 7.059107453483629 distance-from-start_max 2.2176127614009804 distance-from-start_mean 2.2176127614009804 distance-from-start_median 2.2176127614009804 distance-from-start_min 2.2176127614009804 driven_any_max 3.532579606984127 driven_any_mean 3.532579606984127 driven_any_median 3.532579606984127 driven_any_min 3.532579606984127 driven_lanedir_consec_max 3.4064017085173024 driven_lanedir_consec_mean 3.4064017085173024 driven_lanedir_consec_min 3.4064017085173024 driven_lanedir_max 3.4064017085173024 driven_lanedir_mean 3.4064017085173024 driven_lanedir_median 3.4064017085173024 driven_lanedir_min 3.4064017085173024 in-drivable-lane_max 1.899999999999892 in-drivable-lane_mean 1.899999999999892 in-drivable-lane_min 1.899999999999892 per-episodes details {"autolab-000-ego0": {"driven_any": 3.532579606984127, "survival_time": 59.99999999999873, "driven_lanedir": 3.4064017085173024, "in-drivable-lane": 1.899999999999892, "deviation-heading": 7.059107453483629, "distance-from-start": 2.2176127614009804, "deviation-center-line": 5.159547195134336, "driven_lanedir_consec": 3.4064017085173024}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10840
837
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-16 22:53:52+00:00 2022-11-16 22:59:37+00:00 0:05:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 51.949999999999186 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 2.780669378492081 deviation-center-line_median 5.9832374225219125
other stats deviation-center-line_max 5.9832374225219125 deviation-center-line_mean 5.9832374225219125 deviation-center-line_min 5.9832374225219125 deviation-heading_max 5.351741767067895 deviation-heading_mean 5.351741767067895 deviation-heading_median 5.351741767067895 deviation-heading_min 5.351741767067895 distance-from-start_max 1.6305272648718805 distance-from-start_mean 1.6305272648718805 distance-from-start_median 1.6305272648718805 distance-from-start_min 1.6305272648718805 driven_any_max 2.951091089513758 driven_any_mean 2.951091089513758 driven_any_median 2.951091089513758 driven_any_min 2.951091089513758 driven_lanedir_consec_max 2.780669378492081 driven_lanedir_consec_mean 2.780669378492081 driven_lanedir_consec_min 2.780669378492081 driven_lanedir_max 2.780669378492081 driven_lanedir_mean 2.780669378492081 driven_lanedir_median 2.780669378492081 driven_lanedir_min 2.780669378492081 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"loop2-000-ego0": {"driven_any": 2.951091089513758, "survival_time": 51.949999999999186, "driven_lanedir": 2.780669378492081, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067895, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.9832374225219125, "driven_lanedir_consec": 2.780669378492081}}simulation-passed 1 survival_time_max 51.949999999999186 survival_time_mean 51.949999999999186 survival_time_min 51.949999999999186
No reset possible 10534
840
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-16 22:33:16+00:00 2022-11-16 22:53:40+00:00 0:20:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.92499999999992 driven_lanedir_consec_median 1.6962974393876302 deviation-center-line_median 5.6660077048179875
other stats deviation-center-line_max 9.920539816203728 deviation-center-line_mean 6.424810657621769 deviation-center-line_min 4.446687404647375 deviation-heading_max 10.760072335048156 deviation-heading_mean 7.75849277281716 deviation-heading_median 9.162709521693651 deviation-heading_min 1.9484797128331772 distance-from-start_max 2.9523651631034435 distance-from-start_mean 1.7043556043896877 distance-from-start_median 1.5711589276694409 distance-from-start_min 0.7227393991164262 driven_any_max 3.524085546529847 driven_any_mean 2.8239999291942457 driven_any_median 3.4851575826810635 driven_any_min 0.8015990048850082 driven_lanedir_consec_max 3.348811260212561 driven_lanedir_consec_mean 1.8837014899010265 driven_lanedir_consec_min 0.7933998206162842 driven_lanedir_max 3.351348627110138 driven_lanedir_mean 2.6742463059555184 driven_lanedir_median 3.276118388047826 driven_lanedir_min 0.7933998206162842 in-drivable-lane_max 4.299999999999898 in-drivable-lane_mean 2.0374999999999344 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.5197332868688487, "survival_time": 59.99999999999873, "driven_lanedir": 3.351348627110138, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 9.476018293244575, "distance-from-start": 2.0738235372013047, "deviation-center-line": 4.446687404647375, "driven_lanedir_consec": 2.179559038524113}, "zigzag-000-ego1": {"driven_any": 3.4505818784932787, "survival_time": 59.99999999999873, "driven_lanedir": 3.203425515883091, "in-drivable-lane": 4.299999999999898, "deviation-heading": 8.84940075014273, "distance-from-start": 1.068494318137577, "deviation-center-line": 5.899268750309402, "driven_lanedir_consec": 1.2130358402511474}, "zigzag-000-ego2": {"driven_any": 0.8015990048850082, "survival_time": 59.99999999999873, "driven_lanedir": 0.7933998206162842, "in-drivable-lane": 0.0, "deviation-heading": 1.9484797128331772, "distance-from-start": 0.7227393991164262, "deviation-center-line": 9.920539816203728, "driven_lanedir_consec": 0.7933998206162842}, "zigzag-000-ego3": {"driven_any": 3.524085546529847, "survival_time": 59.99999999999873, "driven_lanedir": 3.348811260212561, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 10.760072335048156, "distance-from-start": 2.9523651631034435, "deviation-center-line": 5.432746659326572, "driven_lanedir_consec": 3.348811260212561}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10297
840
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-16 22:12:44+00:00 2022-11-16 22:32:58+00:00 0:20:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.17499999999996 driven_lanedir_consec_median 1.885977987821864 deviation-center-line_median 5.3420440939969716
other stats deviation-center-line_max 7.275924926736645 deviation-center-line_mean 5.706188820851575 deviation-center-line_min 4.86474216867571 deviation-heading_max 24.381184135059772 deviation-heading_mean 11.29955148851905 deviation-heading_median 7.478334178737182 deviation-heading_min 5.860353461542065 distance-from-start_max 2.7566543136035913 distance-from-start_mean 1.9175184910035223 distance-from-start_median 1.732391267435746 distance-from-start_min 1.4486371155390068 driven_any_max 3.519592343713626 driven_any_mean 2.7625082847871507 driven_any_median 2.7621738784712173 driven_any_min 2.006093038492542 driven_lanedir_consec_max 3.3853872720615663 driven_lanedir_consec_mean 2.143156838888662 driven_lanedir_consec_min 1.4152841078493523 driven_lanedir_max 3.3853872720615663 driven_lanedir_mean 2.6342033343012377 driven_lanedir_median 2.6339394480283285 driven_lanedir_min 1.883547169086726 in-drivable-lane_max 2.400000000000034 in-drivable-lane_mean 2.18749999999996 in-drivable-lane_min 1.9999999999998863 per-episodes details {"autolab-000-ego0": {"driven_any": 2.016760537304334, "survival_time": 59.99999999999873, "driven_lanedir": 1.904099016664742, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 24.381184135059772, "distance-from-start": 1.967934233485134, "deviation-center-line": 5.25275935214242, "driven_lanedir_consec": 1.8884088065570024}, "autolab-000-ego1": {"driven_any": 3.519592343713626, "survival_time": 59.99999999999873, "driven_lanedir": 3.3853872720615663, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066767019151304, "distance-from-start": 2.7566543136035913, "deviation-center-line": 5.431328835851522, "driven_lanedir_consec": 3.3853872720615663}, "autolab-000-ego2": {"driven_any": 3.5075872196381, "survival_time": 59.99999999999873, "driven_lanedir": 3.363779879391915, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.860353461542065, "distance-from-start": 1.4486371155390068, "deviation-center-line": 4.86474216867571, "driven_lanedir_consec": 1.4152841078493523}, "autolab-000-ego3": {"driven_any": 2.006093038492542, "survival_time": 59.99999999999873, "driven_lanedir": 1.883547169086726, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 7.889901338323059, "distance-from-start": 1.496848301386358, "deviation-center-line": 7.275924926736645, "driven_lanedir_consec": 1.883547169086726}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10218
842
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 22:07:43+00:00 2022-11-16 22:12:37+00:00 0:04:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 1.690363772759563 deviation-center-line_median 5.303135750931098
other stats deviation-center-line_max 5.303135750931098 deviation-center-line_mean 5.303135750931098 deviation-center-line_min 5.303135750931098 deviation-heading_max 5.395040966687188 deviation-heading_mean 5.395040966687188 deviation-heading_median 5.395040966687188 deviation-heading_min 5.395040966687188 distance-from-start_max 1.3909655252105415 distance-from-start_mean 1.3909655252105415 distance-from-start_median 1.3909655252105415 distance-from-start_min 1.3909655252105415 driven_any_max 3.519587646027775 driven_any_mean 3.519587646027775 driven_any_median 3.519587646027775 driven_any_min 3.519587646027775 driven_lanedir_consec_max 1.690363772759563 driven_lanedir_consec_mean 1.690363772759563 driven_lanedir_consec_min 1.690363772759563 driven_lanedir_max 3.3875021949966126 driven_lanedir_mean 3.3875021949966126 driven_lanedir_median 3.3875021949966126 driven_lanedir_min 3.3875021949966126 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 3.519587646027775, "survival_time": 59.99999999999873, "driven_lanedir": 3.3875021949966126, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395040966687188, "distance-from-start": 1.3909655252105415, "deviation-center-line": 5.303135750931098, "driven_lanedir_consec": 1.690363772759563}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10143
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 22:03:09+00:00 2022-11-16 22:07:36+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613408548548 deviation-center-line_median 3.8033318362841073
other stats deviation-center-line_max 3.8033318362841073 deviation-center-line_mean 3.8033318362841073 deviation-center-line_min 3.8033318362841073 deviation-heading_max 4.074858735595133 deviation-heading_mean 4.074858735595133 deviation-heading_median 4.074858735595133 deviation-heading_min 4.074858735595133 distance-from-start_max 1.574553399562494 distance-from-start_mean 1.574553399562494 distance-from-start_median 1.574553399562494 distance-from-start_min 1.574553399562494 driven_any_max 2.9375948144939867 driven_any_mean 2.9375948144939867 driven_any_median 2.9375948144939867 driven_any_min 2.9375948144939867 driven_lanedir_consec_max 2.896613408548548 driven_lanedir_consec_mean 2.896613408548548 driven_lanedir_consec_min 2.896613408548548 driven_lanedir_max 2.916242176218421 driven_lanedir_mean 2.916242176218421 driven_lanedir_median 2.916242176218421 driven_lanedir_min 2.916242176218421 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 10026
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 21:55:34+00:00 2022-11-16 22:03:02+00:00 0:07:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613408548548 deviation-center-line_median 3.8033318362841073
other stats deviation-center-line_max 3.8033318362841073 deviation-center-line_mean 3.8033318362841073 deviation-center-line_min 3.8033318362841073 deviation-heading_max 4.074858735595133 deviation-heading_mean 4.074858735595133 deviation-heading_median 4.074858735595133 deviation-heading_min 4.074858735595133 distance-from-start_max 1.574553399562494 distance-from-start_mean 1.574553399562494 distance-from-start_median 1.574553399562494 distance-from-start_min 1.574553399562494 driven_any_max 2.9375948144939867 driven_any_mean 2.9375948144939867 driven_any_median 2.9375948144939867 driven_any_min 2.9375948144939867 driven_lanedir_consec_max 2.896613408548548 driven_lanedir_consec_mean 2.896613408548548 driven_lanedir_consec_min 2.896613408548548 driven_lanedir_max 2.916242176218421 driven_lanedir_mean 2.916242176218421 driven_lanedir_median 2.916242176218421 driven_lanedir_min 2.916242176218421 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 9871
845
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-16 21:44:55+00:00 2022-11-16 21:55:07+00:00 0:10:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 2.9739038922098167 deviation-center-line_median 3.987567696169286
other stats deviation-center-line_max 6.355354623012709 deviation-center-line_mean 4.250566789511449 deviation-center-line_min 2.6717771426945145 deviation-heading_max 6.378578140641868 deviation-heading_mean 3.8518643265041 deviation-heading_median 3.299904356349613 deviation-heading_min 2.429070452675305 distance-from-start_max 2.622846621458921 distance-from-start_mean 1.9359200828336065 distance-from-start_median 2.1273822766936967 distance-from-start_min 0.8660691564881121 driven_any_max 3.5795837364268106 driven_any_mean 3.0268033484998975 driven_any_median 3.137096506981778 driven_any_min 2.2534366436092235 driven_lanedir_consec_max 3.4836850218404303 driven_lanedir_consec_mean 2.566865745168916 driven_lanedir_consec_min 0.8359701744156 driven_lanedir_max 3.5606366264507763 driven_lanedir_mean 2.9552897573784933 driven_lanedir_median 3.077183665318938 driven_lanedir_min 2.1061550724253215 in-drivable-lane_max 2.400000000000034 in-drivable-lane_mean 1.1499999999999773 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.727596918833126, "survival_time": 59.99999999999873, "driven_lanedir": 2.6706823087974456, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.429070452675305, "distance-from-start": 2.2619366930709424, "deviation-center-line": 4.5111102127801965, "driven_lanedir_consec": 2.6706819709513203}, "4way-001-ego1": {"driven_any": 3.5795837364268106, "survival_time": 59.99999999999873, "driven_lanedir": 3.5606366264507763, "in-drivable-lane": 0.0, "deviation-heading": 3.343516239036243, "distance-from-start": 1.992827860316451, "deviation-center-line": 2.6717771426945145, "driven_lanedir_consec": 3.277125813468313}, "4way-001-ego2": {"driven_any": 3.5465960951304303, "survival_time": 59.99999999999873, "driven_lanedir": 3.4836850218404303, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.2562924736629832, "distance-from-start": 2.622846621458921, "deviation-center-line": 3.4640251795583756, "driven_lanedir_consec": 3.4836850218404303}, "4way-001-ego3": {"driven_any": 2.2534366436092235, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061550724253215, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140641868, "distance-from-start": 0.8660691564881121, "deviation-center-line": 6.355354623012709, "driven_lanedir_consec": 0.8359701744156}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9762
846
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-0of4 success no davinci-stage-03-6.2.46
2022-11-16 21:37:44+00:00 2022-11-16 21:44:46+00:00 0:07:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.30000000000031 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.72552778560125 deviation-center-line_median 2.855857091333994
other stats deviation-center-line_max 2.855857091333994 deviation-center-line_mean 2.855857091333994 deviation-center-line_min 2.855857091333994 deviation-heading_max 2.4300668794999867 deviation-heading_mean 2.4300668794999867 deviation-heading_median 2.4300668794999867 deviation-heading_min 2.4300668794999867 distance-from-start_max 1.366301151018967 distance-from-start_mean 1.366301151018967 distance-from-start_median 1.366301151018967 distance-from-start_min 1.366301151018967 driven_any_max 1.7825969147103222 driven_any_mean 1.7825969147103222 driven_any_median 1.7825969147103222 driven_any_min 1.7825969147103222 driven_lanedir_consec_max 1.72552778560125 driven_lanedir_consec_mean 1.72552778560125 driven_lanedir_consec_min 1.72552778560125 driven_lanedir_max 1.72552778560125 driven_lanedir_mean 1.72552778560125 driven_lanedir_median 1.72552778560125 driven_lanedir_min 1.72552778560125 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"udem-001-ego0": {"driven_any": 1.7825969147103222, "survival_time": 31.30000000000031, "driven_lanedir": 1.72552778560125, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.4300668794999867, "distance-from-start": 1.366301151018967, "deviation-center-line": 2.855857091333994, "driven_lanedir_consec": 1.72552778560125}}simulation-passed 1 survival_time_max 31.30000000000031 survival_time_mean 31.30000000000031 survival_time_min 31.30000000000031
No reset possible 9693
847
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
347 success yes davinci-stage-03-6.2.46
2022-11-16 21:33:25+00:00 2022-11-16 21:37:37+00:00 0:04:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.6749999999999297 driven_lanedir_consec_median 2.3321113195925243 deviation-center-line_median 6.13698068030466
other stats deviation-center-line_max 7.3703625029550865 deviation-center-line_mean 6.13698068030466 deviation-center-line_min 4.903598857654233 deviation-heading_max 7.744574522534287 deviation-heading_mean 7.106635261644851 deviation-heading_median 7.106635261644851 deviation-heading_min 6.468696000755416 distance-from-start_max 1.648096422950854 distance-from-start_mean 1.427048606043876 distance-from-start_median 1.427048606043876 distance-from-start_min 1.2060007891368982 driven_any_max 3.4850840176976017 driven_any_mean 3.4693367131671256 driven_any_median 3.4693367131671256 driven_any_min 3.45358940863665 driven_lanedir_consec_max 3.243830720825712 driven_lanedir_consec_mean 2.3321113195925243 driven_lanedir_consec_min 1.420391918359337 driven_lanedir_max 3.2905374079610175 driven_lanedir_mean 3.2671840643933647 driven_lanedir_median 3.2671840643933647 driven_lanedir_min 3.243830720825712 in-drivable-lane_max 4.199999999999893 in-drivable-lane_mean 3.6749999999999297 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4850840176976017, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905374079610175, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574522534287, "distance-from-start": 1.2060007891368982, "deviation-center-line": 4.903598857654233, "driven_lanedir_consec": 1.420391918359337}, "loop2-000-ego1": {"driven_any": 3.45358940863665, "survival_time": 59.99999999999873, "driven_lanedir": 3.243830720825712, "in-drivable-lane": 4.199999999999893, "deviation-heading": 6.468696000755416, "distance-from-start": 1.648096422950854, "deviation-center-line": 7.3703625029550865, "driven_lanedir_consec": 3.243830720825712}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9651
848
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 21:31:11+00:00 2022-11-16 21:32:58+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.399999999999984 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.43685686215374986 deviation-center-line_median 0.2706641555254041
other stats deviation-center-line_max 0.2706641555254041 deviation-center-line_mean 0.2706641555254041 deviation-center-line_min 0.2706641555254041 deviation-heading_max 0.7151185427551814 deviation-heading_mean 0.7151185427551814 deviation-heading_median 0.7151185427551814 deviation-heading_min 0.7151185427551814 distance-from-start_max 0.4379491769930655 distance-from-start_mean 0.4379491769930655 distance-from-start_median 0.4379491769930655 distance-from-start_min 0.4379491769930655 driven_any_max 0.44159927688867295 driven_any_mean 0.44159927688867295 driven_any_median 0.44159927688867295 driven_any_min 0.44159927688867295 driven_lanedir_consec_max 0.43685686215374986 driven_lanedir_consec_mean 0.43685686215374986 driven_lanedir_consec_min 0.43685686215374986 driven_lanedir_max 0.43685686215374986 driven_lanedir_mean 0.43685686215374986 driven_lanedir_median 0.43685686215374986 driven_lanedir_min 0.43685686215374986 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.44159927688867295, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215374986, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551814, "distance-from-start": 0.4379491769930655, "deviation-center-line": 0.2706641555254041, "driven_lanedir_consec": 0.43685686215374986}}simulation-passed 1 survival_time_max 8.399999999999984 survival_time_mean 8.399999999999984 survival_time_min 8.399999999999984
No reset possible 9582
849
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 21:26:55+00:00 2022-11-16 21:30:58+00:00 0:04:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.9999999999998863 driven_lanedir_consec_median 2.47341545852428 deviation-center-line_median 4.480730094043885
other stats deviation-center-line_max 4.480730094043885 deviation-center-line_mean 4.480730094043885 deviation-center-line_min 4.480730094043885 deviation-heading_max 5.3925062050984955 deviation-heading_mean 5.3925062050984955 deviation-heading_median 5.3925062050984955 deviation-heading_min 5.3925062050984955 distance-from-start_max 2.5607885841805484 distance-from-start_mean 2.5607885841805484 distance-from-start_median 2.5607885841805484 distance-from-start_min 2.5607885841805484 driven_any_max 3.5195876711082703 driven_any_mean 3.5195876711082703 driven_any_median 3.5195876711082703 driven_any_min 3.5195876711082703 driven_lanedir_consec_max 2.47341545852428 driven_lanedir_consec_mean 2.47341545852428 driven_lanedir_consec_min 2.47341545852428 driven_lanedir_max 3.387731097694833 driven_lanedir_mean 3.387731097694833 driven_lanedir_median 3.387731097694833 driven_lanedir_min 3.387731097694833 in-drivable-lane_max 1.9999999999998863 in-drivable-lane_mean 1.9999999999998863 in-drivable-lane_min 1.9999999999998863 per-episodes details {"loop-000-ego0": {"driven_any": 3.5195876711082703, "survival_time": 59.99999999999873, "driven_lanedir": 3.387731097694833, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.3925062050984955, "distance-from-start": 2.5607885841805484, "deviation-center-line": 4.480730094043885, "driven_lanedir_consec": 2.47341545852428}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9495
850
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-1of4 success no davinci-stage-03-6.2.46
2022-11-16 21:21:47+00:00 2022-11-16 21:26:49+00:00 0:05:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 1.6903612661909375 deviation-center-line_median 5.305267272014263
other stats deviation-center-line_max 5.305267272014263 deviation-center-line_mean 5.305267272014263 deviation-center-line_min 5.305267272014263 deviation-heading_max 5.395915526202696 deviation-heading_mean 5.395915526202696 deviation-heading_median 5.395915526202696 deviation-heading_min 5.395915526202696 distance-from-start_max 1.390965526049516 distance-from-start_mean 1.390965526049516 distance-from-start_median 1.390965526049516 distance-from-start_min 1.390965526049516 driven_any_max 3.5195876463770412 driven_any_mean 3.5195876463770412 driven_any_median 3.5195876463770412 driven_any_min 3.5195876463770412 driven_lanedir_consec_max 1.6903612661909375 driven_lanedir_consec_mean 1.6903612661909375 driven_lanedir_consec_min 1.6903612661909375 driven_lanedir_max 3.3875027877672172 driven_lanedir_mean 3.3875027877672172 driven_lanedir_median 3.3875027877672172 driven_lanedir_min 3.3875027877672172 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"udem1-000-ego0": {"driven_any": 3.5195876463770412, "survival_time": 59.99999999999873, "driven_lanedir": 3.3875027877672172, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395915526202696, "distance-from-start": 1.390965526049516, "deviation-center-line": 5.305267272014263, "driven_lanedir_consec": 1.6903612661909375}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9335
852
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-3of4 success no davinci-stage-03-6.2.46
2022-11-16 21:10:48+00:00 2022-11-16 21:21:41+00:00 0:10:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.499999999999858 driven_lanedir_consec_median 2.0183982038959174 deviation-center-line_median 5.116869283415678
other stats deviation-center-line_max 5.116869283415678 deviation-center-line_mean 5.116869283415678 deviation-center-line_min 5.116869283415678 deviation-heading_max 5.091155339747139 deviation-heading_mean 5.091155339747139 deviation-heading_median 5.091155339747139 deviation-heading_min 5.091155339747139 distance-from-start_max 1.6832286746350418 distance-from-start_mean 1.6832286746350418 distance-from-start_median 1.6832286746350418 distance-from-start_min 1.6832286746350418 driven_any_max 3.5045866946371738 driven_any_mean 3.5045866946371738 driven_any_median 3.5045866946371738 driven_any_min 3.5045866946371738 driven_lanedir_consec_max 2.0183982038959174 driven_lanedir_consec_mean 2.0183982038959174 driven_lanedir_consec_min 2.0183982038959174 driven_lanedir_max 3.36042557719213 driven_lanedir_mean 3.36042557719213 driven_lanedir_median 3.36042557719213 driven_lanedir_min 3.36042557719213 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 2.499999999999858 in-drivable-lane_min 2.499999999999858 per-episodes details {"4way-001-ego0": {"driven_any": 3.5045866946371738, "survival_time": 59.99999999999873, "driven_lanedir": 3.36042557719213, "in-drivable-lane": 2.499999999999858, "deviation-heading": 5.091155339747139, "distance-from-start": 1.6832286746350418, "deviation-center-line": 5.116869283415678, "driven_lanedir_consec": 2.0183982038959174}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9256
853
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-16 21:05:32+00:00 2022-11-16 21:10:23+00:00 0:04:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.9499999999998447 driven_lanedir_consec_median 3.263240026998127 deviation-center-line_median 6.92092898374527
other stats deviation-center-line_max 7.278875768698185 deviation-center-line_mean 6.92092898374527 deviation-center-line_min 6.562982198792354 deviation-heading_max 6.398456444977544 deviation-heading_mean 6.382402306354827 deviation-heading_median 6.382402306354827 deviation-heading_min 6.36634816773211 distance-from-start_max 1.6564545383599565 distance-from-start_mean 1.643956757921588 distance-from-start_median 1.643956757921588 distance-from-start_min 1.63145897748322 driven_any_max 3.4717176906196623 driven_any_mean 3.4611535550941017 driven_any_median 3.4611535550941017 driven_any_min 3.450589419568541 driven_lanedir_consec_max 3.2881993578511035 driven_lanedir_consec_mean 3.263240026998127 driven_lanedir_consec_min 3.2382806961451513 driven_lanedir_max 3.2881993578511035 driven_lanedir_mean 3.263240026998127 driven_lanedir_median 3.263240026998127 driven_lanedir_min 3.2382806961451513 in-drivable-lane_max 4.299999999999894 in-drivable-lane_mean 3.9499999999998447 in-drivable-lane_min 3.5999999999997954 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4717176906196623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2881993578511035, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.36634816773211, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.562982198792354, "driven_lanedir_consec": 3.2881993578511035}, "loop2-000-ego1": {"driven_any": 3.450589419568541, "survival_time": 59.99999999999873, "driven_lanedir": 3.2382806961451513, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.398456444977544, "distance-from-start": 1.6564545383599565, "deviation-center-line": 7.278875768698185, "driven_lanedir_consec": 3.2382806961451513}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9090
852
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-2of4 success no davinci-stage-03-6.2.46
2022-11-16 20:55:10+00:00 2022-11-16 21:05:17+00:00 0:10:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 2.1867953945808276 deviation-center-line_median 5.754559351108546
other stats deviation-center-line_max 5.754559351108546 deviation-center-line_mean 5.754559351108546 deviation-center-line_min 5.754559351108546 deviation-heading_max 6.230350248713809 deviation-heading_mean 6.230350248713809 deviation-heading_median 6.230350248713809 deviation-heading_min 6.230350248713809 distance-from-start_max 1.629792759855455 distance-from-start_mean 1.629792759855455 distance-from-start_median 1.629792759855455 distance-from-start_min 1.629792759855455 driven_any_max 3.4836910226898103 driven_any_mean 3.4836910226898103 driven_any_median 3.4836910226898103 driven_any_min 3.4836910226898103 driven_lanedir_consec_max 2.1867953945808276 driven_lanedir_consec_mean 2.1867953945808276 driven_lanedir_consec_min 2.1867953945808276 driven_lanedir_max 3.299171291146005 driven_lanedir_mean 3.299171291146005 driven_lanedir_median 3.299171291146005 driven_lanedir_min 3.299171291146005 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"4way-000-ego0": {"driven_any": 3.4836910226898103, "survival_time": 59.99999999999873, "driven_lanedir": 3.299171291146005, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.230350248713809, "distance-from-start": 1.629792759855455, "deviation-center-line": 5.754559351108546, "driven_lanedir_consec": 2.1867953945808276}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible