Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 16665
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-0of4 host-error yes davinci-stage-01-6.2.51
2022-11-28 17:05:33+00:00 2022-11-28 17:05:34+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16661
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-1of3 host-error yes davinci-stage-01-6.2.51
2022-11-28 17:05:12+00:00 2022-11-28 17:05:12+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16657
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 host-error yes davinci-stage-01-6.2.51
2022-11-28 17:04:57+00:00 2022-11-28 17:04:58+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16652
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-2of3 host-error yes davinci-stage-01-6.2.51
2022-11-28 17:04:23+00:00 2022-11-28 17:04:24+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16641
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 timeout yes davinci-stage-01-6.2.51
2022-11-28 03:04:56+00:00 - - - - No reset possible 16633
1704
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:47:44+00:00 2022-11-28 03:04:33+00:00 0:16:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.5250000000000004 driven_lanedir_consec_median 3.406408562624881 deviation-center-line_median 6.266768623971568
other stats deviation-center-line_max 7.117542782609248 deviation-center-line_mean 6.142154630645523 deviation-center-line_min 4.91753849202971 deviation-heading_max 7.697145560292741 deviation-heading_mean 6.307290167834601 deviation-heading_median 7.224037098686265 deviation-heading_min 3.0839409136731364 distance-from-start_max 2.99468876105913 distance-from-start_mean 2.7483388598984284 distance-from-start_median 2.8894993963916855 distance-from-start_min 2.2196678857512127 driven_any_max 3.579597577109405 driven_any_mean 3.5248411750169293 driven_any_median 3.5338399362754243 driven_any_min 3.4520872504074633 driven_lanedir_consec_max 3.561467582428756 driven_lanedir_consec_mean 3.3987951569791877 driven_lanedir_consec_min 3.220895920238234 driven_lanedir_max 3.561467582428756 driven_lanedir_mean 3.3987951569791877 driven_lanedir_median 3.406408562624881 driven_lanedir_min 3.220895920238234 in-drivable-lane_max 4.249999999999897 in-drivable-lane_mean 1.8249999999999744 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.579597577109405, "survival_time": 59.99999999999873, "driven_lanedir": 3.561467582428756, "in-drivable-lane": 0.0, "deviation-heading": 3.0839409136731364, "distance-from-start": 2.99468876105913, "deviation-center-line": 6.841254966965407, "driven_lanedir_consec": 3.561467582428756}, "loop-000-ego1": {"driven_any": 3.4520872504074633, "survival_time": 59.99999999999873, "driven_lanedir": 3.220895920238234, "in-drivable-lane": 4.249999999999897, "deviation-heading": 7.290457220494497, "distance-from-start": 2.2196678857512127, "deviation-center-line": 7.117542782609248, "driven_lanedir_consec": 3.220895920238234}, "loop-000-ego2": {"driven_any": 3.5465917398544935, "survival_time": 59.99999999999873, "driven_lanedir": 3.44715177737184, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.1576169768780336, "distance-from-start": 2.7896290117542013, "deviation-center-line": 4.91753849202971, "driven_lanedir_consec": 3.44715177737184}, "loop-000-ego3": {"driven_any": 3.521088132696355, "survival_time": 59.99999999999873, "driven_lanedir": 3.365665347877921, "in-drivable-lane": 1.949999999999985, "deviation-heading": 7.697145560292741, "distance-from-start": 2.98936978102917, "deviation-center-line": 5.692282280977729, "driven_lanedir_consec": 3.365665347877921}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16624
1705
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:30:58+00:00 2022-11-28 02:47:37+00:00 0:16:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.749999999999952 driven_lanedir_consec_median 3.3108429130678627 deviation-center-line_median 6.488612341525324
other stats deviation-center-line_max 7.194535652106716 deviation-center-line_mean 6.189132437353033 deviation-center-line_min 4.584769414254769 deviation-heading_max 5.1659907865965735 deviation-heading_mean 4.395400760189543 deviation-heading_median 4.246938088221968 deviation-heading_min 3.921736077717662 distance-from-start_max 2.702654291483946 distance-from-start_mean 2.5000234387240603 distance-from-start_median 2.696936207575508 distance-from-start_min 1.9035670482612792 driven_any_max 3.5795805678303996 driven_any_mean 3.511364143390294 driven_any_median 3.497093152571938 driven_any_min 3.4716897005868983 driven_lanedir_consec_max 3.392650989219845 driven_lanedir_consec_mean 3.3072216022018863 driven_lanedir_consec_min 3.2145495934519746 driven_lanedir_max 3.5546680924349143 driven_lanedir_mean 3.3922512713982065 driven_lanedir_median 3.361057245426797 driven_lanedir_min 3.2922225023043183 in-drivable-lane_max 3.5999999999999623 in-drivable-lane_mean 2.2749999999999666 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795805678303996, "survival_time": 59.99999999999873, "driven_lanedir": 3.5546680924349143, "in-drivable-lane": 0.0, "deviation-heading": 3.933442455386819, "distance-from-start": 1.9035670482612792, "deviation-center-line": 4.584769414254769, "driven_lanedir_consec": 3.2145495934519746}, "4way-000-ego1": {"driven_any": 3.4850923665530997, "survival_time": 59.99999999999873, "driven_lanedir": 3.329463323831407, "in-drivable-lane": 3.1499999999999595, "deviation-heading": 4.560433721057117, "distance-from-start": 2.702654291483946, "deviation-center-line": 7.194535652106716, "driven_lanedir_consec": 3.329463323831407}, "4way-000-ego2": {"driven_any": 3.509093938590777, "survival_time": 59.99999999999873, "driven_lanedir": 3.3926511670221866, "in-drivable-lane": 2.349999999999945, "deviation-heading": 3.921736077717662, "distance-from-start": 2.698831659135408, "deviation-center-line": 6.220267984933724, "driven_lanedir_consec": 3.392650989219845}, "4way-000-ego3": {"driven_any": 3.4716897005868983, "survival_time": 59.99999999999873, "driven_lanedir": 3.2922225023043183, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.1659907865965735, "distance-from-start": 2.695040756015608, "deviation-center-line": 6.756956698116925, "driven_lanedir_consec": 3.2922225023043183}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16619
1708
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:26:45+00:00 2022-11-28 02:30:32+00:00 0:03:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.265479618005762 deviation-center-line_median 7.114499866441937
other stats deviation-center-line_max 7.114499866441937 deviation-center-line_mean 7.114499866441937 deviation-center-line_min 7.114499866441937 deviation-heading_max 5.7026362693789 deviation-heading_mean 5.7026362693789 deviation-heading_median 5.7026362693789 deviation-heading_min 5.7026362693789 distance-from-start_max 1.6303676024148757 distance-from-start_mean 1.6303676024148757 distance-from-start_median 1.6303676024148757 distance-from-start_min 1.6303676024148757 driven_any_max 3.4663369172887455 driven_any_mean 3.4663369172887455 driven_any_median 3.4663369172887455 driven_any_min 3.4663369172887455 driven_lanedir_consec_max 3.265479618005762 driven_lanedir_consec_mean 3.265479618005762 driven_lanedir_consec_min 3.265479618005762 driven_lanedir_max 3.265479618005762 driven_lanedir_mean 3.265479618005762 driven_lanedir_median 3.265479618005762 driven_lanedir_min 3.265479618005762 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4663369172887455, "survival_time": 59.99999999999873, "driven_lanedir": 3.265479618005762, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.7026362693789, "distance-from-start": 1.6303676024148757, "deviation-center-line": 7.114499866441937, "driven_lanedir_consec": 3.265479618005762}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16611
1710
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:16:55+00:00 2022-11-28 02:26:32+00:00 0:09:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4156597876014327 deviation-center-line_median 5.989789523960853
other stats deviation-center-line_max 8.495537949245412 deviation-center-line_mean 5.971732905101129 deviation-center-line_min 3.411814623237397 deviation-heading_max 5.897113234379067 deviation-heading_mean 4.048666897035051 deviation-heading_median 3.883494575102228 deviation-heading_min 2.53056520355668 distance-from-start_max 2.619089336031859 distance-from-start_mean 2.081728511655291 distance-from-start_median 2.273437348983144 distance-from-start_min 1.1609500126230166 driven_any_max 3.5795929797204047 driven_any_mean 3.0144689618920215 driven_any_median 3.5518420920250877 driven_any_min 1.3745986837975066 driven_lanedir_consec_max 3.4641594614086646 driven_lanedir_consec_mean 2.914869629053038 driven_lanedir_consec_min 1.3639994796006216 driven_lanedir_max 3.558362293690531 driven_lanedir_mean 2.9724232090689076 driven_lanedir_median 3.483665531492239 driven_lanedir_min 1.3639994796006216 in-drivable-lane_max 1.8499999999998948 in-drivable-lane_mean 0.4624999999999737 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795929797204047, "survival_time": 59.99999999999873, "driven_lanedir": 3.5411070899715265, "in-drivable-lane": 0.0, "deviation-heading": 5.897113234379067, "distance-from-start": 2.263048461522456, "deviation-center-line": 5.473740300006772, "driven_lanedir_consec": 3.4641594614086646}, "4way-000-ego1": {"driven_any": 3.524094913434593, "survival_time": 59.99999999999873, "driven_lanedir": 3.4262239730129513, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.513531876713755, "distance-from-start": 2.619089336031859, "deviation-center-line": 6.505838747914936, "driven_lanedir_consec": 3.4262237769992145}, "4way-000-ego2": {"driven_any": 3.579589270615582, "survival_time": 59.99999999999873, "driven_lanedir": 3.558362293690531, "in-drivable-lane": 0.0, "deviation-heading": 4.2534572734907, "distance-from-start": 2.2838262364438315, "deviation-center-line": 3.411814623237397, "driven_lanedir_consec": 3.4050957982036514}, "4way-000-ego3": {"driven_any": 1.3745986837975066, "survival_time": 59.99999999999873, "driven_lanedir": 1.3639994796006216, "in-drivable-lane": 0.0, "deviation-heading": 2.53056520355668, "distance-from-start": 1.1609500126230166, "deviation-center-line": 8.495537949245412, "driven_lanedir_consec": 1.3639994796006216}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16606
1711
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:07:56+00:00 2022-11-28 02:16:26+00:00 0:08:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613408548548 deviation-center-line_median 3.8033318362841073
other stats deviation-center-line_max 3.8033318362841073 deviation-center-line_mean 3.8033318362841073 deviation-center-line_min 3.8033318362841073 deviation-heading_max 4.074858735595133 deviation-heading_mean 4.074858735595133 deviation-heading_median 4.074858735595133 deviation-heading_min 4.074858735595133 distance-from-start_max 1.574553399562494 distance-from-start_mean 1.574553399562494 distance-from-start_median 1.574553399562494 distance-from-start_min 1.574553399562494 driven_any_max 2.9375948144939867 driven_any_mean 2.9375948144939867 driven_any_median 2.9375948144939867 driven_any_min 2.9375948144939867 driven_lanedir_consec_max 2.896613408548548 driven_lanedir_consec_mean 2.896613408548548 driven_lanedir_consec_min 2.896613408548548 driven_lanedir_max 2.916242176218421 driven_lanedir_mean 2.916242176218421 driven_lanedir_median 2.916242176218421 driven_lanedir_min 2.916242176218421 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 16603
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-1of3 aborted yes davinci-stage-01-6.2.51
2022-11-28 02:06:24+00:00 2022-11-28 02:07:51+00:00 0:01:27 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f8da5428e20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f8da5428e20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16600
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-2of3 aborted yes davinci-stage-01-6.2.51
2022-11-28 02:04:42+00:00 2022-11-28 02:06:09+00:00 0:01:27 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7ff916591e20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7ff916591e20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16594
1714
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 02:00:07+00:00 2022-11-28 02:04:20+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.241204615389226 deviation-center-line_median 4.759684198968496
other stats deviation-center-line_max 4.759684198968496 deviation-center-line_mean 4.759684198968496 deviation-center-line_min 4.759684198968496 deviation-heading_max 9.18078892152259 deviation-heading_mean 9.18078892152259 deviation-heading_median 9.18078892152259 deviation-heading_min 9.18078892152259 distance-from-start_max 1.6296054226673595 distance-from-start_mean 1.6296054226673595 distance-from-start_median 1.6296054226673595 distance-from-start_min 1.6296054226673595 driven_any_max 3.519583547683476 driven_any_mean 3.519583547683476 driven_any_median 3.519583547683476 driven_any_min 3.519583547683476 driven_lanedir_consec_max 2.241204615389226 driven_lanedir_consec_mean 2.241204615389226 driven_lanedir_consec_min 2.241204615389226 driven_lanedir_max 3.353584317203001 driven_lanedir_mean 3.353584317203001 driven_lanedir_median 3.353584317203001 driven_lanedir_min 3.353584317203001 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16592
1715
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:57:16+00:00 2022-11-28 01:59:33+00:00 0:02:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16586
1716
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:47:43+00:00 2022-11-28 01:57:02+00:00 0:09:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0000000000000142 driven_lanedir_consec_median 1.857807625020336 deviation-center-line_median 5.28259065053435
other stats deviation-center-line_max 6.835139014020123 deviation-center-line_mean 5.43336239298157 deviation-center-line_min 4.333129256837456 deviation-heading_max 10.8119794492084 deviation-heading_mean 6.0042732735036015 deviation-heading_median 4.89679221006279 deviation-heading_min 3.4115292246804296 distance-from-start_max 2.2673905887925794 distance-from-start_mean 1.383447713974703 distance-from-start_median 1.2056823254161633 distance-from-start_min 0.8550356162739062 driven_any_max 3.5795879547671228 driven_any_mean 2.5262149201005553 driven_any_median 2.515341830463492 driven_any_min 1.494588064708115 driven_lanedir_consec_max 3.438860731479879 driven_lanedir_consec_mean 1.982872428209739 driven_lanedir_consec_min 0.7770137313184056 driven_lanedir_max 3.560278357516038 driven_lanedir_mean 2.4513049805698603 driven_lanedir_median 2.440455044725664 driven_lanedir_min 1.3640314753120752 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 1.0125000000000144 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 3.5795879547671228, "survival_time": 59.99999999999873, "driven_lanedir": 3.560278357516038, "in-drivable-lane": 0.0, "deviation-heading": 4.074339221369879, "distance-from-start": 2.2673905887925794, "deviation-center-line": 4.333129256837456, "driven_lanedir_consec": 3.438860731479879}, "4way-001-ego1": {"driven_any": 2.0840878521440405, "survival_time": 59.99999999999873, "driven_lanedir": 1.951170455689099, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.7192451987557, "distance-from-start": 0.8580872602580342, "deviation-center-line": 6.835139014020123, "driven_lanedir_consec": 0.7951700224687287}, "4way-001-ego2": {"driven_any": 1.494588064708115, "survival_time": 59.99999999999873, "driven_lanedir": 1.3640314753120752, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 10.8119794492084, "distance-from-start": 0.8550356162739062, "deviation-center-line": 5.503515330064552, "driven_lanedir_consec": 0.7770137313184056}, "4way-001-ego3": {"driven_any": 2.946595808782943, "survival_time": 59.99999999999873, "driven_lanedir": 2.929739633762229, "in-drivable-lane": 0.0, "deviation-heading": 3.4115292246804296, "distance-from-start": 1.5532773905742925, "deviation-center-line": 5.061665971004148, "driven_lanedir_consec": 2.9204452275719435}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16583
1717
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:43:04+00:00 2022-11-28 01:47:30+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.95000000000015 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.1174902161570546 deviation-center-line_median 1.2140705885565546
other stats deviation-center-line_max 1.2140705885565546 deviation-center-line_mean 1.2140705885565546 deviation-center-line_min 1.2140705885565546 deviation-heading_max 2.8854089656463153 deviation-heading_mean 2.8854089656463153 deviation-heading_median 2.8854089656463153 deviation-heading_min 2.8854089656463153 distance-from-start_max 1.0329580261748834 distance-from-start_mean 1.0329580261748834 distance-from-start_median 1.0329580261748834 distance-from-start_min 1.0329580261748834 driven_any_max 1.134597717566756 driven_any_mean 1.134597717566756 driven_any_median 1.134597717566756 driven_any_min 1.134597717566756 driven_lanedir_consec_max 1.1174902161570546 driven_lanedir_consec_mean 1.1174902161570546 driven_lanedir_consec_min 1.1174902161570546 driven_lanedir_max 1.1174902161570546 driven_lanedir_mean 1.1174902161570546 driven_lanedir_median 1.1174902161570546 driven_lanedir_min 1.1174902161570546 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.134597717566756, "survival_time": 19.95000000000015, "driven_lanedir": 1.1174902161570546, "in-drivable-lane": 0.0, "deviation-heading": 2.8854089656463153, "distance-from-start": 1.0329580261748834, "deviation-center-line": 1.2140705885565546, "driven_lanedir_consec": 1.1174902161570546}}simulation-passed 1 survival_time_max 19.95000000000015 survival_time_mean 19.95000000000015 survival_time_min 19.95000000000015
No reset possible 16579
1718
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:34:56+00:00 2022-11-28 01:42:56+00:00 0:08:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.1499999999999257 driven_lanedir_consec_median 3.3746337017701507 deviation-center-line_median 6.057454700328478
other stats deviation-center-line_max 6.384332084814334 deviation-center-line_mean 6.038904654854047 deviation-center-line_min 5.656377133944901 deviation-heading_max 7.471247478120028 deviation-heading_mean 6.581525379111778 deviation-heading_median 6.501228349070126 deviation-heading_min 5.8523973401868306 distance-from-start_max 2.955798853097406 distance-from-start_mean 2.2776980078429148 distance-from-start_median 2.4208015729281067 distance-from-start_min 1.313390032418041 driven_any_max 3.579593246505303 driven_any_mean 3.529302881163586 driven_any_median 3.515090515356918 driven_any_min 3.5074372474352056 driven_lanedir_consec_max 3.525823359544204 driven_lanedir_consec_mean 3.062863916917712 driven_lanedir_consec_min 1.9763649045863416 driven_lanedir_max 3.525823359544204 driven_lanedir_mean 3.4097663351344685 driven_lanedir_median 3.3746337017701507 driven_lanedir_min 3.3639745774533676 in-drivable-lane_max 2.400000000000034 in-drivable-lane_mean 1.6749999999999714 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.5195908422465023, "survival_time": 59.99999999999873, "driven_lanedir": 3.384110905730893, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.471247478120028, "distance-from-start": 2.2087786070849105, "deviation-center-line": 5.794137771901705, "driven_lanedir_consec": 3.384110905730893}, "autolab-000-ego2": {"driven_any": 3.5074372474352056, "survival_time": 59.99999999999873, "driven_lanedir": 3.3639745774533676, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8523973401868306, "distance-from-start": 1.313390032418041, "deviation-center-line": 6.320771628755251, "driven_lanedir_consec": 1.9763649045863416}, "autolab-000-ego3": {"driven_any": 3.5105901884673334, "survival_time": 59.99999999999873, "driven_lanedir": 3.365156497809408, "in-drivable-lane": 2.299999999999965, "deviation-heading": 6.180320457204967, "distance-from-start": 2.6328245387713025, "deviation-center-line": 6.384332084814334, "driven_lanedir_consec": 3.365156497809408}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16572
1720
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:25:42+00:00 2022-11-28 01:34:28+00:00 0:08:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.249999999999929 driven_lanedir_consec_median 3.4642921416450347 deviation-center-line_median 6.136200161902763
other stats deviation-center-line_max 6.136200161902763 deviation-center-line_mean 6.136200161902763 deviation-center-line_min 6.136200161902763 deviation-heading_max 4.680365944406787 deviation-heading_mean 4.680365944406787 deviation-heading_median 4.680365944406787 deviation-heading_min 4.680365944406787 distance-from-start_max 2.417373767628198 distance-from-start_mean 2.417373767628198 distance-from-start_median 2.417373767628198 distance-from-start_min 2.417373767628198 driven_any_max 3.542094542339661 driven_any_mean 3.542094542339661 driven_any_median 3.542094542339661 driven_any_min 3.542094542339661 driven_lanedir_consec_max 3.4642921416450347 driven_lanedir_consec_mean 3.4642921416450347 driven_lanedir_consec_min 3.4642921416450347 driven_lanedir_max 3.4642921416450347 driven_lanedir_mean 3.4642921416450347 driven_lanedir_median 3.4642921416450347 driven_lanedir_min 3.4642921416450347 in-drivable-lane_max 1.249999999999929 in-drivable-lane_mean 1.249999999999929 in-drivable-lane_min 1.249999999999929 per-episodes details {"loop-000-ego0": {"driven_any": 3.542094542339661, "survival_time": 59.99999999999873, "driven_lanedir": 3.4642921416450347, "in-drivable-lane": 1.249999999999929, "deviation-heading": 4.680365944406787, "distance-from-start": 2.417373767628198, "deviation-center-line": 6.136200161902763, "driven_lanedir_consec": 3.4642921416450347}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16566
1721
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:20:30+00:00 2022-11-28 01:25:21+00:00 0:04:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.275400628096487 deviation-center-line_median 5.720691806105115
other stats deviation-center-line_max 5.720691806105115 deviation-center-line_mean 5.720691806105115 deviation-center-line_min 5.720691806105115 deviation-heading_max 5.389911935102068 deviation-heading_mean 5.389911935102068 deviation-heading_median 5.389911935102068 deviation-heading_min 5.389911935102068 distance-from-start_max 1.706973798275489 distance-from-start_mean 1.706973798275489 distance-from-start_median 1.706973798275489 distance-from-start_min 1.706973798275489 driven_any_max 3.5195876689872945 driven_any_mean 3.5195876689872945 driven_any_median 3.5195876689872945 driven_any_min 3.5195876689872945 driven_lanedir_consec_max 2.275400628096487 driven_lanedir_consec_mean 2.275400628096487 driven_lanedir_consec_min 2.275400628096487 driven_lanedir_max 3.387708520229716 driven_lanedir_mean 3.387708520229716 driven_lanedir_median 3.387708520229716 driven_lanedir_min 3.387708520229716 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5195876689872945, "survival_time": 59.99999999999873, "driven_lanedir": 3.387708520229716, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.389911935102068, "distance-from-start": 1.706973798275489, "deviation-center-line": 5.720691806105115, "driven_lanedir_consec": 2.275400628096487}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16561
1723
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:17:49+00:00 2022-11-28 01:20:16+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.400000000000013 in-drivable-lane_median 7.100000000000017 driven_lanedir_consec_median 0.33123013524902545 deviation-center-line_median 0.26973522366843383
other stats deviation-center-line_max 0.26973522366843383 deviation-center-line_mean 0.26973522366843383 deviation-center-line_min 0.26973522366843383 deviation-heading_max 2.53835057480462 deviation-heading_mean 2.53835057480462 deviation-heading_median 2.53835057480462 deviation-heading_min 2.53835057480462 distance-from-start_max 1.5453191784191067 distance-from-start_mean 1.5453191784191067 distance-from-start_median 1.5453191784191067 distance-from-start_min 1.5453191784191067 driven_any_max 1.545427894810905 driven_any_mean 1.545427894810905 driven_any_median 1.545427894810905 driven_any_min 1.545427894810905 driven_lanedir_consec_max 0.33123013524902545 driven_lanedir_consec_mean 0.33123013524902545 driven_lanedir_consec_min 0.33123013524902545 driven_lanedir_max 0.33123013524902545 driven_lanedir_mean 0.33123013524902545 driven_lanedir_median 0.33123013524902545 driven_lanedir_min 0.33123013524902545 in-drivable-lane_max 7.100000000000017 in-drivable-lane_mean 7.100000000000017 in-drivable-lane_min 7.100000000000017 per-episodes details {"loop2-000-ego0": {"driven_any": 1.545427894810905, "survival_time": 10.400000000000013, "driven_lanedir": 0.33123013524902545, "in-drivable-lane": 7.100000000000017, "deviation-heading": 2.53835057480462, "distance-from-start": 1.5453191784191067, "deviation-center-line": 0.26973522366843383, "driven_lanedir_consec": 0.33123013524902545}}simulation-passed 1 survival_time_max 10.400000000000013 survival_time_mean 10.400000000000013 survival_time_min 10.400000000000013
No reset possible 16556
1724
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:15:49+00:00 2022-11-28 01:17:20+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16552
1725
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:14:03+00:00 2022-11-28 01:15:34+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16548
1726
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:11:48+00:00 2022-11-28 01:13:30+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1969462908187456 survival_time_median 10.450000000000014 deviation-center-line_median 0.12539072943048185 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.12539072943048185 deviation-center-line_mean 0.12539072943048185 deviation-center-line_min 0.12539072943048185 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 1.550823637656203 distance-from-start_mean 1.550823637656203 distance-from-start_median 1.550823637656203 distance-from-start_min 1.550823637656203 driven_any_max 1.5511368313112863 driven_any_mean 1.5511368313112863 driven_any_median 1.5511368313112863 driven_any_min 1.5511368313112863 driven_lanedir_consec_max 0.1969462908187456 driven_lanedir_consec_mean 0.1969462908187456 driven_lanedir_consec_min 0.1969462908187456 driven_lanedir_max 0.1969462908187456 driven_lanedir_mean 0.1969462908187456 driven_lanedir_median 0.1969462908187456 driven_lanedir_min 0.1969462908187456 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5511368313112863, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969462908187456, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.550823637656203, "deviation-center-line": 0.12539072943048185, "driven_lanedir_consec": 0.1969462908187456}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 16545
1727
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:10:07+00:00 2022-11-28 01:11:33+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16540
1728
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:06:17+00:00 2022-11-28 01:09:40+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.299999999999983 in-drivable-lane_median 6.624999999999982 driven_lanedir_consec_median 0.19060094269967293 deviation-center-line_median 0.1216458457586781
other stats deviation-center-line_max 0.21751801628337733 deviation-center-line_mean 0.13818990472822829 deviation-center-line_min 0.0919499111121796 deviation-heading_max 1.097213756170657 deviation-heading_mean 0.8726834400339218 deviation-heading_median 0.8752529260804078 deviation-heading_min 0.6430141518042152 distance-from-start_max 1.1999739970209826 distance-from-start_mean 0.960682482291036 distance-from-start_median 0.9932177858395684 distance-from-start_min 0.6563203604640253 driven_any_max 1.2000364664329273 driven_any_mean 0.960724520660087 driven_any_median 0.9932647664055376 driven_any_min 0.6563320833963454 driven_lanedir_consec_max 0.5527361332180669 driven_lanedir_consec_mean 0.26843501239744166 driven_lanedir_consec_min 0.139802030972354 driven_lanedir_max 0.5527361332180669 driven_lanedir_mean 0.26843501239744166 driven_lanedir_median 0.19060094269967293 driven_lanedir_min 0.139802030972354 in-drivable-lane_max 6.849999999999983 in-drivable-lane_mean 6.137499999999984 in-drivable-lane_min 4.449999999999989 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6563320833963454, "survival_time": 8.299999999999983, "driven_lanedir": 0.139802030972354, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.9654177247981324, "distance-from-start": 0.6563203604640253, "deviation-center-line": 0.09390669229815438, "driven_lanedir_consec": 0.139802030972354}, "zigzag-000-ego1": {"driven_any": 0.9932647664055404, "survival_time": 8.299999999999983, "driven_lanedir": 0.5527361332180669, "in-drivable-lane": 4.449999999999989, "deviation-heading": 1.097213756170657, "distance-from-start": 0.9932177858395674, "deviation-center-line": 0.21751801628337733, "driven_lanedir_consec": 0.5527361332180669}, "zigzag-000-ego2": {"driven_any": 0.9932647664055346, "survival_time": 8.299999999999983, "driven_lanedir": 0.2351170339597527, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.6430141518042152, "distance-from-start": 0.9932177858395694, "deviation-center-line": 0.1493849992192018, "driven_lanedir_consec": 0.2351170339597527}, "zigzag-000-ego3": {"driven_any": 1.2000364664329273, "survival_time": 8.299999999999983, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}simulation-passed 1 survival_time_max 8.299999999999983 survival_time_mean 8.299999999999983 survival_time_min 8.299999999999983
No reset possible 16537
1729
Bea Baselines 🐤minimal-agent aido-LFP-sim-validation
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 01:04:23+00:00 2022-11-28 01:06:10+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.850000000000003 in-drivable-lane_median 8.100000000000005 driven_lanedir_consec_median 0.19955231542410212 deviation-center-line_median 0.12567533372192938
other stats deviation-center-line_max 0.12567533372192938 deviation-center-line_mean 0.12567533372192938 deviation-center-line_min 0.12567533372192938 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 1.4547842507789297 distance-from-start_mean 1.4547842507789297 distance-from-start_median 1.4547842507789297 distance-from-start_min 1.4547842507789297 driven_any_max 1.4548913237462744 driven_any_mean 1.4548913237462744 driven_any_median 1.4548913237462744 driven_any_min 1.4548913237462744 driven_lanedir_consec_max 0.19955231542410212 driven_lanedir_consec_mean 0.19955231542410212 driven_lanedir_consec_min 0.19955231542410212 driven_lanedir_max 0.19955231542410212 driven_lanedir_mean 0.19955231542410212 driven_lanedir_median 0.19955231542410212 driven_lanedir_min 0.19955231542410212 in-drivable-lane_max 8.100000000000005 in-drivable-lane_mean 8.100000000000005 in-drivable-lane_min 8.100000000000005 per-episodes details {"loop-000-ego0": {"driven_any": 1.4548913237462744, "survival_time": 9.850000000000003, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 8.100000000000005, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.4547842507789297, "deviation-center-line": 0.12567533372192938, "driven_lanedir_consec": 0.19955231542410212}}simulation-passed 1 survival_time_max 9.850000000000003 survival_time_mean 9.850000000000003 survival_time_min 9.850000000000003
No reset possible 16532
1733
Bea Baselines 🐤minimal-agent lx22-state-estimation
sim success yes davinci-stage-01-6.2.51
2022-11-28 01:00:10+00:00 2022-11-28 01:04:04+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.602316779928666 survival_time_median 11.250000000000025 deviation-center-line_median 0.25844063605243855 in-drivable-lane_median 6.600000000000033
other stats deviation-center-line_max 0.46940419435631386 deviation-center-line_mean 0.31601951040293014 deviation-center-line_min 0.220213700800038 deviation-heading_max 2.138198727189773 deviation-heading_mean 1.3887557886235824 deviation-heading_median 1.3576715425669252 deviation-heading_min 0.6703970961140492 distance-from-start_max 2.9006007855190927 distance-from-start_mean 2.0801990954134797 distance-from-start_median 1.6889817408539205 distance-from-start_min 1.651014759867426 driven_any_max 2.9015373770561546 driven_any_mean 2.0805808076947017 driven_any_median 1.68908053965813 driven_any_min 1.65112450636982 driven_lanedir_consec_max 0.6591118533086625 driven_lanedir_consec_mean 0.5555566616524058 driven_lanedir_consec_min 0.40524135171988895 driven_lanedir_max 0.6591118533086625 driven_lanedir_mean 0.5555566616524058 driven_lanedir_median 0.602316779928666 driven_lanedir_min 0.40524135171988895 in-drivable-lane_max 15.750000000000131 in-drivable-lane_mean 9.550000000000065 in-drivable-lane_min 6.300000000000031 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 1.65112450636982, "survival_time": 11.050000000000022, "driven_lanedir": 0.6591118533086625, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3576715425669252, "distance-from-start": 1.651014759867426, "deviation-center-line": 0.220213700800038, "driven_lanedir_consec": 0.6591118533086625}, "LF-zig-zag-001-ego0": {"driven_any": 2.9015373770561546, "survival_time": 18.60000000000013, "driven_lanedir": 0.40524135171988895, "in-drivable-lane": 15.750000000000131, "deviation-heading": 0.6703970961140492, "distance-from-start": 2.9006007855190927, "deviation-center-line": 0.25844063605243855, "driven_lanedir_consec": 0.40524135171988895}, "LF-zig-zag-002-ego0": {"driven_any": 1.68908053965813, "survival_time": 11.250000000000025, "driven_lanedir": 0.602316779928666, "in-drivable-lane": 6.600000000000033, "deviation-heading": 2.138198727189773, "distance-from-start": 1.6889817408539205, "deviation-center-line": 0.46940419435631386, "driven_lanedir_consec": 0.602316779928666}}simulation-passed 1 survival_time_max 18.60000000000013 survival_time_mean 13.633333333333391 survival_time_min 11.050000000000022
No reset possible 16527
1734
Bea Baselines 🐤minimal-agent lx22-BV1
sim-2of5 success yes davinci-stage-01-6.2.51
2022-11-28 00:58:11+00:00 2022-11-28 00:59:36+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.3319611918663517
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.3319611918663517 distance-from-start_median 0.3319611918663517 distance-from-start_min 0.3319611918663517 driven_any_max 0.33196649000356754 driven_any_mean 0.33196649000356754 driven_any_median 0.33196649000356754 driven_any_min 0.33196649000356754 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.049999999999997 in-drivable-lane_mean 3.049999999999997 in-drivable-lane_median 3.049999999999997 in-drivable-lane_min 3.049999999999997 per-episodes details {"d40-ego0": {"driven_any": 0.33196649000356754, "survival_time": 3.049999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 3.049999999999997, "deviation-heading": 0.0, "distance-from-start": 0.3319611918663517, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 3.049999999999997 survival_time_median 3.049999999999997 survival_time_min 3.049999999999997
No reset possible 16522
1741
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:54:26+00:00 2022-11-28 00:57:37+00:00 0:03:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666265914899656 deviation-center-line_median 0.1078383533310603
other stats deviation-center-line_max 0.1078383533310603 deviation-center-line_mean 0.1078383533310603 deviation-center-line_min 0.1078383533310603 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 1.6182798682575184 distance-from-start_mean 1.6182798682575184 distance-from-start_median 1.6182798682575184 distance-from-start_min 1.6182798682575184 driven_any_max 1.618389277101389 driven_any_mean 1.618389277101389 driven_any_median 1.618389277101389 driven_any_min 1.618389277101389 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"loop-000-ego0": {"driven_any": 1.618389277101389, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 16517
1743
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:51:55+00:00 2022-11-28 00:54:04+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.850000000000003 in-drivable-lane_median 8.450000000000005 driven_lanedir_consec_median 0.13666265914899656 deviation-center-line_median 0.10783777071756002
other stats deviation-center-line_max 0.10783777071756002 deviation-center-line_mean 0.10783777071756002 deviation-center-line_min 0.10783777071756002 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.4547842507789357 distance-from-start_mean 1.4547842507789357 distance-from-start_median 1.4547842507789357 distance-from-start_min 1.4547842507789357 driven_any_max 1.454891323746283 driven_any_mean 1.454891323746283 driven_any_median 1.454891323746283 driven_any_min 1.454891323746283 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 8.450000000000005 in-drivable-lane_mean 8.450000000000005 in-drivable-lane_min 8.450000000000005 per-episodes details {"udem1-000-ego0": {"driven_any": 1.454891323746283, "survival_time": 9.850000000000003, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 8.450000000000005, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.4547842507789357, "deviation-center-line": 0.10783777071756002, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 9.850000000000003 survival_time_mean 9.850000000000003 survival_time_min 9.850000000000003
No reset possible 16507
1745
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:47:58+00:00 2022-11-28 00:51:41+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.050000000000022 in-drivable-lane_median 9.425000000000022 driven_lanedir_consec_median 0.18712269938788828 deviation-center-line_median 0.15973050554702342
other stats deviation-center-line_max 0.21472209870657577 deviation-center-line_mean 0.16050533162691244 deviation-center-line_min 0.10783821670702712 deviation-heading_max 1.3047652579244493 deviation-heading_mean 0.8970980849375731 deviation-heading_median 0.8549948818349844 deviation-heading_min 0.5736373181558745 distance-from-start_max 1.6510147598674252 distance-from-start_mean 0.6888645402096076 distance-from-start_median 0.439724395200456 distance-from-start_min 0.2249946105700932 driven_any_max 1.6511245063698194 driven_any_mean 0.6888969972348484 driven_any_median 0.43973285777181176 driven_any_min 0.2249977670259511 driven_lanedir_consec_max 0.6611934212369679 driven_lanedir_consec_mean 0.2874529754105062 driven_lanedir_consec_min 0.11437308162928028 driven_lanedir_max 0.6611934212369679 driven_lanedir_mean 0.2874529754105062 driven_lanedir_median 0.18712269938788828 driven_lanedir_min 0.11437308162928028 in-drivable-lane_max 9.850000000000025 in-drivable-lane_mean 8.750000000000025 in-drivable-lane_min 6.300000000000031 per-episodes details {"udem-000-ego0": {"driven_any": 0.5146585239873331, "survival_time": 11.050000000000022, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 9.650000000000022, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595168, "deviation-center-line": 0.10783821670702712, "driven_lanedir_consec": 0.13666480491620847}, "udem-000-ego1": {"driven_any": 0.3648071915562904, "survival_time": 11.050000000000022, "driven_lanedir": 0.2375805938595681, "in-drivable-lane": 9.20000000000002, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.3648008475413953, "deviation-center-line": 0.20320962418622543, "driven_lanedir_consec": 0.2375805938595681}, "udem-000-ego2": {"driven_any": 1.6511245063698194, "survival_time": 11.050000000000022, "driven_lanedir": 0.6611934212369679, "in-drivable-lane": 6.300000000000031, "deviation-heading": 1.3047652579244493, "distance-from-start": 1.6510147598674252, "deviation-center-line": 0.21472209870657577, "driven_lanedir_consec": 0.6611934212369679}, "udem-000-ego3": {"driven_any": 0.2249977670259511, "survival_time": 11.050000000000022, "driven_lanedir": 0.11437308162928028, "in-drivable-lane": 9.850000000000025, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.2249946105700932, "deviation-center-line": 0.1162513869078214, "driven_lanedir_consec": 0.11437308162928028}}simulation-passed 1 survival_time_max 11.050000000000022 survival_time_mean 11.050000000000022 survival_time_min 11.050000000000022
No reset possible 16502
1746
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:42:04+00:00 2022-11-28 00:47:45+00:00 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.200000000000166 in-drivable-lane_median 19.625000000000163 driven_lanedir_consec_median 0.17676532608959172 deviation-center-line_median 0.12055883486711412
other stats deviation-center-line_max 0.8045746318533537 deviation-center-line_mean 0.2853942640066456 deviation-center-line_min 0.09588475443900028 deviation-heading_max 5.2482884111975086 deviation-heading_mean 1.8371274357323064 deviation-heading_median 0.7612914460035247 deviation-heading_min 0.5776384397246679 distance-from-start_max 3.3354107982510546 distance-from-start_mean 2.2110865327147784 distance-from-start_median 2.191605904940471 distance-from-start_min 1.1257235227271165 driven_any_max 3.3361297078559655 driven_any_mean 2.2114839832360524 driven_any_median 2.1920133941339253 driven_any_min 1.1257794368203942 driven_lanedir_consec_max 1.1849271720723111 driven_lanedir_consec_mean 0.4079658658358902 driven_lanedir_consec_min 0.09340563909206612 driven_lanedir_max 1.1849271720723111 driven_lanedir_mean 0.4079658658358902 driven_lanedir_median 0.17676532608959172 driven_lanedir_min 0.09340563909206612 in-drivable-lane_max 20.100000000000165 in-drivable-lane_mean 17.837500000000155 in-drivable-lane_min 12.00000000000012 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.3361297078559655, "survival_time": 21.200000000000166, "driven_lanedir": 1.1849271720723111, "in-drivable-lane": 12.00000000000012, "deviation-heading": 5.2482884111975086, "distance-from-start": 3.3354107982510546, "deviation-center-line": 0.8045746318533537, "driven_lanedir_consec": 1.1849271720723111}, "zigzag-000-ego1": {"driven_any": 2.855019965863893, "survival_time": 21.200000000000166, "driven_lanedir": 0.14869325237796405, "in-drivable-lane": 19.850000000000165, "deviation-heading": 0.5776384397246679, "distance-from-start": 2.8543136070620254, "deviation-center-line": 0.1372078405659203, "driven_lanedir_consec": 0.14869325237796405}, "zigzag-000-ego2": {"driven_any": 1.5290068224039577, "survival_time": 21.200000000000166, "driven_lanedir": 0.20483739980121937, "in-drivable-lane": 19.40000000000017, "deviation-heading": 0.7499200019270054, "distance-from-start": 1.5288982028189169, "deviation-center-line": 0.09588475443900028, "driven_lanedir_consec": 0.20483739980121937}, "zigzag-000-ego3": {"driven_any": 1.1257794368203942, "survival_time": 21.200000000000166, "driven_lanedir": 0.09340563909206612, "in-drivable-lane": 20.100000000000165, "deviation-heading": 0.772662890080044, "distance-from-start": 1.1257235227271165, "deviation-center-line": 0.10390982916830796, "driven_lanedir_consec": 0.09340563909206612}}simulation-passed 1 survival_time_max 21.200000000000166 survival_time_mean 21.200000000000166 survival_time_min 21.200000000000166
No reset possible 16500
1747
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:39:41+00:00 2022-11-28 00:41:50+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.050000000000036 in-drivable-lane_median 8.950000000000042 driven_lanedir_consec_median 0.30902388815479953 deviation-center-line_median 0.26861568883973136
other stats deviation-center-line_max 0.26861568883973136 deviation-center-line_mean 0.26861568883973136 deviation-center-line_min 0.26861568883973136 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 1.816331806096384 distance-from-start_mean 1.816331806096384 distance-from-start_median 1.816331806096384 distance-from-start_min 1.816331806096384 driven_any_max 1.8164449732417056 driven_any_mean 1.8164449732417056 driven_any_median 1.8164449732417056 driven_any_min 1.8164449732417056 driven_lanedir_consec_max 0.30902388815479953 driven_lanedir_consec_mean 0.30902388815479953 driven_lanedir_consec_min 0.30902388815479953 driven_lanedir_max 0.30902388815479953 driven_lanedir_mean 0.30902388815479953 driven_lanedir_median 0.30902388815479953 driven_lanedir_min 0.30902388815479953 in-drivable-lane_max 8.950000000000042 in-drivable-lane_mean 8.950000000000042 in-drivable-lane_min 8.950000000000042 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8164449732417056, "survival_time": 12.050000000000036, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 8.950000000000042, "deviation-heading": 2.499533756017491, "distance-from-start": 1.816331806096384, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}simulation-passed 1 survival_time_max 12.050000000000036 survival_time_mean 12.050000000000036 survival_time_min 12.050000000000036
No reset possible 16497
1747
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:37:39+00:00 2022-11-28 00:39:23+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.14999999999999 in-drivable-lane_median 3.74999999999999 driven_lanedir_consec_median 0.13665955970746824 deviation-center-line_median 0.10783802485851962
other stats deviation-center-line_max 0.10783802485851962 deviation-center-line_mean 0.10783802485851962 deviation-center-line_min 0.10783802485851962 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.6813626821293306 distance-from-start_mean 0.6813626821293306 distance-from-start_median 0.6813626821293306 distance-from-start_min 0.6813626821293306 driven_any_max 0.6813744088473564 driven_any_mean 0.6813744088473564 driven_any_median 0.6813744088473564 driven_any_min 0.6813744088473564 driven_lanedir_consec_max 0.13665955970746824 driven_lanedir_consec_mean 0.13665955970746824 driven_lanedir_consec_min 0.13665955970746824 driven_lanedir_max 0.13665955970746824 driven_lanedir_mean 0.13665955970746824 driven_lanedir_median 0.13665955970746824 driven_lanedir_min 0.13665955970746824 in-drivable-lane_max 3.74999999999999 in-drivable-lane_mean 3.74999999999999 in-drivable-lane_min 3.74999999999999 per-episodes details {"autolab-000-ego0": {"driven_any": 0.6813744088473564, "survival_time": 5.14999999999999, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 3.74999999999999, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.6813626821293306, "deviation-center-line": 0.10783802485851962, "driven_lanedir_consec": 0.13665955970746824}}simulation-passed 1 survival_time_max 5.14999999999999 survival_time_mean 5.14999999999999 survival_time_min 5.14999999999999
No reset possible 16486
1750
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:27:27+00:00 2022-11-28 00:37:12+00:00 0:09:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 32.59999999999934 driven_lanedir_consec_median 3.188903489140139 deviation-center-line_median 2.073194603814537
other stats deviation-center-line_max 2.073194603814537 deviation-center-line_mean 2.073194603814537 deviation-center-line_min 2.073194603814537 deviation-heading_max 22.568051387890012 deviation-heading_mean 22.568051387890012 deviation-heading_median 22.568051387890012 deviation-heading_min 22.568051387890012 distance-from-start_max 0.3334145866799692 distance-from-start_mean 0.3334145866799692 distance-from-start_median 0.3334145866799692 distance-from-start_min 0.3334145866799692 driven_any_max 11.431418504580686 driven_any_mean 11.431418504580686 driven_any_median 11.431418504580686 driven_any_min 11.431418504580686 driven_lanedir_consec_max 3.188903489140139 driven_lanedir_consec_mean 3.188903489140139 driven_lanedir_consec_min 3.188903489140139 driven_lanedir_max 3.188903489140139 driven_lanedir_mean 3.188903489140139 driven_lanedir_median 3.188903489140139 driven_lanedir_min 3.188903489140139 in-drivable-lane_max 32.59999999999934 in-drivable-lane_mean 32.59999999999934 in-drivable-lane_min 32.59999999999934 per-episodes details {"udem1-000-ego0": {"driven_any": 11.431418504580686, "survival_time": 59.99999999999873, "driven_lanedir": 3.188903489140139, "in-drivable-lane": 32.59999999999934, "deviation-heading": 22.568051387890012, "distance-from-start": 0.3334145866799692, "deviation-center-line": 2.073194603814537, "driven_lanedir_consec": 3.188903489140139}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16477
1752
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-28 00:04:49+00:00 2022-11-28 00:27:07+00:00 0:22:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.82499999999869 driven_lanedir_consec_median 0.7376014238718469 deviation-center-line_median 0.30198623554382326
other stats deviation-center-line_max 2.366376009812845 deviation-center-line_mean 0.7627252823049072 deviation-center-line_min 0.0805526483191376 deviation-heading_max 25.789083881374733 deviation-heading_mean 8.6645657157836 deviation-heading_median 4.135797254140849 deviation-heading_min 0.5975844734779651 distance-from-start_max 0.987787860994932 distance-from-start_mean 0.48923186214679126 distance-from-start_median 0.34118853752814593 distance-from-start_min 0.28676251253594115 driven_any_max 4.439767244545547 driven_any_mean 2.324319934459137 driven_any_median 2.228499100665258 driven_any_min 0.4005142919604858 driven_lanedir_consec_max 1.380563005799297 driven_lanedir_consec_mean 0.7455027255599789 driven_lanedir_consec_min 0.1262450486969251 driven_lanedir_max 1.380563005799297 driven_lanedir_mean 0.7455027255599789 driven_lanedir_median 0.7376014238718469 driven_lanedir_min 0.1262450486969251 in-drivable-lane_max 58.99999999999873 in-drivable-lane_mean 48.38749999999888 in-drivable-lane_min 26.89999999999943 per-episodes details {"udem-000-ego0": {"driven_any": 4.439767244545547, "survival_time": 59.99999999999873, "driven_lanedir": 1.380563005799297, "in-drivable-lane": 26.89999999999943, "deviation-heading": 25.789083881374733, "distance-from-start": 0.28676251253594115, "deviation-center-line": 2.366376009812845, "driven_lanedir_consec": 1.380563005799297}, "udem-000-ego1": {"driven_any": 1.117160988263973, "survival_time": 59.99999999999873, "driven_lanedir": 0.1262450486969251, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.5975844734779651, "distance-from-start": 0.987787860994932, "deviation-center-line": 0.08531734816466498, "driven_lanedir_consec": 0.1262450486969251}, "udem-000-ego2": {"driven_any": 3.3398372130665432, "survival_time": 59.99999999999873, "driven_lanedir": 1.1463060492099306, "in-drivable-lane": 49.44999999999865, "deviation-heading": 7.614397892985068, "distance-from-start": 0.30690190736808753, "deviation-center-line": 0.5186551229229815, "driven_lanedir_consec": 1.1463060492099306}, "udem-000-ego3": {"driven_any": 0.4005142919604858, "survival_time": 59.99999999999873, "driven_lanedir": 0.3288967985337632, "in-drivable-lane": 58.19999999999872, "deviation-heading": 0.6571966152966302, "distance-from-start": 0.3754751676882043, "deviation-center-line": 0.0805526483191376, "driven_lanedir_consec": 0.3288967985337632}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16474
1754
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 23:53:48+00:00 2022-11-28 00:04:41+00:00 0:10:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.899999999999395 driven_lanedir_consec_median -0.02110858268307525 deviation-center-line_median 2.591965874562201
other stats deviation-center-line_max 2.591965874562201 deviation-center-line_mean 2.591965874562201 deviation-center-line_min 2.591965874562201 deviation-heading_max 24.295476299212183 deviation-heading_mean 24.295476299212183 deviation-heading_median 24.295476299212183 deviation-heading_min 24.295476299212183 distance-from-start_max 0.12741912095912317 distance-from-start_mean 0.12741912095912317 distance-from-start_median 0.12741912095912317 distance-from-start_min 0.12741912095912317 driven_any_max 1.1811356926556948 driven_any_mean 1.1811356926556948 driven_any_median 1.1811356926556948 driven_any_min 1.1811356926556948 driven_lanedir_consec_max -0.02110858268307525 driven_lanedir_consec_mean -0.02110858268307525 driven_lanedir_consec_min -0.02110858268307525 driven_lanedir_max -0.02110858268307525 driven_lanedir_mean -0.02110858268307525 driven_lanedir_median -0.02110858268307525 driven_lanedir_min -0.02110858268307525 in-drivable-lane_max 28.899999999999395 in-drivable-lane_mean 28.899999999999395 in-drivable-lane_min 28.899999999999395 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.1811356926556948, "survival_time": 59.99999999999873, "driven_lanedir": -0.02110858268307525, "in-drivable-lane": 28.899999999999395, "deviation-heading": 24.295476299212183, "distance-from-start": 0.12741912095912317, "deviation-center-line": 2.591965874562201, "driven_lanedir_consec": -0.02110858268307525}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16470
1754
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 23:46:21+00:00 2022-11-27 23:53:11+00:00 0:06:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 57.09999999999889 in-drivable-lane_median 54.699999999998894 driven_lanedir_consec_median 0.2380318100801353 deviation-center-line_median 0.22620998412496507
other stats deviation-center-line_max 0.22620998412496507 deviation-center-line_mean 0.22620998412496507 deviation-center-line_min 0.22620998412496507 deviation-heading_max 1.7351718825420666 deviation-heading_mean 1.7351718825420666 deviation-heading_median 1.7351718825420666 deviation-heading_min 1.7351718825420666 distance-from-start_max 0.9936080941851894 distance-from-start_mean 0.9936080941851894 distance-from-start_median 0.9936080941851894 distance-from-start_min 0.9936080941851894 driven_any_max 9.925696248814669 driven_any_mean 9.925696248814669 driven_any_median 9.925696248814669 driven_any_min 9.925696248814669 driven_lanedir_consec_max 0.2380318100801353 driven_lanedir_consec_mean 0.2380318100801353 driven_lanedir_consec_min 0.2380318100801353 driven_lanedir_max 0.2380318100801353 driven_lanedir_mean 0.2380318100801353 driven_lanedir_median 0.2380318100801353 driven_lanedir_min 0.2380318100801353 in-drivable-lane_max 54.699999999998894 in-drivable-lane_mean 54.699999999998894 in-drivable-lane_min 54.699999999998894 per-episodes details {"loop2-000-ego0": {"driven_any": 9.925696248814669, "survival_time": 57.09999999999889, "driven_lanedir": 0.2380318100801353, "in-drivable-lane": 54.699999999998894, "deviation-heading": 1.7351718825420666, "distance-from-start": 0.9936080941851894, "deviation-center-line": 0.22620998412496507, "driven_lanedir_consec": 0.2380318100801353}}simulation-passed 1 survival_time_max 57.09999999999889 survival_time_mean 57.09999999999889 survival_time_min 57.09999999999889
No reset possible 16455
1766
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 23:26:49+00:00 2022-11-27 23:45:58+00:00 0:19:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 37.7499999999988 driven_lanedir_consec_median 1.3387443568358792 deviation-center-line_median 1.4750725219959044
other stats deviation-center-line_max 1.4750725219959044 deviation-center-line_mean 1.4750725219959044 deviation-center-line_min 1.4750725219959044 deviation-heading_max 18.7713215905758 deviation-heading_mean 18.7713215905758 deviation-heading_median 18.7713215905758 deviation-heading_min 18.7713215905758 distance-from-start_max 0.7130457160152507 distance-from-start_mean 0.7130457160152507 distance-from-start_median 0.7130457160152507 distance-from-start_min 0.7130457160152507 driven_any_max 5.481454095192461 driven_any_mean 5.481454095192461 driven_any_median 5.481454095192461 driven_any_min 5.481454095192461 driven_lanedir_consec_max 1.3387443568358792 driven_lanedir_consec_mean 1.3387443568358792 driven_lanedir_consec_min 1.3387443568358792 driven_lanedir_max 1.3387443568358792 driven_lanedir_mean 1.3387443568358792 driven_lanedir_median 1.3387443568358792 driven_lanedir_min 1.3387443568358792 in-drivable-lane_max 37.7499999999988 in-drivable-lane_mean 37.7499999999988 in-drivable-lane_min 37.7499999999988 per-episodes details {"autolab-000-ego0": {"driven_any": 5.481454095192461, "survival_time": 59.99999999999873, "driven_lanedir": 1.3387443568358792, "in-drivable-lane": 37.7499999999988, "deviation-heading": 18.7713215905758, "distance-from-start": 0.7130457160152507, "deviation-center-line": 1.4750725219959044, "driven_lanedir_consec": 1.3387443568358792}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16450
1768
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 23:25:06+00:00 2022-11-27 23:26:36+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16437
1771
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:55:18+00:00 2022-11-27 23:24:46+00:00 0:29:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.7249999999987 driven_lanedir_consec_median 0.454921297017584 deviation-center-line_median 0.6974749749431727
other stats deviation-center-line_max 1.2289107234352754 deviation-center-line_mean 0.7465183199466825 deviation-center-line_min 0.36221260646510905 deviation-heading_max 10.747669890048885 deviation-heading_mean 5.217075000618098 deviation-heading_median 3.8575509611233407 deviation-heading_min 2.405528190176829 distance-from-start_max 0.8906349158843042 distance-from-start_mean 0.5509638453554111 distance-from-start_median 0.49618840737134856 distance-from-start_min 0.32084365079464316 driven_any_max 9.594225342584588 driven_any_mean 5.398565670873957 driven_any_median 4.556579801155596 driven_any_min 2.886877738600047 driven_lanedir_consec_max 0.7994021954471623 driven_lanedir_consec_mean 0.4823888295893775 driven_lanedir_consec_min 0.22031052887517985 driven_lanedir_max 0.9831299842680968 driven_lanedir_mean 0.6456489561290962 driven_lanedir_median 0.6895776556865543 driven_lanedir_min 0.22031052887517985 in-drivable-lane_max 56.59999999999874 in-drivable-lane_mean 52.44999999999869 in-drivable-lane_min 45.7499999999986 per-episodes details {"autolab-000-ego0": {"driven_any": 2.886877738600047, "survival_time": 59.99999999999873, "driven_lanedir": 0.5797531159259464, "in-drivable-lane": 54.59999999999873, "deviation-heading": 3.764327276744409, "distance-from-start": 0.32084365079464316, "deviation-center-line": 0.4035703760651697, "driven_lanedir_consec": 0.5797531159259464}, "autolab-000-ego1": {"driven_any": 9.594225342584588, "survival_time": 59.99999999999873, "driven_lanedir": 0.7994021954471623, "in-drivable-lane": 52.84999999999867, "deviation-heading": 3.950774645502272, "distance-from-start": 0.8906349158843042, "deviation-center-line": 0.9913795738211756, "driven_lanedir_consec": 0.7994021954471623}, "autolab-000-ego2": {"driven_any": 5.897718708388023, "survival_time": 59.99999999999873, "driven_lanedir": 0.9831299842680968, "in-drivable-lane": 45.7499999999986, "deviation-heading": 10.747669890048885, "distance-from-start": 0.6582850667234794, "deviation-center-line": 1.2289107234352754, "driven_lanedir_consec": 0.3300894781092216}, "autolab-000-ego3": {"driven_any": 3.2154408939231685, "survival_time": 59.99999999999873, "driven_lanedir": 0.22031052887517985, "in-drivable-lane": 56.59999999999874, "deviation-heading": 2.405528190176829, "distance-from-start": 0.3340917480192177, "deviation-center-line": 0.36221260646510905, "driven_lanedir_consec": 0.22031052887517985}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16427
1773
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:39:55+00:00 2022-11-27 22:54:58+00:00 0:15:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.69999999999937 in-drivable-lane_median 36.64999999999927 driven_lanedir_consec_median 0.27329071924012593 deviation-center-line_median 0.8940598330260409
other stats deviation-center-line_max 0.8940598330260409 deviation-center-line_mean 0.8940598330260409 deviation-center-line_min 0.8940598330260409 deviation-heading_max 9.653852545002117 deviation-heading_mean 9.653852545002117 deviation-heading_median 9.653852545002117 deviation-heading_min 9.653852545002117 distance-from-start_max 1.1351054760255814 distance-from-start_mean 1.1351054760255814 distance-from-start_median 1.1351054760255814 distance-from-start_min 1.1351054760255814 driven_any_max 12.221812291295889 driven_any_mean 12.221812291295889 driven_any_median 12.221812291295889 driven_any_min 12.221812291295889 driven_lanedir_consec_max 0.27329071924012593 driven_lanedir_consec_mean 0.27329071924012593 driven_lanedir_consec_min 0.27329071924012593 driven_lanedir_max 0.26112935377464863 driven_lanedir_mean 0.26112935377464863 driven_lanedir_median 0.26112935377464863 driven_lanedir_min 0.26112935377464863 in-drivable-lane_max 36.64999999999927 in-drivable-lane_mean 36.64999999999927 in-drivable-lane_min 36.64999999999927 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}simulation-passed 1 survival_time_max 48.69999999999937 survival_time_mean 48.69999999999937 survival_time_min 48.69999999999937
No reset possible 16425
1774
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:38:14+00:00 2022-11-27 22:39:48+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16413
1777
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:22:03+00:00 2022-11-27 22:38:07+00:00 0:16:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.19999999999969 driven_lanedir_consec_median 0.1481685404123385 deviation-center-line_median 0.6130052941053471
other stats deviation-center-line_max 6.361236990588696 deviation-center-line_mean 1.968961967548878 deviation-center-line_min 0.28860029139612103 deviation-heading_max 22.59467278731015 deviation-heading_mean 9.325639720688413 deviation-heading_median 6.178891513015082 deviation-heading_min 2.350103069413334 distance-from-start_max 1.0093404360059293 distance-from-start_mean 0.6788871313560756 distance-from-start_median 0.651676229557197 distance-from-start_min 0.40285563030397936 driven_any_max 10.522906217249696 driven_any_mean 4.533111394485939 driven_any_median 3.592731455205004 driven_any_min 0.4240764502840531 driven_lanedir_consec_max 0.3902130173718561 driven_lanedir_consec_mean 0.1975964492168203 driven_lanedir_consec_min 0.10383569867074804 driven_lanedir_max 0.3902130173718561 driven_lanedir_mean 0.18988251265665312 driven_lanedir_median 0.1348795225002798 driven_lanedir_min 0.09955798825419682 in-drivable-lane_max 39.84999999999967 in-drivable-lane_mean 27.787499999999763 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 16409
1778
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:13:24+00:00 2022-11-27 22:21:27+00:00 0:08:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 37.09999999999956 driven_lanedir_consec_median 0.23705557260553295 deviation-center-line_median 0.6463758558852182
other stats deviation-center-line_max 0.7555292890833561 deviation-center-line_mean 0.6463758558852182 deviation-center-line_min 0.5372224226870801 deviation-heading_max 5.523299123594233 deviation-heading_mean 5.0377292657796975 deviation-heading_median 5.0377292657796975 deviation-heading_min 4.552159407965162 distance-from-start_max 1.0442247976691843 distance-from-start_mean 0.9534278048696496 distance-from-start_median 0.9534278048696496 distance-from-start_min 0.8626308120701148 driven_any_max 11.376062002465083 driven_any_mean 9.15341861992026 driven_any_median 9.15341861992026 driven_any_min 6.9307752373754345 driven_lanedir_consec_max 0.26764947507969805 driven_lanedir_consec_mean 0.23705557260553295 driven_lanedir_consec_min 0.20646167013136785 driven_lanedir_max 0.2496387990426845 driven_lanedir_mean 0.2213862628967403 driven_lanedir_median 0.2213862628967403 driven_lanedir_min 0.1931337267507961 in-drivable-lane_max 37.649999999999565 in-drivable-lane_mean 37.09999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 16405
1779
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:09:13+00:00 2022-11-27 22:13:09+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.200000000000195 in-drivable-lane_median 14.65000000000017 driven_lanedir_consec_median 0.2737852330803683 deviation-center-line_median 0.7687318160431588
other stats deviation-center-line_max 0.7687318160431588 deviation-center-line_mean 0.7687318160431588 deviation-center-line_min 0.7687318160431588 deviation-heading_max 5.758343085491201 deviation-heading_mean 5.758343085491201 deviation-heading_median 5.758343085491201 deviation-heading_min 5.758343085491201 distance-from-start_max 0.7357883576773739 distance-from-start_mean 0.7357883576773739 distance-from-start_median 0.7357883576773739 distance-from-start_min 0.7357883576773739 driven_any_max 5.318401064622404 driven_any_mean 5.318401064622404 driven_any_median 5.318401064622404 driven_any_min 5.318401064622404 driven_lanedir_consec_max 0.2737852330803683 driven_lanedir_consec_mean 0.2737852330803683 driven_lanedir_consec_min 0.2737852330803683 driven_lanedir_max 0.2557745570433345 driven_lanedir_mean 0.2557745570433345 driven_lanedir_median 0.2557745570433345 driven_lanedir_min 0.2557745570433345 in-drivable-lane_max 14.65000000000017 in-drivable-lane_mean 14.65000000000017 in-drivable-lane_min 14.65000000000017 per-episodes details {"autolab-000-ego0": {"driven_any": 5.318401064622404, "survival_time": 23.200000000000195, "driven_lanedir": 0.2557745570433345, "in-drivable-lane": 14.65000000000017, "deviation-heading": 5.758343085491201, "distance-from-start": 0.7357883576773739, "deviation-center-line": 0.7687318160431588, "driven_lanedir_consec": 0.2737852330803683}}simulation-passed 1 survival_time_max 23.200000000000195 survival_time_mean 23.200000000000195 survival_time_min 23.200000000000195
No reset possible 16402
1779
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 22:05:01+00:00 2022-11-27 22:08:53+00:00 0:03:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.700000000000088 in-drivable-lane_median 8.100000000000078 driven_lanedir_consec_median 0.27378153863999577 deviation-center-line_median 0.6226670229639317
other stats deviation-center-line_max 0.6226670229639317 deviation-center-line_mean 0.6226670229639317 deviation-center-line_min 0.6226670229639317 deviation-heading_max 4.9776949056766355 deviation-heading_mean 4.9776949056766355 deviation-heading_median 4.9776949056766355 deviation-heading_min 4.9776949056766355 distance-from-start_max 0.6297514211538986 distance-from-start_mean 0.6297514211538986 distance-from-start_median 0.6297514211538986 distance-from-start_min 0.6297514211538986 driven_any_max 3.532822332695487 driven_any_mean 3.532822332695487 driven_any_median 3.532822332695487 driven_any_min 3.532822332695487 driven_lanedir_consec_max 0.27378153863999577 driven_lanedir_consec_mean 0.27378153863999577 driven_lanedir_consec_min 0.27378153863999577 driven_lanedir_max 0.2627748326499355 driven_lanedir_mean 0.2627748326499355 driven_lanedir_median 0.2627748326499355 driven_lanedir_min 0.2627748326499355 in-drivable-lane_max 8.100000000000078 in-drivable-lane_mean 8.100000000000078 in-drivable-lane_min 8.100000000000078 per-episodes details {"loop2-000-ego0": {"driven_any": 3.532822332695487, "survival_time": 15.700000000000088, "driven_lanedir": 0.2627748326499355, "in-drivable-lane": 8.100000000000078, "deviation-heading": 4.9776949056766355, "distance-from-start": 0.6297514211538986, "deviation-center-line": 0.6226670229639317, "driven_lanedir_consec": 0.27378153863999577}}simulation-passed 1 survival_time_max 15.700000000000088 survival_time_mean 15.700000000000088 survival_time_min 15.700000000000088
No reset possible 16401
1780
Bea Baselines 🐤template-random lx22-modcon
sim success yes davinci-stage-01-6.2.51
2022-11-27 22:01:12+00:00 2022-11-27 22:04:21+00:00 0:03:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 5.975000000000012 deviation-center-line_median 0.11301514542099378 driven_lanedir_consec_median -0.0018954959261547888 survival_time_median 7.35000000000001
other stats deviation-center-line_max 0.1446772460243307 deviation-center-line_mean 0.11301514542099378 deviation-center-line_min 0.08135304481765684 deviation-heading_max 1.386814265924231 deviation-heading_mean 1.07792007492562 deviation-heading_median 1.07792007492562 deviation-heading_min 0.7690258839270088 distance-from-start_max 0.5461575079396507 distance-from-start_mean 0.4044333226818525 distance-from-start_median 0.4044333226818525 distance-from-start_min 0.2627091374240543 driven_any_max 2.2158554268274218 driven_any_mean 1.246529558046526 driven_any_median 1.246529558046526 driven_any_min 0.2772036892656306 driven_lanedir_consec_max 0.003586872133226393 driven_lanedir_consec_mean -0.0018954959261547888 driven_lanedir_consec_min -0.007377863985535971 driven_lanedir_max 0.003586872133226393 driven_lanedir_mean -0.0018954959261547888 driven_lanedir_median -0.0018954959261547888 driven_lanedir_min -0.007377863985535971 in-drivable-lane_max 9.400000000000029 in-drivable-lane_mean 5.975000000000012 in-drivable-lane_min 2.5499999999999963 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 2.2158554268274218, "survival_time": 11.200000000000024, "driven_lanedir": -0.007377863985535971, "in-drivable-lane": 9.400000000000029, "deviation-heading": 1.386814265924231, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.1446772460243307, "driven_lanedir_consec": -0.007377863985535971}, "LF-full-loop-001-ego0": {"driven_any": 0.2772036892656306, "survival_time": 3.4999999999999956, "driven_lanedir": 0.003586872133226393, "in-drivable-lane": 2.5499999999999963, "deviation-heading": 0.7690258839270088, "distance-from-start": 0.2627091374240543, "deviation-center-line": 0.08135304481765684, "driven_lanedir_consec": 0.003586872133226393}}simulation-passed 1 survival_time_max 11.200000000000024 survival_time_mean 7.35000000000001 survival_time_min 3.4999999999999956
No reset possible 16397
1784
Bea Baselines 🐤template-random lx22-BV1
sim-0of5 success yes davinci-stage-01-6.2.51
2022-11-27 21:58:19+00:00 2022-11-27 22:00:45+00:00 0:02:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4028556303039808
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4028556303039808 distance-from-start_median 0.4028556303039808 distance-from-start_min 0.4028556303039808 driven_any_max 0.4240764502839582 driven_any_mean 0.4240764502839582 driven_any_median 0.4240764502839582 driven_any_min 0.4240764502839582 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.7499999999999942 in-drivable-lane_mean 3.7499999999999942 in-drivable-lane_median 3.7499999999999942 in-drivable-lane_min 3.7499999999999942 per-episodes details {"d30-ego0": {"driven_any": 0.4240764502839582, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.4028556303039808, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_median 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 16394
1784
Bea Baselines 🐤template-random lx22-BV1
sim-3of5 success yes davinci-stage-01-6.2.51
2022-11-27 21:55:15+00:00 2022-11-27 21:57:57+00:00 0:02:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6297514211538973
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6297514211538973 distance-from-start_median 0.6297514211538973 distance-from-start_min 0.6297514211538973 driven_any_max 3.022989906942301 driven_any_mean 3.022989906942301 driven_any_median 3.022989906942301 driven_any_min 3.022989906942301 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 12.850000000000048 in-drivable-lane_mean 12.850000000000048 in-drivable-lane_median 12.850000000000048 in-drivable-lane_min 12.850000000000048 per-episodes details {"d50-ego0": {"driven_any": 3.022989906942301, "survival_time": 12.850000000000048, "driven_lanedir": 0.0, "in-drivable-lane": 12.850000000000048, "deviation-heading": 0.0, "distance-from-start": 0.6297514211538973, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_median 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 16388
1791
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:47:47+00:00 2022-11-27 21:54:50+00:00 0:07:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 27.70000000000026 in-drivable-lane_median 21.450000000000205 driven_lanedir_consec_median 0.012425607873532307 deviation-center-line_median 0.5849703367275559
other stats deviation-center-line_max 0.5849703367275559 deviation-center-line_mean 0.5849703367275559 deviation-center-line_min 0.5849703367275559 deviation-heading_max 4.775258728877611 deviation-heading_mean 4.775258728877611 deviation-heading_median 4.775258728877611 deviation-heading_min 4.775258728877611 distance-from-start_max 0.7960980578537297 distance-from-start_mean 0.7960980578537297 distance-from-start_median 0.7960980578537297 distance-from-start_min 0.7960980578537297 driven_any_max 6.63545554755722 driven_any_mean 6.63545554755722 driven_any_median 6.63545554755722 driven_any_min 6.63545554755722 driven_lanedir_consec_max 0.012425607873532307 driven_lanedir_consec_mean 0.012425607873532307 driven_lanedir_consec_min 0.012425607873532307 driven_lanedir_max 0.01577326127428158 driven_lanedir_mean 0.01577326127428158 driven_lanedir_median 0.01577326127428158 driven_lanedir_min 0.01577326127428158 in-drivable-lane_max 21.450000000000205 in-drivable-lane_mean 21.450000000000205 in-drivable-lane_min 21.450000000000205 per-episodes details {"loop-000-ego0": {"driven_any": 6.63545554755722, "survival_time": 27.70000000000026, "driven_lanedir": 0.01577326127428158, "in-drivable-lane": 21.450000000000205, "deviation-heading": 4.775258728877611, "distance-from-start": 0.7960980578537297, "deviation-center-line": 0.5849703367275559, "driven_lanedir_consec": 0.012425607873532307}}simulation-passed 1 survival_time_max 27.70000000000026 survival_time_mean 27.70000000000026 survival_time_min 27.70000000000026
No reset possible 16386
1792
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:46:02+00:00 2022-11-27 21:47:32+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16382
1793
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:40:58+00:00 2022-11-27 21:45:29+00:00 0:04:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.450000000000212 in-drivable-lane_median 17.850000000000154 driven_lanedir_consec_median 0.050146904256652025 deviation-center-line_median 0.5014783130439592
other stats deviation-center-line_max 0.5014783130439592 deviation-center-line_mean 0.5014783130439592 deviation-center-line_min 0.5014783130439592 deviation-heading_max 5.174156496722106 deviation-heading_mean 5.174156496722106 deviation-heading_median 5.174156496722106 deviation-heading_min 5.174156496722106 distance-from-start_max 0.796098057853711 distance-from-start_mean 0.796098057853711 distance-from-start_median 0.796098057853711 distance-from-start_min 0.796098057853711 driven_any_max 5.895396370035972 driven_any_mean 5.895396370035972 driven_any_median 5.895396370035972 driven_any_min 5.895396370035972 driven_lanedir_consec_max 0.050146904256652025 driven_lanedir_consec_mean 0.050146904256652025 driven_lanedir_consec_min 0.050146904256652025 driven_lanedir_max 0.053494557657393305 driven_lanedir_mean 0.053494557657393305 driven_lanedir_median 0.053494557657393305 driven_lanedir_min 0.053494557657393305 in-drivable-lane_max 17.850000000000154 in-drivable-lane_mean 17.850000000000154 in-drivable-lane_min 17.850000000000154 per-episodes details {"udem1-000-ego0": {"driven_any": 5.895396370035972, "survival_time": 24.450000000000212, "driven_lanedir": 0.053494557657393305, "in-drivable-lane": 17.850000000000154, "deviation-heading": 5.174156496722106, "distance-from-start": 0.796098057853711, "deviation-center-line": 0.5014783130439592, "driven_lanedir_consec": 0.050146904256652025}}simulation-passed 1 survival_time_max 24.450000000000212 survival_time_mean 24.450000000000212 survival_time_min 24.450000000000212
No reset possible 16379
1793
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:37:16+00:00 2022-11-27 21:40:35+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.029484722837852084 deviation-center-line_median 0.326841308646148
other stats deviation-center-line_max 0.326841308646148 deviation-center-line_mean 0.326841308646148 deviation-center-line_min 0.326841308646148 deviation-heading_max 2.548872600298709 deviation-heading_mean 2.548872600298709 deviation-heading_median 2.548872600298709 deviation-heading_min 2.548872600298709 distance-from-start_max 0.5461575079396456 distance-from-start_mean 0.5461575079396456 distance-from-start_median 0.5461575079396456 distance-from-start_min 0.5461575079396456 driven_any_max 2.2955250818765065 driven_any_mean 2.2955250818765065 driven_any_median 2.2955250818765065 driven_any_min 2.2955250818765065 driven_lanedir_consec_max 0.029484722837852084 driven_lanedir_consec_mean 0.029484722837852084 driven_lanedir_consec_min 0.029484722837852084 driven_lanedir_max 0.03283106493648602 driven_lanedir_mean 0.03283106493648602 driven_lanedir_median 0.03283106493648602 driven_lanedir_min 0.03283106493648602 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.2955250818765065, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283106493648602, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.548872600298709, "distance-from-start": 0.5461575079396456, "deviation-center-line": 0.326841308646148, "driven_lanedir_consec": 0.029484722837852084}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 16367
1796
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:14:54+00:00 2022-11-27 21:36:48+00:00 0:21:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.199999999998774 in-drivable-lane_median 51.49999999999876 driven_lanedir_consec_median 0.21853936665470375 deviation-center-line_median 0.6558628477973304
other stats deviation-center-line_max 1.3919847015555789 deviation-center-line_mean 0.81620218081524 deviation-center-line_min 0.56109832611072 deviation-heading_max 9.906601177812297 deviation-heading_mean 5.728605671043064 deviation-heading_median 4.536008719589965 deviation-heading_min 3.9358040671800296 distance-from-start_max 1.3543782763136274 distance-from-start_mean 1.0494456679466913 distance-from-start_median 1.023653168809703 distance-from-start_min 0.7960980578537311 driven_any_max 14.612175482594528 driven_any_mean 10.218740534833987 driven_any_median 10.08333461358712 driven_any_min 6.09611742956719 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.20899163900592865 driven_lanedir_consec_min 0.15333036042477757 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.19479761986375457 driven_lanedir_median 0.2060280026190392 driven_lanedir_min 0.1313147247826545 in-drivable-lane_max 52.39999999999874 in-drivable-lane_mean 50.149999999998734 in-drivable-lane_min 45.19999999999868 per-episodes details {"loop-000-ego0": {"driven_any": 14.612175482594528, "survival_time": 59.199999999998774, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 45.19999999999868, "deviation-heading": 9.906601177812297, "distance-from-start": 1.3543782763136274, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}, "loop-000-ego1": {"driven_any": 11.349124250612942, "survival_time": 59.199999999998774, "driven_lanedir": 0.22565943649319545, "in-drivable-lane": 51.14999999999877, "deviation-heading": 4.17325696101659, "distance-from-start": 1.0442247976692065, "deviation-center-line": 0.6271479250601518, "driven_lanedir_consec": 0.2397934631518233}, "loop-000-ego2": {"driven_any": 6.09611742956719, "survival_time": 59.199999999998774, "driven_lanedir": 0.1313147247826545, "in-drivable-lane": 52.39999999999874, "deviation-heading": 3.9358040671800296, "distance-from-start": 0.7960980578537311, "deviation-center-line": 0.684577770534509, "driven_lanedir_consec": 0.15333036042477757}, "loop-000-ego3": {"driven_any": 8.817544976561296, "survival_time": 59.199999999998774, "driven_lanedir": 0.18639656874488297, "in-drivable-lane": 51.849999999998744, "deviation-heading": 4.898760478163339, "distance-from-start": 1.0030815399501998, "deviation-center-line": 0.56109832611072, "driven_lanedir_consec": 0.19728527015758424}}simulation-passed 1 survival_time_max 59.199999999998774 survival_time_mean 59.199999999998774 survival_time_min 59.199999999998774
No reset possible 16361
1798
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:10:02+00:00 2022-11-27 21:14:20+00:00 0:04:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.800000000000049 in-drivable-lane_median 9.100000000000016 driven_lanedir_consec_median 0.792546253949078 deviation-center-line_median 0.3106003436998643
other stats deviation-center-line_max 0.3106003436998643 deviation-center-line_mean 0.3106003436998643 deviation-center-line_min 0.3106003436998643 deviation-heading_max 2.3006803822827915 deviation-heading_mean 2.3006803822827915 deviation-heading_median 2.3006803822827915 deviation-heading_min 2.3006803822827915 distance-from-start_max 3.1200436766716972 distance-from-start_mean 3.1200436766716972 distance-from-start_median 3.1200436766716972 distance-from-start_min 3.1200436766716972 driven_any_max 3.4684154404735907 driven_any_mean 3.4684154404735907 driven_any_median 3.4684154404735907 driven_any_min 3.4684154404735907 driven_lanedir_consec_max 0.792546253949078 driven_lanedir_consec_mean 0.792546253949078 driven_lanedir_consec_min 0.792546253949078 driven_lanedir_max 0.792546253949078 driven_lanedir_mean 0.792546253949078 driven_lanedir_median 0.792546253949078 driven_lanedir_min 0.792546253949078 in-drivable-lane_max 9.100000000000016 in-drivable-lane_mean 9.100000000000016 in-drivable-lane_min 9.100000000000016 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4684154404735907, "survival_time": 12.800000000000049, "driven_lanedir": 0.792546253949078, "in-drivable-lane": 9.100000000000016, "deviation-heading": 2.3006803822827915, "distance-from-start": 3.1200436766716972, "deviation-center-line": 0.3106003436998643, "driven_lanedir_consec": 0.792546253949078}}simulation-passed 1 survival_time_max 12.800000000000049 survival_time_mean 12.800000000000049 survival_time_min 12.800000000000049
No reset possible 16356
1799
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:08:05+00:00 2022-11-27 21:09:40+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16350
1800
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:05:45+00:00 2022-11-27 21:07:58+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.699999999999989 in-drivable-lane_median 6.599999999999988 driven_lanedir_consec_median 0.5238351957062339 deviation-center-line_median 0.231942229827818
other stats deviation-center-line_max 0.231942229827818 deviation-center-line_mean 0.231942229827818 deviation-center-line_min 0.231942229827818 deviation-heading_max 0.586438488139706 deviation-heading_mean 0.586438488139706 deviation-heading_median 0.586438488139706 deviation-heading_min 0.586438488139706 distance-from-start_max 2.2347963655773304 distance-from-start_mean 2.2347963655773304 distance-from-start_median 2.2347963655773304 distance-from-start_min 2.2347963655773304 driven_any_max 2.3024749874284702 driven_any_mean 2.3024749874284702 driven_any_median 2.3024749874284702 driven_any_min 2.3024749874284702 driven_lanedir_consec_max 0.5238351957062339 driven_lanedir_consec_mean 0.5238351957062339 driven_lanedir_consec_min 0.5238351957062339 driven_lanedir_max 0.5238351957062339 driven_lanedir_mean 0.5238351957062339 driven_lanedir_median 0.5238351957062339 driven_lanedir_min 0.5238351957062339 in-drivable-lane_max 6.599999999999988 in-drivable-lane_mean 6.599999999999988 in-drivable-lane_min 6.599999999999988 per-episodes details {"udem1-000-ego0": {"driven_any": 2.3024749874284702, "survival_time": 8.699999999999989, "driven_lanedir": 0.5238351957062339, "in-drivable-lane": 6.599999999999988, "deviation-heading": 0.586438488139706, "distance-from-start": 2.2347963655773304, "deviation-center-line": 0.231942229827818, "driven_lanedir_consec": 0.5238351957062339}}simulation-passed 1 survival_time_max 8.699999999999989 survival_time_mean 8.699999999999989 survival_time_min 8.699999999999989
No reset possible 16343
1802
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 21:00:37+00:00 2022-11-27 21:05:33+00:00 0:04:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.850000000000048 in-drivable-lane_median 10.05000000000005 driven_lanedir_consec_median 0.6007291555552065 deviation-center-line_median 0.2235966833831283
other stats deviation-center-line_max 0.34239810574848734 deviation-center-line_mean 0.23354432065977665 deviation-center-line_min 0.14458581012436247 deviation-heading_max 1.8197477582919823 deviation-heading_mean 1.105553346989346 deviation-heading_median 1.077677163546177 deviation-heading_min 0.4471113025730472 distance-from-start_max 3.2008732967695757 distance-from-start_mean 1.3559172562285868 distance-from-start_median 0.9147413118754194 distance-from-start_min 0.39331310439393263 driven_any_max 3.544371000196078 driven_any_mean 1.4448405589471904 driven_any_median 0.9199869335692932 driven_any_min 0.3950173684540971 driven_lanedir_consec_max 0.949035137431405 driven_lanedir_consec_mean 0.6223101433134745 driven_lanedir_consec_min 0.3387471247120799 driven_lanedir_max 1.1661377107047834 driven_lanedir_mean 0.6840375195859836 driven_lanedir_median 0.6156326214635356 driven_lanedir_min 0.3387471247120799 in-drivable-lane_max 11.150000000000048 in-drivable-lane_mean 9.81250000000005 in-drivable-lane_min 8.000000000000057 per-episodes details {"udem-000-ego0": {"driven_any": 0.3950173684540971, "survival_time": 12.850000000000048, "driven_lanedir": 0.3387471247120799, "in-drivable-lane": 11.150000000000048, "deviation-heading": 0.6454820448819919, "distance-from-start": 0.39331310439393263, "deviation-center-line": 0.14458581012436247, "driven_lanedir_consec": 0.3387471247120799}, "udem-000-ego1": {"driven_any": 0.7041836775814676, "survival_time": 12.850000000000048, "driven_lanedir": 0.4287335903346605, "in-drivable-lane": 11.100000000000048, "deviation-heading": 0.4471113025730472, "distance-from-start": 0.700530494546, "deviation-center-line": 0.19876298064967188, "driven_lanedir_consec": 0.4287335903346605}, "udem-000-ego2": {"driven_any": 3.544371000196078, "survival_time": 12.850000000000048, "driven_lanedir": 1.1661377107047834, "in-drivable-lane": 8.000000000000057, "deviation-heading": 1.5098722822103623, "distance-from-start": 3.2008732967695757, "deviation-center-line": 0.34239810574848734, "driven_lanedir_consec": 0.949035137431405}, "udem-000-ego3": {"driven_any": 1.135790189557119, "survival_time": 12.850000000000048, "driven_lanedir": 0.8025316525924107, "in-drivable-lane": 9.000000000000053, "deviation-heading": 1.8197477582919823, "distance-from-start": 1.1289521292048388, "deviation-center-line": 0.24843038611658472, "driven_lanedir_consec": 0.7727247207757524}}simulation-passed 1 survival_time_max 12.850000000000048 survival_time_mean 12.850000000000048 survival_time_min 12.850000000000048
No reset possible 16333
1806
Bea Baselines 🐤template-ros lx22-objdet
sim success yes davinci-stage-01-6.2.51
2022-11-27 20:53:54+00:00 2022-11-27 20:59:57+00:00 0:06:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.250000000000068 driven_lanedir_consec_median 1.2334022328817815
other stats deviation-center-line_max 0.543567457142396 deviation-center-line_mean 0.3573533601351863 deviation-center-line_median 0.3573533601351863 deviation-center-line_min 0.17113926312797667 deviation-heading_max 2.3207860276122907 deviation-heading_mean 1.822696184278053 deviation-heading_median 1.822696184278053 deviation-heading_min 1.3246063409438151 distance-from-start_max 10.16112163305466 distance-from-start_mean 6.5893664066176045 distance-from-start_median 6.5893664066176045 distance-from-start_min 3.0176111801805487 driven_any_max 10.805715241637197 driven_any_mean 7.405819260176774 driven_any_median 7.405819260176774 driven_any_min 4.005923278716352 driven_lanedir_consec_max 2.0460098562123084 driven_lanedir_consec_mean 1.2334022328817815 driven_lanedir_consec_min 0.4207946095512547 driven_lanedir_max 2.0460098562123084 driven_lanedir_mean 1.233401748457264 driven_lanedir_median 1.233401748457264 driven_lanedir_min 0.4207936407022199 in-drivable-lane_max 29.10000000000005 in-drivable-lane_mean 20.175000000000047 in-drivable-lane_median 20.175000000000047 in-drivable-lane_min 11.250000000000044 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 4.005923278716352, "survival_time": 14.100000000000064, "driven_lanedir": 0.4207936407022199, "in-drivable-lane": 11.250000000000044, "deviation-heading": 2.3207860276122907, "distance-from-start": 3.0176111801805487, "deviation-center-line": 0.17113926312797667, "driven_lanedir_consec": 0.4207946095512547}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 10.805715241637197, "survival_time": 36.40000000000007, "driven_lanedir": 2.0460098562123084, "in-drivable-lane": 29.10000000000005, "deviation-heading": 1.3246063409438151, "distance-from-start": 10.16112163305466, "deviation-center-line": 0.543567457142396, "driven_lanedir_consec": 2.0460098562123084}}simulation-passed 1 survival_time_max 36.40000000000007 survival_time_mean 25.250000000000068 survival_time_min 14.100000000000064
No reset possible 16328
1809
Bea Baselines 🐤template-ros lx22-BV1
sim-4of5 success yes davinci-stage-01-6.2.51
2022-11-27 20:52:01+00:00 2022-11-27 20:53:27+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4543727679060994
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4543727679060994 distance-from-start_median 0.4543727679060994 distance-from-start_min 0.4543727679060994 driven_any_max 0.4554511596167776 driven_any_mean 0.4554511596167776 driven_any_median 0.4554511596167776 driven_any_min 0.4554511596167776 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.3999999999999995 in-drivable-lane_mean 2.3999999999999995 in-drivable-lane_median 2.3999999999999995 in-drivable-lane_min 2.3999999999999995 per-episodes details {"d60-ego0": {"driven_any": 0.4554511596167776, "survival_time": 2.3999999999999995, "driven_lanedir": 0.0, "in-drivable-lane": 2.3999999999999995, "deviation-heading": 0.0, "distance-from-start": 0.4543727679060994, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.3999999999999995 survival_time_mean 2.3999999999999995 survival_time_median 2.3999999999999995 survival_time_min 2.3999999999999995
No reset possible 16325
1816
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:49:19+00:00 2022-11-27 20:51:55+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2499999999999964 in-drivable-lane_median 2.3999999999999964 driven_lanedir_consec_median 0.16319399306653004 deviation-center-line_median 0.0575721771086458
other stats deviation-center-line_max 0.0575721771086458 deviation-center-line_mean 0.0575721771086458 deviation-center-line_min 0.0575721771086458 deviation-heading_max 0.5239168321767484 deviation-heading_mean 0.5239168321767484 deviation-heading_median 0.5239168321767484 deviation-heading_min 0.5239168321767484 distance-from-start_max 0.734650321223654 distance-from-start_mean 0.734650321223654 distance-from-start_median 0.734650321223654 distance-from-start_min 0.734650321223654 driven_any_max 0.7404305749525849 driven_any_mean 0.7404305749525849 driven_any_median 0.7404305749525849 driven_any_min 0.7404305749525849 driven_lanedir_consec_max 0.16319399306653004 driven_lanedir_consec_mean 0.16319399306653004 driven_lanedir_consec_min 0.16319399306653004 driven_lanedir_max 0.16319399306653004 driven_lanedir_mean 0.16319399306653004 driven_lanedir_median 0.16319399306653004 driven_lanedir_min 0.16319399306653004 in-drivable-lane_max 2.3999999999999964 in-drivable-lane_mean 2.3999999999999964 in-drivable-lane_min 2.3999999999999964 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7404305749525849, "survival_time": 3.2499999999999964, "driven_lanedir": 0.16319399306653004, "in-drivable-lane": 2.3999999999999964, "deviation-heading": 0.5239168321767484, "distance-from-start": 0.734650321223654, "deviation-center-line": 0.0575721771086458, "driven_lanedir_consec": 0.16319399306653004}}simulation-passed 1 survival_time_max 3.2499999999999964 survival_time_mean 3.2499999999999964 survival_time_min 3.2499999999999964
No reset possible 16319
1817
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:47:27+00:00 2022-11-27 20:48:59+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16315
1818
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:44:57+00:00 2022-11-27 20:47:02+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.0499999999999865 in-drivable-lane_median 5.199999999999986 driven_lanedir_consec_median 0.10410056177841698 deviation-center-line_median 0.05304793076073566
other stats deviation-center-line_max 0.05304793076073566 deviation-center-line_mean 0.05304793076073566 deviation-center-line_min 0.05304793076073566 deviation-heading_max 0.6496663324576849 deviation-heading_mean 0.6496663324576849 deviation-heading_median 0.6496663324576849 deviation-heading_min 0.6496663324576849 distance-from-start_max 1.3605296175866768 distance-from-start_mean 1.3605296175866768 distance-from-start_median 1.3605296175866768 distance-from-start_min 1.3605296175866768 driven_any_max 1.4440532105380597 driven_any_mean 1.4440532105380597 driven_any_median 1.4440532105380597 driven_any_min 1.4440532105380597 driven_lanedir_consec_max 0.10410056177841698 driven_lanedir_consec_mean 0.10410056177841698 driven_lanedir_consec_min 0.10410056177841698 driven_lanedir_max 0.10410056177841698 driven_lanedir_mean 0.10410056177841698 driven_lanedir_median 0.10410056177841698 driven_lanedir_min 0.10410056177841698 in-drivable-lane_max 5.199999999999986 in-drivable-lane_mean 5.199999999999986 in-drivable-lane_min 5.199999999999986 per-episodes details {"udem1-000-ego0": {"driven_any": 1.4440532105380597, "survival_time": 6.0499999999999865, "driven_lanedir": 0.10410056177841698, "in-drivable-lane": 5.199999999999986, "deviation-heading": 0.6496663324576849, "distance-from-start": 1.3605296175866768, "deviation-center-line": 0.05304793076073566, "driven_lanedir_consec": 0.10410056177841698}}simulation-passed 1 survival_time_max 6.0499999999999865 survival_time_mean 6.0499999999999865 survival_time_min 6.0499999999999865
No reset possible 16311
1819
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:42:45+00:00 2022-11-27 20:44:51+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.10134916144367612 survival_time_median 10.95000000000002 deviation-center-line_median 0.0525197446271717 in-drivable-lane_median 10.05000000000002
other stats deviation-center-line_max 0.0525197446271717 deviation-center-line_mean 0.0525197446271717 deviation-center-line_min 0.0525197446271717 deviation-heading_max 0.6972772439999627 deviation-heading_mean 0.6972772439999627 deviation-heading_median 0.6972772439999627 deviation-heading_min 0.6972772439999627 distance-from-start_max 2.7662073774564035 distance-from-start_mean 2.7662073774564035 distance-from-start_median 2.7662073774564035 distance-from-start_min 2.7662073774564035 driven_any_max 2.974875991519025 driven_any_mean 2.974875991519025 driven_any_median 2.974875991519025 driven_any_min 2.974875991519025 driven_lanedir_consec_max 0.10134916144367612 driven_lanedir_consec_mean 0.10134916144367612 driven_lanedir_consec_min 0.10134916144367612 driven_lanedir_max 0.10134916144367612 driven_lanedir_mean 0.10134916144367612 driven_lanedir_median 0.10134916144367612 driven_lanedir_min 0.10134916144367612 in-drivable-lane_max 10.05000000000002 in-drivable-lane_mean 10.05000000000002 in-drivable-lane_min 10.05000000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.974875991519025, "survival_time": 10.95000000000002, "driven_lanedir": 0.10134916144367612, "in-drivable-lane": 10.05000000000002, "deviation-heading": 0.6972772439999627, "distance-from-start": 2.7662073774564035, "deviation-center-line": 0.0525197446271717, "driven_lanedir_consec": 0.10134916144367612}}simulation-passed 1 survival_time_max 10.95000000000002 survival_time_mean 10.95000000000002 survival_time_min 10.95000000000002
No reset possible 16305
1821
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:38:25+00:00 2022-11-27 20:42:19+00:00 0:03:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.750000000000004 in-drivable-lane_median 8.150000000000006 driven_lanedir_consec_median 0.2849065667534627 deviation-center-line_median 0.07938954302138793
other stats deviation-center-line_max 0.24893184529085 deviation-center-line_mean 0.11822496942408184 deviation-center-line_min 0.06518894636270156 deviation-heading_max 0.7770781723006734 deviation-heading_mean 0.6782978114568425 deviation-heading_median 0.6991993994913677 deviation-heading_min 0.5377142745439614 distance-from-start_max 2.513061117781051 distance-from-start_mean 1.0096456354315737 distance-from-start_median 0.5457321381818376 distance-from-start_min 0.4340571475815683 driven_any_max 2.6458424784601764 driven_any_mean 1.0437215293829545 driven_any_median 0.5473340711007557 driven_any_min 0.4343754968701295 driven_lanedir_consec_max 0.5589149996980953 driven_lanedir_consec_mean 0.3136748111149514 driven_lanedir_consec_min 0.12597111125478477 driven_lanedir_max 0.5589149996980953 driven_lanedir_mean 0.3136748111149514 driven_lanedir_median 0.2849065667534627 driven_lanedir_min 0.12597111125478477 in-drivable-lane_max 8.850000000000003 in-drivable-lane_mean 6.287500000000003 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.45453130211118586, "survival_time": 9.750000000000004, "driven_lanedir": 0.13577636462690013, "in-drivable-lane": 8.800000000000004, "deviation-heading": 0.6485703152343104, "distance-from-start": 0.4536304706659993, "deviation-center-line": 0.06518894636270156, "driven_lanedir_consec": 0.13577636462690013}, "autolab-000-ego1": {"driven_any": 2.6458424784601764, "survival_time": 9.750000000000004, "driven_lanedir": 0.5589149996980953, "in-drivable-lane": 7.500000000000008, "deviation-heading": 0.7498284837484249, "distance-from-start": 2.513061117781051, "deviation-center-line": 0.24893184529085, "driven_lanedir_consec": 0.5589149996980953}, "autolab-000-ego2": {"driven_any": 0.4343754968701295, "survival_time": 9.750000000000004, "driven_lanedir": 0.4340367688800253, "in-drivable-lane": 0.0, "deviation-heading": 0.7770781723006734, "distance-from-start": 0.4340571475815683, "deviation-center-line": 0.07413065691258286, "driven_lanedir_consec": 0.4340367688800253}, "autolab-000-ego3": {"driven_any": 0.6401368400903256, "survival_time": 9.750000000000004, "driven_lanedir": 0.12597111125478477, "in-drivable-lane": 8.850000000000003, "deviation-heading": 0.5377142745439614, "distance-from-start": 0.637833805697676, "deviation-center-line": 0.08464842913019299, "driven_lanedir_consec": 0.12597111125478477}}simulation-passed 1 survival_time_max 9.750000000000004 survival_time_mean 9.750000000000004 survival_time_min 9.750000000000004
No reset possible 16300
1822
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:36:22+00:00 2022-11-27 20:38:05+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.09999999999999 in-drivable-lane_median 3.5499999999999927 driven_lanedir_consec_median 0.18390444865259023 deviation-center-line_median 0.12133951375165332
other stats deviation-center-line_max 0.12133951375165332 deviation-center-line_mean 0.12133951375165332 deviation-center-line_min 0.12133951375165332 deviation-heading_max 1.5513388943141628 deviation-heading_mean 1.5513388943141628 deviation-heading_median 1.5513388943141628 deviation-heading_min 1.5513388943141628 distance-from-start_max 1.2043108248283017 distance-from-start_mean 1.2043108248283017 distance-from-start_median 1.2043108248283017 distance-from-start_min 1.2043108248283017 driven_any_max 1.2598362442146822 driven_any_mean 1.2598362442146822 driven_any_median 1.2598362442146822 driven_any_min 1.2598362442146822 driven_lanedir_consec_max 0.18390444865259023 driven_lanedir_consec_mean 0.18390444865259023 driven_lanedir_consec_min 0.18390444865259023 driven_lanedir_max 0.18390444865259023 driven_lanedir_mean 0.18390444865259023 driven_lanedir_median 0.18390444865259023 driven_lanedir_min 0.18390444865259023 in-drivable-lane_max 3.5499999999999927 in-drivable-lane_mean 3.5499999999999927 in-drivable-lane_min 3.5499999999999927 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.2598362442146822, "survival_time": 5.09999999999999, "driven_lanedir": 0.18390444865259023, "in-drivable-lane": 3.5499999999999927, "deviation-heading": 1.5513388943141628, "distance-from-start": 1.2043108248283017, "deviation-center-line": 0.12133951375165332, "driven_lanedir_consec": 0.18390444865259023}}simulation-passed 1 survival_time_max 5.09999999999999 survival_time_mean 5.09999999999999 survival_time_min 5.09999999999999
No reset possible 16298
1822
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:34:45+00:00 2022-11-27 20:36:15+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.899999999999987 in-drivable-lane_median 4.949999999999987 driven_lanedir_consec_median 0.1409947408219938 deviation-center-line_median 0.067766451412658
other stats deviation-center-line_max 0.067766451412658 deviation-center-line_mean 0.067766451412658 deviation-center-line_min 0.067766451412658 deviation-heading_max 0.6451278321647893 deviation-heading_mean 0.6451278321647893 deviation-heading_median 0.6451278321647893 deviation-heading_min 0.6451278321647893 distance-from-start_max 1.4996050470586424 distance-from-start_mean 1.4996050470586424 distance-from-start_median 1.4996050470586424 distance-from-start_min 1.4996050470586424 driven_any_max 1.511912650132615 driven_any_mean 1.511912650132615 driven_any_median 1.511912650132615 driven_any_min 1.511912650132615 driven_lanedir_consec_max 0.1409947408219938 driven_lanedir_consec_mean 0.1409947408219938 driven_lanedir_consec_min 0.1409947408219938 driven_lanedir_max 0.1409947408219938 driven_lanedir_mean 0.1409947408219938 driven_lanedir_median 0.1409947408219938 driven_lanedir_min 0.1409947408219938 in-drivable-lane_max 4.949999999999987 in-drivable-lane_mean 4.949999999999987 in-drivable-lane_min 4.949999999999987 per-episodes details {"loop-000-ego0": {"driven_any": 1.511912650132615, "survival_time": 5.899999999999987, "driven_lanedir": 0.1409947408219938, "in-drivable-lane": 4.949999999999987, "deviation-heading": 0.6451278321647893, "distance-from-start": 1.4996050470586424, "deviation-center-line": 0.067766451412658, "driven_lanedir_consec": 0.1409947408219938}}simulation-passed 1 survival_time_max 5.899999999999987 survival_time_mean 5.899999999999987 survival_time_min 5.899999999999987
No reset possible 16293
1848
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success yes davinci-stage-01-6.2.51
2022-11-27 20:30:36+00:00 2022-11-27 20:34:19+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 2.468563747469079
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 2.468563747469079 distance-from-start_median 2.468563747469079 distance-from-start_min 2.468563747469079 driven_any_max 2.508076473577293 driven_any_mean 2.508076473577293 driven_any_median 2.508076473577293 driven_any_min 2.508076473577293 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 21.250000000000167 in-drivable-lane_mean 21.250000000000167 in-drivable-lane_median 21.250000000000167 in-drivable-lane_min 21.250000000000167 per-episodes details {"d40-ego0": {"driven_any": 2.508076473577293, "survival_time": 21.250000000000167, "driven_lanedir": 0.0, "in-drivable-lane": 21.250000000000167, "deviation-heading": 0.0, "distance-from-start": 2.468563747469079, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 21.250000000000167 survival_time_mean 21.250000000000167 survival_time_median 21.250000000000167 survival_time_min 21.250000000000167
No reset possible 16291
1843
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:28:56+00:00 2022-11-27 20:30:27+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16287
1844
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-1of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:27:32+00:00 2022-11-27 20:28:33+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16282
1845
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:24:33+00:00 2022-11-27 20:26:21+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16275
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-3of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:22:10+00:00 2022-11-27 20:23:52+00:00 0:01:42 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16270
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-0of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:20:06+00:00 2022-11-27 20:21:35+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16267
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success yes davinci-stage-01-6.2.51
2022-11-27 20:18:09+00:00 2022-11-27 20:19:43+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.8745882772962291
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.8745882772962291 distance-from-start_median 0.8745882772962291 distance-from-start_min 0.8745882772962291 driven_any_max 0.9755426386362192 driven_any_mean 0.9755426386362192 driven_any_median 0.9755426386362192 driven_any_min 0.9755426386362192 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.7499999999999942 in-drivable-lane_mean 3.7499999999999942 in-drivable-lane_median 3.7499999999999942 in-drivable-lane_min 3.7499999999999942 per-episodes details {"d40-ego0": {"driven_any": 0.9755426386362192, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.8745882772962291, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_median 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 16263
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-01-6.2.51
2022-11-27 20:15:55+00:00 2022-11-27 20:17:41+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6177600080595083
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6177600080595083 distance-from-start_median 0.6177600080595083 distance-from-start_min 0.6177600080595083 driven_any_max 0.6177600080595129 driven_any_mean 0.6177600080595129 driven_any_median 0.6177600080595129 driven_any_min 0.6177600080595129 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.899999999999994 in-drivable-lane_mean 3.899999999999994 in-drivable-lane_median 3.899999999999994 in-drivable-lane_min 3.899999999999994 per-episodes details {"d45-ego0": {"driven_any": 0.6177600080595129, "survival_time": 3.899999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 3.899999999999994, "deviation-heading": 0.0, "distance-from-start": 0.6177600080595083, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 3.899999999999994 survival_time_median 3.899999999999994 survival_time_min 3.899999999999994
No reset possible 16255
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 aborted no davinci-stage-01-6.2.51
2022-11-27 20:13:55+00:00 2022-11-27 20:15:04+00:00 0:01:09 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16249
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-2of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:11:51+00:00 2022-11-27 20:13:29+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16245
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-0of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:10:00+00:00 2022-11-27 20:11:45+00:00 0:01:45 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16241
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 20:08:12+00:00 2022-11-27 20:09:46+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16236
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-0of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:06:15+00:00 2022-11-27 20:07:57+00:00 0:01:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16231
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-1of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:04:54+00:00 2022-11-27 20:05:52+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16225
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-0of4 failed yes davinci-stage-01-6.2.51
2022-11-27 20:02:50+00:00 2022-11-27 20:04:33+00:00 0:01:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16215
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-0of4 success yes davinci-stage-01-6.2.51
2022-11-27 19:54:43+00:00 2022-11-27 20:02:34+00:00 0:07:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.9403727836875286 survival_time_median 59.99999999999873 deviation-center-line_median 3.35246588475966 in-drivable-lane_median 23.199999999999378
other stats deviation-center-line_max 3.35246588475966 deviation-center-line_mean 3.35246588475966 deviation-center-line_min 3.35246588475966 deviation-heading_max 28.12162617098523 deviation-heading_mean 28.12162617098523 deviation-heading_median 28.12162617098523 deviation-heading_min 28.12162617098523 distance-from-start_max 0.15105455166361306 distance-from-start_mean 0.15105455166361306 distance-from-start_median 0.15105455166361306 distance-from-start_min 0.15105455166361306 driven_any_max 10.926237497126593 driven_any_mean 10.926237497126593 driven_any_median 10.926237497126593 driven_any_min 10.926237497126593 driven_lanedir_consec_max -2.9403727836875286 driven_lanedir_consec_mean -2.9403727836875286 driven_lanedir_consec_min -2.9403727836875286 driven_lanedir_max -2.9403727836875286 driven_lanedir_mean -2.9403727836875286 driven_lanedir_median -2.9403727836875286 driven_lanedir_min -2.9403727836875286 in-drivable-lane_max 23.199999999999378 in-drivable-lane_mean 23.199999999999378 in-drivable-lane_min 23.199999999999378 per-episodes details {"autolab-000-ego0": {"driven_any": 10.926237497126593, "survival_time": 59.99999999999873, "driven_lanedir": -2.9403727836875286, "in-drivable-lane": 23.199999999999378, "deviation-heading": 28.12162617098523, "distance-from-start": 0.15105455166361306, "deviation-center-line": 3.35246588475966, "driven_lanedir_consec": -2.9403727836875286}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16211
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-3of4 timeout yes davinci-stage-01-6.2.51
2022-11-27 19:52:10+00:00 2022-11-27 19:54:23+00:00 0:02:13 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16200
1598
Andrea Daniele lx22-modcon lx22-modcon
sim success yes davinci-stage-01-6.2.51
2022-11-27 07:00:13+00:00 2022-11-27 07:09:36+00:00 0:09:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 37.42499999999947 deviation-center-line_median 0.4152940129174528 driven_lanedir_consec_median 0.23397617855895925 survival_time_median 41.54999999999946
other stats deviation-center-line_max 0.4251983444667487 deviation-center-line_mean 0.4152940129174528 deviation-center-line_min 0.4053896813681569 deviation-heading_max 4.970970633349435 deviation-heading_mean 4.701761795986769 deviation-heading_median 4.701761795986769 deviation-heading_min 4.432552958624103 distance-from-start_max 2.0050282270334088 distance-from-start_mean 1.7451506892860853 distance-from-start_median 1.7451506892860853 distance-from-start_min 1.485273151538762 driven_any_max 8.330764789573013 driven_any_mean 5.7069415029122395 driven_any_median 5.7069415029122395 driven_any_min 3.0831182162514654 driven_lanedir_consec_max 0.2994970154807519 driven_lanedir_consec_mean 0.23397617855895925 driven_lanedir_consec_min 0.16845534163716658 driven_lanedir_max 0.2994970154807519 driven_lanedir_mean 0.2344507624273412 driven_lanedir_median 0.2344507624273412 driven_lanedir_min 0.16940450937393048 in-drivable-lane_max 56.049999999998775 in-drivable-lane_mean 37.42499999999947 in-drivable-lane_min 18.80000000000017 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 3.0831182162514654, "survival_time": 23.100000000000193, "driven_lanedir": 0.2994970154807519, "in-drivable-lane": 18.80000000000017, "deviation-heading": 4.432552958624103, "distance-from-start": 2.0050282270334088, "deviation-center-line": 0.4251983444667487, "driven_lanedir_consec": 0.2994970154807519}, "LF-full-loop-001-ego0": {"driven_any": 8.330764789573013, "survival_time": 59.99999999999873, "driven_lanedir": 0.16940450937393048, "in-drivable-lane": 56.049999999998775, "deviation-heading": 4.970970633349435, "distance-from-start": 1.485273151538762, "deviation-center-line": 0.4053896813681569, "driven_lanedir_consec": 0.16845534163716658}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 41.54999999999946 survival_time_min 23.100000000000193
No reset possible 16198
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-01-6.2.51
2022-11-27 03:48:10+00:00 2022-11-27 03:56:29+00:00 0:08:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16194
1591
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-test
step1-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:49:37+00:00 2022-11-27 00:50:12+00:00 0:00:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16193
1591
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-test
step1-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:48:40+00:00 2022-11-27 00:49:14+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16191
1591
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-test
step1-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:47:56+00:00 2022-11-27 00:48:25+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16187
1585
Andrea Daniele planning-exercise lx22-planning-dd-dynamic-vali
step1-1of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:46:40+00:00 2022-11-27 00:47:29+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16167
1587
Andrea Daniele planning-exercise lx22-planning-dd-empty-vali
step1 success yes davinci-stage-01-6.2.51
2022-11-27 00:29:42+00:00 2022-11-27 00:46:19+00:00 0:16:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.9629629629629628 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16165
1588
Andrea Daniele planning-exercise lx22-planning-cc-dynamic-vali
step1-3of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:28:59+00:00 2022-11-27 00:29:34+00:00 0:00:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16162
1589
Andrea Daniele planning-exercise lx22-planning-cc-static-vali
step1-2of4 success yes davinci-stage-01-6.2.51
2022-11-27 00:27:37+00:00 2022-11-27 00:28:27+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16158
1584
Andrea Censi exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-01-6.2.51
2022-11-26 23:26:00+00:00 2022-11-26 23:35:41+00:00 0:09:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16153
1576
Andrea Censi planning-exercise lx22-planning-dd-dynamic-test
step1-1of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:46:46+00:00 2022-11-26 22:47:35+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16152
1576
Andrea Censi planning-exercise lx22-planning-dd-dynamic-test
step1-3of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:45:46+00:00 2022-11-26 22:46:32+00:00 0:00:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16147
1577
Andrea Censi planning-exercise lx22-planning-dd-static-test
step1-0of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:40:51+00:00 2022-11-26 22:45:40+00:00 0:04:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16144
1577
Andrea Censi planning-exercise lx22-planning-dd-static-test
step1-2of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:36:19+00:00 2022-11-26 22:40:45+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16124
1572
Andrea Censi planning-exercise lx22-planning-dd-empty-vali
step1 success yes davinci-stage-01-6.2.51
2022-11-26 22:18:54+00:00 2022-11-26 22:35:53+00:00 0:16:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.9629629629629628 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16123
1573
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-3of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:17:59+00:00 2022-11-26 22:18:46+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16119
1574
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-3of4 success yes davinci-stage-01-6.2.51
2022-11-26 22:14:49+00:00 2022-11-26 22:17:29+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16111
1558
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-1of4 error yes davinci-stage-01-6.2.51
2022-11-26 20:59:42+00:00 2022-11-26 21:16:48+00:00 0:17:06 Waited 1006 seconds [...] Waited 1006 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16107
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-2of4 failed yes davinci-stage-01-6.2.51
2022-11-26 20:58:35+00:00 2022-11-26 20:59:14+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16099
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-2of4 failed yes davinci-stage-01-6.2.51
2022-11-26 20:57:42+00:00 2022-11-26 20:58:21+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16096
1563
Andrea Censi planning-exercise lx22-planning-cc-empty-vali
step1 failed yes davinci-stage-01-6.2.51
2022-11-26 20:54:08+00:00 2022-11-26 20:57:20+00:00 0:03:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16091
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-01-6.2.51
2022-11-26 19:41:57+00:00 2022-11-26 19:51:53+00:00 0:09:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16084
1556
Frank (Chude) Qian exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-01-6.2.51
2022-11-26 19:17:53+00:00 2022-11-26 19:25:55+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16081
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 host-error no davinci-stage-01-6.2.51
2022-11-25 17:16:29+00:00 2022-11-25 17:18:15+00:00 0:01:46 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-01-6.2.51-job16081-191036, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-01-6.2.51-job16081-191036', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16076
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 16:29:15+00:00 2022-11-25 16:42:28+00:00 0:13:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 33.9249999999991 driven_lanedir_consec_median -2.7770763659602773 deviation-center-line_median 2.412298641231417
other stats deviation-center-line_max 2.5188026432482276 deviation-center-line_mean 2.412298641231417 deviation-center-line_min 2.3057946392146063 deviation-heading_max 23.164084755023524 deviation-heading_mean 22.952000922468727 deviation-heading_median 22.952000922468727 deviation-heading_min 22.739917089913927 distance-from-start_max 0.16603949728298367 distance-from-start_mean 0.1525400346461364 distance-from-start_median 0.1525400346461364 distance-from-start_min 0.1390405720092891 driven_any_max 11.450035024572966 driven_any_mean 11.37551771562872 driven_any_median 11.37551771562872 driven_any_min 11.301000406684471 driven_lanedir_consec_max -2.7050710539892298 driven_lanedir_consec_mean -2.7770763659602773 driven_lanedir_consec_min -2.8490816779313253 driven_lanedir_max -2.7050710539892298 driven_lanedir_mean -2.8896476827916526 driven_lanedir_median -2.8896476827916526 driven_lanedir_min -3.074224311594075 in-drivable-lane_max 34.199999999999065 in-drivable-lane_mean 33.9249999999991 in-drivable-lane_min 33.64999999999914 per-episodes details {"loop2-000-ego0": {"driven_any": 11.450035024572966, "survival_time": 59.99999999999873, "driven_lanedir": -3.074224311594075, "in-drivable-lane": 34.199999999999065, "deviation-heading": 22.739917089913927, "distance-from-start": 0.16603949728298367, "deviation-center-line": 2.3057946392146063, "driven_lanedir_consec": -2.8490816779313253}, "loop2-000-ego1": {"driven_any": 11.301000406684471, "survival_time": 59.99999999999873, "driven_lanedir": -2.7050710539892298, "in-drivable-lane": 33.64999999999914, "deviation-heading": 23.164084755023524, "distance-from-start": 0.1390405720092891, "deviation-center-line": 2.5188026432482276, "driven_lanedir_consec": -2.7050710539892298}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16072
386
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 16:19:46+00:00 2022-11-25 16:29:01+00:00 0:09:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.299999999999297 driven_lanedir_consec_median -3.196034287238012 deviation-center-line_median 3.579442790415117
other stats deviation-center-line_max 3.579442790415117 deviation-center-line_mean 3.579442790415117 deviation-center-line_min 3.579442790415117 deviation-heading_max 28.76597102979224 deviation-heading_mean 28.76597102979224 deviation-heading_median 28.76597102979224 deviation-heading_min 28.76597102979224 distance-from-start_max 0.2095546452915397 distance-from-start_mean 0.2095546452915397 distance-from-start_median 0.2095546452915397 distance-from-start_min 0.2095546452915397 driven_any_max 12.533938926311738 driven_any_mean 12.533938926311738 driven_any_median 12.533938926311738 driven_any_min 12.533938926311738 driven_lanedir_consec_max -3.196034287238012 driven_lanedir_consec_mean -3.196034287238012 driven_lanedir_consec_min -3.196034287238012 driven_lanedir_max -3.637704015939586 driven_lanedir_mean -3.637704015939586 driven_lanedir_median -3.637704015939586 driven_lanedir_min -3.637704015939586 in-drivable-lane_max 23.299999999999297 in-drivable-lane_mean 23.299999999999297 in-drivable-lane_min 23.299999999999297 per-episodes details {"loop-000-ego0": {"driven_any": 12.533938926311738, "survival_time": 59.99999999999873, "driven_lanedir": -3.637704015939586, "in-drivable-lane": 23.299999999999297, "deviation-heading": 28.76597102979224, "distance-from-start": 0.2095546452915397, "deviation-center-line": 3.579442790415117, "driven_lanedir_consec": -3.196034287238012}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16069
387
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 16:08:54+00:00 2022-11-25 16:19:32+00:00 0:10:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.649999999999174 driven_lanedir_consec_median -2.857292356092006 deviation-center-line_median 2.591593082417518
other stats deviation-center-line_max 2.591593082417518 deviation-center-line_mean 2.591593082417518 deviation-center-line_min 2.591593082417518 deviation-heading_max 25.055641134867017 deviation-heading_mean 25.055641134867017 deviation-heading_median 25.055641134867017 deviation-heading_min 25.055641134867017 distance-from-start_max 0.16730126606932008 distance-from-start_mean 0.16730126606932008 distance-from-start_median 0.16730126606932008 distance-from-start_min 0.16730126606932008 driven_any_max 11.018743306167394 driven_any_mean 11.018743306167394 driven_any_median 11.018743306167394 driven_any_min 11.018743306167394 driven_lanedir_consec_max -2.857292356092006 driven_lanedir_consec_mean -2.857292356092006 driven_lanedir_consec_min -2.857292356092006 driven_lanedir_max -3.0868523952094886 driven_lanedir_mean -3.0868523952094886 driven_lanedir_median -3.0868523952094886 driven_lanedir_min -3.0868523952094886 in-drivable-lane_max 30.649999999999174 in-drivable-lane_mean 30.649999999999174 in-drivable-lane_min 30.649999999999174 per-episodes details {"loop2-000-ego0": {"driven_any": 11.018743306167394, "survival_time": 59.99999999999873, "driven_lanedir": -3.0868523952094886, "in-drivable-lane": 30.649999999999174, "deviation-heading": 25.055641134867017, "distance-from-start": 0.16730126606932008, "deviation-center-line": 2.591593082417518, "driven_lanedir_consec": -2.857292356092006}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16056
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 15:38:23+00:00 2022-11-25 16:08:33+00:00 0:30:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 12.599999999999696 driven_lanedir_consec_median -2.863281828905863 deviation-center-line_median 4.776067249624486
other stats deviation-center-line_max 5.11414337937269 deviation-center-line_mean 4.717207661047479 deviation-center-line_min 4.202552765568254 deviation-heading_max 31.46560514615706 deviation-heading_mean 24.586281597539376 deviation-heading_median 24.73682021261793 deviation-heading_min 17.40588081876458 distance-from-start_max 0.20290713192875612 distance-from-start_mean 0.18003665780836445 distance-from-start_median 0.18432231524037357 distance-from-start_min 0.1485948688239545 driven_any_max 13.333268205480003 driven_any_mean 8.457054115274536 driven_any_median 9.811924088069397 driven_any_min 0.8711000794793509 driven_lanedir_consec_max -0.07511157662120338 driven_lanedir_consec_mean -2.4401661799697707 driven_lanedir_consec_min -3.9589894854461543 driven_lanedir_max -0.07511157662120338 driven_lanedir_mean -3.74431150748842 driven_lanedir_median -4.118904857438202 driven_lanedir_min -6.664324738456072 in-drivable-lane_max 18.699999999999953 in-drivable-lane_mean 11.262499999999834 in-drivable-lane_min 1.149999999999996 per-episodes details {"4way-000-ego0": {"driven_any": 9.454065999153103, "survival_time": 59.99999999999873, "driven_lanedir": -3.4061648433756044, "in-drivable-lane": 18.699999999999953, "deviation-heading": 17.40588081876458, "distance-from-start": 0.16903165566734005, "deviation-center-line": 4.793468166002499, "driven_lanedir_consec": -2.976064430513107}, "4way-000-ego1": {"driven_any": 0.8711000794793509, "survival_time": 59.99999999999873, "driven_lanedir": -0.07511157662120338, "in-drivable-lane": 1.149999999999996, "deviation-heading": 21.268258551162123, "distance-from-start": 0.1485948688239545, "deviation-center-line": 5.11414337937269, "driven_lanedir_consec": -0.07511157662120338}, "4way-000-ego2": {"driven_any": 13.333268205480003, "survival_time": 59.99999999999873, "driven_lanedir": -6.664324738456072, "in-drivable-lane": 14.699999999999536, "deviation-heading": 31.46560514615706, "distance-from-start": 0.1996129748134071, "deviation-center-line": 4.202552765568254, "driven_lanedir_consec": -3.9589894854461543}, "4way-000-ego3": {"driven_any": 10.169782176985684, "survival_time": 59.99999999999873, "driven_lanedir": -4.831644871500799, "in-drivable-lane": 10.499999999999853, "deviation-heading": 28.20538187407373, "distance-from-start": 0.20290713192875612, "deviation-center-line": 4.758666333246474, "driven_lanedir_consec": -2.7504992272986186}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16046
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 15:05:29+00:00 2022-11-25 15:38:06+00:00 0:32:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 29.149999999999224 driven_lanedir_consec_median -2.684539079413186 deviation-center-line_median 2.9262405312388093
other stats deviation-center-line_max 3.371517294001455 deviation-center-line_mean 2.8117784453718597 deviation-center-line_min 2.0231154250083643 deviation-heading_max 26.89680317409823 deviation-heading_mean 24.991513714913506 deviation-heading_median 26.02062834812541 deviation-heading_min 21.027994989304965 distance-from-start_max 0.17528506879859054 distance-from-start_mean 0.16022125785826274 distance-from-start_median 0.16060510670024614 distance-from-start_min 0.1443897492339681 driven_any_max 12.127345474902253 driven_any_mean 11.646848825786869 driven_any_median 11.590068342495638 driven_any_min 11.27991314325394 driven_lanedir_consec_max -2.5797326192691035 driven_lanedir_consec_mean -2.864906328045412 driven_lanedir_consec_min -3.5108145340861734 driven_lanedir_max -2.5797326192691035 driven_lanedir_mean -2.864906328045412 driven_lanedir_median -2.684539079413186 driven_lanedir_min -3.5108145340861734 in-drivable-lane_max 36.79999999999899 in-drivable-lane_mean 30.73749999999916 in-drivable-lane_min 27.84999999999921 per-episodes details {"loop-000-ego0": {"driven_any": 11.382278058293688, "survival_time": 59.99999999999873, "driven_lanedir": -2.6997540559944606, "in-drivable-lane": 27.84999999999921, "deviation-heading": 26.322959144755792, "distance-from-start": 0.15560906054336457, "deviation-center-line": 3.2270908230144792, "driven_lanedir_consec": -2.6997540559944606}, "loop-000-ego1": {"driven_any": 12.127345474902253, "survival_time": 59.99999999999873, "driven_lanedir": -2.669324102831911, "in-drivable-lane": 30.199999999999157, "deviation-heading": 26.89680317409823, "distance-from-start": 0.17528506879859054, "deviation-center-line": 3.371517294001455, "driven_lanedir_consec": -2.669324102831911}, "loop-000-ego2": {"driven_any": 11.27991314325394, "survival_time": 59.99999999999873, "driven_lanedir": -2.5797326192691035, "in-drivable-lane": 36.79999999999899, "deviation-heading": 21.027994989304965, "distance-from-start": 0.1443897492339681, "deviation-center-line": 2.0231154250083643, "driven_lanedir_consec": -2.5797326192691035}, "loop-000-ego3": {"driven_any": 11.797858626697588, "survival_time": 59.99999999999873, "driven_lanedir": -3.5108145340861734, "in-drivable-lane": 28.09999999999929, "deviation-heading": 25.71829755149502, "distance-from-start": 0.16560115285712768, "deviation-center-line": 2.625390239463139, "driven_lanedir_consec": -3.5108145340861734}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16042
393
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 14:58:31+00:00 2022-11-25 15:05:08+00:00 0:06:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.49999999999935 driven_lanedir_consec_median -2.0129507942909655 deviation-center-line_median 3.512411455393321
other stats deviation-center-line_max 3.512411455393321 deviation-center-line_mean 3.512411455393321 deviation-center-line_min 3.512411455393321 deviation-heading_max 27.427351732588967 deviation-heading_mean 27.427351732588967 deviation-heading_median 27.427351732588967 deviation-heading_min 27.427351732588967 distance-from-start_max 0.19959328591445233 distance-from-start_mean 0.19959328591445233 distance-from-start_median 0.19959328591445233 distance-from-start_min 0.19959328591445233 driven_any_max 10.183511929135332 driven_any_mean 10.183511929135332 driven_any_median 10.183511929135332 driven_any_min 10.183511929135332 driven_lanedir_consec_max -2.0129507942909655 driven_lanedir_consec_mean -2.0129507942909655 driven_lanedir_consec_min -2.0129507942909655 driven_lanedir_max -2.0129507942909655 driven_lanedir_mean -2.0129507942909655 driven_lanedir_median -2.0129507942909655 driven_lanedir_min -2.0129507942909655 in-drivable-lane_max 23.49999999999935 in-drivable-lane_mean 23.49999999999935 in-drivable-lane_min 23.49999999999935 per-episodes details {"loop2-000-ego0": {"driven_any": 10.183511929135332, "survival_time": 59.99999999999873, "driven_lanedir": -2.0129507942909655, "in-drivable-lane": 23.49999999999935, "deviation-heading": 27.427351732588967, "distance-from-start": 0.19959328591445233, "deviation-center-line": 3.512411455393321, "driven_lanedir_consec": -2.0129507942909655}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16027
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 14:34:35+00:00 2022-11-25 14:58:02+00:00 0:23:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 6.525000000000046 driven_lanedir_consec_median -0.9896772477322192 deviation-center-line_median 3.705202275234573
other stats deviation-center-line_max 4.272572810857424 deviation-center-line_mean 3.5290393084888168 deviation-center-line_min 2.4331798726286977 deviation-heading_max 31.180173221530712 deviation-heading_mean 27.519695941219197 deviation-heading_median 27.601374495597057 deviation-heading_min 23.69586155215195 distance-from-start_max 0.17644903899474948 distance-from-start_mean 0.16423793351331345 distance-from-start_median 0.162857766664558 distance-from-start_min 0.15478716172938828 driven_any_max 12.70771801025503 driven_any_mean 5.501389197241191 driven_any_median 3.785243756092511 driven_any_min 1.7273512665247113 driven_lanedir_consec_max -0.4143576732618106 driven_lanedir_consec_mean -1.2725149336547552 driven_lanedir_consec_min -2.696347565892772 driven_lanedir_max -0.4143576732618106 driven_lanedir_mean -1.3437875650054498 driven_lanedir_median -1.132222510433608 driven_lanedir_min -2.696347565892772 in-drivable-lane_max 34.99999999999909 in-drivable-lane_mean 12.774999999999794 in-drivable-lane_min 3.0499999999999954 per-episodes details {"4way-000-ego0": {"driven_any": 3.858211516646764, "survival_time": 59.99999999999873, "driven_lanedir": -1.068956939902514, "in-drivable-lane": 7.000000000000046, "deviation-heading": 25.972793624986046, "distance-from-start": 0.16208265763827598, "deviation-center-line": 3.696975684813417, "driven_lanedir_consec": -1.0769327662245658}, "4way-000-ego1": {"driven_any": 1.7273512665247113, "survival_time": 59.99999999999873, "driven_lanedir": -0.4143576732618106, "in-drivable-lane": 3.0499999999999954, "deviation-heading": 31.180173221530712, "distance-from-start": 0.15478716172938828, "deviation-center-line": 4.272572810857424, "driven_lanedir_consec": -0.4143576732618106}, "4way-000-ego2": {"driven_any": 3.7122759955382585, "survival_time": 59.99999999999873, "driven_lanedir": -1.1954880809647022, "in-drivable-lane": 6.050000000000045, "deviation-heading": 29.22995536620807, "distance-from-start": 0.16363287569084004, "deviation-center-line": 3.713428865655728, "driven_lanedir_consec": -0.9024217292398724}, "4way-000-ego3": {"driven_any": 12.70771801025503, "survival_time": 59.99999999999873, "driven_lanedir": -2.696347565892772, "in-drivable-lane": 34.99999999999909, "deviation-heading": 23.69586155215195, "distance-from-start": 0.17644903899474948, "deviation-center-line": 2.4331798726286977, "driven_lanedir_consec": -2.696347565892772}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16022
514
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-validation
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 14:33:03+00:00 2022-11-25 14:34:15+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16018
515
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-validation
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 14:31:59+00:00 2022-11-25 14:32:56+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16013
517
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-validation
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 14:29:49+00:00 2022-11-25 14:31:23+00:00 0:01:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16007
518
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 14:28:12+00:00 2022-11-25 14:29:42+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15971
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 14:05:51+00:00 2022-11-25 14:28:00+00:00 0:22:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.599999999999989 driven_lanedir_consec_median 8.283101657007226 deviation-center-line_median 2.81569487416211
other stats deviation-center-line_max 3.366040337440521 deviation-center-line_mean 2.8084207461921715 deviation-center-line_min 2.2362528990039436 deviation-heading_max 13.036949591966913 deviation-heading_mean 12.643661848108213 deviation-heading_median 12.603104422371972 deviation-heading_min 12.331488955721989 distance-from-start_max 4.4708423214946595 distance-from-start_mean 4.103099249702124 distance-from-start_median 4.122749108101148 distance-from-start_min 3.69605646111154 driven_any_max 9.19962757695862 driven_any_mean 8.9325958288158 driven_any_median 8.906394744347605 driven_any_min 8.717966249609367 driven_lanedir_consec_max 8.587617836733164 driven_lanedir_consec_mean 8.265157308482484 driven_lanedir_consec_min 7.906808083182322 driven_lanedir_max 8.587617836733164 driven_lanedir_mean 8.265157308482484 driven_lanedir_median 8.283101657007226 driven_lanedir_min 7.906808083182322 in-drivable-lane_max 2.4499999999998607 in-drivable-lane_mean 1.4874999999999607 in-drivable-lane_min 0.30000000000000426 per-episodes details {"zigzag-000-ego0": {"driven_any": 8.717966249609367, "survival_time": 59.99999999999873, "driven_lanedir": 8.106186612248358, "in-drivable-lane": 1.299999999999983, "deviation-heading": 12.331488955721989, "distance-from-start": 3.69605646111154, "deviation-center-line": 2.4936480479289194, "driven_lanedir_consec": 8.106186612248358}, "zigzag-000-ego1": {"driven_any": 9.062305142244822, "survival_time": 59.99999999999873, "driven_lanedir": 8.587617836733164, "in-drivable-lane": 0.30000000000000426, "deviation-heading": 12.559101352088446, "distance-from-start": 3.791648741039917, "deviation-center-line": 2.2362528990039436, "driven_lanedir_consec": 8.587617836733164}, "zigzag-000-ego2": {"driven_any": 9.19962757695862, "survival_time": 59.99999999999873, "driven_lanedir": 8.460016701766094, "in-drivable-lane": 1.899999999999995, "deviation-heading": 12.6471074926555, "distance-from-start": 4.4708423214946595, "deviation-center-line": 3.366040337440521, "driven_lanedir_consec": 8.460016701766094}, "zigzag-000-ego3": {"driven_any": 8.750484346450387, "survival_time": 59.99999999999873, "driven_lanedir": 7.906808083182322, "in-drivable-lane": 2.4499999999998607, "deviation-heading": 13.036949591966913, "distance-from-start": 4.45384947516238, "deviation-center-line": 3.1377417003953005, "driven_lanedir_consec": 7.906808083182322}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15967
529
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 14:02:10+00:00 2022-11-25 14:05:15+00:00 0:03:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.800000000000175 in-drivable-lane_median 0.5000000000000071 driven_lanedir_consec_median 3.6676111292020326 deviation-center-line_median 1.3311642298419055
other stats deviation-center-line_max 1.3311642298419055 deviation-center-line_mean 1.3311642298419055 deviation-center-line_min 1.3311642298419055 deviation-heading_max 6.2720072444351 deviation-heading_mean 6.2720072444351 deviation-heading_median 6.2720072444351 deviation-heading_min 6.2720072444351 distance-from-start_max 2.1401500491681413 distance-from-start_mean 2.1401500491681413 distance-from-start_median 2.1401500491681413 distance-from-start_min 2.1401500491681413 driven_any_max 4.028239102882528 driven_any_mean 4.028239102882528 driven_any_median 4.028239102882528 driven_any_min 4.028239102882528 driven_lanedir_consec_max 3.6676111292020326 driven_lanedir_consec_mean 3.6676111292020326 driven_lanedir_consec_min 3.6676111292020326 driven_lanedir_max 3.6676111292020326 driven_lanedir_mean 3.6676111292020326 driven_lanedir_median 3.6676111292020326 driven_lanedir_min 3.6676111292020326 in-drivable-lane_max 0.5000000000000071 in-drivable-lane_mean 0.5000000000000071 in-drivable-lane_min 0.5000000000000071 per-episodes details {"loop-000-ego0": {"driven_any": 4.028239102882528, "survival_time": 21.800000000000175, "driven_lanedir": 3.6676111292020326, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 6.2720072444351, "distance-from-start": 2.1401500491681413, "deviation-center-line": 1.3311642298419055, "driven_lanedir_consec": 3.6676111292020326}}simulation-passed 1 survival_time_max 21.800000000000175 survival_time_mean 21.800000000000175 survival_time_min 21.800000000000175
No reset possible 15959
531
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 13:54:28+00:00 2022-11-25 14:01:55+00:00 0:07:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.000000000000263 in-drivable-lane_median 0.3999999999999986 driven_lanedir_consec_median 3.974899482227345 deviation-center-line_median 1.1742752030987125
other stats deviation-center-line_max 1.1742752030987125 deviation-center-line_mean 1.1742752030987125 deviation-center-line_min 1.1742752030987125 deviation-heading_max 5.641017385937345 deviation-heading_mean 5.641017385937345 deviation-heading_median 5.641017385937345 deviation-heading_min 5.641017385937345 distance-from-start_max 3.269762439292758 distance-from-start_mean 3.269762439292758 distance-from-start_median 3.269762439292758 distance-from-start_min 3.269762439292758 driven_any_max 4.227758031645519 driven_any_mean 4.227758031645519 driven_any_median 4.227758031645519 driven_any_min 4.227758031645519 driven_lanedir_consec_max 3.974899482227345 driven_lanedir_consec_mean 3.974899482227345 driven_lanedir_consec_min 3.974899482227345 driven_lanedir_max 3.976686007240642 driven_lanedir_mean 3.976686007240642 driven_lanedir_median 3.976686007240642 driven_lanedir_min 3.976686007240642 in-drivable-lane_max 0.3999999999999986 in-drivable-lane_mean 0.3999999999999986 in-drivable-lane_min 0.3999999999999986 per-episodes details {"udem-000-ego0": {"driven_any": 4.227758031645519, "survival_time": 28.000000000000263, "driven_lanedir": 3.976686007240642, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 5.641017385937345, "distance-from-start": 3.269762439292758, "deviation-center-line": 1.1742752030987125, "driven_lanedir_consec": 3.974899482227345}}simulation-passed 1 survival_time_max 28.000000000000263 survival_time_mean 28.000000000000263 survival_time_min 28.000000000000263
No reset possible 15957
532
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 13:51:18+00:00 2022-11-25 13:54:14+00:00 0:02:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15953
533
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 13:44:05+00:00 2022-11-25 13:51:04+00:00 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.511832316017031 survival_time_median 59.99999999999873 deviation-center-line_median 3.0181242187371593 in-drivable-lane_median 0.0
other stats deviation-center-line_max 3.0181242187371593 deviation-center-line_mean 3.0181242187371593 deviation-center-line_min 3.0181242187371593 deviation-heading_max 12.839753797092351 deviation-heading_mean 12.839753797092351 deviation-heading_median 12.839753797092351 deviation-heading_min 12.839753797092351 distance-from-start_max 4.043090005229174 distance-from-start_mean 4.043090005229174 distance-from-start_median 4.043090005229174 distance-from-start_min 4.043090005229174 driven_any_max 8.912950299917474 driven_any_mean 8.912950299917474 driven_any_median 8.912950299917474 driven_any_min 8.912950299917474 driven_lanedir_consec_max 8.511832316017031 driven_lanedir_consec_mean 8.511832316017031 driven_lanedir_consec_min 8.511832316017031 driven_lanedir_max 8.511832316017031 driven_lanedir_mean 8.511832316017031 driven_lanedir_median 8.511832316017031 driven_lanedir_min 8.511832316017031 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 8.912950299917474, "survival_time": 59.99999999999873, "driven_lanedir": 8.511832316017031, "in-drivable-lane": 0.0, "deviation-heading": 12.839753797092351, "distance-from-start": 4.043090005229174, "deviation-center-line": 3.0181242187371593, "driven_lanedir_consec": 8.511832316017031}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15950
533
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 13:40:46+00:00 2022-11-25 13:43:50+00:00 0:03:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.0492982531011403 survival_time_median 21.750000000000178 deviation-center-line_median 1.1938808051664378 in-drivable-lane_median 2.900000000000041
other stats deviation-center-line_max 1.1938808051664378 deviation-center-line_mean 1.1938808051664378 deviation-center-line_min 1.1938808051664378 deviation-heading_max 4.521700434023744 deviation-heading_mean 4.521700434023744 deviation-heading_median 4.521700434023744 deviation-heading_min 4.521700434023744 distance-from-start_max 2.661855451400428 distance-from-start_mean 2.661855451400428 distance-from-start_median 2.661855451400428 distance-from-start_min 2.661855451400428 driven_any_max 3.633282800387284 driven_any_mean 3.633282800387284 driven_any_median 3.633282800387284 driven_any_min 3.633282800387284 driven_lanedir_consec_max 3.0492982531011403 driven_lanedir_consec_mean 3.0492982531011403 driven_lanedir_consec_min 3.0492982531011403 driven_lanedir_max 3.0492982531011403 driven_lanedir_mean 3.0492982531011403 driven_lanedir_median 3.0492982531011403 driven_lanedir_min 3.0492982531011403 in-drivable-lane_max 2.900000000000041 in-drivable-lane_mean 2.900000000000041 in-drivable-lane_min 2.900000000000041 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.633282800387284, "survival_time": 21.750000000000178, "driven_lanedir": 3.0492982531011403, "in-drivable-lane": 2.900000000000041, "deviation-heading": 4.521700434023744, "distance-from-start": 2.661855451400428, "deviation-center-line": 1.1938808051664378, "driven_lanedir_consec": 3.0492982531011403}}simulation-passed 1 survival_time_max 21.750000000000178 survival_time_mean 21.750000000000178 survival_time_min 21.750000000000178
No reset possible 15948
534
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 13:38:59+00:00 2022-11-25 13:40:22+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15947
534
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-validation
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 13:37:39+00:00 2022-11-25 13:38:43+00:00 0:01:04 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15946
534
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-validation
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 13:36:21+00:00 2022-11-25 13:37:23+00:00 0:01:02 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15945
535
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-testing
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 13:34:42+00:00 2022-11-25 13:35:56+00:00 0:01:14 The container "solut [...] The container "solution-ego1" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15935
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 13:20:04+00:00 2022-11-25 13:34:35+00:00 0:14:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1499999999999773 driven_lanedir_consec_median 7.860170882292171 deviation-center-line_median 3.347597821988393
other stats deviation-center-line_max 3.347597821988393 deviation-center-line_mean 3.347597821988393 deviation-center-line_min 3.347597821988393 deviation-heading_max 16.143149016852565 deviation-heading_mean 16.143149016852565 deviation-heading_median 16.143149016852565 deviation-heading_min 16.143149016852565 distance-from-start_max 3.2597856250429 distance-from-start_mean 3.2597856250429 distance-from-start_median 3.2597856250429 distance-from-start_min 3.2597856250429 driven_any_max 8.701602927640016 driven_any_mean 8.701602927640016 driven_any_median 8.701602927640016 driven_any_min 8.701602927640016 driven_lanedir_consec_max 7.860170882292171 driven_lanedir_consec_mean 7.860170882292171 driven_lanedir_consec_min 7.860170882292171 driven_lanedir_max 7.860170882292171 driven_lanedir_mean 7.860170882292171 driven_lanedir_median 7.860170882292171 driven_lanedir_min 7.860170882292171 in-drivable-lane_max 1.1499999999999773 in-drivable-lane_mean 1.1499999999999773 in-drivable-lane_min 1.1499999999999773 per-episodes details {"autolab-000-ego0": {"driven_any": 8.701602927640016, "survival_time": 59.99999999999873, "driven_lanedir": 7.860170882292171, "in-drivable-lane": 1.1499999999999773, "deviation-heading": 16.143149016852565, "distance-from-start": 3.2597856250429, "deviation-center-line": 3.347597821988393, "driven_lanedir_consec": 7.860170882292171}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15933
538
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 13:17:47+00:00 2022-11-25 13:19:42+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15926
539
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 13:09:40+00:00 2022-11-25 13:17:33+00:00 0:07:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.599999999999884 driven_lanedir_consec_median 8.210593749662642 deviation-center-line_median 3.2301656899419076
other stats deviation-center-line_max 3.2301656899419076 deviation-center-line_mean 3.2301656899419076 deviation-center-line_min 3.2301656899419076 deviation-heading_max 16.137106452290023 deviation-heading_mean 16.137106452290023 deviation-heading_median 16.137106452290023 deviation-heading_min 16.137106452290023 distance-from-start_max 1.9950041683695996 distance-from-start_mean 1.9950041683695996 distance-from-start_median 1.9950041683695996 distance-from-start_min 1.9950041683695996 driven_any_max 10.111679850712337 driven_any_mean 10.111679850712337 driven_any_median 10.111679850712337 driven_any_min 10.111679850712337 driven_lanedir_consec_max 8.210593749662642 driven_lanedir_consec_mean 8.210593749662642 driven_lanedir_consec_min 8.210593749662642 driven_lanedir_max 8.582192132918525 driven_lanedir_mean 8.582192132918525 driven_lanedir_median 8.582192132918525 driven_lanedir_min 8.582192132918525 in-drivable-lane_max 5.599999999999884 in-drivable-lane_mean 5.599999999999884 in-drivable-lane_min 5.599999999999884 per-episodes details {"udem1-000-ego0": {"driven_any": 10.111679850712337, "survival_time": 59.99999999999873, "driven_lanedir": 8.582192132918525, "in-drivable-lane": 5.599999999999884, "deviation-heading": 16.137106452290023, "distance-from-start": 1.9950041683695996, "deviation-center-line": 3.2301656899419076, "driven_lanedir_consec": 8.210593749662642}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15923
541
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 13:04:36+00:00 2022-11-25 13:09:11+00:00 0:04:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.9076851819434415 survival_time_median 38.49999999999995 deviation-center-line_median 1.8247332118549853 in-drivable-lane_median 5.349999999999756
other stats deviation-center-line_max 1.8247332118549853 deviation-center-line_mean 1.8247332118549853 deviation-center-line_min 1.8247332118549853 deviation-heading_max 11.603874457708152 deviation-heading_mean 11.603874457708152 deviation-heading_median 11.603874457708152 deviation-heading_min 11.603874457708152 distance-from-start_max 3.521896287918739 distance-from-start_mean 3.521896287918739 distance-from-start_median 3.521896287918739 distance-from-start_min 3.521896287918739 driven_any_max 6.356369600183621 driven_any_mean 6.356369600183621 driven_any_median 6.356369600183621 driven_any_min 6.356369600183621 driven_lanedir_consec_max 4.9076851819434415 driven_lanedir_consec_mean 4.9076851819434415 driven_lanedir_consec_min 4.9076851819434415 driven_lanedir_max 4.9076851819434415 driven_lanedir_mean 4.9076851819434415 driven_lanedir_median 4.9076851819434415 driven_lanedir_min 4.9076851819434415 in-drivable-lane_max 5.349999999999756 in-drivable-lane_mean 5.349999999999756 in-drivable-lane_min 5.349999999999756 per-episodes details {"loop-000-ego0": {"driven_any": 6.356369600183621, "survival_time": 38.49999999999995, "driven_lanedir": 4.9076851819434415, "in-drivable-lane": 5.349999999999756, "deviation-heading": 11.603874457708152, "distance-from-start": 3.521896287918739, "deviation-center-line": 1.8247332118549853, "driven_lanedir_consec": 4.9076851819434415}}simulation-passed 1 survival_time_max 38.49999999999995 survival_time_mean 38.49999999999995 survival_time_min 38.49999999999995
No reset possible 15918
542
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 13:03:01+00:00 2022-11-25 13:04:16+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15913
765
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802 aido-hello-sim-validation
sanity-check success no davinci-stage-01-6.2.51
2022-11-25 13:01:33+00:00 2022-11-25 13:02:41+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.026775499221724397 deviation-center-line_median 0.005432592574900659
other stats deviation-center-line_max 0.005432592574900659 deviation-center-line_mean 0.005432592574900659 deviation-center-line_min 0.005432592574900659 deviation-heading_max 0.29043306037195926 deviation-heading_mean 0.29043306037195926 deviation-heading_median 0.29043306037195926 deviation-heading_min 0.29043306037195926 distance-from-start_max 0.03319608298502622 distance-from-start_mean 0.03319608298502622 distance-from-start_median 0.03319608298502622 distance-from-start_min 0.03319608298502622 driven_any_max 0.033247214385369664 driven_any_mean 0.033247214385369664 driven_any_median 0.033247214385369664 driven_any_min 0.033247214385369664 driven_lanedir_consec_max 0.026775499221724397 driven_lanedir_consec_mean 0.026775499221724397 driven_lanedir_consec_min 0.026775499221724397 driven_lanedir_max 0.026775499221724397 driven_lanedir_mean 0.026775499221724397 driven_lanedir_median 0.026775499221724397 driven_lanedir_min 0.026775499221724397 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.033247214385369664, "survival_time": 0.49999999999999994, "driven_lanedir": 0.026775499221724397, "in-drivable-lane": 0.0, "deviation-heading": 0.29043306037195926, "distance-from-start": 0.03319608298502622, "deviation-center-line": 0.005432592574900659, "driven_lanedir_consec": 0.026775499221724397}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15910
796
Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1 aido-hello-sim-validation
sanity-check failed no davinci-stage-01-6.2.51
2022-11-25 13:00:26+00:00 2022-11-25 13:01:21+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15906
802
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551 aido-hello-sim-validation
sanity-check success no davinci-stage-01-6.2.51
2022-11-25 12:59:10+00:00 2022-11-25 13:00:18+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.02866015980948355 deviation-center-line_median 0.005705232375737332
other stats deviation-center-line_max 0.005705232375737332 deviation-center-line_mean 0.005705232375737332 deviation-center-line_min 0.005705232375737332 deviation-heading_max 0.2975691760921432 deviation-heading_mean 0.2975691760921432 deviation-heading_median 0.2975691760921432 deviation-heading_min 0.2975691760921432 distance-from-start_max 0.03657881744213536 distance-from-start_mean 0.03657881744213536 distance-from-start_median 0.03657881744213536 distance-from-start_min 0.03657881744213536 driven_any_max 0.03665227344479731 driven_any_mean 0.03665227344479731 driven_any_median 0.03665227344479731 driven_any_min 0.03665227344479731 driven_lanedir_consec_max 0.02866015980948355 driven_lanedir_consec_mean 0.02866015980948355 driven_lanedir_consec_min 0.02866015980948355 driven_lanedir_max 0.02866015980948355 driven_lanedir_mean 0.02866015980948355 driven_lanedir_median 0.02866015980948355 driven_lanedir_min 0.02866015980948355 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03665227344479731, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02866015980948355, "in-drivable-lane": 0.0, "deviation-heading": 0.2975691760921432, "distance-from-start": 0.03657881744213536, "deviation-center-line": 0.005705232375737332, "driven_lanedir_consec": 0.02866015980948355}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15900
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 12:55:03+00:00 2022-11-25 12:59:03+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.804192854394257 deviation-center-line_median 0.16028545636710145
other stats deviation-center-line_max 0.16028545636710145 deviation-center-line_mean 0.16028545636710145 deviation-center-line_min 0.16028545636710145 deviation-heading_max 1.6564513443463602 deviation-heading_mean 1.6564513443463602 deviation-heading_median 1.6564513443463602 deviation-heading_min 1.6564513443463602 distance-from-start_max 2.5357490341649536 distance-from-start_mean 2.5357490341649536 distance-from-start_median 2.5357490341649536 distance-from-start_min 2.5357490341649536 driven_any_max 5.81208847227964 driven_any_mean 5.81208847227964 driven_any_median 5.81208847227964 driven_any_min 5.81208847227964 driven_lanedir_consec_max 5.804192854394257 driven_lanedir_consec_mean 5.804192854394257 driven_lanedir_consec_min 5.804192854394257 driven_lanedir_max 5.804192854394257 driven_lanedir_mean 5.804192854394257 driven_lanedir_median 5.804192854394257 driven_lanedir_min 5.804192854394257 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.81208847227964, "survival_time": 59.99999999999873, "driven_lanedir": 5.804192854394257, "in-drivable-lane": 0.0, "deviation-heading": 1.6564513443463602, "distance-from-start": 2.5357490341649536, "deviation-center-line": 0.16028545636710145, "driven_lanedir_consec": 5.804192854394257}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15897
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 12:48:37+00:00 2022-11-25 12:54:29+00:00 0:05:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.560422051338984 deviation-center-line_median 0.27120156757925695
other stats deviation-center-line_max 0.27120156757925695 deviation-center-line_mean 0.27120156757925695 deviation-center-line_min 0.27120156757925695 deviation-heading_max 2.2601023015918167 deviation-heading_mean 2.2601023015918167 deviation-heading_median 2.2601023015918167 deviation-heading_min 2.2601023015918167 distance-from-start_max 2.771434789584769 distance-from-start_mean 2.771434789584769 distance-from-start_median 2.771434789584769 distance-from-start_min 2.771434789584769 driven_any_max 5.976806373273059 driven_any_mean 5.976806373273059 driven_any_median 5.976806373273059 driven_any_min 5.976806373273059 driven_lanedir_consec_max 5.560422051338984 driven_lanedir_consec_mean 5.560422051338984 driven_lanedir_consec_min 5.560422051338984 driven_lanedir_max 5.964295771107123 driven_lanedir_mean 5.964295771107123 driven_lanedir_median 5.964295771107123 driven_lanedir_min 5.964295771107123 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 5.976806373273059, "survival_time": 59.99999999999873, "driven_lanedir": 5.964295771107123, "in-drivable-lane": 0.0, "deviation-heading": 2.2601023015918167, "distance-from-start": 2.771434789584769, "deviation-center-line": 0.27120156757925695, "driven_lanedir_consec": 5.560422051338984}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15896
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 12:46:36+00:00 2022-11-25 12:48:11+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15889
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 12:35:20+00:00 2022-11-25 12:46:30+00:00 0:11:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.87044918682097 deviation-center-line_median 0.1629208044133267
other stats deviation-center-line_max 3.4506790593202896 deviation-center-line_mean 0.975722942917009 deviation-center-line_min 0.12637110352109293 deviation-heading_max 26.9052448670844 deviation-heading_mean 7.787954995168265 deviation-heading_median 1.622296803656659 deviation-heading_min 1.001981506275341 distance-from-start_max 3.1388446632722284 distance-from-start_mean 1.8800227125863065 distance-from-start_median 2.190623093536498 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.732211587504052 driven_any_mean 3.9710285465457744 driven_any_median 5.075951299339257 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 5.726105869591416 driven_lanedir_consec_mean 3.866751060808339 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.72610611271169 driven_lanedir_mean 3.9673328096636857 driven_lanedir_median 5.071612562971525 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 4.62060007041619, "survival_time": 59.99999999999873, "driven_lanedir": 4.618548386263603, "in-drivable-lane": 0.0, "deviation-heading": 1.001981506275341, "distance-from-start": 3.1388446632722284, "deviation-center-line": 0.12637110352109293, "driven_lanedir_consec": 4.61854797027584}, "4way-001-ego1": {"driven_any": 5.732211587504052, "survival_time": 59.99999999999873, "driven_lanedir": 5.72610611271169, "in-drivable-lane": 0.0, "deviation-heading": 1.7047057639689014, "distance-from-start": 2.052047610153934, "deviation-center-line": 0.17436950864269551, "driven_lanedir_consec": 5.726105869591416}, "4way-001-ego2": {"driven_any": 5.531302528262324, "survival_time": 59.99999999999873, "driven_lanedir": 5.524676739679447, "in-drivable-lane": 0.0, "deviation-heading": 1.5398878433444168, "distance-from-start": 2.329198576919062, "deviation-center-line": 0.1514721001839579, "driven_lanedir_consec": 5.122350403366101}, "4way-001-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.4506790593202896, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15883
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 12:31:02+00:00 2022-11-25 12:35:06+00:00 0:04:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.678569183796779 deviation-center-line_median 0.4080169826843029
other stats deviation-center-line_max 0.4080169826843029 deviation-center-line_mean 0.4080169826843029 deviation-center-line_min 0.4080169826843029 deviation-heading_max 3.400261711047307 deviation-heading_mean 3.400261711047307 deviation-heading_median 3.400261711047307 deviation-heading_min 3.400261711047307 distance-from-start_max 1.069625617276668 distance-from-start_mean 1.069625617276668 distance-from-start_median 1.069625617276668 distance-from-start_min 1.069625617276668 driven_any_max 5.695209014172635 driven_any_mean 5.695209014172635 driven_any_median 5.695209014172635 driven_any_min 5.695209014172635 driven_lanedir_consec_max 5.678569183796779 driven_lanedir_consec_mean 5.678569183796779 driven_lanedir_consec_min 5.678569183796779 driven_lanedir_max 5.678569183796779 driven_lanedir_mean 5.678569183796779 driven_lanedir_median 5.678569183796779 driven_lanedir_min 5.678569183796779 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.695209014172635, "survival_time": 59.99999999999873, "driven_lanedir": 5.678569183796779, "in-drivable-lane": 0.0, "deviation-heading": 3.400261711047307, "distance-from-start": 1.069625617276668, "deviation-center-line": 0.4080169826843029, "driven_lanedir_consec": 5.678569183796779}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15878
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 12:26:37+00:00 2022-11-25 12:30:35+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.762199167368613 deviation-center-line_median 0.2695568246827997
other stats deviation-center-line_max 0.2695568246827997 deviation-center-line_mean 0.2695568246827997 deviation-center-line_min 0.2695568246827997 deviation-heading_max 2.286728929136476 deviation-heading_mean 2.286728929136476 deviation-heading_median 2.286728929136476 deviation-heading_min 2.286728929136476 distance-from-start_max 2.8947685325489236 distance-from-start_mean 2.8947685325489236 distance-from-start_median 2.8947685325489236 distance-from-start_min 2.8947685325489236 driven_any_max 5.7779481252581375 driven_any_mean 5.7779481252581375 driven_any_median 5.7779481252581375 driven_any_min 5.7779481252581375 driven_lanedir_consec_max 5.762199167368613 driven_lanedir_consec_mean 5.762199167368613 driven_lanedir_consec_min 5.762199167368613 driven_lanedir_max 5.762199167368613 driven_lanedir_mean 5.762199167368613 driven_lanedir_median 5.762199167368613 driven_lanedir_min 5.762199167368613 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.7779481252581375, "survival_time": 59.99999999999873, "driven_lanedir": 5.762199167368613, "in-drivable-lane": 0.0, "deviation-heading": 2.286728929136476, "distance-from-start": 2.8947685325489236, "deviation-center-line": 0.2695568246827997, "driven_lanedir_consec": 5.762199167368613}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15873
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 12:21:16+00:00 2022-11-25 12:26:17+00:00 0:05:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065274986524993
other stats deviation-center-line_max 0.4065274986524993 deviation-center-line_mean 0.4065274986524993 deviation-center-line_min 0.4065274986524993 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065274986524993, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15868
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 12:09:43+00:00 2022-11-25 12:20:54+00:00 0:11:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.38577379311006 deviation-center-line_median 0.2253916973044201
other stats deviation-center-line_max 0.25150945762104626 deviation-center-line_mean 0.2258728989276509 deviation-center-line_min 0.20119874348071703 deviation-heading_max 1.870868162450936 deviation-heading_mean 1.6814661218930986 deviation-heading_median 1.6978808943178063 deviation-heading_min 1.4592345364858448 distance-from-start_max 2.4901635835539864 distance-from-start_mean 2.340615857594544 distance-from-start_median 2.4217755218392245 distance-from-start_min 2.0287488031457404 driven_any_max 5.888840872450049 driven_any_mean 5.666255234642627 driven_any_median 5.696354385105463 driven_any_min 5.383471295909528 driven_lanedir_consec_max 5.88286659371623 driven_lanedir_consec_mean 5.383274938407007 driven_lanedir_consec_min 4.878685573691682 driven_lanedir_max 5.88286659371623 driven_lanedir_mean 5.6600988125150735 driven_lanedir_median 5.689408214739162 driven_lanedir_min 5.378712226865741 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.589326286428048, "survival_time": 59.99999999999873, "driven_lanedir": 5.583554682769149, "in-drivable-lane": 0.0, "deviation-heading": 1.828622792773347, "distance-from-start": 2.3544469360186357, "deviation-center-line": 0.2485102614270095, "driven_lanedir_consec": 4.878685573691682}, "4way-001-ego1": {"driven_any": 5.888840872450049, "survival_time": 59.99999999999873, "driven_lanedir": 5.88286659371623, "in-drivable-lane": 0.0, "deviation-heading": 1.4592345364858448, "distance-from-start": 2.4891041076598133, "deviation-center-line": 0.20119874348071703, "driven_lanedir_consec": 5.88286659371623}, "4way-001-ego2": {"driven_any": 5.803382483782878, "survival_time": 59.99999999999873, "driven_lanedir": 5.795261746709174, "in-drivable-lane": 0.0, "deviation-heading": 1.870868162450936, "distance-from-start": 2.4901635835539864, "deviation-center-line": 0.25150945762104626, "driven_lanedir_consec": 5.392835359354378}, "4way-001-ego3": {"driven_any": 5.383471295909528, "survival_time": 59.99999999999873, "driven_lanedir": 5.378712226865741, "in-drivable-lane": 0.0, "deviation-heading": 1.567138995862266, "distance-from-start": 2.0287488031457404, "deviation-center-line": 0.2022731331818307, "driven_lanedir_consec": 5.378712226865741}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15863
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 11:59:29+00:00 2022-11-25 12:09:35+00:00 0:10:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.354121751024167 deviation-center-line_median 1.5907898424502358
other stats deviation-center-line_max 3.468394386342305 deviation-center-line_mean 1.7204870668180092 deviation-center-line_min 0.23197419602925975 deviation-heading_max 37.822937304744066 deviation-heading_mean 15.410893192415545 deviation-heading_median 10.924693244125017 deviation-heading_min 1.9712489766680776 distance-from-start_max 4.757326687346635 distance-from-start_mean 1.9702948065027592 distance-from-start_median 1.5619262693322007 distance-from-start_min 2.220446049250313e-16 driven_any_max 5.8896577604958456 driven_any_mean 2.651059104566359 driven_any_median 2.357289328884662 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 5.867756494746063 driven_lanedir_consec_mean 2.6439994058236502 driven_lanedir_consec_min -2.3734997967039817e-06 driven_lanedir_max 5.867756494746063 driven_lanedir_mean 2.6439994058236502 driven_lanedir_median 2.354121751024167 driven_lanedir_min -2.3734997967039817e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.8896577604958456, "survival_time": 59.99999999999873, "driven_lanedir": 5.867756494746063, "in-drivable-lane": 0.0, "deviation-heading": 3.5399584722448916, "distance-from-start": 4.757326687346635, "deviation-center-line": 0.4191165927509713, "driven_lanedir_consec": 5.867756494746063}, "zigzag-000-ego1": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.468394386342305, "driven_lanedir_consec": 0.0}, "zigzag-000-ego2": {"driven_any": 4.714578657768775, "survival_time": 59.99999999999873, "driven_lanedir": 4.708243502048335, "in-drivable-lane": 0.0, "deviation-heading": 1.9712489766680776, "distance-from-start": 3.123852538664401, "deviation-center-line": 0.23197419602925975, "driven_lanedir_consec": 4.708243502048335}, "zigzag-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.3734997967039817e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822937304744066, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624630921495004, "driven_lanedir_consec": -2.3734997967039817e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15855
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 11:46:12+00:00 2022-11-25 11:58:55+00:00 0:12:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.1417360050531755 deviation-center-line_median 0.53453245126959
other stats deviation-center-line_max 0.53453245126959 deviation-center-line_mean 0.53453245126959 deviation-center-line_min 0.53453245126959 deviation-heading_max 4.002468114919836 deviation-heading_mean 4.002468114919836 deviation-heading_median 4.002468114919836 deviation-heading_min 4.002468114919836 distance-from-start_max 3.4062886142559416 distance-from-start_mean 3.4062886142559416 distance-from-start_median 3.4062886142559416 distance-from-start_min 3.4062886142559416 driven_any_max 5.164260198360464 driven_any_mean 5.164260198360464 driven_any_median 5.164260198360464 driven_any_min 5.164260198360464 driven_lanedir_consec_max 5.1417360050531755 driven_lanedir_consec_mean 5.1417360050531755 driven_lanedir_consec_min 5.1417360050531755 driven_lanedir_max 5.1417360050531755 driven_lanedir_mean 5.1417360050531755 driven_lanedir_median 5.1417360050531755 driven_lanedir_min 5.1417360050531755 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.164260198360464, "survival_time": 59.99999999999873, "driven_lanedir": 5.1417360050531755, "in-drivable-lane": 0.0, "deviation-heading": 4.002468114919836, "distance-from-start": 3.4062886142559416, "deviation-center-line": 0.53453245126959, "driven_lanedir_consec": 5.1417360050531755}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15850
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 11:43:22+00:00 2022-11-25 11:45:49+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.250000000000153 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.822088964337002 deviation-center-line_median 0.20357564547105955
other stats deviation-center-line_max 0.20357564547105955 deviation-center-line_mean 0.20357564547105955 deviation-center-line_min 0.20357564547105955 deviation-heading_max 1.6073324247192475 deviation-heading_mean 1.6073324247192475 deviation-heading_median 1.6073324247192475 deviation-heading_min 1.6073324247192475 distance-from-start_max 1.059982869303493 distance-from-start_mean 1.059982869303493 distance-from-start_median 1.059982869303493 distance-from-start_min 1.059982869303493 driven_any_max 1.8350627704817688 driven_any_mean 1.8350627704817688 driven_any_median 1.8350627704817688 driven_any_min 1.8350627704817688 driven_lanedir_consec_max 1.822088964337002 driven_lanedir_consec_mean 1.822088964337002 driven_lanedir_consec_min 1.822088964337002 driven_lanedir_max 1.822088964337002 driven_lanedir_mean 1.822088964337002 driven_lanedir_median 1.822088964337002 driven_lanedir_min 1.822088964337002 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8350627704817688, "survival_time": 20.250000000000153, "driven_lanedir": 1.822088964337002, "in-drivable-lane": 0.0, "deviation-heading": 1.6073324247192475, "distance-from-start": 1.059982869303493, "deviation-center-line": 0.20357564547105955, "driven_lanedir_consec": 1.822088964337002}}simulation-passed 1 survival_time_max 20.250000000000153 survival_time_mean 20.250000000000153 survival_time_min 20.250000000000153
No reset possible 15844
1324
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:41:48+00:00 2022-11-25 11:43:01+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15838
1325
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:40:22+00:00 2022-11-25 11:41:34+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15835
1327
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:39:12+00:00 2022-11-25 11:40:11+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15829
1328
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:37:39+00:00 2022-11-25 11:38:53+00:00 0:01:14 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15823
1329
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:36:19+00:00 2022-11-25 11:37:32+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15818
1330
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:34:54+00:00 2022-11-25 11:35:51+00:00 0:00:57 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15813
1335
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-2of5 failed no davinci-stage-01-6.2.51
2022-11-25 11:33:30+00:00 2022-11-25 11:34:27+00:00 0:00:57 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15808
1342
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:31:27+00:00 2022-11-25 11:32:55+00:00 0:01:28 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15803
1343
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:29:46+00:00 2022-11-25 11:30:58+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15800
1344
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:28:21+00:00 2022-11-25 11:29:33+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15795
1345
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:27:10+00:00 2022-11-25 11:28:08+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15792
1345
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:25:43+00:00 2022-11-25 11:26:41+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15789
1347
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:24:22+00:00 2022-11-25 11:25:35+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15784
1347
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 11:22:49+00:00 2022-11-25 11:24:13+00:00 0:01:24 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15777
1349
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 11:13:02+00:00 2022-11-25 11:22:29+00:00 0:09:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949116056299469
other stats deviation-center-line_max 0.8949116056299469 deviation-center-line_mean 0.8949116056299469 deviation-center-line_min 0.8949116056299469 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.577566798522237e-16 distance-from-start_mean 4.577566798522237e-16 distance-from-start_median 4.577566798522237e-16 distance-from-start_min 4.577566798522237e-16 driven_any_max 5.49308015822675e-13 driven_any_mean 5.49308015822675e-13 driven_any_median 5.49308015822675e-13 driven_any_min 5.49308015822675e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15775
1350
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 11:10:54+00:00 2022-11-25 11:12:49+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15772
1351
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 11:08:36+00:00 2022-11-25 11:10:47+00:00 0:02:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.949999999999983 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7393650912295743 deviation-center-line_median 0.19396129195182027
other stats deviation-center-line_max 0.19396129195182027 deviation-center-line_mean 0.19396129195182027 deviation-center-line_min 0.19396129195182027 deviation-heading_max 1.6557607135359702 deviation-heading_mean 1.6557607135359702 deviation-heading_median 1.6557607135359702 deviation-heading_min 1.6557607135359702 distance-from-start_max 0.6263862636426112 distance-from-start_mean 0.6263862636426112 distance-from-start_median 0.6263862636426112 distance-from-start_min 0.6263862636426112 driven_any_max 0.7713609389392817 driven_any_mean 0.7713609389392817 driven_any_median 0.7713609389392817 driven_any_min 0.7713609389392817 driven_lanedir_consec_max 0.7393650912295743 driven_lanedir_consec_mean 0.7393650912295743 driven_lanedir_consec_min 0.7393650912295743 driven_lanedir_max 0.7511359975311799 driven_lanedir_mean 0.7511359975311799 driven_lanedir_median 0.7511359975311799 driven_lanedir_min 0.7511359975311799 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.7713609389392817, "survival_time": 6.949999999999983, "driven_lanedir": 0.7511359975311799, "in-drivable-lane": 0.0, "deviation-heading": 1.6557607135359702, "distance-from-start": 0.6263862636426112, "deviation-center-line": 0.19396129195182027, "driven_lanedir_consec": 0.7393650912295743}}simulation-passed 1 survival_time_max 6.949999999999983 survival_time_mean 6.949999999999983 survival_time_min 6.949999999999983
No reset possible 15768
1352
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 11:05:03+00:00 2022-11-25 11:08:22+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8426231052052713 survival_time_median 23.350000000000197 deviation-center-line_median 0.202092710390596 in-drivable-lane_median 16.150000000000215
other stats deviation-center-line_max 0.202092710390596 deviation-center-line_mean 0.202092710390596 deviation-center-line_min 0.202092710390596 deviation-heading_max 1.80378637268389 deviation-heading_mean 1.80378637268389 deviation-heading_median 1.80378637268389 deviation-heading_min 1.80378637268389 distance-from-start_max 1.0836541460322802 distance-from-start_mean 1.0836541460322802 distance-from-start_median 1.0836541460322802 distance-from-start_min 1.0836541460322802 driven_any_max 2.9485410994592325 driven_any_mean 2.9485410994592325 driven_any_median 2.9485410994592325 driven_any_min 2.9485410994592325 driven_lanedir_consec_max 0.8426231052052713 driven_lanedir_consec_mean 0.8426231052052713 driven_lanedir_consec_min 0.8426231052052713 driven_lanedir_max 0.8426231052052713 driven_lanedir_mean 0.8426231052052713 driven_lanedir_median 0.8426231052052713 driven_lanedir_min 0.8426231052052713 in-drivable-lane_max 16.150000000000215 in-drivable-lane_mean 16.150000000000215 in-drivable-lane_min 16.150000000000215 per-episodes details {"loop2-000-ego0": {"driven_any": 2.9485410994592325, "survival_time": 23.350000000000197, "driven_lanedir": 0.8426231052052713, "in-drivable-lane": 16.150000000000215, "deviation-heading": 1.80378637268389, "distance-from-start": 1.0836541460322802, "deviation-center-line": 0.202092710390596, "driven_lanedir_consec": 0.8426231052052713}}simulation-passed 1 survival_time_max 23.350000000000197 survival_time_mean 23.350000000000197 survival_time_min 23.350000000000197
No reset possible 15758
1354
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 10:48:26+00:00 2022-11-25 11:04:48+00:00 0:16:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.949999999999584 in-drivable-lane_median 33.84999999999954 driven_lanedir_consec_median 0.7539993224391985 deviation-center-line_median 1.037057319807822
other stats deviation-center-line_max 2.0110289364051197 deviation-center-line_mean 1.049437108199575 deviation-center-line_min 0.112604856777536 deviation-heading_max 9.997952963218088 deviation-heading_mean 5.908639874221761 deviation-heading_median 6.441055543201866 deviation-heading_min 0.7544954472652194 distance-from-start_max 1.7534689463994817 distance-from-start_mean 1.189139495730775 distance-from-start_median 1.178797049411329 distance-from-start_min 0.6454949377009616 driven_any_max 5.822024155205296 driven_any_mean 3.0445344402249255 driven_any_median 2.589967468885819 driven_any_min 1.176178667922769 driven_lanedir_consec_max 0.9398373099395696 driven_lanedir_consec_mean 0.7015407623836791 driven_lanedir_consec_min 0.3583270947167496 driven_lanedir_max 2.0068322886878858 driven_lanedir_mean 1.1149192710544042 driven_lanedir_median 1.0472588504064906 driven_lanedir_min 0.3583270947167496 in-drivable-lane_max 41.59999999999958 in-drivable-lane_mean 33.82499999999952 in-drivable-lane_min 25.99999999999944 per-episodes details {"autolab-000-ego0": {"driven_any": 1.176178667922769, "survival_time": 44.949999999999584, "driven_lanedir": 0.6819155262405183, "in-drivable-lane": 37.99999999999959, "deviation-heading": 3.874068869854553, "distance-from-start": 0.6454949377009616, "deviation-center-line": 0.4761442720664508, "driven_lanedir_consec": 0.6819155262405183}, "autolab-000-ego1": {"driven_any": 2.5897078816356265, "survival_time": 44.949999999999584, "driven_lanedir": 1.4126021745724628, "in-drivable-lane": 29.699999999999488, "deviation-heading": 9.997952963218088, "distance-from-start": 0.701376603810614, "deviation-center-line": 1.5979703675491927, "driven_lanedir_consec": 0.8260831186378788}, "autolab-000-ego2": {"driven_any": 5.822024155205296, "survival_time": 44.949999999999584, "driven_lanedir": 2.0068322886878858, "in-drivable-lane": 25.99999999999944, "deviation-heading": 9.00804221654918, "distance-from-start": 1.7534689463994817, "deviation-center-line": 2.0110289364051197, "driven_lanedir_consec": 0.9398373099395696}, "autolab-000-ego3": {"driven_any": 2.590227056136012, "survival_time": 44.949999999999584, "driven_lanedir": 0.3583270947167496, "in-drivable-lane": 41.59999999999958, "deviation-heading": 0.7544954472652194, "distance-from-start": 1.6562174950120432, "deviation-center-line": 0.112604856777536, "driven_lanedir_consec": 0.3583270947167496}}simulation-passed 1 survival_time_max 44.949999999999584 survival_time_mean 44.949999999999584 survival_time_min 44.949999999999584
No reset possible 15754
1355
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 10:43:12+00:00 2022-11-25 10:48:11+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 36.00000000000009 in-drivable-lane_median 1.7000000000000195 driven_lanedir_consec_median 2.8140053840249473 deviation-center-line_median 2.7252841060252506
other stats deviation-center-line_max 2.7252841060252506 deviation-center-line_mean 2.7252841060252506 deviation-center-line_min 2.7252841060252506 deviation-heading_max 8.46984404483963 deviation-heading_mean 8.46984404483963 deviation-heading_median 8.46984404483963 deviation-heading_min 8.46984404483963 distance-from-start_max 2.2382515121898003 distance-from-start_mean 2.2382515121898003 distance-from-start_median 2.2382515121898003 distance-from-start_min 2.2382515121898003 driven_any_max 4.628244518660855 driven_any_mean 4.628244518660855 driven_any_median 4.628244518660855 driven_any_min 4.628244518660855 driven_lanedir_consec_max 2.8140053840249473 driven_lanedir_consec_mean 2.8140053840249473 driven_lanedir_consec_min 2.8140053840249473 driven_lanedir_max 4.132670056486969 driven_lanedir_mean 4.132670056486969 driven_lanedir_median 4.132670056486969 driven_lanedir_min 4.132670056486969 in-drivable-lane_max 1.7000000000000195 in-drivable-lane_mean 1.7000000000000195 in-drivable-lane_min 1.7000000000000195 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.628244518660855, "survival_time": 36.00000000000009, "driven_lanedir": 4.132670056486969, "in-drivable-lane": 1.7000000000000195, "deviation-heading": 8.46984404483963, "distance-from-start": 2.2382515121898003, "deviation-center-line": 2.7252841060252506, "driven_lanedir_consec": 2.8140053840249473}}simulation-passed 1 survival_time_max 36.00000000000009 survival_time_mean 36.00000000000009 survival_time_min 36.00000000000009
No reset possible 15753
1355
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 10:37:35+00:00 2022-11-25 10:42:50+00:00 0:05:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 16.399999999999544 driven_lanedir_consec_median 5.587032647015478 deviation-center-line_median 5.279180546445404
other stats deviation-center-line_max 5.279180546445404 deviation-center-line_mean 5.279180546445404 deviation-center-line_min 5.279180546445404 deviation-heading_max 7.011806756460665 deviation-heading_mean 7.011806756460665 deviation-heading_median 7.011806756460665 deviation-heading_min 7.011806756460665 distance-from-start_max 1.4245426014265494 distance-from-start_mean 1.4245426014265494 distance-from-start_median 1.4245426014265494 distance-from-start_min 1.4245426014265494 driven_any_max 7.907839205612788 driven_any_mean 7.907839205612788 driven_any_median 7.907839205612788 driven_any_min 7.907839205612788 driven_lanedir_consec_max 5.587032647015478 driven_lanedir_consec_mean 5.587032647015478 driven_lanedir_consec_min 5.587032647015478 driven_lanedir_max 5.587032647015478 driven_lanedir_mean 5.587032647015478 driven_lanedir_median 5.587032647015478 driven_lanedir_min 5.587032647015478 in-drivable-lane_max 16.399999999999544 in-drivable-lane_mean 16.399999999999544 in-drivable-lane_min 16.399999999999544 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907839205612788, "survival_time": 59.99999999999873, "driven_lanedir": 5.587032647015478, "in-drivable-lane": 16.399999999999544, "deviation-heading": 7.011806756460665, "distance-from-start": 1.4245426014265494, "deviation-center-line": 5.279180546445404, "driven_lanedir_consec": 5.587032647015478}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15748
1360
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-3of5 success no davinci-stage-01-6.2.51
2022-11-25 10:33:20+00:00 2022-11-25 10:37:08+00:00 0:03:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.3595717163565524
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.3595717163565524 distance-from-start_median 1.3595717163565524 distance-from-start_min 1.3595717163565524 driven_any_max 1.3689002753133452 driven_any_mean 1.3689002753133452 driven_any_median 1.3689002753133452 driven_any_min 1.3689002753133452 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.450000000000028 in-drivable-lane_mean 11.450000000000028 in-drivable-lane_median 11.450000000000028 in-drivable-lane_min 11.450000000000028 per-episodes details {"d50-ego0": {"driven_any": 1.3689002753133452, "survival_time": 11.450000000000028, "driven_lanedir": 0.0, "in-drivable-lane": 11.450000000000028, "deviation-heading": 0.0, "distance-from-start": 1.3595717163565524, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_median 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 15745
1360
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-4of5 success no davinci-stage-01-6.2.51
2022-11-25 10:30:42+00:00 2022-11-25 10:32:47+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.38048100922016304
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.38048100922016304 distance-from-start_median 0.38048100922016304 distance-from-start_min 0.38048100922016304 driven_any_max 0.7912891825164747 driven_any_mean 0.7912891825164747 driven_any_median 0.7912891825164747 driven_any_min 0.7912891825164747 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 7.099999999999983 in-drivable-lane_mean 7.099999999999983 in-drivable-lane_median 7.099999999999983 in-drivable-lane_min 7.099999999999983 per-episodes details {"d60-ego0": {"driven_any": 0.7912891825164747, "survival_time": 7.099999999999983, "driven_lanedir": 0.0, "in-drivable-lane": 7.099999999999983, "deviation-heading": 0.0, "distance-from-start": 0.38048100922016304, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_median 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 15737
1368
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 10:16:24+00:00 2022-11-25 10:30:28+00:00 0:14:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 6.299999999999934 driven_lanedir_consec_median 3.3983535786279893 deviation-center-line_median 4.025785960698089
other stats deviation-center-line_max 4.025785960698089 deviation-center-line_mean 4.025785960698089 deviation-center-line_min 4.025785960698089 deviation-heading_max 12.906171186114296 deviation-heading_mean 12.906171186114296 deviation-heading_median 12.906171186114296 deviation-heading_min 12.906171186114296 distance-from-start_max 1.528519813678358 distance-from-start_mean 1.528519813678358 distance-from-start_median 1.528519813678358 distance-from-start_min 1.528519813678358 driven_any_max 7.91393687570393 driven_any_mean 7.91393687570393 driven_any_median 7.91393687570393 driven_any_min 7.91393687570393 driven_lanedir_consec_max 3.3983535786279893 driven_lanedir_consec_mean 3.3983535786279893 driven_lanedir_consec_min 3.3983535786279893 driven_lanedir_max 6.619655267534741 driven_lanedir_mean 6.619655267534741 driven_lanedir_median 6.619655267534741 driven_lanedir_min 6.619655267534741 in-drivable-lane_max 6.299999999999934 in-drivable-lane_mean 6.299999999999934 in-drivable-lane_min 6.299999999999934 per-episodes details {"4way-000-ego0": {"driven_any": 7.91393687570393, "survival_time": 59.99999999999873, "driven_lanedir": 6.619655267534741, "in-drivable-lane": 6.299999999999934, "deviation-heading": 12.906171186114296, "distance-from-start": 1.528519813678358, "deviation-center-line": 4.025785960698089, "driven_lanedir_consec": 3.3983535786279893}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15733
1370
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 10:11:05+00:00 2022-11-25 10:16:04+00:00 0:04:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 7.257076358139224 survival_time_median 59.99999999999873 deviation-center-line_median 3.9569096055519832 in-drivable-lane_median 3.699999999999921
other stats deviation-center-line_max 3.9569096055519832 deviation-center-line_mean 3.9569096055519832 deviation-center-line_min 3.9569096055519832 deviation-heading_max 8.014800122924795 deviation-heading_mean 8.014800122924795 deviation-heading_median 8.014800122924795 deviation-heading_min 8.014800122924795 distance-from-start_max 3.1352067930056204 distance-from-start_mean 3.1352067930056204 distance-from-start_median 3.1352067930056204 distance-from-start_min 3.1352067930056204 driven_any_max 7.90792348070859 driven_any_mean 7.90792348070859 driven_any_median 7.90792348070859 driven_any_min 7.90792348070859 driven_lanedir_consec_max 7.257076358139224 driven_lanedir_consec_mean 7.257076358139224 driven_lanedir_consec_min 7.257076358139224 driven_lanedir_max 7.257076358139224 driven_lanedir_mean 7.257076358139224 driven_lanedir_median 7.257076358139224 driven_lanedir_min 7.257076358139224 in-drivable-lane_max 3.699999999999921 in-drivable-lane_mean 3.699999999999921 in-drivable-lane_min 3.699999999999921 per-episodes details {"loop-000-ego0": {"driven_any": 7.90792348070859, "survival_time": 59.99999999999873, "driven_lanedir": 7.257076358139224, "in-drivable-lane": 3.699999999999921, "deviation-heading": 8.014800122924795, "distance-from-start": 3.1352067930056204, "deviation-center-line": 3.9569096055519832, "driven_lanedir_consec": 7.257076358139224}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15729
1371
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 10:02:52+00:00 2022-11-25 10:10:41+00:00 0:07:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.600000000000088 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.632159705482154 deviation-center-line_median 1.3081389239405827
other stats deviation-center-line_max 2.326700738789359 deviation-center-line_mean 1.3553184483715823 deviation-center-line_min 0.478295206815805 deviation-heading_max 13.275582297742869 deviation-heading_mean 5.86203126759388 deviation-heading_median 3.87409882358932 deviation-heading_min 2.4243451254540154 distance-from-start_max 1.7642383767171703 distance-from-start_mean 0.8529002822895393 distance-from-start_median 0.6282559729710666 distance-from-start_min 0.3908508064988535 driven_any_max 1.9264193226652369 driven_any_mean 1.1845053699943453 driven_any_median 1.1794481232075351 driven_any_min 0.4527059108970736 driven_lanedir_consec_max 1.4481088798299764 driven_lanedir_consec_mean 0.7743773511394898 driven_lanedir_consec_min 0.3850811137636747 driven_lanedir_max 1.866592754655453 driven_lanedir_mean 0.878998319845859 driven_lanedir_median 0.632159705482154 driven_lanedir_min 0.3850811137636747 in-drivable-lane_max 9.750000000000052 in-drivable-lane_mean 2.4375000000000133 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.7381216309300388, "survival_time": 15.600000000000088, "driven_lanedir": 0.6542081678349949, "in-drivable-lane": 0.0, "deviation-heading": 4.518202801384537, "distance-from-start": 0.6630227072269572, "deviation-center-line": 2.015004802080792, "driven_lanedir_consec": 0.6542081678349949}, "udem-000-ego1": {"driven_any": 0.4527059108970736, "survival_time": 15.600000000000088, "driven_lanedir": 0.3850811137636747, "in-drivable-lane": 0.0, "deviation-heading": 13.275582297742869, "distance-from-start": 0.3908508064988535, "deviation-center-line": 2.326700738789359, "driven_lanedir_consec": 0.3850811137636747}, "udem-000-ego2": {"driven_any": 1.620774615485032, "survival_time": 15.600000000000088, "driven_lanedir": 0.6101112431293132, "in-drivable-lane": 9.750000000000052, "deviation-heading": 2.4243451254540154, "distance-from-start": 0.593489238715176, "deviation-center-line": 0.478295206815805, "driven_lanedir_consec": 0.6101112431293132}, "udem-000-ego3": {"driven_any": 1.9264193226652369, "survival_time": 15.600000000000088, "driven_lanedir": 1.866592754655453, "in-drivable-lane": 0.0, "deviation-heading": 3.2299948457941037, "distance-from-start": 1.7642383767171703, "deviation-center-line": 0.6012730458003733, "driven_lanedir_consec": 1.4481088798299764}}simulation-passed 1 survival_time_max 15.600000000000088 survival_time_mean 15.600000000000088 survival_time_min 15.600000000000088
No reset possible 15725
1372
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 09:53:11+00:00 2022-11-25 10:02:22+00:00 0:09:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 20.99999999999923 driven_lanedir_consec_median 4.0884837380458805 deviation-center-line_median 2.695625680055459
other stats deviation-center-line_max 3.760494235524334 deviation-center-line_mean 2.695625680055459 deviation-center-line_min 1.6307571245865848 deviation-heading_max 16.4105973807697 deviation-heading_mean 11.860227671622678 deviation-heading_median 11.860227671622678 deviation-heading_min 7.309857962475653 distance-from-start_max 1.304426928202213 distance-from-start_mean 1.2965999605088792 distance-from-start_median 1.2965999605088792 distance-from-start_min 1.2887729928155454 driven_any_max 7.907152912095959 driven_any_mean 6.31401902459978 driven_any_median 6.31401902459978 driven_any_min 4.7208851371036005 driven_lanedir_consec_max 5.458715746988582 driven_lanedir_consec_mean 4.0884837380458805 driven_lanedir_consec_min 2.718251729103179 driven_lanedir_max 6.3988192240923825 driven_lanedir_mean 4.646395886012135 driven_lanedir_median 4.646395886012135 driven_lanedir_min 2.8939725479318863 in-drivable-lane_max 35.44999999999849 in-drivable-lane_mean 20.99999999999923 in-drivable-lane_min 6.5499999999999705 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907152912095959, "survival_time": 59.99999999999873, "driven_lanedir": 6.3988192240923825, "in-drivable-lane": 6.5499999999999705, "deviation-heading": 16.4105973807697, "distance-from-start": 1.304426928202213, "deviation-center-line": 3.760494235524334, "driven_lanedir_consec": 5.458715746988582}, "loop2-000-ego1": {"driven_any": 4.7208851371036005, "survival_time": 59.99999999999873, "driven_lanedir": 2.8939725479318863, "in-drivable-lane": 35.44999999999849, "deviation-heading": 7.309857962475653, "distance-from-start": 1.2887729928155454, "deviation-center-line": 1.6307571245865848, "driven_lanedir_consec": 2.718251729103179}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15715
1375
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 09:41:49+00:00 2022-11-25 09:53:03+00:00 0:11:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 47.79999999999942 in-drivable-lane_median 2.8000000000000256 driven_lanedir_consec_median 5.18459434359118 deviation-center-line_median 3.699496100516519
other stats deviation-center-line_max 3.699496100516519 deviation-center-line_mean 3.699496100516519 deviation-center-line_min 3.699496100516519 deviation-heading_max 9.466298481362792 deviation-heading_mean 9.466298481362792 deviation-heading_median 9.466298481362792 deviation-heading_min 9.466298481362792 distance-from-start_max 3.1238999301798773 distance-from-start_mean 3.1238999301798773 distance-from-start_median 3.1238999301798773 distance-from-start_min 3.1238999301798773 driven_any_max 6.201539235860637 driven_any_mean 6.201539235860637 driven_any_median 6.201539235860637 driven_any_min 6.201539235860637 driven_lanedir_consec_max 5.18459434359118 driven_lanedir_consec_mean 5.18459434359118 driven_lanedir_consec_min 5.18459434359118 driven_lanedir_max 5.57926013447783 driven_lanedir_mean 5.57926013447783 driven_lanedir_median 5.57926013447783 driven_lanedir_min 5.57926013447783 in-drivable-lane_max 2.8000000000000256 in-drivable-lane_mean 2.8000000000000256 in-drivable-lane_min 2.8000000000000256 per-episodes details {"udem-000-ego0": {"driven_any": 6.201539235860637, "survival_time": 47.79999999999942, "driven_lanedir": 5.57926013447783, "in-drivable-lane": 2.8000000000000256, "deviation-heading": 9.466298481362792, "distance-from-start": 3.1238999301798773, "deviation-center-line": 3.699496100516519, "driven_lanedir_consec": 5.18459434359118}}simulation-passed 1 survival_time_max 47.79999999999942 survival_time_mean 47.79999999999942 survival_time_min 47.79999999999942
No reset possible 15712
1376
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 09:39:22+00:00 2022-11-25 09:41:43+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.799999999999991 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4508087220962482 deviation-center-line_median 0.16893126465397185
other stats deviation-center-line_max 0.16893126465397185 deviation-center-line_mean 0.16893126465397185 deviation-center-line_min 0.16893126465397185 deviation-heading_max 1.982521126203933 deviation-heading_mean 1.982521126203933 deviation-heading_median 1.982521126203933 deviation-heading_min 1.982521126203933 distance-from-start_max 0.45750013825958025 distance-from-start_mean 0.45750013825958025 distance-from-start_median 0.45750013825958025 distance-from-start_min 0.45750013825958025 driven_any_max 0.48593360268052593 driven_any_mean 0.48593360268052593 driven_any_median 0.48593360268052593 driven_any_min 0.48593360268052593 driven_lanedir_consec_max 0.4508087220962482 driven_lanedir_consec_mean 0.4508087220962482 driven_lanedir_consec_min 0.4508087220962482 driven_lanedir_max 0.4508087220962482 driven_lanedir_mean 0.4508087220962482 driven_lanedir_median 0.4508087220962482 driven_lanedir_min 0.4508087220962482 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.48593360268052593, "survival_time": 4.799999999999991, "driven_lanedir": 0.4508087220962482, "in-drivable-lane": 0.0, "deviation-heading": 1.982521126203933, "distance-from-start": 0.45750013825958025, "deviation-center-line": 0.16893126465397185, "driven_lanedir_consec": 0.4508087220962482}}simulation-passed 1 survival_time_max 4.799999999999991 survival_time_mean 4.799999999999991 survival_time_min 4.799999999999991
No reset possible 15709
1376
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 09:37:24+00:00 2022-11-25 09:39:09+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15703
1378
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 09:24:57+00:00 2022-11-25 09:37:16+00:00 0:12:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.800000000000274 in-drivable-lane_median 6.650000000000064 driven_lanedir_consec_median 1.1819784673925595 deviation-center-line_median 2.327495474805292
other stats deviation-center-line_max 3.639994534529533 deviation-center-line_mean 2.105579761495143 deviation-center-line_min 0.12733356184045555 deviation-heading_max 25.60059403409511 deviation-heading_mean 12.564369041529636 deviation-heading_median 11.726203593219768 deviation-heading_min 1.2044749455838888 distance-from-start_max 2.038362492802486 distance-from-start_mean 1.0142688268450035 distance-from-start_median 0.7954147949250567 distance-from-start_min 0.4278832247274144 driven_any_max 4.2097505972879405 driven_any_mean 1.9363176043199228 driven_any_median 1.5413935362486242 driven_any_min 0.4527327474945024 driven_lanedir_consec_max 2.095712208962743 driven_lanedir_consec_mean 1.2204896907187788 driven_lanedir_consec_min 0.4222896191272536 driven_lanedir_max 2.6283194516987542 driven_lanedir_mean 1.3536415014027816 driven_lanedir_median 1.1819784673925595 driven_lanedir_min 0.4222896191272536 in-drivable-lane_max 28.400000000000283 in-drivable-lane_mean 10.425000000000104 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.4527327474945024, "survival_time": 32.800000000000274, "driven_lanedir": 0.4222896191272536, "in-drivable-lane": 0.0, "deviation-heading": 25.60059403409511, "distance-from-start": 0.4278832247274144, "deviation-center-line": 3.0696696398623726, "driven_lanedir_consec": 0.4222896191272536}, "udem-000-ego1": {"driven_any": 2.550403927403496, "survival_time": 32.800000000000274, "driven_lanedir": 1.8856407751808713, "in-drivable-lane": 4.300000000000061, "deviation-heading": 14.294733664066182, "distance-from-start": 2.038362492802486, "deviation-center-line": 3.639994534529533, "driven_lanedir_consec": 1.8856407751808713}, "udem-000-ego2": {"driven_any": 4.2097505972879405, "survival_time": 32.800000000000274, "driven_lanedir": 2.6283194516987542, "in-drivable-lane": 9.000000000000068, "deviation-heading": 9.157673522373354, "distance-from-start": 1.1049798715162102, "deviation-center-line": 1.5853213097482113, "driven_lanedir_consec": 2.095712208962743}, "udem-000-ego3": {"driven_any": 0.5323831450937525, "survival_time": 32.800000000000274, "driven_lanedir": 0.478316159604248, "in-drivable-lane": 28.400000000000283, "deviation-heading": 1.2044749455838888, "distance-from-start": 0.4858497183339032, "deviation-center-line": 0.12733356184045555, "driven_lanedir_consec": 0.478316159604248}}simulation-passed 1 survival_time_max 32.800000000000274 survival_time_mean 32.800000000000274 survival_time_min 32.800000000000274
No reset possible 15702
1378
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 09:22:58+00:00 2022-11-25 09:24:41+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15701
1378
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 09:20:51+00:00 2022-11-25 09:22:22+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15697
1379
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 09:16:25+00:00 2022-11-25 09:20:16+00:00 0:03:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.6000000000001 in-drivable-lane_median 4.000000000000039 driven_lanedir_consec_median 0.9318161065088516 deviation-center-line_median 1.7070485583129478
other stats deviation-center-line_max 2.3861558724099616 deviation-center-line_mean 1.7070485583129478 deviation-center-line_min 1.027941244215934 deviation-heading_max 2.859705219083658 deviation-heading_mean 2.7073206256158873 deviation-heading_median 2.7073206256158873 deviation-heading_min 2.5549360321481163 distance-from-start_max 0.9364211858596492 distance-from-start_mean 0.7935180157020639 distance-from-start_median 0.7935180157020639 distance-from-start_min 0.6506148455444788 driven_any_max 2.0525516416244045 driven_any_mean 1.4717072560229565 driven_any_median 1.4717072560229565 driven_any_min 0.8908628704215079 driven_lanedir_consec_max 1.0063823079096532 driven_lanedir_consec_mean 0.9318161065088516 driven_lanedir_consec_min 0.8572499051080499 driven_lanedir_max 1.0063823079096532 driven_lanedir_mean 0.9318161065088516 driven_lanedir_median 0.9318161065088516 driven_lanedir_min 0.8572499051080499 in-drivable-lane_max 8.000000000000078 in-drivable-lane_mean 4.000000000000039 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 2.0525516416244045, "survival_time": 16.6000000000001, "driven_lanedir": 1.0063823079096532, "in-drivable-lane": 8.000000000000078, "deviation-heading": 2.5549360321481163, "distance-from-start": 0.9364211858596492, "deviation-center-line": 1.027941244215934, "driven_lanedir_consec": 1.0063823079096532}, "loop2-000-ego1": {"driven_any": 0.8908628704215079, "survival_time": 16.6000000000001, "driven_lanedir": 0.8572499051080499, "in-drivable-lane": 0.0, "deviation-heading": 2.859705219083658, "distance-from-start": 0.6506148455444788, "deviation-center-line": 2.3861558724099616, "driven_lanedir_consec": 0.8572499051080499}}simulation-passed 1 survival_time_max 16.6000000000001 survival_time_mean 16.6000000000001 survival_time_min 16.6000000000001
No reset possible 15688
1384
Bea Baselines 🐤baseline-duckietown lx22-state-estimation
sim success yes davinci-stage-01-6.2.51
2022-11-25 08:58:39+00:00 2022-11-25 09:16:17+00:00 0:17:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 6.758084964004935 survival_time_median 59.99999999999873 deviation-center-line_median 4.110887960185084 in-drivable-lane_median 6.699999999999772
other stats deviation-center-line_max 4.751705434067512 deviation-center-line_mean 4.083047675833452 deviation-center-line_min 3.3865496332477587 deviation-heading_max 10.318812605167231 deviation-heading_mean 8.579691749776854 deviation-heading_median 8.590258659029166 deviation-heading_min 6.830003985134167 distance-from-start_max 3.179927177753368 distance-from-start_mean 2.916036932329033 distance-from-start_median 2.949213652789888 distance-from-start_min 2.6189699664438435 driven_any_max 7.921230029171734 driven_any_mean 7.916682424154999 driven_any_median 7.921108515534519 driven_any_min 7.907708727758742 driven_lanedir_consec_max 7.452580355005264 driven_lanedir_consec_mean 6.834157213873958 driven_lanedir_consec_min 6.291806322611676 driven_lanedir_max 7.452580355005264 driven_lanedir_mean 6.834157213873958 driven_lanedir_median 6.758084964004935 driven_lanedir_min 6.291806322611676 in-drivable-lane_max 10.649999999999904 in-drivable-lane_mean 6.666666666666565 in-drivable-lane_min 2.650000000000018 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 7.907708727758742, "survival_time": 59.99999999999873, "driven_lanedir": 6.291806322611676, "in-drivable-lane": 10.649999999999904, "deviation-heading": 8.590258659029166, "distance-from-start": 2.6189699664438435, "deviation-center-line": 3.3865496332477587, "driven_lanedir_consec": 6.291806322611676}, "LF-zig-zag-001-ego0": {"driven_any": 7.921108515534519, "survival_time": 59.99999999999873, "driven_lanedir": 6.758084964004935, "in-drivable-lane": 6.699999999999772, "deviation-heading": 10.318812605167231, "distance-from-start": 2.949213652789888, "deviation-center-line": 4.110887960185084, "driven_lanedir_consec": 6.758084964004935}, "LF-zig-zag-002-ego0": {"driven_any": 7.921230029171734, "survival_time": 59.99999999999873, "driven_lanedir": 7.452580355005264, "in-drivable-lane": 2.650000000000018, "deviation-heading": 6.830003985134167, "distance-from-start": 3.179927177753368, "deviation-center-line": 4.751705434067512, "driven_lanedir_consec": 7.452580355005264}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15685
1385
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-2of5 success no davinci-stage-01-6.2.51
2022-11-25 08:55:15+00:00 2022-11-25 08:58:22+00:00 0:03:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 2.2908545631196513
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 2.2908545631196513 distance-from-start_median 2.2908545631196513 distance-from-start_min 2.2908545631196513 driven_any_max 2.424431777963462 driven_any_mean 2.424431777963462 driven_any_median 2.424431777963462 driven_any_min 2.424431777963462 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 19.40000000000014 in-drivable-lane_mean 19.40000000000014 in-drivable-lane_median 19.40000000000014 in-drivable-lane_min 19.40000000000014 per-episodes details {"d40-ego0": {"driven_any": 2.424431777963462, "survival_time": 19.40000000000014, "driven_lanedir": 0.0, "in-drivable-lane": 19.40000000000014, "deviation-heading": 0.0, "distance-from-start": 2.2908545631196513, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 19.40000000000014 survival_time_mean 19.40000000000014 survival_time_median 19.40000000000014 survival_time_min 19.40000000000014
No reset possible 15678
1393
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 08:44:19+00:00 2022-11-25 08:54:47+00:00 0:10:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 41.749999999999766 in-drivable-lane_median 6.900000000000016 driven_lanedir_consec_median 3.9745094660687017 deviation-center-line_median 2.5019534309596674
other stats deviation-center-line_max 2.5019534309596674 deviation-center-line_mean 2.5019534309596674 deviation-center-line_min 2.5019534309596674 deviation-heading_max 8.823164661208377 deviation-heading_mean 8.823164661208377 deviation-heading_median 8.823164661208377 deviation-heading_min 8.823164661208377 distance-from-start_max 2.066861249644476 distance-from-start_mean 2.066861249644476 distance-from-start_median 2.066861249644476 distance-from-start_min 2.066861249644476 driven_any_max 5.398103349298411 driven_any_mean 5.398103349298411 driven_any_median 5.398103349298411 driven_any_min 5.398103349298411 driven_lanedir_consec_max 3.9745094660687017 driven_lanedir_consec_mean 3.9745094660687017 driven_lanedir_consec_min 3.9745094660687017 driven_lanedir_max 4.1875242033103195 driven_lanedir_mean 4.1875242033103195 driven_lanedir_median 4.1875242033103195 driven_lanedir_min 4.1875242033103195 in-drivable-lane_max 6.900000000000016 in-drivable-lane_mean 6.900000000000016 in-drivable-lane_min 6.900000000000016 per-episodes details {"4way-000-ego0": {"driven_any": 5.398103349298411, "survival_time": 41.749999999999766, "driven_lanedir": 4.1875242033103195, "in-drivable-lane": 6.900000000000016, "deviation-heading": 8.823164661208377, "distance-from-start": 2.066861249644476, "deviation-center-line": 2.5019534309596674, "driven_lanedir_consec": 3.9745094660687017}}simulation-passed 1 survival_time_max 41.749999999999766 survival_time_mean 41.749999999999766 survival_time_min 41.749999999999766
No reset possible 15675
1393
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 08:41:56+00:00 2022-11-25 08:44:05+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15674
1393
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 08:39:55+00:00 2022-11-25 08:41:27+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15672
1394
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 08:37:10+00:00 2022-11-25 08:39:29+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15671
1394
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 08:35:24+00:00 2022-11-25 08:36:56+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15668
1395
Bea Baselines 🐤baseline-duckietown aido-LF-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 08:30:51+00:00 2022-11-25 08:35:17+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.711171788364922 survival_time_median 40.349999999999845 deviation-center-line_median 1.240748308689016 in-drivable-lane_median 23.799999999999777
other stats deviation-center-line_max 1.240748308689016 deviation-center-line_mean 1.240748308689016 deviation-center-line_min 1.240748308689016 deviation-heading_max 6.101282580884011 deviation-heading_mean 6.101282580884011 deviation-heading_median 6.101282580884011 deviation-heading_min 6.101282580884011 distance-from-start_max 2.212301493910936 distance-from-start_mean 2.212301493910936 distance-from-start_median 2.212301493910936 distance-from-start_min 2.212301493910936 driven_any_max 5.2057204076601575 driven_any_mean 5.2057204076601575 driven_any_median 5.2057204076601575 driven_any_min 5.2057204076601575 driven_lanedir_consec_max 1.711171788364922 driven_lanedir_consec_mean 1.711171788364922 driven_lanedir_consec_min 1.711171788364922 driven_lanedir_max 1.8491205538830244 driven_lanedir_mean 1.8491205538830244 driven_lanedir_median 1.8491205538830244 driven_lanedir_min 1.8491205538830244 in-drivable-lane_max 23.799999999999777 in-drivable-lane_mean 23.799999999999777 in-drivable-lane_min 23.799999999999777 per-episodes details {"loop-000-ego0": {"driven_any": 5.2057204076601575, "survival_time": 40.349999999999845, "driven_lanedir": 1.8491205538830244, "in-drivable-lane": 23.799999999999777, "deviation-heading": 6.101282580884011, "distance-from-start": 2.212301493910936, "deviation-center-line": 1.240748308689016, "driven_lanedir_consec": 1.711171788364922}}simulation-passed 1 survival_time_max 40.349999999999845 survival_time_mean 40.349999999999845 survival_time_min 40.349999999999845
No reset possible 15666
1395
Bea Baselines 🐤baseline-duckietown aido-LF-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 08:26:48+00:00 2022-11-25 08:30:24+00:00 0:03:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.5043463704630229 survival_time_median 38.64999999999994 deviation-center-line_median 1.641184807496483 in-drivable-lane_median 13.049999999999702
other stats deviation-center-line_max 1.641184807496483 deviation-center-line_mean 1.641184807496483 deviation-center-line_min 1.641184807496483 deviation-heading_max 9.004333474597422 deviation-heading_mean 9.004333474597422 deviation-heading_median 9.004333474597422 deviation-heading_min 9.004333474597422 distance-from-start_max 1.289867875184339 distance-from-start_mean 1.289867875184339 distance-from-start_median 1.289867875184339 distance-from-start_min 1.289867875184339 driven_any_max 4.979950459048229 driven_any_mean 4.979950459048229 driven_any_median 4.979950459048229 driven_any_min 4.979950459048229 driven_lanedir_consec_max 1.5043463704630229 driven_lanedir_consec_mean 1.5043463704630229 driven_lanedir_consec_min 1.5043463704630229 driven_lanedir_max 2.9702712220813323 driven_lanedir_mean 2.9702712220813323 driven_lanedir_median 2.9702712220813323 driven_lanedir_min 2.9702712220813323 in-drivable-lane_max 13.049999999999702 in-drivable-lane_mean 13.049999999999702 in-drivable-lane_min 13.049999999999702 per-episodes details {"loop2-000-ego0": {"driven_any": 4.979950459048229, "survival_time": 38.64999999999994, "driven_lanedir": 2.9702712220813323, "in-drivable-lane": 13.049999999999702, "deviation-heading": 9.004333474597422, "distance-from-start": 1.289867875184339, "deviation-center-line": 1.641184807496483, "driven_lanedir_consec": 1.5043463704630229}}simulation-passed 1 survival_time_max 38.64999999999994 survival_time_mean 38.64999999999994 survival_time_min 38.64999999999994
No reset possible 15664
1396
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 08:24:29+00:00 2022-11-25 08:26:28+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15663
1396
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 08:18:36+00:00 2022-11-25 08:24:13+00:00 0:05:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.05000000000005 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5291202982996431 deviation-center-line_median 1.3650771644154482
other stats deviation-center-line_max 1.4143558820850943 deviation-center-line_mean 1.1740449019634125 deviation-center-line_min 0.5516693969376595 deviation-heading_max 14.054115112461073 deviation-heading_mean 6.373939040616064 deviation-heading_median 4.363362508254529 deviation-heading_min 2.7149160334941276 distance-from-start_max 1.348161259745274 distance-from-start_mean 0.6995666109185092 distance-from-start_median 0.5188504504250671 distance-from-start_min 0.4124042830786292 driven_any_max 1.587934088864421 driven_any_mean 0.7962633574937147 driven_any_median 0.5721987494193335 driven_any_min 0.45272184227177104 driven_lanedir_consec_max 1.0486503476144455 driven_lanedir_consec_mean 0.6293850194412886 driven_lanedir_consec_min 0.4106491335514222 driven_lanedir_max 1.0486503476144455 driven_lanedir_mean 0.6293908617427207 driven_lanedir_median 0.5291319829025077 driven_lanedir_min 0.4106491335514222 in-drivable-lane_max 3.2000000000000117 in-drivable-lane_mean 0.8000000000000029 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.6186246522010059, "survival_time": 13.05000000000005, "driven_lanedir": 0.5450962481416455, "in-drivable-lane": 0.0, "deviation-heading": 14.054115112461073, "distance-from-start": 0.5257387254184841, "deviation-center-line": 1.4072081625881283, "driven_lanedir_consec": 0.5450962481416455}, "4way-000-ego1": {"driven_any": 0.5257728466376609, "survival_time": 13.05000000000005, "driven_lanedir": 0.51316771766337, "in-drivable-lane": 0.0, "deviation-heading": 2.7149160334941276, "distance-from-start": 0.5119621754316501, "deviation-center-line": 1.4143558820850943, "driven_lanedir_consec": 0.5131443484576408}, "4way-000-ego2": {"driven_any": 1.587934088864421, "survival_time": 13.05000000000005, "driven_lanedir": 1.0486503476144455, "in-drivable-lane": 3.2000000000000117, "deviation-heading": 3.28110944127775, "distance-from-start": 1.348161259745274, "deviation-center-line": 0.5516693969376595, "driven_lanedir_consec": 1.0486503476144455}, "4way-000-ego3": {"driven_any": 0.45272184227177104, "survival_time": 13.05000000000005, "driven_lanedir": 0.4106491335514222, "in-drivable-lane": 0.0, "deviation-heading": 5.445615575231307, "distance-from-start": 0.4124042830786292, "deviation-center-line": 1.3229461662427675, "driven_lanedir_consec": 0.4106491335514222}}simulation-passed 1 survival_time_max 13.05000000000005 survival_time_mean 13.05000000000005 survival_time_min 13.05000000000005
No reset possible 15651
1399
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 08:07:04+00:00 2022-11-25 08:18:16+00:00 0:11:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4352426430008087 deviation-center-line_median 3.497394545816877
other stats deviation-center-line_max 3.497394545816877 deviation-center-line_mean 3.497394545816877 deviation-center-line_min 3.497394545816877 deviation-heading_max 4.5431846817285875 deviation-heading_mean 4.5431846817285875 deviation-heading_median 4.5431846817285875 deviation-heading_min 4.5431846817285875 distance-from-start_max 2.2779004007617862 distance-from-start_mean 2.2779004007617862 distance-from-start_median 2.2779004007617862 distance-from-start_min 2.2779004007617862 driven_any_max 3.579588780115603 driven_any_mean 3.579588780115603 driven_any_median 3.579588780115603 driven_any_min 3.579588780115603 driven_lanedir_consec_max 3.4352426430008087 driven_lanedir_consec_mean 3.4352426430008087 driven_lanedir_consec_min 3.4352426430008087 driven_lanedir_max 3.556065828743906 driven_lanedir_mean 3.556065828743906 driven_lanedir_median 3.556065828743906 driven_lanedir_min 3.556065828743906 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579588780115603, "survival_time": 59.99999999999873, "driven_lanedir": 3.556065828743906, "in-drivable-lane": 0.0, "deviation-heading": 4.5431846817285875, "distance-from-start": 2.2779004007617862, "deviation-center-line": 3.497394545816877, "driven_lanedir_consec": 3.4352426430008087}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15645
1401
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 07:58:53+00:00 2022-11-25 08:06:35+00:00 0:07:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.8916689297600247 deviation-center-line_median 5.681440925821353
other stats deviation-center-line_max 5.681440925821353 deviation-center-line_mean 5.681440925821353 deviation-center-line_min 5.681440925821353 deviation-heading_max 11.493741379653043 deviation-heading_mean 11.493741379653043 deviation-heading_median 11.493741379653043 deviation-heading_min 11.493741379653043 distance-from-start_max 2.522916946842169 distance-from-start_mean 2.522916946842169 distance-from-start_median 2.522916946842169 distance-from-start_min 2.522916946842169 driven_any_max 3.4265750568184306 driven_any_mean 3.4265750568184306 driven_any_median 3.4265750568184306 driven_any_min 3.4265750568184306 driven_lanedir_consec_max 2.8916689297600247 driven_lanedir_consec_mean 2.8916689297600247 driven_lanedir_consec_min 2.8916689297600247 driven_lanedir_max 3.0974169287243676 driven_lanedir_mean 3.0974169287243676 driven_lanedir_median 3.0974169287243676 driven_lanedir_min 3.0974169287243676 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4265750568184306, "survival_time": 59.99999999999873, "driven_lanedir": 3.0974169287243676, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.493741379653043, "distance-from-start": 2.522916946842169, "deviation-center-line": 5.681440925821353, "driven_lanedir_consec": 2.8916689297600247}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15640
1402
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 07:51:53+00:00 2022-11-25 07:58:15+00:00 0:06:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.499999999999858 driven_lanedir_consec_median 2.0645358809359813 deviation-center-line_median 5.566213132905718
other stats deviation-center-line_max 5.566213132905718 deviation-center-line_mean 5.566213132905718 deviation-center-line_min 5.566213132905718 deviation-heading_max 4.9431426026826735 deviation-heading_mean 4.9431426026826735 deviation-heading_median 4.9431426026826735 deviation-heading_min 4.9431426026826735 distance-from-start_max 1.7331587954302872 distance-from-start_mean 1.7331587954302872 distance-from-start_median 1.7331587954302872 distance-from-start_min 1.7331587954302872 driven_any_max 3.504736975249796 driven_any_mean 3.504736975249796 driven_any_median 3.504736975249796 driven_any_min 3.504736975249796 driven_lanedir_consec_max 2.0645358809359813 driven_lanedir_consec_mean 2.0645358809359813 driven_lanedir_consec_min 2.0645358809359813 driven_lanedir_max 3.3607755978458167 driven_lanedir_mean 3.3607755978458167 driven_lanedir_median 3.3607755978458167 driven_lanedir_min 3.3607755978458167 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 2.499999999999858 in-drivable-lane_min 2.499999999999858 per-episodes details {"4way-000-ego0": {"driven_any": 3.504736975249796, "survival_time": 59.99999999999873, "driven_lanedir": 3.3607755978458167, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.9431426026826735, "distance-from-start": 1.7331587954302872, "deviation-center-line": 5.566213132905718, "driven_lanedir_consec": 2.0645358809359813}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15635
1403
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 07:37:02+00:00 2022-11-25 07:51:43+00:00 0:14:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.9999999999999822 driven_lanedir_consec_median 3.396874188758651 deviation-center-line_median 6.848336335212338
other stats deviation-center-line_max 7.516036575940118 deviation-center-line_mean 6.209131018472381 deviation-center-line_min 3.6238148275247304 deviation-heading_max 7.032818929812941 deviation-heading_mean 4.55196967857351 deviation-heading_median 4.199788237499533 deviation-heading_min 2.7754833094820346 distance-from-start_max 2.9834410770695685 distance-from-start_mean 2.4797248726783128 distance-from-start_median 2.446473764157263 distance-from-start_min 2.0425108853291554 driven_any_max 3.579596486578675 driven_any_mean 3.314094256325256 driven_any_median 3.5210921058800326 driven_any_min 2.6345963269622827 driven_lanedir_consec_max 3.551753017565808 driven_lanedir_consec_mean 3.229798941754201 driven_lanedir_consec_min 2.573694371933692 driven_lanedir_max 3.551753017565808 driven_lanedir_mean 3.229798941754201 driven_lanedir_median 3.396874188758651 driven_lanedir_min 2.573694371933692 in-drivable-lane_max 2.9999999999998295 in-drivable-lane_mean 1.2499999999999485 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 2.6345963269622827, "survival_time": 59.99999999999873, "driven_lanedir": 2.573694371933692, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920074235215898, "distance-from-start": 2.0425108853291554, "deviation-center-line": 7.516036575940118, "driven_lanedir_consec": 2.573694371933692}, "loop-000-ego1": {"driven_any": 3.579596486578675, "survival_time": 59.99999999999873, "driven_lanedir": 3.551753017565808, "in-drivable-lane": 0.0, "deviation-heading": 2.7754833094820346, "distance-from-start": 2.724162342686075, "deviation-center-line": 6.299841022357562, "driven_lanedir_consec": 3.551753017565808}, "loop-000-ego2": {"driven_any": 3.5525920285820543, "survival_time": 59.99999999999873, "driven_lanedir": 3.458623985525704, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 7.032818929812941, "distance-from-start": 2.9834410770695685, "deviation-center-line": 3.6238148275247304, "driven_lanedir_consec": 3.458623985525704}, "loop-000-ego3": {"driven_any": 3.489592183178011, "survival_time": 59.99999999999873, "driven_lanedir": 3.335124391991598, "in-drivable-lane": 2.9999999999998295, "deviation-heading": 5.479502239783168, "distance-from-start": 2.168785185628451, "deviation-center-line": 7.396831648067114, "driven_lanedir_consec": 3.335124391991598}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15632
1404
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 07:35:01+00:00 2022-11-25 07:36:39+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15630
1404
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 07:33:22+00:00 2022-11-25 07:34:54+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15626
1405
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 07:27:21+00:00 2022-11-25 07:32:51+00:00 0:05:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 3.4859795177769355 deviation-center-line_median 5.328952992335323
other stats deviation-center-line_max 5.328952992335323 deviation-center-line_mean 5.328952992335323 deviation-center-line_min 5.328952992335323 deviation-heading_max 2.913818063831324 deviation-heading_mean 2.913818063831324 deviation-heading_median 2.913818063831324 deviation-heading_min 2.913818063831324 distance-from-start_max 2.6400931371900738 distance-from-start_mean 2.6400931371900738 distance-from-start_median 2.6400931371900738 distance-from-start_min 2.6400931371900738 driven_any_max 3.5467463468284044 driven_any_mean 3.5467463468284044 driven_any_median 3.5467463468284044 driven_any_min 3.5467463468284044 driven_lanedir_consec_max 3.4859795177769355 driven_lanedir_consec_mean 3.4859795177769355 driven_lanedir_consec_min 3.4859795177769355 driven_lanedir_max 3.4859795177769355 driven_lanedir_mean 3.4859795177769355 driven_lanedir_median 3.4859795177769355 driven_lanedir_min 3.4859795177769355 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 1.0999999999999377 in-drivable-lane_min 1.0999999999999377 per-episodes details {"loop-000-ego0": {"driven_any": 3.5467463468284044, "survival_time": 59.99999999999873, "driven_lanedir": 3.4859795177769355, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.913818063831324, "distance-from-start": 2.6400931371900738, "deviation-center-line": 5.328952992335323, "driven_lanedir_consec": 3.4859795177769355}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15619
1407
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 07:21:24+00:00 2022-11-25 07:27:14+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.599999999999376 in-drivable-lane_median 3.099999999999902 driven_lanedir_consec_median 2.1822085786120473 deviation-center-line_median 4.281969506383752
other stats deviation-center-line_max 4.281969506383752 deviation-center-line_mean 4.281969506383752 deviation-center-line_min 4.281969506383752 deviation-heading_max 8.956926170181262 deviation-heading_mean 8.956926170181262 deviation-heading_median 8.956926170181262 deviation-heading_min 8.956926170181262 distance-from-start_max 1.84932503046977 distance-from-start_mean 1.84932503046977 distance-from-start_median 1.84932503046977 distance-from-start_min 1.84932503046977 driven_any_max 2.760582128240964 driven_any_mean 2.760582128240964 driven_any_median 2.760582128240964 driven_any_min 2.760582128240964 driven_lanedir_consec_max 2.1822085786120473 driven_lanedir_consec_mean 2.1822085786120473 driven_lanedir_consec_min 2.1822085786120473 driven_lanedir_max 2.5502818256429407 driven_lanedir_mean 2.5502818256429407 driven_lanedir_median 2.5502818256429407 driven_lanedir_min 2.5502818256429407 in-drivable-lane_max 3.099999999999902 in-drivable-lane_mean 3.099999999999902 in-drivable-lane_min 3.099999999999902 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}simulation-passed 1 survival_time_max 48.599999999999376 survival_time_mean 48.599999999999376 survival_time_min 48.599999999999376
No reset possible 15615
1408
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 07:13:50+00:00 2022-11-25 07:21:17+00:00 0:07:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0916627020116696 deviation-center-line_median 5.917247386091067
other stats deviation-center-line_max 5.917247386091067 deviation-center-line_mean 5.917247386091067 deviation-center-line_min 5.917247386091067 deviation-heading_max 8.389432171221175 deviation-heading_mean 8.389432171221175 deviation-heading_median 8.389432171221175 deviation-heading_min 8.389432171221175 distance-from-start_max 1.030783298044124 distance-from-start_mean 1.030783298044124 distance-from-start_median 1.030783298044124 distance-from-start_min 1.030783298044124 driven_any_max 3.449081983725078 driven_any_mean 3.449081983725078 driven_any_median 3.449081983725078 driven_any_min 3.449081983725078 driven_lanedir_consec_max 2.0916627020116696 driven_lanedir_consec_mean 2.0916627020116696 driven_lanedir_consec_min 2.0916627020116696 driven_lanedir_max 3.204014012014441 driven_lanedir_mean 3.204014012014441 driven_lanedir_median 3.204014012014441 driven_lanedir_min 3.204014012014441 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081983725078, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014012014441, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432171221175, "distance-from-start": 1.030783298044124, "deviation-center-line": 5.917247386091067, "driven_lanedir_consec": 2.0916627020116696}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15612
1409
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 07:11:12+00:00 2022-11-25 07:13:43+00:00 0:02:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15607
1410
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 06:53:55+00:00 2022-11-25 07:10:34+00:00 0:16:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.1749999999998764 driven_lanedir_consec_median 3.3248172596190684 deviation-center-line_median 5.75716887821971
other stats deviation-center-line_max 6.627907079134618 deviation-center-line_mean 5.497801828136498 deviation-center-line_min 3.848962476971951 deviation-heading_max 11.413636489405157 deviation-heading_mean 7.6893062297262045 deviation-heading_median 7.06163724081356 deviation-heading_min 5.220313947872544 distance-from-start_max 3.071318609975737 distance-from-start_mean 2.3992593598839593 distance-from-start_median 2.4470384918328207 distance-from-start_min 1.6316418458944593 driven_any_max 3.579587562679039 driven_any_mean 3.521088411159384 driven_any_median 3.51433972593214 driven_any_min 3.476086630094217 driven_lanedir_consec_max 3.4776012543896866 driven_lanedir_consec_mean 3.338894985703014 driven_lanedir_consec_min 3.2283441691842336 driven_lanedir_max 3.4776012543896866 driven_lanedir_mean 3.377098944667144 driven_lanedir_median 3.3812666483317493 driven_lanedir_min 3.2682612276153913 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 1.9499999999999087 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.509092316575898, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813732916227455, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222638225493, "distance-from-start": 1.6316418458944593, "deviation-center-line": 6.627907079134618, "driven_lanedir_consec": 3.3813732916227455}, "autolab-000-ego1": {"driven_any": 3.5195871352883814, "survival_time": 59.99999999999873, "driven_lanedir": 3.381160005040753, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.220313947872544, "distance-from-start": 2.830245940398582, "deviation-center-line": 6.258804535671791, "driven_lanedir_consec": 3.2283441691842336}, "autolab-000-ego2": {"driven_any": 3.476086630094217, "survival_time": 59.99999999999873, "driven_lanedir": 3.2682612276153913, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.691051843401628, "distance-from-start": 2.063831043267061, "deviation-center-line": 5.25553322076763, "driven_lanedir_consec": 3.2682612276153913}, "autolab-000-ego3": {"driven_any": 3.579587562679039, "survival_time": 59.99999999999873, "driven_lanedir": 3.4776012543896866, "in-drivable-lane": 0.0, "deviation-heading": 11.413636489405157, "distance-from-start": 3.071318609975737, "deviation-center-line": 3.848962476971951, "driven_lanedir_consec": 3.4776012543896866}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15599
1412
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 06:47:24+00:00 2022-11-25 06:53:14+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.849999999999876 driven_lanedir_consec_median 2.226136954518312 deviation-center-line_median 6.024694972149957
other stats deviation-center-line_max 6.024694972149957 deviation-center-line_mean 6.024694972149957 deviation-center-line_min 6.024694972149957 deviation-heading_max 10.118703616800987 deviation-heading_mean 10.118703616800987 deviation-heading_median 10.118703616800987 deviation-heading_min 10.118703616800987 distance-from-start_max 1.7127730347184449 distance-from-start_mean 1.7127730347184449 distance-from-start_median 1.7127730347184449 distance-from-start_min 1.7127730347184449 driven_any_max 3.434377949467938 driven_any_mean 3.434377949467938 driven_any_median 3.434377949467938 driven_any_min 3.434377949467938 driven_lanedir_consec_max 2.226136954518312 driven_lanedir_consec_mean 2.226136954518312 driven_lanedir_consec_min 2.226136954518312 driven_lanedir_max 3.149126612551262 driven_lanedir_mean 3.149126612551262 driven_lanedir_median 3.149126612551262 driven_lanedir_min 3.149126612551262 in-drivable-lane_max 4.849999999999876 in-drivable-lane_mean 4.849999999999876 in-drivable-lane_min 4.849999999999876 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.434377949467938, "survival_time": 59.99999999999873, "driven_lanedir": 3.149126612551262, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.118703616800987, "distance-from-start": 1.7127730347184449, "deviation-center-line": 6.024694972149957, "driven_lanedir_consec": 2.226136954518312}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15597
1413
Bea Baselines 🐤minimal-agent-full aido-hello-sim-full-validation
sanity-check success no davinci-stage-01-6.2.51
2022-11-25 06:45:33+00:00 2022-11-25 06:47:03+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.010100650259948551 deviation-center-line_median 0.006374430067497517
other stats deviation-center-line_max 0.006374430067497517 deviation-center-line_mean 0.006374430067497517 deviation-center-line_min 0.006374430067497517 deviation-heading_max 0.2614212407761817 deviation-heading_mean 0.2614212407761817 deviation-heading_median 0.2614212407761817 deviation-heading_min 0.2614212407761817 distance-from-start_max 0.011536496219628692 distance-from-start_mean 0.011536496219628692 distance-from-start_median 0.011536496219628692 distance-from-start_min 0.011536496219628692 driven_any_max 0.011538646402322758 driven_any_mean 0.011538646402322758 driven_any_median 0.011538646402322758 driven_any_min 0.011538646402322758 driven_lanedir_consec_max 0.010100650259948551 driven_lanedir_consec_mean 0.010100650259948551 driven_lanedir_consec_min 0.010100650259948551 driven_lanedir_max 0.010100650259948551 driven_lanedir_mean 0.010100650259948551 driven_lanedir_median 0.010100650259948551 driven_lanedir_min 0.010100650259948551 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.011538646402322758, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100650259948551, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628692, "deviation-center-line": 0.006374430067497517, "driven_lanedir_consec": 0.010100650259948551}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15588
1416
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 06:35:32+00:00 2022-11-25 06:45:26+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.0889200570209905 deviation-center-line_median 4.314589046654948
other stats deviation-center-line_max 4.8936832240285515 deviation-center-line_mean 4.21123266117369 deviation-center-line_min 3.322069327356314 deviation-heading_max 4.486523530569267 deviation-heading_mean 3.521671102618294 deviation-heading_median 3.585810169469168 deviation-heading_min 2.4285405409655727 distance-from-start_max 2.3451607383802098 distance-from-start_mean 2.0486952679802566 distance-from-start_median 2.129939218686506 distance-from-start_min 1.5897418961678045 driven_any_max 3.5795869614824305 driven_any_mean 3.25109025299247 driven_any_median 3.2660893638644968 driven_any_min 2.8925953227584573 driven_lanedir_consec_max 3.397941501351981 driven_lanedir_consec_mean 3.109352247171395 driven_lanedir_consec_min 2.8616273732916166 driven_lanedir_max 3.5621601978351585 driven_lanedir_mean 3.221959634688333 driven_lanedir_median 3.226336335661105 driven_lanedir_min 2.873005669595961 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 0.27499999999998437 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.9525969188333514, "survival_time": 59.99999999999873, "driven_lanedir": 2.895716604572407, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4285405409655727, "distance-from-start": 2.3451607383802098, "deviation-center-line": 4.511140920492081, "driven_lanedir_consec": 2.895716415698084}, "4way-001-ego1": {"driven_any": 2.8925953227584573, "survival_time": 59.99999999999873, "driven_lanedir": 2.873005669595961, "in-drivable-lane": 0.0, "deviation-heading": 3.9504849161101903, "distance-from-start": 1.5897418961678045, "deviation-center-line": 4.8936832240285515, "driven_lanedir_consec": 2.8616273732916166}, "4way-001-ego2": {"driven_any": 3.5795869614824305, "survival_time": 59.99999999999873, "driven_lanedir": 3.556956066749803, "in-drivable-lane": 0.0, "deviation-heading": 4.486523530569267, "distance-from-start": 2.2859218093052247, "deviation-center-line": 4.1180371728178145, "driven_lanedir_consec": 3.397941501351981}, "4way-001-ego3": {"driven_any": 3.579581808895642, "survival_time": 59.99999999999873, "driven_lanedir": 3.5621601978351585, "in-drivable-lane": 0.0, "deviation-heading": 3.221135422828146, "distance-from-start": 1.9739566280677876, "deviation-center-line": 3.322069327356314, "driven_lanedir_consec": 3.282123698343897}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15581
1417
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 06:25:40+00:00 2022-11-25 06:35:23+00:00 0:09:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.29523972955995 deviation-center-line_median 3.2365915346637033
other stats deviation-center-line_max 3.2365915346637033 deviation-center-line_mean 3.2365915346637033 deviation-center-line_min 3.2365915346637033 deviation-heading_max 2.8126081910568588 deviation-heading_mean 2.8126081910568588 deviation-heading_median 2.8126081910568588 deviation-heading_min 2.8126081910568588 distance-from-start_max 2.0188492106698117 distance-from-start_mean 2.0188492106698117 distance-from-start_median 2.0188492106698117 distance-from-start_min 2.0188492106698117 driven_any_max 3.5795821627460884 driven_any_mean 3.5795821627460884 driven_any_median 3.5795821627460884 driven_any_min 3.5795821627460884 driven_lanedir_consec_max 3.29523972955995 driven_lanedir_consec_mean 3.29523972955995 driven_lanedir_consec_min 3.29523972955995 driven_lanedir_max 3.5654143377633662 driven_lanedir_mean 3.5654143377633662 driven_lanedir_median 3.5654143377633662 driven_lanedir_min 3.5654143377633662 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 3.5795821627460884, "survival_time": 59.99999999999873, "driven_lanedir": 3.5654143377633662, "in-drivable-lane": 0.0, "deviation-heading": 2.8126081910568588, "distance-from-start": 2.0188492106698117, "deviation-center-line": 3.2365915346637033, "driven_lanedir_consec": 3.29523972955995}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15577
1418
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
466 error yes davinci-stage-01-6.2.51
2022-11-25 06:23:57+00:00 2022-11-25 06:25:26+00:00 0:01:29 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f9a3ca3de50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f9a3ca3de50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15573
1420
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 06:19:59+00:00 2022-11-25 06:23:51+00:00 0:03:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 1.601745896224546 deviation-center-line_median 5.338593212765516
other stats deviation-center-line_max 5.338593212765516 deviation-center-line_mean 5.338593212765516 deviation-center-line_min 5.338593212765516 deviation-heading_max 6.235252951727364 deviation-heading_mean 6.235252951727364 deviation-heading_median 6.235252951727364 deviation-heading_min 6.235252951727364 distance-from-start_max 1.390965508634873 distance-from-start_mean 1.390965508634873 distance-from-start_median 1.390965508634873 distance-from-start_min 1.390965508634873 driven_any_max 3.4836910006517208 driven_any_mean 3.4836910006517208 driven_any_median 3.4836910006517208 driven_any_min 3.4836910006517208 driven_lanedir_consec_max 1.601745896224546 driven_lanedir_consec_mean 1.601745896224546 driven_lanedir_consec_min 1.601745896224546 driven_lanedir_max 3.2989420775531983 driven_lanedir_mean 3.2989420775531983 driven_lanedir_median 3.2989420775531983 driven_lanedir_min 3.2989420775531983 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"loop-000-ego0": {"driven_any": 3.4836910006517208, "survival_time": 59.99999999999873, "driven_lanedir": 3.2989420775531983, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.235252951727364, "distance-from-start": 1.390965508634873, "deviation-center-line": 5.338593212765516, "driven_lanedir_consec": 1.601745896224546}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15566
1421
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 06:15:13+00:00 2022-11-25 06:19:31+00:00 0:04:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9499999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.9030524638411164 deviation-center-line_median 3.789617561777741
other stats deviation-center-line_max 3.789617561777741 deviation-center-line_mean 3.789617561777741 deviation-center-line_min 3.789617561777741 deviation-heading_max 4.33452755283993 deviation-heading_mean 4.33452755283993 deviation-heading_median 4.33452755283993 deviation-heading_min 4.33452755283993 distance-from-start_max 1.573887224004309 distance-from-start_mean 1.573887224004309 distance-from-start_median 1.573887224004309 distance-from-start_min 1.573887224004309 driven_any_max 2.934594724979699 driven_any_mean 2.934594724979699 driven_any_median 2.934594724979699 driven_any_min 2.934594724979699 driven_lanedir_consec_max 2.9030524638411164 driven_lanedir_consec_mean 2.9030524638411164 driven_lanedir_consec_min 2.9030524638411164 driven_lanedir_max 2.9099692680363995 driven_lanedir_mean 2.9099692680363995 driven_lanedir_median 2.9099692680363995 driven_lanedir_min 2.9099692680363995 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.934594724979699, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099692680363995, "in-drivable-lane": 0.0, "deviation-heading": 4.33452755283993, "distance-from-start": 1.573887224004309, "deviation-center-line": 3.789617561777741, "driven_lanedir_consec": 2.9030524638411164}}simulation-passed 1 survival_time_max 49.9499999999993 survival_time_mean 49.9499999999993 survival_time_min 49.9499999999993
No reset possible 15562
1422
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 06:05:18+00:00 2022-11-25 06:14:51+00:00 0:09:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5500000000000078 driven_lanedir_consec_median 2.825841304293628 deviation-center-line_median 6.148412844000683
other stats deviation-center-line_max 7.459308588139718 deviation-center-line_mean 5.79704956898892 deviation-center-line_min 3.4320639998145963 deviation-heading_max 5.71924387882506 deviation-heading_mean 3.762143800377421 deviation-heading_median 3.459178970777112 deviation-heading_min 2.410973381130398 distance-from-start_max 2.3395282410041216 distance-from-start_mean 1.7201588165346102 distance-from-start_median 1.841509860392298 distance-from-start_min 0.8580873043497238 driven_any_max 3.579593143168887 driven_any_mean 2.845719156432434 driven_any_median 2.859597815206898 driven_any_min 2.0840878521470536 driven_lanedir_consec_max 3.541021205942728 driven_lanedir_consec_mean 2.496966407955825 driven_lanedir_consec_min 0.795161817293316 driven_lanedir_max 3.5571658869822893 driven_lanedir_mean 2.7899921003455295 driven_lanedir_median 2.8258414934613327 driven_lanedir_min 1.9511195274771624 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.7875000000000112 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 2.889596951730418, "survival_time": 59.99999999999873, "driven_lanedir": 2.8328219934740586, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.497059451447388, "distance-from-start": 2.1662522780274744, "deviation-center-line": 7.459308588139718, "driven_lanedir_consec": 2.8328219934740586}, "udem-001-ego1": {"driven_any": 2.0840878521470536, "survival_time": 59.99999999999873, "driven_lanedir": 1.9511195274771624, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.71924387882506, "distance-from-start": 0.8580873043497238, "deviation-center-line": 6.835139580883994, "driven_lanedir_consec": 0.795161817293316}, "udem-001-ego2": {"driven_any": 2.8295986786833778, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486073, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130398, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113197}, "udem-001-ego3": {"driven_any": 3.579593143168887, "survival_time": 59.99999999999873, "driven_lanedir": 3.5571658869822893, "in-drivable-lane": 0.0, "deviation-heading": 4.421298490106836, "distance-from-start": 1.5167674427571216, "deviation-center-line": 3.4320639998145963, "driven_lanedir_consec": 3.541021205942728}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15557
1424
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 05:56:40+00:00 2022-11-25 06:05:11+00:00 0:08:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.7499999999999003 driven_lanedir_consec_median 3.413654775946143 deviation-center-line_median 5.825136539085346
other stats deviation-center-line_max 7.271389663591529 deviation-center-line_mean 5.643680285819743 deviation-center-line_min 3.653058401516753 deviation-heading_max 7.874648432322972 deviation-heading_mean 6.124556829055049 deviation-heading_median 6.375210937656442 deviation-heading_min 3.873157008584335 distance-from-start_max 2.9910037406399708 distance-from-start_mean 2.647919639528748 distance-from-start_median 2.691628549092109 distance-from-start_min 2.2174177192908053 driven_any_max 3.546591928181605 driven_any_mean 3.512845634385255 driven_any_median 3.527100534458862 driven_any_min 3.4505895404416917 driven_lanedir_consec_max 3.4489608990054887 driven_lanedir_consec_mean 3.3789582924454376 driven_lanedir_consec_min 3.2395627188839757 driven_lanedir_max 3.4489608990054887 driven_lanedir_mean 3.3789582924454376 driven_lanedir_median 3.413654775946143 driven_lanedir_min 3.2395627188839757 in-drivable-lane_max 4.299999999999894 in-drivable-lane_mean 2.2249999999999277 in-drivable-lane_min 1.1000000000000156 per-episodes details {"loop-000-ego0": {"driven_any": 3.543607782867822, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359237462525183, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.874648432322972, "distance-from-start": 2.7860421196308716, "deviation-center-line": 4.889961247945737, "driven_lanedir_consec": 3.4359237462525183}, "loop-000-ego1": {"driven_any": 3.4505895404416917, "survival_time": 59.99999999999873, "driven_lanedir": 3.2395627188839757, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.05385337048463, "distance-from-start": 2.2174177192908053, "deviation-center-line": 7.271389663591529, "driven_lanedir_consec": 3.2395627188839757}, "loop-000-ego2": {"driven_any": 3.546591928181605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4489608990054887, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 6.696568504828256, "distance-from-start": 2.9910037406399708, "deviation-center-line": 3.653058401516753, "driven_lanedir_consec": 3.4489608990054887}, "loop-000-ego3": {"driven_any": 3.5105932860499025, "survival_time": 59.99999999999873, "driven_lanedir": 3.391385805639767, "in-drivable-lane": 2.2999999999998693, "deviation-heading": 3.873157008584335, "distance-from-start": 2.597214978553346, "deviation-center-line": 6.760311830224953, "driven_lanedir_consec": 3.391385805639767}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15551
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-01-6.2.51
2022-11-25 05:47:24+00:00 2022-11-25 05:56:27+00:00 0:09:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15543
1426
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 05:35:25+00:00 2022-11-25 05:47:18+00:00 0:11:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4692997359006403 deviation-center-line_median 3.623644320092078
other stats deviation-center-line_max 3.623644320092078 deviation-center-line_mean 3.623644320092078 deviation-center-line_min 3.623644320092078 deviation-heading_max 11.947232259174388 deviation-heading_mean 11.947232259174388 deviation-heading_median 11.947232259174388 deviation-heading_min 11.947232259174388 distance-from-start_max 3.168925231786075 distance-from-start_mean 3.168925231786075 distance-from-start_median 3.168925231786075 distance-from-start_min 3.168925231786075 driven_any_max 3.5795865108076983 driven_any_mean 3.5795865108076983 driven_any_median 3.5795865108076983 driven_any_min 3.5795865108076983 driven_lanedir_consec_max 3.4692997359006403 driven_lanedir_consec_mean 3.4692997359006403 driven_lanedir_consec_min 3.4692997359006403 driven_lanedir_max 3.4692997359006403 driven_lanedir_mean 3.4692997359006403 driven_lanedir_median 3.4692997359006403 driven_lanedir_min 3.4692997359006403 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5795865108076983, "survival_time": 59.99999999999873, "driven_lanedir": 3.4692997359006403, "in-drivable-lane": 0.0, "deviation-heading": 11.947232259174388, "distance-from-start": 3.168925231786075, "deviation-center-line": 3.623644320092078, "driven_lanedir_consec": 3.4692997359006403}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15540
1427
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 05:31:20+00:00 2022-11-25 05:35:10+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091631317677411 deviation-center-line_median 5.914152927086772
other stats deviation-center-line_max 5.914152927086772 deviation-center-line_mean 5.914152927086772 deviation-center-line_min 5.914152927086772 deviation-heading_max 8.388766833741702 deviation-heading_mean 8.388766833741702 deviation-heading_median 8.388766833741702 deviation-heading_min 8.388766833741702 distance-from-start_max 1.0308142273247416 distance-from-start_mean 1.0308142273247416 distance-from-start_median 1.0308142273247416 distance-from-start_min 1.0308142273247416 driven_any_max 3.449081983452879 driven_any_mean 3.449081983452879 driven_any_median 3.449081983452879 driven_any_min 3.449081983452879 driven_lanedir_consec_max 2.091631317677411 driven_lanedir_consec_mean 2.091631317677411 driven_lanedir_consec_min 2.091631317677411 driven_lanedir_max 3.203997570451749 driven_lanedir_mean 3.203997570451749 driven_lanedir_median 3.203997570451749 driven_lanedir_min 3.203997570451749 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.449081983452879, "survival_time": 59.99999999999873, "driven_lanedir": 3.203997570451749, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.388766833741702, "distance-from-start": 1.0308142273247416, "deviation-center-line": 5.914152927086772, "driven_lanedir_consec": 2.091631317677411}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15536
1428
Bea Baselines 🐤minimal-agent-state aido-hello-sim-state-validation
sanity-check success no davinci-stage-01-6.2.51
2022-11-25 05:29:42+00:00 2022-11-25 05:31:00+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.010100888678529872 deviation-center-line_median 0.00637454737911999
other stats deviation-center-line_max 0.00637454737911999 deviation-center-line_mean 0.00637454737911999 deviation-center-line_min 0.00637454737911999 deviation-heading_max 0.2614212407761817 deviation-heading_mean 0.2614212407761817 deviation-heading_median 0.2614212407761817 deviation-heading_min 0.2614212407761817 distance-from-start_max 0.011536496219628309 distance-from-start_mean 0.011536496219628309 distance-from-start_median 0.011536496219628309 distance-from-start_min 0.011536496219628309 driven_any_max 0.011538646402324344 driven_any_mean 0.011538646402324344 driven_any_median 0.011538646402324344 driven_any_min 0.011538646402324344 driven_lanedir_consec_max 0.010100888678529872 driven_lanedir_consec_mean 0.010100888678529872 driven_lanedir_consec_min 0.010100888678529872 driven_lanedir_max 0.010100888678529872 driven_lanedir_mean 0.010100888678529872 driven_lanedir_median 0.010100888678529872 driven_lanedir_min 0.010100888678529872 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.011538646402324344, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010100888678529872, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761817, "distance-from-start": 0.011536496219628309, "deviation-center-line": 0.00637454737911999, "driven_lanedir_consec": 0.010100888678529872}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15532
1429
Bea Baselines 🐤minimal-agent aido-LFV-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 05:26:33+00:00 2022-11-25 05:29:07+00:00 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.2 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.16440570511787245 deviation-center-line_median 0.19162140900760455
other stats deviation-center-line_max 0.19162140900760455 deviation-center-line_mean 0.19162140900760455 deviation-center-line_min 0.19162140900760455 deviation-heading_max 1.1939422489088862 deviation-heading_mean 1.1939422489088862 deviation-heading_median 1.1939422489088862 deviation-heading_min 1.1939422489088862 distance-from-start_max 0.19201183050647508 distance-from-start_mean 0.19201183050647508 distance-from-start_median 0.19201183050647508 distance-from-start_min 0.19201183050647508 driven_any_max 0.19201481064322065 driven_any_mean 0.19201481064322065 driven_any_median 0.19201481064322065 driven_any_min 0.19201481064322065 driven_lanedir_consec_max 0.16440570511787245 driven_lanedir_consec_mean 0.16440570511787245 driven_lanedir_consec_min 0.16440570511787245 driven_lanedir_max 0.16440570511787245 driven_lanedir_mean 0.16440570511787245 driven_lanedir_median 0.16440570511787245 driven_lanedir_min 0.16440570511787245 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.19201481064322065, "survival_time": 2.2, "driven_lanedir": 0.16440570511787245, "in-drivable-lane": 0.0, "deviation-heading": 1.1939422489088862, "distance-from-start": 0.19201183050647508, "deviation-center-line": 0.19162140900760455, "driven_lanedir_consec": 0.16440570511787245}}simulation-passed 1 survival_time_max 2.2 survival_time_mean 2.2 survival_time_min 2.2
No reset possible 15527
1431
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 05:23:52+00:00 2022-11-25 05:25:56+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 4.949999999999983 driven_lanedir_consec_median 0.19955565328420843 deviation-center-line_median 0.12567493837705537
other stats deviation-center-line_max 0.12567493837705537 deviation-center-line_mean 0.12567493837705537 deviation-center-line_min 0.12567493837705537 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.9347143740566054 distance-from-start_mean 0.9347143740566054 distance-from-start_median 0.9347143740566054 distance-from-start_min 0.9347143740566054 driven_any_max 0.9347451682894398 driven_any_mean 0.9347451682894398 driven_any_median 0.9347451682894398 driven_any_min 0.9347451682894398 driven_lanedir_consec_max 0.19955565328420843 driven_lanedir_consec_mean 0.19955565328420843 driven_lanedir_consec_min 0.19955565328420843 driven_lanedir_max 0.19955565328420843 driven_lanedir_mean 0.19955565328420843 driven_lanedir_median 0.19955565328420843 driven_lanedir_min 0.19955565328420843 in-drivable-lane_max 4.949999999999983 in-drivable-lane_mean 4.949999999999983 in-drivable-lane_min 4.949999999999983 per-episodes details {"udem1-000-ego0": {"driven_any": 0.9347451682894398, "survival_time": 6.699999999999984, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 4.949999999999983, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566054, "deviation-center-line": 0.12567493837705537, "driven_lanedir_consec": 0.19955565328420843}}simulation-passed 1 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 15524
1431
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 05:22:06+00:00 2022-11-25 05:23:37+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15515
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 05:19:33+00:00 2022-11-25 05:21:51+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.31872576909325967 survival_time_median 12.40000000000004 deviation-center-line_median 0.2634611971893196 in-drivable-lane_median 9.150000000000045
other stats deviation-center-line_max 0.2634611971893196 deviation-center-line_mean 0.2634611971893196 deviation-center-line_min 0.2634611971893196 deviation-heading_max 2.539741615834614 deviation-heading_mean 2.539741615834614 deviation-heading_median 2.539741615834614 deviation-heading_min 2.539741615834614 distance-from-start_max 1.8751243016635968 distance-from-start_mean 1.8751243016635968 distance-from-start_median 1.8751243016635968 distance-from-start_min 1.8751243016635968 driven_any_max 1.875978020012028 driven_any_mean 1.875978020012028 driven_any_median 1.875978020012028 driven_any_min 1.875978020012028 driven_lanedir_consec_max 0.31872576909325967 driven_lanedir_consec_mean 0.31872576909325967 driven_lanedir_consec_min 0.31872576909325967 driven_lanedir_max 0.31872576909325967 driven_lanedir_mean 0.31872576909325967 driven_lanedir_median 0.31872576909325967 driven_lanedir_min 0.31872576909325967 in-drivable-lane_max 9.150000000000045 in-drivable-lane_mean 9.150000000000045 in-drivable-lane_min 9.150000000000045 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.875978020012028, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872576909325967, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635968, "deviation-center-line": 0.2634611971893196, "driven_lanedir_consec": 0.31872576909325967}}simulation-passed 1 survival_time_max 12.40000000000004 survival_time_mean 12.40000000000004 survival_time_min 12.40000000000004
No reset possible 15512
1432
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-1of4 host-error no davinci-stage-01-6.2.51
2022-11-25 05:18:58+00:00 2022-11-25 05:19:15+00:00 0:00:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15508
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-1of4 host-error no davinci-stage-01-6.2.51
2022-11-25 05:17:41+00:00 2022-11-25 05:18:44+00:00 0:01:03 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15506
1434
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 05:14:08+00:00 2022-11-25 05:17:27+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.299999999999983 in-drivable-lane_median 6.624999999999982 driven_lanedir_consec_median 0.19060094269967293 deviation-center-line_median 0.1216458457586781
other stats deviation-center-line_max 0.21751801628337733 deviation-center-line_mean 0.13818990472822829 deviation-center-line_min 0.0919499111121796 deviation-heading_max 1.097213756170657 deviation-heading_mean 0.8726834400339218 deviation-heading_median 0.8752529260804078 deviation-heading_min 0.6430141518042152 distance-from-start_max 1.1999739970209826 distance-from-start_mean 0.960682482291036 distance-from-start_median 0.9932177858395684 distance-from-start_min 0.6563203604640253 driven_any_max 1.2000364664329273 driven_any_mean 0.960724520660087 driven_any_median 0.9932647664055376 driven_any_min 0.6563320833963454 driven_lanedir_consec_max 0.5527361332180669 driven_lanedir_consec_mean 0.26843501239744166 driven_lanedir_consec_min 0.139802030972354 driven_lanedir_max 0.5527361332180669 driven_lanedir_mean 0.26843501239744166 driven_lanedir_median 0.19060094269967293 driven_lanedir_min 0.139802030972354 in-drivable-lane_max 6.849999999999983 in-drivable-lane_mean 6.137499999999984 in-drivable-lane_min 4.449999999999989 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6563320833963454, "survival_time": 8.299999999999983, "driven_lanedir": 0.139802030972354, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.9654177247981324, "distance-from-start": 0.6563203604640253, "deviation-center-line": 0.09390669229815438, "driven_lanedir_consec": 0.139802030972354}, "zigzag-000-ego1": {"driven_any": 0.9932647664055404, "survival_time": 8.299999999999983, "driven_lanedir": 0.5527361332180669, "in-drivable-lane": 4.449999999999989, "deviation-heading": 1.097213756170657, "distance-from-start": 0.9932177858395674, "deviation-center-line": 0.21751801628337733, "driven_lanedir_consec": 0.5527361332180669}, "zigzag-000-ego2": {"driven_any": 0.9932647664055346, "survival_time": 8.299999999999983, "driven_lanedir": 0.2351170339597527, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.6430141518042152, "distance-from-start": 0.9932177858395694, "deviation-center-line": 0.1493849992192018, "driven_lanedir_consec": 0.2351170339597527}, "zigzag-000-ego3": {"driven_any": 1.2000364664329273, "survival_time": 8.299999999999983, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 6.849999999999983, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}simulation-passed 1 survival_time_max 8.299999999999983 survival_time_mean 8.299999999999983 survival_time_min 8.299999999999983
No reset possible 15498
1436
Bea Baselines 🐤minimal-agent lx22-modcon
sim success yes davinci-stage-01-6.2.51
2022-11-25 05:09:24+00:00 2022-11-25 05:13:40+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 15.200000000000092 deviation-center-line_median 0.0 driven_lanedir_consec_median 0.0 survival_time_median 15.200000000000092
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 3.705646613157915 distance-from-start_mean 2.336800784178124 distance-from-start_median 2.336800784178124 distance-from-start_min 0.9679549551983332 driven_any_max 3.707570013404081 driven_any_mean 2.33778303094729 driven_any_median 2.33778303094729 driven_any_min 0.9679960484904996 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 23.5000000000002 in-drivable-lane_mean 15.200000000000092 in-drivable-lane_min 6.8999999999999835 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 3.707570013404081, "survival_time": 23.5000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.5000000000002, "deviation-heading": 0.0, "distance-from-start": 3.705646613157915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.9679960484904996, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 0.9679549551983332, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 23.5000000000002 survival_time_mean 15.200000000000092 survival_time_min 6.8999999999999835
No reset possible 15495
1440
Bea Baselines 🐤minimal-agent lx22-BV1
sim-2of5 success no davinci-stage-01-6.2.51
2022-11-25 05:07:32+00:00 2022-11-25 05:09:03+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.3319611918663517
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.3319611918663517 distance-from-start_median 0.3319611918663517 distance-from-start_min 0.3319611918663517 driven_any_max 0.33196649000356754 driven_any_mean 0.33196649000356754 driven_any_median 0.33196649000356754 driven_any_min 0.33196649000356754 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.049999999999997 in-drivable-lane_mean 3.049999999999997 in-drivable-lane_median 3.049999999999997 in-drivable-lane_min 3.049999999999997 per-episodes details {"d40-ego0": {"driven_any": 0.33196649000356754, "survival_time": 3.049999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 3.049999999999997, "deviation-heading": 0.0, "distance-from-start": 0.3319611918663517, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 3.049999999999997 survival_time_median 3.049999999999997 survival_time_min 3.049999999999997
No reset possible 15491
1440
Bea Baselines 🐤minimal-agent lx22-BV1
sim-1of5 success no davinci-stage-01-6.2.51
2022-11-25 05:05:33+00:00 2022-11-25 05:07:14+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.6233192523068
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.6233192523068 distance-from-start_median 0.6233192523068 distance-from-start_min 0.6233192523068 driven_any_max 0.6233308988046636 driven_any_mean 0.6233308988046636 driven_any_median 0.6233308988046636 driven_any_min 0.6233308988046636 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 4.799999999999991 in-drivable-lane_mean 4.799999999999991 in-drivable-lane_median 4.799999999999991 in-drivable-lane_min 4.799999999999991 per-episodes details {"d45-ego0": {"driven_any": 0.6233308988046636, "survival_time": 4.799999999999991, "driven_lanedir": 0.0, "in-drivable-lane": 4.799999999999991, "deviation-heading": 0.0, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 4.799999999999991 survival_time_mean 4.799999999999991 survival_time_median 4.799999999999991 survival_time_min 4.799999999999991
No reset possible 15484
1447
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 05:02:20+00:00 2022-11-25 05:05:07+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.80000000000006 in-drivable-lane_median 10.700000000000069 driven_lanedir_consec_median 0.3090253186660683 deviation-center-line_median 0.26861536036719097
other stats deviation-center-line_max 0.26861536036719097 deviation-center-line_mean 0.26861536036719097 deviation-center-line_min 0.26861536036719097 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 2.1070810871296555 distance-from-start_mean 2.1070810871296555 distance-from-start_median 2.1070810871296555 distance-from-start_min 2.1070810871296555 driven_any_max 2.1073264492289447 driven_any_mean 2.1073264492289447 driven_any_median 2.1073264492289447 driven_any_min 2.1073264492289447 driven_lanedir_consec_max 0.3090253186660683 driven_lanedir_consec_mean 0.3090253186660683 driven_lanedir_consec_min 0.3090253186660683 driven_lanedir_max 0.3090253186660683 driven_lanedir_mean 0.3090253186660683 driven_lanedir_median 0.3090253186660683 driven_lanedir_min 0.3090253186660683 in-drivable-lane_max 10.700000000000069 in-drivable-lane_mean 10.700000000000069 in-drivable-lane_min 10.700000000000069 per-episodes details {"loop2-000-ego0": {"driven_any": 2.1073264492289447, "survival_time": 13.80000000000006, "driven_lanedir": 0.3090253186660683, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.1070810871296555, "deviation-center-line": 0.26861536036719097, "driven_lanedir_consec": 0.3090253186660683}}simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 13.80000000000006 survival_time_min 13.80000000000006
No reset possible 15483
1448
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 05:00:32+00:00 2022-11-25 05:02:06+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15477
1449
Bea Baselines 🐤minimal-agent aido-LFI-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 04:58:43+00:00 2022-11-25 05:00:13+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15473
1450
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 04:56:15+00:00 2022-11-25 04:58:16+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.13666265914899656 survival_time_median 16.300000000000097 deviation-center-line_median 0.10783824785325348 in-drivable-lane_median 14.900000000000096
other stats deviation-center-line_max 0.10783824785325348 deviation-center-line_mean 0.10783824785325348 deviation-center-line_min 0.10783824785325348 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 2.521293261515461 distance-from-start_mean 2.521293261515461 distance-from-start_median 2.521293261515461 distance-from-start_min 2.521293261515461 driven_any_max 2.521966526425084 driven_any_mean 2.521966526425084 driven_any_median 2.521966526425084 driven_any_min 2.521966526425084 driven_lanedir_consec_max 0.13666265914899656 driven_lanedir_consec_mean 0.13666265914899656 driven_lanedir_consec_min 0.13666265914899656 driven_lanedir_max 0.13666265914899656 driven_lanedir_mean 0.13666265914899656 driven_lanedir_median 0.13666265914899656 driven_lanedir_min 0.13666265914899656 in-drivable-lane_max 14.900000000000096 in-drivable-lane_mean 14.900000000000096 in-drivable-lane_min 14.900000000000096 per-episodes details {"autolab-000-ego0": {"driven_any": 2.521966526425084, "survival_time": 16.300000000000097, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.9508048428349388, "distance-from-start": 2.521293261515461, "deviation-center-line": 0.10783824785325348, "driven_lanedir_consec": 0.13666265914899656}}simulation-passed 1 survival_time_max 16.300000000000097 survival_time_mean 16.300000000000097 survival_time_min 16.300000000000097
No reset possible 15470
1451
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 04:54:17+00:00 2022-11-25 04:55:54+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15466
1452
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 04:48:25+00:00 2022-11-25 04:53:56+00:00 0:05:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 10.375000000000036 driven_lanedir_consec_median 0.2917316817322182 deviation-center-line_median 0.3629004861869609
other stats deviation-center-line_max 0.8581383651069324 deviation-center-line_mean 0.42294435916773776 deviation-center-line_min 0.1078380991900969 deviation-heading_max 2.3443591222660065 deviation-heading_mean 1.288863217377771 deviation-heading_median 1.0259544132050231 deviation-heading_min 0.7591849208350303 distance-from-start_max 2.2726748388714895 distance-from-start_mean 0.9481278044889968 distance-from-start_median 0.535788907847825 distance-from-start_min 0.4482585633888487 driven_any_max 2.2731784865558287 driven_any_mean 0.9482607511676968 driven_any_median 0.5357988542299352 driven_any_min 0.4482668096550876 driven_lanedir_consec_max 1.1053767537677208 driven_lanedir_consec_mean 0.4508020778201367 driven_lanedir_consec_min 0.1143681940483896 driven_lanedir_max 1.1053767537677208 driven_lanedir_mean 0.4508020778201367 driven_lanedir_median 0.2917316817322182 driven_lanedir_min 0.1143681940483896 in-drivable-lane_max 13.600000000000076 in-drivable-lane_mean 8.587500000000038 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.4482668096550913, "survival_time": 14.800000000000075, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 13.400000000000077, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4482585633888487, "deviation-center-line": 0.1078380991900969, "driven_lanedir_consec": 0.13665955970746824}, "autolab-000-ego1": {"driven_any": 2.2731784865558287, "survival_time": 14.800000000000075, "driven_lanedir": 1.1053767537677208, "in-drivable-lane": 7.349999999999999, "deviation-heading": 2.3443591222660065, "distance-from-start": 2.2726748388714895, "deviation-center-line": 0.6095492402054283, "driven_lanedir_consec": 1.1053767537677208}, "autolab-000-ego2": {"driven_any": 0.4482668096550876, "survival_time": 14.800000000000075, "driven_lanedir": 0.44680380375696815, "in-drivable-lane": 0.0, "deviation-heading": 1.1011039835751082, "distance-from-start": 0.44825856338885, "deviation-center-line": 0.8581383651069324, "driven_lanedir_consec": 0.44680380375696815}, "autolab-000-ego3": {"driven_any": 0.6233308988047791, "survival_time": 14.800000000000075, "driven_lanedir": 0.1143681940483896, "in-drivable-lane": 13.600000000000076, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.11625173216849344, "driven_lanedir_consec": 0.1143681940483896}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 15463
1453
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 04:46:33+00:00 2022-11-25 04:48:18+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.15000000000001 in-drivable-lane_median 7.050000000000014 driven_lanedir_consec_median 0.3090241265730129 deviation-center-line_median 0.2686164080772624
other stats deviation-center-line_max 0.2686164080772624 deviation-center-line_mean 0.2686164080772624 deviation-center-line_min 0.2686164080772624 deviation-heading_max 2.49953375601749 deviation-heading_mean 2.49953375601749 deviation-heading_median 2.49953375601749 deviation-heading_min 2.49953375601749 distance-from-start_max 1.5040665006803369 distance-from-start_mean 1.5040665006803369 distance-from-start_median 1.5040665006803369 distance-from-start_min 1.5040665006803369 driven_any_max 1.5041747780934245 driven_any_mean 1.5041747780934245 driven_any_median 1.5041747780934245 driven_any_min 1.5041747780934245 driven_lanedir_consec_max 0.3090241265730129 driven_lanedir_consec_mean 0.3090241265730129 driven_lanedir_consec_min 0.3090241265730129 driven_lanedir_max 0.3090241265730129 driven_lanedir_mean 0.3090241265730129 driven_lanedir_median 0.3090241265730129 driven_lanedir_min 0.3090241265730129 in-drivable-lane_max 7.050000000000014 in-drivable-lane_mean 7.050000000000014 in-drivable-lane_min 7.050000000000014 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.5041747780934245, "survival_time": 10.15000000000001, "driven_lanedir": 0.3090241265730129, "in-drivable-lane": 7.050000000000014, "deviation-heading": 2.49953375601749, "distance-from-start": 1.5040665006803369, "deviation-center-line": 0.2686164080772624, "driven_lanedir_consec": 0.3090241265730129}}simulation-passed 1 survival_time_max 10.15000000000001 survival_time_mean 10.15000000000001 survival_time_min 10.15000000000001
No reset possible 15454
1455
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 04:35:43+00:00 2022-11-25 04:46:24+00:00 0:10:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.75000000000022 in-drivable-lane_median 24.450000000000134 driven_lanedir_consec_median 0.1721227540844814 deviation-center-line_median 0.9601526159893984
other stats deviation-center-line_max 0.9601526159893984 deviation-center-line_mean 0.9601526159893984 deviation-center-line_min 0.9601526159893984 deviation-heading_max 7.047994959530865 deviation-heading_mean 7.047994959530865 deviation-heading_median 7.047994959530865 deviation-heading_min 7.047994959530865 distance-from-start_max 0.6540128032227285 distance-from-start_mean 0.6540128032227285 distance-from-start_median 0.6540128032227285 distance-from-start_min 0.6540128032227285 driven_any_max 4.259684302782205 driven_any_mean 4.259684302782205 driven_any_median 4.259684302782205 driven_any_min 4.259684302782205 driven_lanedir_consec_max 0.1721227540844814 driven_lanedir_consec_mean 0.1721227540844814 driven_lanedir_consec_min 0.1721227540844814 driven_lanedir_max 0.7754012865119102 driven_lanedir_mean 0.7754012865119102 driven_lanedir_median 0.7754012865119102 driven_lanedir_min 0.7754012865119102 in-drivable-lane_max 24.450000000000134 in-drivable-lane_mean 24.450000000000134 in-drivable-lane_min 24.450000000000134 per-episodes details {"udem-000-ego0": {"driven_any": 4.259684302782205, "survival_time": 33.75000000000022, "driven_lanedir": 0.7754012865119102, "in-drivable-lane": 24.450000000000134, "deviation-heading": 7.047994959530865, "distance-from-start": 0.6540128032227285, "deviation-center-line": 0.9601526159893984, "driven_lanedir_consec": 0.1721227540844814}}simulation-passed 1 survival_time_max 33.75000000000022 survival_time_mean 33.75000000000022 survival_time_min 33.75000000000022
No reset possible 15448
1457
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 04:29:35+00:00 2022-11-25 04:35:23+00:00 0:05:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9605088016966356 survival_time_median 40.899999999999814 deviation-center-line_median 1.998784943848254 in-drivable-lane_median 21.949999999999797
other stats deviation-center-line_max 1.998784943848254 deviation-center-line_mean 1.998784943848254 deviation-center-line_min 1.998784943848254 deviation-heading_max 14.556944477464462 deviation-heading_mean 14.556944477464462 deviation-heading_median 14.556944477464462 deviation-heading_min 14.556944477464462 distance-from-start_max 0.24798712129570116 distance-from-start_mean 0.24798712129570116 distance-from-start_median 0.24798712129570116 distance-from-start_min 0.24798712129570116 driven_any_max 3.1047803896968875 driven_any_mean 3.1047803896968875 driven_any_median 3.1047803896968875 driven_any_min 3.1047803896968875 driven_lanedir_consec_max 0.9605088016966356 driven_lanedir_consec_mean 0.9605088016966356 driven_lanedir_consec_min 0.9605088016966356 driven_lanedir_max 0.9605088016966356 driven_lanedir_mean 0.9605088016966356 driven_lanedir_median 0.9605088016966356 driven_lanedir_min 0.9605088016966356 in-drivable-lane_max 21.949999999999797 in-drivable-lane_mean 21.949999999999797 in-drivable-lane_min 21.949999999999797 per-episodes details {"autolab-000-ego0": {"driven_any": 3.1047803896968875, "survival_time": 40.899999999999814, "driven_lanedir": 0.9605088016966356, "in-drivable-lane": 21.949999999999797, "deviation-heading": 14.556944477464462, "distance-from-start": 0.24798712129570116, "deviation-center-line": 1.998784943848254, "driven_lanedir_consec": 0.9605088016966356}}simulation-passed 1 survival_time_max 40.899999999999814 survival_time_mean 40.899999999999814 survival_time_min 40.899999999999814
No reset possible 15443
1554
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-01-6.2.51
2022-11-25 04:22:03+00:00 2022-11-25 04:29:07+00:00 0:07:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15433
1459
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 03:55:33+00:00 2022-11-25 04:21:50+00:00 0:26:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.54999999999869 driven_lanedir_consec_median 0.4711607767798817 deviation-center-line_median 0.5256504666599181
other stats deviation-center-line_max 2.222037371159145 deviation-center-line_mean 0.8359727098954918 deviation-center-line_min 0.07055253510298627 deviation-heading_max 21.44960991367315 deviation-heading_mean 7.707666248374859 deviation-heading_median 4.419440636351531 deviation-heading_min 0.5421738071232222 distance-from-start_max 1.3648838046094058 distance-from-start_mean 0.6977954012582492 distance-from-start_median 0.565844999989229 distance-from-start_min 0.29460780044513346 driven_any_max 7.837893973885188 driven_any_mean 4.158510625411441 driven_any_median 3.97952779440738 driven_any_min 0.8370929389458154 driven_lanedir_consec_max 0.6336507866516037 driven_lanedir_consec_mean 0.4214348479173699 driven_lanedir_consec_min 0.1097670514581126 driven_lanedir_max 1.6779729359595523 driven_lanedir_mean 0.7590525290169462 driven_lanedir_median 0.6242350643250598 driven_lanedir_min 0.1097670514581126 in-drivable-lane_max 59.14999999999873 in-drivable-lane_mean 50.012499999998845 in-drivable-lane_min 33.79999999999927 per-episodes details {"autolab-000-ego0": {"driven_any": 1.7113714009220629, "survival_time": 59.99999999999873, "driven_lanedir": 0.6336507866516037, "in-drivable-lane": 52.99999999999869, "deviation-heading": 5.318567783190397, "distance-from-start": 0.29460780044513346, "deviation-center-line": 0.32815736118754146, "driven_lanedir_consec": 0.6336507866516037}, "autolab-000-ego1": {"driven_any": 0.8370929389458154, "survival_time": 59.99999999999873, "driven_lanedir": 0.1097670514581126, "in-drivable-lane": 59.14999999999873, "deviation-heading": 0.5421738071232222, "distance-from-start": 0.8213070259966145, "deviation-center-line": 0.07055253510298627, "driven_lanedir_consec": 0.1097670514581126}, "autolab-000-ego2": {"driven_any": 7.837893973885188, "survival_time": 59.99999999999873, "driven_lanedir": 0.6148193419985158, "in-drivable-lane": 54.09999999999869, "deviation-heading": 3.520313489512666, "distance-from-start": 1.3648838046094058, "deviation-center-line": 0.7231435721322947, "driven_lanedir_consec": 0.6148193419985158}, "autolab-000-ego3": {"driven_any": 6.247684187892697, "survival_time": 59.99999999999873, "driven_lanedir": 1.6779729359595523, "in-drivable-lane": 33.79999999999927, "deviation-heading": 21.44960991367315, "distance-from-start": 0.3103829739818434, "deviation-center-line": 2.222037371159145, "driven_lanedir_consec": 0.3275022115612476}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15429
1460
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 03:47:14+00:00 2022-11-25 03:55:01+00:00 0:07:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 37.49999999999894 driven_lanedir_consec_median 1.5504905001193978 deviation-center-line_median 1.4721185992008206
other stats deviation-center-line_max 1.4721185992008206 deviation-center-line_mean 1.4721185992008206 deviation-center-line_min 1.4721185992008206 deviation-heading_max 16.70835053810376 deviation-heading_mean 16.70835053810376 deviation-heading_median 16.70835053810376 deviation-heading_min 16.70835053810376 distance-from-start_max 0.2521440520841907 distance-from-start_mean 0.2521440520841907 distance-from-start_median 0.2521440520841907 distance-from-start_min 0.2521440520841907 driven_any_max 6.369213828324638 driven_any_mean 6.369213828324638 driven_any_median 6.369213828324638 driven_any_min 6.369213828324638 driven_lanedir_consec_max 1.5504905001193978 driven_lanedir_consec_mean 1.5504905001193978 driven_lanedir_consec_min 1.5504905001193978 driven_lanedir_max 1.5504905001193978 driven_lanedir_mean 1.5504905001193978 driven_lanedir_median 1.5504905001193978 driven_lanedir_min 1.5504905001193978 in-drivable-lane_max 37.49999999999894 in-drivable-lane_mean 37.49999999999894 in-drivable-lane_min 37.49999999999894 per-episodes details {"loop2-000-ego0": {"driven_any": 6.369213828324638, "survival_time": 59.99999999999873, "driven_lanedir": 1.5504905001193978, "in-drivable-lane": 37.49999999999894, "deviation-heading": 16.70835053810376, "distance-from-start": 0.2521440520841907, "deviation-center-line": 1.4721185992008206, "driven_lanedir_consec": 1.5504905001193978}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15424
1463
Bea Baselines 🐤template-pytorch lx22-visservoing
sim success yes davinci-stage-01-6.2.51
2022-11-25 03:39:00+00:00 2022-11-25 03:47:02+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 35.77499999999931 deviation-center-line_median 2.3542982879080347 driven_lanedir_consec_median 2.0432484430845195 survival_time_median 59.99999999999873
other stats deviation-center-line_max 2.71412896157018 deviation-center-line_mean 2.3542982879080347 deviation-center-line_min 1.9944676142458897 deviation-heading_max 19.09713207877171 deviation-heading_mean 17.29880545572107 deviation-heading_median 17.29880545572107 deviation-heading_min 15.50047883267043 distance-from-start_max 0.4504822772603544 distance-from-start_mean 0.42819694176093426 distance-from-start_median 0.42819694176093426 distance-from-start_min 0.40591160626151407 driven_any_max 7.949972454798498 driven_any_mean 7.277045535910713 driven_any_median 7.277045535910713 driven_any_min 6.6041186170229285 driven_lanedir_consec_max 2.9266807619650836 driven_lanedir_consec_mean 2.0432484430845195 driven_lanedir_consec_min 1.1598161242039549 driven_lanedir_max 2.9266807619650836 driven_lanedir_mean 2.0432484430845195 driven_lanedir_median 2.0432484430845195 driven_lanedir_min 1.1598161242039549 in-drivable-lane_max 41.79999999999927 in-drivable-lane_mean 35.77499999999931 in-drivable-lane_min 29.749999999999353 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 7.949972454798498, "survival_time": 59.99999999999873, "driven_lanedir": 2.9266807619650836, "in-drivable-lane": 29.749999999999353, "deviation-heading": 19.09713207877171, "distance-from-start": 0.4504822772603544, "deviation-center-line": 2.71412896157018, "driven_lanedir_consec": 2.9266807619650836}, "LF-small-loop-001-ego0": {"driven_any": 6.6041186170229285, "survival_time": 59.99999999999873, "driven_lanedir": 1.1598161242039549, "in-drivable-lane": 41.79999999999927, "deviation-heading": 15.50047883267043, "distance-from-start": 0.40591160626151407, "deviation-center-line": 1.9944676142458897, "driven_lanedir_consec": 1.1598161242039549}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15419
1465
Bea Baselines 🐤template-pytorch lx22-BV1
sim-4of5 success no davinci-stage-01-6.2.51
2022-11-25 03:34:42+00:00 2022-11-25 03:38:41+00:00 0:03:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.4629500227942848
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.4629500227942848 distance-from-start_median 0.4629500227942848 distance-from-start_min 0.4629500227942848 driven_any_max 3.3442420008666285 driven_any_mean 3.3442420008666285 driven_any_median 3.3442420008666285 driven_any_min 3.3442420008666285 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 21.200000000000166 in-drivable-lane_mean 21.200000000000166 in-drivable-lane_median 21.200000000000166 in-drivable-lane_min 21.200000000000166 per-episodes details {"d60-ego0": {"driven_any": 3.3442420008666285, "survival_time": 21.200000000000166, "driven_lanedir": 0.0, "in-drivable-lane": 21.200000000000166, "deviation-heading": 0.0, "distance-from-start": 0.4629500227942848, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 21.200000000000166 survival_time_mean 21.200000000000166 survival_time_median 21.200000000000166 survival_time_min 21.200000000000166
No reset possible 15414
1472
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 03:24:55+00:00 2022-11-25 03:34:17+00:00 0:09:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 58.09999999999883 in-drivable-lane_median 32.09999999999923 driven_lanedir_consec_median 2.285309212406326 deviation-center-line_median 2.0562169761437534
other stats deviation-center-line_max 2.0562169761437534 deviation-center-line_mean 2.0562169761437534 deviation-center-line_min 2.0562169761437534 deviation-heading_max 20.976687397524923 deviation-heading_mean 20.976687397524923 deviation-heading_median 20.976687397524923 deviation-heading_min 20.976687397524923 distance-from-start_max 0.9849942510343522 distance-from-start_mean 0.9849942510343522 distance-from-start_median 0.9849942510343522 distance-from-start_min 0.9849942510343522 driven_any_max 9.585625279096668 driven_any_mean 9.585625279096668 driven_any_median 9.585625279096668 driven_any_min 9.585625279096668 driven_lanedir_consec_max 2.285309212406326 driven_lanedir_consec_mean 2.285309212406326 driven_lanedir_consec_min 2.285309212406326 driven_lanedir_max 2.634096664453221 driven_lanedir_mean 2.634096664453221 driven_lanedir_median 2.634096664453221 driven_lanedir_min 2.634096664453221 in-drivable-lane_max 32.09999999999923 in-drivable-lane_mean 32.09999999999923 in-drivable-lane_min 32.09999999999923 per-episodes details {"loop2-000-ego0": {"driven_any": 9.585625279096668, "survival_time": 58.09999999999883, "driven_lanedir": 2.634096664453221, "in-drivable-lane": 32.09999999999923, "deviation-heading": 20.976687397524923, "distance-from-start": 0.9849942510343522, "deviation-center-line": 2.0562169761437534, "driven_lanedir_consec": 2.285309212406326}}simulation-passed 1 survival_time_max 58.09999999999883 survival_time_mean 58.09999999999883 survival_time_min 58.09999999999883
No reset possible 15395
1477
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 02:46:59+00:00 2022-11-25 03:24:21+00:00 0:37:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 46.599999999998765 driven_lanedir_consec_median 0.4962028717866136 deviation-center-line_median 1.2846809782080038
other stats deviation-center-line_max 1.9453363033822224 deviation-center-line_mean 1.2818522219158184 deviation-center-line_min 0.6127106278650436 deviation-heading_max 20.10234003005866 deviation-heading_mean 11.693110798780063 deviation-heading_median 10.987432664718783 deviation-heading_min 4.695237835624029 distance-from-start_max 0.8820793396287102 distance-from-start_mean 0.554447973140692 distance-from-start_median 0.5454584782366507 distance-from-start_min 0.2447955964607566 driven_any_max 11.616753348235402 driven_any_mean 6.589970921062089 driven_any_median 5.980995685467521 driven_any_min 2.781138965077911 driven_lanedir_consec_max 2.2422041677056965 driven_lanedir_consec_mean 0.8736362258435676 driven_lanedir_consec_min 0.25993499209534665 driven_lanedir_max 2.2422041677056965 driven_lanedir_mean 0.9347954398678554 driven_lanedir_median 0.6185212998351892 driven_lanedir_min 0.25993499209534665 in-drivable-lane_max 53.64999999999871 in-drivable-lane_mean 45.32499999999888 in-drivable-lane_min 34.449999999999264 per-episodes details {"autolab-000-ego0": {"driven_any": 3.188026076554507, "survival_time": 59.99999999999873, "driven_lanedir": 0.25993499209534665, "in-drivable-lane": 53.64999999999871, "deviation-heading": 4.695237835624029, "distance-from-start": 0.8820793396287102, "deviation-center-line": 0.6127106278650436, "driven_lanedir_consec": 0.25993499209534665}, "autolab-000-ego1": {"driven_any": 8.773965294380535, "survival_time": 59.99999999999873, "driven_lanedir": 0.6174441971477558, "in-drivable-lane": 52.849999999998744, "deviation-heading": 5.250375140483648, "distance-from-start": 0.6616599466286205, "deviation-center-line": 0.7507712386494101, "driven_lanedir_consec": 0.6174441971477558}, "autolab-000-ego2": {"driven_any": 11.616753348235402, "survival_time": 59.99999999999873, "driven_lanedir": 2.2422041677056965, "in-drivable-lane": 40.349999999998786, "deviation-heading": 16.724490188953922, "distance-from-start": 0.2447955964607566, "deviation-center-line": 1.8185907177665972, "driven_lanedir_consec": 2.2422041677056965}, "autolab-000-ego3": {"driven_any": 2.781138965077911, "survival_time": 59.99999999999873, "driven_lanedir": 0.6195984025226227, "in-drivable-lane": 34.449999999999264, "deviation-heading": 20.10234003005866, "distance-from-start": 0.429257009844681, "deviation-center-line": 1.9453363033822224, "driven_lanedir_consec": 0.3749615464254714}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15388
1478
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 02:36:28+00:00 2022-11-25 02:46:39+00:00 0:10:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 41.19999999999897 driven_lanedir_consec_median 0.9433809020081684 deviation-center-line_median 1.7707337530167282
other stats deviation-center-line_max 1.7707337530167282 deviation-center-line_mean 1.7707337530167282 deviation-center-line_min 1.7707337530167282 deviation-heading_max 15.76430112286994 deviation-heading_mean 15.76430112286994 deviation-heading_median 15.76430112286994 deviation-heading_min 15.76430112286994 distance-from-start_max 0.3166322350340697 distance-from-start_mean 0.3166322350340697 distance-from-start_median 0.3166322350340697 distance-from-start_min 0.3166322350340697 driven_any_max 7.687863304438897 driven_any_mean 7.687863304438897 driven_any_median 7.687863304438897 driven_any_min 7.687863304438897 driven_lanedir_consec_max 0.9433809020081684 driven_lanedir_consec_mean 0.9433809020081684 driven_lanedir_consec_min 0.9433809020081684 driven_lanedir_max 1.4089985419342723 driven_lanedir_mean 1.4089985419342723 driven_lanedir_median 1.4089985419342723 driven_lanedir_min 1.4089985419342723 in-drivable-lane_max 41.19999999999897 in-drivable-lane_mean 41.19999999999897 in-drivable-lane_min 41.19999999999897 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.687863304438897, "survival_time": 59.99999999999873, "driven_lanedir": 1.4089985419342723, "in-drivable-lane": 41.19999999999897, "deviation-heading": 15.76430112286994, "distance-from-start": 0.3166322350340697, "deviation-center-line": 1.7707337530167282, "driven_lanedir_consec": 0.9433809020081684}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15386
1479
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 02:29:54+00:00 2022-11-25 02:35:58+00:00 0:06:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.7000000000002 in-drivable-lane_median 14.450000000000168 driven_lanedir_consec_median 0.2737854971621658 deviation-center-line_median 0.899035755764141
other stats deviation-center-line_max 0.899035755764141 deviation-center-line_mean 0.899035755764141 deviation-center-line_min 0.899035755764141 deviation-heading_max 6.757937307021479 deviation-heading_mean 6.757937307021479 deviation-heading_median 6.757937307021479 deviation-heading_min 6.757937307021479 distance-from-start_max 0.7357883576773867 distance-from-start_mean 0.7357883576773867 distance-from-start_median 0.7357883576773867 distance-from-start_min 0.7357883576773867 driven_any_max 5.6000766802176365 driven_any_mean 5.6000766802176365 driven_any_median 5.6000766802176365 driven_any_min 5.6000766802176365 driven_lanedir_consec_max 0.2737854971621658 driven_lanedir_consec_mean 0.2737854971621658 driven_lanedir_consec_min 0.2737854971621658 driven_lanedir_max 0.2557752979619581 driven_lanedir_mean 0.2557752979619581 driven_lanedir_median 0.2557752979619581 driven_lanedir_min 0.2557752979619581 in-drivable-lane_max 14.450000000000168 in-drivable-lane_mean 14.450000000000168 in-drivable-lane_min 14.450000000000168 per-episodes details {"loop-000-ego0": {"driven_any": 5.6000766802176365, "survival_time": 23.7000000000002, "driven_lanedir": 0.2557752979619581, "in-drivable-lane": 14.450000000000168, "deviation-heading": 6.757937307021479, "distance-from-start": 0.7357883576773867, "deviation-center-line": 0.899035755764141, "driven_lanedir_consec": 0.2737854971621658}}simulation-passed 1 survival_time_max 23.7000000000002 survival_time_mean 23.7000000000002 survival_time_min 23.7000000000002
No reset possible 15382
1480
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 02:27:48+00:00 2022-11-25 02:29:19+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15376
1482
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 02:24:21+00:00 2022-11-25 02:27:31+00:00 0:03:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27378584101885495 survival_time_median 20.550000000000157 deviation-center-line_median 0.7687309613328539 in-drivable-lane_median 12.000000000000131
other stats deviation-center-line_max 0.7687309613328539 deviation-center-line_mean 0.7687309613328539 deviation-center-line_min 0.7687309613328539 deviation-heading_max 5.7583430601860695 deviation-heading_mean 5.7583430601860695 deviation-heading_median 5.7583430601860695 deviation-heading_min 5.7583430601860695 distance-from-start_max 0.7357883576773772 distance-from-start_mean 0.7357883576773772 distance-from-start_median 0.7357883576773772 distance-from-start_min 0.7357883576773772 driven_any_max 4.915576034387011 driven_any_mean 4.915576034387011 driven_any_median 4.915576034387011 driven_any_min 4.915576034387011 driven_lanedir_consec_max 0.27378584101885495 driven_lanedir_consec_mean 0.27378584101885495 driven_lanedir_consec_min 0.27378584101885495 driven_lanedir_max 0.2557751649818414 driven_lanedir_mean 0.2557751649818414 driven_lanedir_median 0.2557751649818414 driven_lanedir_min 0.2557751649818414 in-drivable-lane_max 12.000000000000131 in-drivable-lane_mean 12.000000000000131 in-drivable-lane_min 12.000000000000131 per-episodes details {"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}simulation-passed 1 survival_time_max 20.550000000000157 survival_time_mean 20.550000000000157 survival_time_min 20.550000000000157
No reset possible 15373
1482
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 02:20:14+00:00 2022-11-25 02:24:09+00:00 0:03:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2676465159268615 survival_time_median 25.00000000000022 deviation-center-line_median 0.7555297758130887 in-drivable-lane_median 16.4500000000002
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.187140538312911 driven_any_mean 6.187140538312911 driven_any_median 6.187140538312911 driven_any_min 6.187140538312911 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.4500000000002 in-drivable-lane_mean 16.4500000000002 in-drivable-lane_min 16.4500000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.187140538312911, "survival_time": 25.00000000000022, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.4500000000002, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 25.00000000000022 survival_time_mean 25.00000000000022 survival_time_min 25.00000000000022
No reset possible 15369
1483
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 02:07:26+00:00 2022-11-25 02:19:48+00:00 0:12:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 22.925000000000257 driven_lanedir_consec_median 0.1842700338005553 deviation-center-line_median 0.4627381849764669
other stats deviation-center-line_max 4.099655310425073 deviation-center-line_mean 1.3331675709092048 deviation-center-line_min 0.3075386032588124 deviation-heading_max 14.96173668874226 deviation-heading_mean 6.250128407006366 deviation-heading_median 3.9170785755528663 deviation-heading_min 2.204619788177472 distance-from-start_max 0.8626308120701165 distance-from-start_mean 0.6103488428669119 distance-from-start_median 0.5879544645467749 distance-from-start_min 0.4028556303039817 driven_any_max 7.1610713584054295 driven_any_mean 3.3142682447917635 driven_any_median 2.835962585238713 driven_any_min 0.4240764502841981 driven_lanedir_consec_max 0.3901369682576328 driven_lanedir_consec_mean 0.21562824323701707 driven_lanedir_consec_min 0.10383593708932493 driven_lanedir_max 0.3901369682576328 driven_lanedir_mean 0.2054725659587014 driven_lanedir_median 0.16943030307989526 driven_lanedir_min 0.09289268941738228 in-drivable-lane_max 24.45000000000027 in-drivable-lane_mean 17.800000000000196 in-drivable-lane_min 0.9 per-episodes details {"udem-000-ego0": {"driven_any": 0.4240764502841981, "survival_time": 28.850000000000275, "driven_lanedir": 0.3901369682576328, "in-drivable-lane": 0.9, "deviation-heading": 14.96173668874226, "distance-from-start": 0.4028556303039817, "deviation-center-line": 4.099655310425073, "driven_lanedir_consec": 0.3901369682576328}, "udem-000-ego1": {"driven_any": 7.1610713584054295, "survival_time": 28.850000000000275, "driven_lanedir": 0.1969626852808437, "in-drivable-lane": 21.40000000000026, "deviation-heading": 4.716518246290203, "distance-from-start": 0.8626308120701165, "deviation-center-line": 0.5494202956548411, "driven_lanedir_consec": 0.21028967498696935}, "udem-000-ego2": {"driven_any": 2.4684338587868724, "survival_time": 28.850000000000275, "driven_lanedir": 0.1418979208789468, "in-drivable-lane": 24.45000000000027, "deviation-heading": 2.204619788177472, "distance-from-start": 0.5461575079396516, "deviation-center-line": 0.37605607429809274, "driven_lanedir_consec": 0.1582503926141412}, "udem-000-ego3": {"driven_any": 3.2034913116905535, "survival_time": 28.850000000000275, "driven_lanedir": 0.09289268941738228, "in-drivable-lane": 24.45000000000025, "deviation-heading": 3.1176389048155295, "distance-from-start": 0.6297514211538984, "deviation-center-line": 0.3075386032588124, "driven_lanedir_consec": 0.10383593708932493}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 15368
1483
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 02:05:37+00:00 2022-11-25 02:07:04+00:00 0:01:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15362
1485
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 01:56:49+00:00 2022-11-25 02:05:22+00:00 0:08:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.099999999999135 driven_lanedir_consec_median 0.33349329950959106 deviation-center-line_median 2.107688838912731
other stats deviation-center-line_max 2.107688838912731 deviation-center-line_mean 2.107688838912731 deviation-center-line_min 2.107688838912731 deviation-heading_max 23.30238865255163 deviation-heading_mean 23.30238865255163 deviation-heading_median 23.30238865255163 deviation-heading_min 23.30238865255163 distance-from-start_max 1.4108418329398933 distance-from-start_mean 1.4108418329398933 distance-from-start_median 1.4108418329398933 distance-from-start_min 1.4108418329398933 driven_any_max 15.326310847370516 driven_any_mean 15.326310847370516 driven_any_median 15.326310847370516 driven_any_min 15.326310847370516 driven_lanedir_consec_max 0.33349329950959106 driven_lanedir_consec_mean 0.33349329950959106 driven_lanedir_consec_min 0.33349329950959106 driven_lanedir_max 0.2728719387129268 driven_lanedir_mean 0.2728719387129268 driven_lanedir_median 0.2728719387129268 driven_lanedir_min 0.2728719387129268 in-drivable-lane_max 36.099999999999135 in-drivable-lane_mean 36.099999999999135 in-drivable-lane_min 36.099999999999135 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370516, "survival_time": 59.99999999999873, "driven_lanedir": 0.2728719387129268, "in-drivable-lane": 36.099999999999135, "deviation-heading": 23.30238865255163, "distance-from-start": 1.4108418329398933, "deviation-center-line": 2.107688838912731, "driven_lanedir_consec": 0.33349329950959106}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15346
1497
Bea Baselines 🐤template-random aido-LFV-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 01:38:43+00:00 2022-11-25 01:56:19+00:00 0:17:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.69999999999868 driven_lanedir_consec_median 0.035772152071414265 deviation-center-line_median 0.5480591600958397
other stats deviation-center-line_max 0.5480591600958397 deviation-center-line_mean 0.5480591600958397 deviation-center-line_min 0.5480591600958397 deviation-heading_max 5.01528057758804 deviation-heading_mean 5.01528057758804 deviation-heading_median 5.01528057758804 deviation-heading_min 5.01528057758804 distance-from-start_max 1.4108418329398995 distance-from-start_mean 1.4108418329398995 distance-from-start_median 1.4108418329398995 distance-from-start_min 1.4108418329398995 driven_any_max 15.32631084737064 driven_any_mean 15.32631084737064 driven_any_median 15.32631084737064 driven_any_min 15.32631084737064 driven_lanedir_consec_max 0.035772152071414265 driven_lanedir_consec_mean 0.035772152071414265 driven_lanedir_consec_min 0.035772152071414265 driven_lanedir_max 0.035772152071414265 driven_lanedir_mean 0.035772152071414265 driven_lanedir_median 0.035772152071414265 driven_lanedir_min 0.035772152071414265 in-drivable-lane_max 53.69999999999868 in-drivable-lane_mean 53.69999999999868 in-drivable-lane_min 53.69999999999868 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.32631084737064, "survival_time": 59.99999999999873, "driven_lanedir": 0.035772152071414265, "in-drivable-lane": 53.69999999999868, "deviation-heading": 5.01528057758804, "distance-from-start": 1.4108418329398995, "deviation-center-line": 0.5480591600958397, "driven_lanedir_consec": 0.035772152071414265}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15345
1498
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 01:36:58+00:00 2022-11-25 01:38:30+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15339
1499
Bea Baselines 🐤template-random aido-LFI-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 01:33:35+00:00 2022-11-25 01:36:44+00:00 0:03:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.029484722837852084 deviation-center-line_median 0.326841308646148
other stats deviation-center-line_max 0.326841308646148 deviation-center-line_mean 0.326841308646148 deviation-center-line_min 0.326841308646148 deviation-heading_max 2.548872600298709 deviation-heading_mean 2.548872600298709 deviation-heading_median 2.548872600298709 deviation-heading_min 2.548872600298709 distance-from-start_max 0.5461575079396456 distance-from-start_mean 0.5461575079396456 distance-from-start_median 0.5461575079396456 distance-from-start_min 0.5461575079396456 driven_any_max 2.2955250818765065 driven_any_mean 2.2955250818765065 driven_any_median 2.2955250818765065 driven_any_min 2.2955250818765065 driven_lanedir_consec_max 0.029484722837852084 driven_lanedir_consec_mean 0.029484722837852084 driven_lanedir_consec_min 0.029484722837852084 driven_lanedir_max 0.03283106493648602 driven_lanedir_mean 0.03283106493648602 driven_lanedir_median 0.03283106493648602 driven_lanedir_min 0.03283106493648602 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.2955250818765065, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283106493648602, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.548872600298709, "distance-from-start": 0.5461575079396456, "deviation-center-line": 0.326841308646148, "driven_lanedir_consec": 0.029484722837852084}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 15327
1502
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 01:08:31+00:00 2022-11-25 01:33:28+00:00 0:24:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 50.29999999999875 driven_lanedir_consec_median 0.2447360136393999 deviation-center-line_median 0.8201377542768524
other stats deviation-center-line_max 1.1069457194070875 deviation-center-line_mean 0.7677403353962817 deviation-center-line_min 0.3237401136243348 deviation-heading_max 12.93145476995294 deviation-heading_mean 8.15077258988621 deviation-heading_median 8.265274464791538 deviation-heading_min 3.141086660008822 distance-from-start_max 1.410841832939908 distance-from-start_mean 1.0363313004962076 distance-from-start_median 1.0345816229075964 distance-from-start_min 0.6653201232297296 driven_any_max 15.326310847370548 driven_any_mean 9.916481674175056 driven_any_median 10.348447553867391 driven_any_min 3.642720741594884 driven_lanedir_consec_max 0.41005402159019166 driven_lanedir_consec_mean 0.2556548579850866 driven_lanedir_consec_min 0.12309338307135484 driven_lanedir_max 0.40636448176148865 driven_lanedir_mean 0.24489136742153575 driven_lanedir_median 0.23207066701918888 driven_lanedir_min 0.10905965388627664 in-drivable-lane_max 55.59999999999871 in-drivable-lane_mean 50.837499999998734 in-drivable-lane_min 47.14999999999874 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.1929529246946, "survival_time": 59.99999999999873, "driven_lanedir": 0.22628350607467773, "in-drivable-lane": 47.999999999998806, "deviation-heading": 10.0526055653766, "distance-from-start": 1.1351054760255626, "deviation-center-line": 0.970368058015948, "driven_lanedir_consec": 0.22628350607467773}, "zigzag-000-ego1": {"driven_any": 15.326310847370548, "survival_time": 59.99999999999873, "driven_lanedir": 0.23785782796370003, "in-drivable-lane": 47.14999999999874, "deviation-heading": 12.93145476995294, "distance-from-start": 1.410841832939908, "deviation-center-line": 1.1069457194070875, "driven_lanedir_consec": 0.26318852120412206}, "zigzag-000-ego2": {"driven_any": 8.503942183040182, "survival_time": 59.99999999999873, "driven_lanedir": 0.10905965388627664, "in-drivable-lane": 55.59999999999871, "deviation-heading": 3.141086660008822, "distance-from-start": 0.9340577697896302, "deviation-center-line": 0.3237401136243348, "driven_lanedir_consec": 0.12309338307135484}, "zigzag-000-ego3": {"driven_any": 3.642720741594884, "survival_time": 59.99999999999873, "driven_lanedir": 0.40636448176148865, "in-drivable-lane": 52.59999999999869, "deviation-heading": 6.477943364206477, "distance-from-start": 0.6653201232297296, "deviation-center-line": 0.6699074505377567, "driven_lanedir_consec": 0.41005402159019166}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15322
1504
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 01:05:27+00:00 2022-11-25 01:08:03+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.949999999999994 in-drivable-lane_median 2.749999999999994 driven_lanedir_consec_median 0.23208378758149809 deviation-center-line_median 0.08388040272345895
other stats deviation-center-line_max 0.08388040272345895 deviation-center-line_mean 0.08388040272345895 deviation-center-line_min 0.08388040272345895 deviation-heading_max 0.6002064395665178 deviation-heading_mean 0.6002064395665178 deviation-heading_median 0.6002064395665178 deviation-heading_min 0.6002064395665178 distance-from-start_max 0.8538813679503334 distance-from-start_mean 0.8538813679503334 distance-from-start_median 0.8538813679503334 distance-from-start_min 0.8538813679503334 driven_any_max 0.8651349901328192 driven_any_mean 0.8651349901328192 driven_any_median 0.8651349901328192 driven_any_min 0.8651349901328192 driven_lanedir_consec_max 0.23208378758149809 driven_lanedir_consec_mean 0.23208378758149809 driven_lanedir_consec_min 0.23208378758149809 driven_lanedir_max 0.23208378758149809 driven_lanedir_mean 0.23208378758149809 driven_lanedir_median 0.23208378758149809 driven_lanedir_min 0.23208378758149809 in-drivable-lane_max 2.749999999999994 in-drivable-lane_mean 2.749999999999994 in-drivable-lane_min 2.749999999999994 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.8651349901328192, "survival_time": 3.949999999999994, "driven_lanedir": 0.23208378758149809, "in-drivable-lane": 2.749999999999994, "deviation-heading": 0.6002064395665178, "distance-from-start": 0.8538813679503334, "deviation-center-line": 0.08388040272345895, "driven_lanedir_consec": 0.23208378758149809}}simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 3.949999999999994 survival_time_min 3.949999999999994
No reset possible 15315
1505
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 01:02:18+00:00 2022-11-25 01:05:08+00:00 0:02:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 3.999999999999986 driven_lanedir_consec_median 0.6427441219517038 deviation-center-line_median 0.12340377037304624
other stats deviation-center-line_max 0.12340377037304624 deviation-center-line_mean 0.12340377037304624 deviation-center-line_min 0.12340377037304624 deviation-heading_max 0.9753107562611032 deviation-heading_mean 0.9753107562611032 deviation-heading_median 0.9753107562611032 deviation-heading_min 0.9753107562611032 distance-from-start_max 1.6672663787746052 distance-from-start_mean 1.6672663787746052 distance-from-start_median 1.6672663787746052 distance-from-start_min 1.6672663787746052 driven_any_max 1.7205308771110224 driven_any_mean 1.7205308771110224 driven_any_median 1.7205308771110224 driven_any_min 1.7205308771110224 driven_lanedir_consec_max 0.6427441219517038 driven_lanedir_consec_mean 0.6427441219517038 driven_lanedir_consec_min 0.6427441219517038 driven_lanedir_max 0.6427441219517038 driven_lanedir_mean 0.6427441219517038 driven_lanedir_median 0.6427441219517038 driven_lanedir_min 0.6427441219517038 in-drivable-lane_max 3.999999999999986 in-drivable-lane_mean 3.999999999999986 in-drivable-lane_min 3.999999999999986 per-episodes details {"4way-000-ego0": {"driven_any": 1.7205308771110224, "survival_time": 6.699999999999984, "driven_lanedir": 0.6427441219517038, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.9753107562611032, "distance-from-start": 1.6672663787746052, "deviation-center-line": 0.12340377037304624, "driven_lanedir_consec": 0.6427441219517038}}simulation-passed 1 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 15310
1506
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 01:00:24+00:00 2022-11-25 01:02:11+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15307
1507
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 00:58:11+00:00 2022-11-25 01:00:17+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.3657117800026628 survival_time_median 12.000000000000036 deviation-center-line_median 0.13361223194976385 in-drivable-lane_median 10.550000000000036
other stats deviation-center-line_max 0.13361223194976385 deviation-center-line_mean 0.13361223194976385 deviation-center-line_min 0.13361223194976385 deviation-heading_max 0.5412485999130785 deviation-heading_mean 0.5412485999130785 deviation-heading_median 0.5412485999130785 deviation-heading_min 0.5412485999130785 distance-from-start_max 3.2361085033334867 distance-from-start_mean 3.2361085033334867 distance-from-start_median 3.2361085033334867 distance-from-start_min 3.2361085033334867 driven_any_max 3.4202197527789795 driven_any_mean 3.4202197527789795 driven_any_median 3.4202197527789795 driven_any_min 3.4202197527789795 driven_lanedir_consec_max 0.3657117800026628 driven_lanedir_consec_mean 0.3657117800026628 driven_lanedir_consec_min 0.3657117800026628 driven_lanedir_max 0.3657117800026628 driven_lanedir_mean 0.3657117800026628 driven_lanedir_median 0.3657117800026628 driven_lanedir_min 0.3657117800026628 in-drivable-lane_max 10.550000000000036 in-drivable-lane_mean 10.550000000000036 in-drivable-lane_min 10.550000000000036 per-episodes details {"autolab-000-ego0": {"driven_any": 3.4202197527789795, "survival_time": 12.000000000000036, "driven_lanedir": 0.3657117800026628, "in-drivable-lane": 10.550000000000036, "deviation-heading": 0.5412485999130785, "distance-from-start": 3.2361085033334867, "deviation-center-line": 0.13361223194976385, "driven_lanedir_consec": 0.3657117800026628}}simulation-passed 1 survival_time_max 12.000000000000036 survival_time_mean 12.000000000000036 survival_time_min 12.000000000000036
No reset possible 15300
1509
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 00:53:54+00:00 2022-11-25 00:57:51+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.150000000000023 in-drivable-lane_median 9.825000000000024 driven_lanedir_consec_median 0.2555216417572225 deviation-center-line_median 0.08352725658732929
other stats deviation-center-line_max 0.10743236911598328 deviation-center-line_mean 0.08680371315936009 deviation-center-line_min 0.07272797034679844 deviation-heading_max 0.7013547158095468 deviation-heading_mean 0.5614641495195424 deviation-heading_median 0.5577664022627087 deviation-heading_min 0.4289690777432053 distance-from-start_max 2.9825448423629854 distance-from-start_mean 1.425370233697472 distance-from-start_median 1.249990803390043 distance-from-start_min 0.21895448564681644 driven_any_max 3.0599088804073458 driven_any_mean 1.4600250052605177 driven_any_median 1.280215296102581 driven_any_min 0.2197605484295637 driven_lanedir_consec_max 0.3415161963621618 driven_lanedir_consec_mean 0.24017931693733616 driven_lanedir_consec_min 0.108157787872738 driven_lanedir_max 0.3415161963621618 driven_lanedir_mean 0.24017931693733616 driven_lanedir_median 0.2555216417572225 driven_lanedir_min 0.108157787872738 in-drivable-lane_max 10.300000000000022 in-drivable-lane_mean 9.900000000000023 in-drivable-lane_min 9.650000000000023 per-episodes details {"loop-000-ego0": {"driven_any": 0.8044592974434548, "survival_time": 11.150000000000023, "driven_lanedir": 0.18364900901259615, "in-drivable-lane": 9.950000000000024, "deviation-heading": 0.7013547158095468, "distance-from-start": 0.791597480060548, "deviation-center-line": 0.07853802896480808, "driven_lanedir_consec": 0.18364900901259615}, "loop-000-ego1": {"driven_any": 0.2197605484295637, "survival_time": 11.150000000000023, "driven_lanedir": 0.108157787872738, "in-drivable-lane": 10.300000000000022, "deviation-heading": 0.5629898040602626, "distance-from-start": 0.21895448564681644, "deviation-center-line": 0.07272797034679844, "driven_lanedir_consec": 0.108157787872738}, "loop-000-ego2": {"driven_any": 1.7559712947617072, "survival_time": 11.150000000000023, "driven_lanedir": 0.32739427450184877, "in-drivable-lane": 9.650000000000023, "deviation-heading": 0.5525430004651549, "distance-from-start": 1.7083841267195383, "deviation-center-line": 0.08851648420985052, "driven_lanedir_consec": 0.32739427450184877}, "loop-000-ego3": {"driven_any": 3.0599088804073458, "survival_time": 11.150000000000023, "driven_lanedir": 0.3415161963621618, "in-drivable-lane": 9.700000000000024, "deviation-heading": 0.4289690777432053, "distance-from-start": 2.9825448423629854, "deviation-center-line": 0.10743236911598328, "driven_lanedir_consec": 0.3415161963621618}}simulation-passed 1 survival_time_max 11.150000000000023 survival_time_mean 11.150000000000023 survival_time_min 11.150000000000023
No reset possible 15290
1512
Bea Baselines 🐤template-ros lx22-objdet
sim success yes davinci-stage-01-6.2.51
2022-11-25 00:49:51+00:00 2022-11-25 00:53:47+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.42500000000007 driven_lanedir_consec_median 0.5009709373222968
other stats deviation-center-line_max 0.243977355916786 deviation-center-line_mean 0.21001021471976228 deviation-center-line_median 0.21001021471976228 deviation-center-line_min 0.1760430735227386 deviation-heading_max 2.555038691573485 deviation-heading_mean 1.97620067851346 deviation-heading_median 1.97620067851346 deviation-heading_min 1.3973626654534348 distance-from-start_max 3.097587692003627 distance-from-start_mean 2.9780881610390084 distance-from-start_median 2.9780881610390084 distance-from-start_min 2.8585886300743892 driven_any_max 4.090031309258139 driven_any_mean 3.9400459735049673 driven_any_median 3.9400459735049673 driven_any_min 3.790060637751796 driven_lanedir_consec_max 0.5884560958177474 driven_lanedir_consec_mean 0.5009709373222968 driven_lanedir_consec_min 0.41348577882684623 driven_lanedir_max 0.5884560958177474 driven_lanedir_mean 0.5265534813886481 driven_lanedir_median 0.5265534813886481 driven_lanedir_min 0.4646508669595488 in-drivable-lane_max 11.900000000000084 in-drivable-lane_mean 11.325000000000069 in-drivable-lane_median 11.325000000000069 in-drivable-lane_min 10.75000000000005 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 3.790060637751796, "survival_time": 13.75000000000006, "driven_lanedir": 0.5884560958177474, "in-drivable-lane": 10.75000000000005, "deviation-heading": 1.3973626654534348, "distance-from-start": 3.097587692003627, "deviation-center-line": 0.1760430735227386, "driven_lanedir_consec": 0.5884560958177474}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 4.090031309258139, "survival_time": 15.10000000000008, "driven_lanedir": 0.4646508669595488, "in-drivable-lane": 11.900000000000084, "deviation-heading": 2.555038691573485, "distance-from-start": 2.8585886300743892, "deviation-center-line": 0.243977355916786, "driven_lanedir_consec": 0.41348577882684623}}simulation-passed 1 survival_time_max 15.10000000000008 survival_time_mean 14.42500000000007 survival_time_min 13.75000000000006
No reset possible 15288
1515
Bea Baselines 🐤template-ros lx22-BV1
sim-1of5 success no davinci-stage-01-6.2.51
2022-11-25 00:47:59+00:00 2022-11-25 00:49:37+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.017702888028105
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.017702888028105 distance-from-start_median 1.017702888028105 distance-from-start_min 1.017702888028105 driven_any_max 1.024829420261272 driven_any_mean 1.024829420261272 driven_any_median 1.024829420261272 driven_any_min 1.024829420261272 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 4.3499999999999925 in-drivable-lane_mean 4.3499999999999925 in-drivable-lane_median 4.3499999999999925 in-drivable-lane_min 4.3499999999999925 per-episodes details {"d45-ego0": {"driven_any": 1.024829420261272, "survival_time": 4.3499999999999925, "driven_lanedir": 0.0, "in-drivable-lane": 4.3499999999999925, "deviation-heading": 0.0, "distance-from-start": 1.017702888028105, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 4.3499999999999925 survival_time_mean 4.3499999999999925 survival_time_median 4.3499999999999925 survival_time_min 4.3499999999999925
No reset possible 15285
1518
Bea Baselines 🐤template-ros aido-hello-sim-validation
sanity-check success no davinci-stage-01-6.2.51
2022-11-25 00:46:36+00:00 2022-11-25 00:47:45+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.04576938501256911 deviation-center-line_median 0.005909732276170936
other stats deviation-center-line_max 0.005909732276170936 deviation-center-line_mean 0.005909732276170936 deviation-center-line_min 0.005909732276170936 deviation-heading_max 0.25573874861194135 deviation-heading_mean 0.25573874861194135 deviation-heading_median 0.25573874861194135 deviation-heading_min 0.25573874861194135 distance-from-start_max 0.05161790130654944 distance-from-start_mean 0.05161790130654944 distance-from-start_median 0.05161790130654944 distance-from-start_min 0.05161790130654944 driven_any_max 0.051633112730493515 driven_any_mean 0.051633112730493515 driven_any_median 0.051633112730493515 driven_any_min 0.051633112730493515 driven_lanedir_consec_max 0.04576938501256911 driven_lanedir_consec_mean 0.04576938501256911 driven_lanedir_consec_min 0.04576938501256911 driven_lanedir_max 0.04576938501256911 driven_lanedir_mean 0.04576938501256911 driven_lanedir_median 0.04576938501256911 driven_lanedir_min 0.04576938501256911 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.051633112730493515, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04576938501256911, "in-drivable-lane": 0.0, "deviation-heading": 0.25573874861194135, "distance-from-start": 0.05161790130654944, "deviation-center-line": 0.005909732276170936, "driven_lanedir_consec": 0.04576938501256911}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15279
1522
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-25 00:43:54+00:00 2022-11-25 00:46:21+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.899999999999994 in-drivable-lane_median 2.949999999999994 driven_lanedir_consec_median 0.14014852138692135 deviation-center-line_median 0.06934841112847788
other stats deviation-center-line_max 0.06934841112847788 deviation-center-line_mean 0.06934841112847788 deviation-center-line_min 0.06934841112847788 deviation-heading_max 0.6282904365020621 deviation-heading_mean 0.6282904365020621 deviation-heading_median 0.6282904365020621 deviation-heading_min 0.6282904365020621 distance-from-start_max 0.8244692621494307 distance-from-start_mean 0.8244692621494307 distance-from-start_median 0.8244692621494307 distance-from-start_min 0.8244692621494307 driven_any_max 0.8290107404907947 driven_any_mean 0.8290107404907947 driven_any_median 0.8290107404907947 driven_any_min 0.8290107404907947 driven_lanedir_consec_max 0.14014852138692135 driven_lanedir_consec_mean 0.14014852138692135 driven_lanedir_consec_min 0.14014852138692135 driven_lanedir_max 0.14014852138692135 driven_lanedir_mean 0.14014852138692135 driven_lanedir_median 0.14014852138692135 driven_lanedir_min 0.14014852138692135 in-drivable-lane_max 2.949999999999994 in-drivable-lane_mean 2.949999999999994 in-drivable-lane_min 2.949999999999994 per-episodes details {"autolab-000-ego0": {"driven_any": 0.8290107404907947, "survival_time": 3.899999999999994, "driven_lanedir": 0.14014852138692135, "in-drivable-lane": 2.949999999999994, "deviation-heading": 0.6282904365020621, "distance-from-start": 0.8244692621494307, "deviation-center-line": 0.06934841112847788, "driven_lanedir_consec": 0.14014852138692135}}simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 3.899999999999994 survival_time_min 3.899999999999994
No reset possible 15274
1524
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 00:41:22+00:00 2022-11-25 00:43:26+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.399999999999992 in-drivable-lane_median 3.5499999999999923 driven_lanedir_consec_median 0.10535388292703018 deviation-center-line_median 0.05353855384847317
other stats deviation-center-line_max 0.05353855384847317 deviation-center-line_mean 0.05353855384847317 deviation-center-line_min 0.05353855384847317 deviation-heading_max 0.6480896486884022 deviation-heading_mean 0.6480896486884022 deviation-heading_median 0.6480896486884022 deviation-heading_min 0.6480896486884022 distance-from-start_max 0.9359033451413244 distance-from-start_mean 0.9359033451413244 distance-from-start_median 0.9359033451413244 distance-from-start_min 0.9359033451413244 driven_any_max 0.9659345305564264 driven_any_mean 0.9659345305564264 driven_any_median 0.9659345305564264 driven_any_min 0.9659345305564264 driven_lanedir_consec_max 0.10535388292703018 driven_lanedir_consec_mean 0.10535388292703018 driven_lanedir_consec_min 0.10535388292703018 driven_lanedir_max 0.10535388292703018 driven_lanedir_mean 0.10535388292703018 driven_lanedir_median 0.10535388292703018 driven_lanedir_min 0.10535388292703018 in-drivable-lane_max 3.5499999999999923 in-drivable-lane_mean 3.5499999999999923 in-drivable-lane_min 3.5499999999999923 per-episodes details {"udem1-000-ego0": {"driven_any": 0.9659345305564264, "survival_time": 4.399999999999992, "driven_lanedir": 0.10535388292703018, "in-drivable-lane": 3.5499999999999923, "deviation-heading": 0.6480896486884022, "distance-from-start": 0.9359033451413244, "deviation-center-line": 0.05353855384847317, "driven_lanedir_consec": 0.10535388292703018}}simulation-passed 1 survival_time_max 4.399999999999992 survival_time_mean 4.399999999999992 survival_time_min 4.399999999999992
No reset possible 15269
1525
Bea Baselines 🐤template-ros aido-LF-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 00:38:47+00:00 2022-11-25 00:41:06+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9598851183240598 survival_time_median 13.500000000000057 deviation-center-line_median 0.3810121135881993 in-drivable-lane_median 8.750000000000057
other stats deviation-center-line_max 0.3810121135881993 deviation-center-line_mean 0.3810121135881993 deviation-center-line_min 0.3810121135881993 deviation-heading_max 3.067255826734681 deviation-heading_mean 3.067255826734681 deviation-heading_median 3.067255826734681 deviation-heading_min 3.067255826734681 distance-from-start_max 3.605216238980083 distance-from-start_mean 3.605216238980083 distance-from-start_median 3.605216238980083 distance-from-start_min 3.605216238980083 driven_any_max 3.7082195557607536 driven_any_mean 3.7082195557607536 driven_any_median 3.7082195557607536 driven_any_min 3.7082195557607536 driven_lanedir_consec_max 0.9598851183240598 driven_lanedir_consec_mean 0.9598851183240598 driven_lanedir_consec_min 0.9598851183240598 driven_lanedir_max 0.9598851183240598 driven_lanedir_mean 0.9598851183240598 driven_lanedir_median 0.9598851183240598 driven_lanedir_min 0.9598851183240598 in-drivable-lane_max 8.750000000000057 in-drivable-lane_mean 8.750000000000057 in-drivable-lane_min 8.750000000000057 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.7082195557607536, "survival_time": 13.500000000000057, "driven_lanedir": 0.9598851183240598, "in-drivable-lane": 8.750000000000057, "deviation-heading": 3.067255826734681, "distance-from-start": 3.605216238980083, "deviation-center-line": 0.3810121135881993, "driven_lanedir_consec": 0.9598851183240598}}simulation-passed 1 survival_time_max 13.500000000000057 survival_time_mean 13.500000000000057 survival_time_min 13.500000000000057
No reset possible 15262
1527
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 00:33:53+00:00 2022-11-25 00:38:21+00:00 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.050000000000022 in-drivable-lane_median 9.425000000000026 driven_lanedir_consec_median 0.1897326765814348 deviation-center-line_median 0.14522923654810574
other stats deviation-center-line_max 0.1843987971605399 deviation-center-line_mean 0.134046640016488 deviation-center-line_min 0.06132928980920063 deviation-heading_max 1.5462301976160349 deviation-heading_mean 1.0494549386529402 deviation-heading_median 1.1005094225358654 deviation-heading_min 0.450570711923995 distance-from-start_max 2.9815144430942606 distance-from-start_mean 1.9611273053992184 distance-from-start_median 2.07569160101298 distance-from-start_min 0.7116115764766539 driven_any_max 3.1235773457865976 driven_any_mean 2.0215896026501787 driven_any_median 2.11822265675419 driven_any_min 0.7263357513057368 driven_lanedir_consec_max 0.6249077921755377 driven_lanedir_consec_mean 0.27929988793991234 driven_lanedir_consec_min 0.11282640642124207 driven_lanedir_max 0.6249077921755377 driven_lanedir_mean 0.27929988793991234 driven_lanedir_median 0.1897326765814348 driven_lanedir_min 0.11282640642124207 in-drivable-lane_max 10.350000000000025 in-drivable-lane_mean 9.437500000000025 in-drivable-lane_min 8.550000000000026 per-episodes details {"loop-000-ego0": {"driven_any": 2.5489795429522393, "survival_time": 11.050000000000022, "driven_lanedir": 0.18219362729971625, "in-drivable-lane": 9.500000000000025, "deviation-heading": 1.5462301976160349, "distance-from-start": 2.494794572978906, "deviation-center-line": 0.12012342964706892, "driven_lanedir_consec": 0.18219362729971625}, "loop-000-ego1": {"driven_any": 1.687465770556141, "survival_time": 11.050000000000022, "driven_lanedir": 0.19727172586315336, "in-drivable-lane": 9.350000000000025, "deviation-heading": 1.414299299452922, "distance-from-start": 1.6565886290470548, "deviation-center-line": 0.17033504344914255, "driven_lanedir_consec": 0.19727172586315336}, "loop-000-ego2": {"driven_any": 3.1235773457865976, "survival_time": 11.050000000000022, "driven_lanedir": 0.6249077921755377, "in-drivable-lane": 8.550000000000026, "deviation-heading": 0.7867195456188087, "distance-from-start": 2.9815144430942606, "deviation-center-line": 0.1843987971605399, "driven_lanedir_consec": 0.6249077921755377}, "loop-000-ego3": {"driven_any": 0.7263357513057368, "survival_time": 11.050000000000022, "driven_lanedir": 0.11282640642124207, "in-drivable-lane": 10.350000000000025, "deviation-heading": 0.450570711923995, "distance-from-start": 0.7116115764766539, "deviation-center-line": 0.06132928980920063, "driven_lanedir_consec": 0.11282640642124207}}simulation-passed 1 survival_time_max 11.050000000000022 survival_time_mean 11.050000000000022 survival_time_min 11.050000000000022
No reset possible 15257
1528
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 00:31:47+00:00 2022-11-25 00:33:23+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.649999999999981 in-drivable-lane_median 5.999999999999983 driven_lanedir_consec_median 0.2194477695364847 deviation-center-line_median 0.13191579740172762
other stats deviation-center-line_max 0.13191579740172762 deviation-center-line_mean 0.13191579740172762 deviation-center-line_min 0.13191579740172762 deviation-heading_max 1.543300577986892 deviation-heading_mean 1.543300577986892 deviation-heading_median 1.543300577986892 deviation-heading_min 1.543300577986892 distance-from-start_max 1.8855709405211127 distance-from-start_mean 1.8855709405211127 distance-from-start_median 1.8855709405211127 distance-from-start_min 1.8855709405211127 driven_any_max 1.8998364896591933 driven_any_mean 1.8998364896591933 driven_any_median 1.8998364896591933 driven_any_min 1.8998364896591933 driven_lanedir_consec_max 0.2194477695364847 driven_lanedir_consec_mean 0.2194477695364847 driven_lanedir_consec_min 0.2194477695364847 driven_lanedir_max 0.2194477695364847 driven_lanedir_mean 0.2194477695364847 driven_lanedir_median 0.2194477695364847 driven_lanedir_min 0.2194477695364847 in-drivable-lane_max 5.999999999999983 in-drivable-lane_mean 5.999999999999983 in-drivable-lane_min 5.999999999999983 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8998364896591933, "survival_time": 7.649999999999981, "driven_lanedir": 0.2194477695364847, "in-drivable-lane": 5.999999999999983, "deviation-heading": 1.543300577986892, "distance-from-start": 1.8855709405211127, "deviation-center-line": 0.13191579740172762, "driven_lanedir_consec": 0.2194477695364847}}simulation-passed 1 survival_time_max 7.649999999999981 survival_time_mean 7.649999999999981 survival_time_min 7.649999999999981
No reset possible 15253
1529
Bea Baselines 🐤template-tensorflow aido-LFV-sim-validation
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:30:11+00:00 2022-11-25 00:31:40+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15248
1530
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 00:28:19+00:00 2022-11-25 00:29:50+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15242
1531
Bea Baselines 🐤template-tensorflow aido-LFI-sim-validation
sim-1of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:26:22+00:00 2022-11-25 00:27:52+00:00 0:01:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15239
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:25:04+00:00 2022-11-25 00:26:04+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15234
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-3of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:23:16+00:00 2022-11-25 00:24:42+00:00 0:01:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15228
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:21:49+00:00 2022-11-25 00:22:50+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15224
1539
Bea Baselines 🐤template-tensorflow lx22-state-estimation
sim failed yes davinci-stage-01-6.2.51
2022-11-25 00:20:22+00:00 2022-11-25 00:21:21+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15216
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:18:22+00:00 2022-11-25 00:20:02+00:00 0:01:40 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15211
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-25 00:16:30+00:00 2022-11-25 00:18:02+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15206
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-25 00:14:43+00:00 2022-11-25 00:16:17+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15201
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-25 00:13:15+00:00 2022-11-25 00:14:15+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15186
1369
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-25 00:04:18+00:00 2022-11-25 00:12:53+00:00 0:08:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 58.09999999999883 in-drivable-lane_median 8.64999999999991 driven_lanedir_consec_median 5.807516968051963 deviation-center-line_median 3.721679634762375
other stats deviation-center-line_max 3.721679634762375 deviation-center-line_mean 3.721679634762375 deviation-center-line_min 3.721679634762375 deviation-heading_max 11.47831521989677 deviation-heading_mean 11.47831521989677 deviation-heading_median 11.47831521989677 deviation-heading_min 11.47831521989677 distance-from-start_max 2.8239877124383903 distance-from-start_mean 2.8239877124383903 distance-from-start_median 2.8239877124383903 distance-from-start_min 2.8239877124383903 driven_any_max 7.562499095835856 driven_any_mean 7.562499095835856 driven_any_median 7.562499095835856 driven_any_min 7.562499095835856 driven_lanedir_consec_max 5.807516968051963 driven_lanedir_consec_mean 5.807516968051963 driven_lanedir_consec_min 5.807516968051963 driven_lanedir_max 6.084793639871202 driven_lanedir_mean 6.084793639871202 driven_lanedir_median 6.084793639871202 driven_lanedir_min 6.084793639871202 in-drivable-lane_max 8.64999999999991 in-drivable-lane_mean 8.64999999999991 in-drivable-lane_min 8.64999999999991 per-episodes details {"udem1-000-ego0": {"driven_any": 7.562499095835856, "survival_time": 58.09999999999883, "driven_lanedir": 6.084793639871202, "in-drivable-lane": 8.64999999999991, "deviation-heading": 11.47831521989677, "distance-from-start": 2.8239877124383903, "deviation-center-line": 3.721679634762375, "driven_lanedir_consec": 5.807516968051963}}simulation-passed 1 survival_time_max 58.09999999999883 survival_time_mean 58.09999999999883 survival_time_min 58.09999999999883
No reset possible 15180
1294
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-0of4 aborted no davinci-stage-01-6.2.51
2022-11-24 23:56:33+00:00 2022-11-25 00:03:43+00:00 0:07:10 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15175
1295
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-24 23:49:43+00:00 2022-11-24 23:56:18+00:00 0:06:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.7499999999996 driven_lanedir_consec_median 0.054336775833862205 deviation-center-line_median 0.6346586353316823
other stats deviation-center-line_max 0.6346586353316823 deviation-center-line_mean 0.6346586353316823 deviation-center-line_min 0.6346586353316823 deviation-heading_max 5.904235246936354 deviation-heading_mean 5.904235246936354 deviation-heading_median 5.904235246936354 deviation-heading_min 5.904235246936354 distance-from-start_max 1.009340436005913 distance-from-start_mean 1.009340436005913 distance-from-start_median 1.009340436005913 distance-from-start_min 1.009340436005913 driven_any_max 10.522906217249686 driven_any_mean 10.522906217249686 driven_any_median 10.522906217249686 driven_any_min 10.522906217249686 driven_lanedir_consec_max 0.054336775833862205 driven_lanedir_consec_mean 0.054336775833862205 driven_lanedir_consec_min 0.054336775833862205 driven_lanedir_max 0.05768311793249614 driven_lanedir_mean 0.05768311793249614 driven_lanedir_median 0.05768311793249614 driven_lanedir_min 0.05768311793249614 in-drivable-lane_max 35.7499999999996 in-drivable-lane_mean 35.7499999999996 in-drivable-lane_min 35.7499999999996 per-episodes details {"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 15170
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-24 23:42:15+00:00 2022-11-24 23:49:17+00:00 0:07:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.7801015017607646 survival_time_median 59.99999999999873 deviation-center-line_median 3.280554563493571 in-drivable-lane_median 22.899999999999466
other stats deviation-center-line_max 3.280554563493571 deviation-center-line_mean 3.280554563493571 deviation-center-line_min 3.280554563493571 deviation-heading_max 28.560889378701336 deviation-heading_mean 28.560889378701336 deviation-heading_median 28.560889378701336 deviation-heading_min 28.560889378701336 distance-from-start_max 0.16130247649574314 distance-from-start_mean 0.16130247649574314 distance-from-start_median 0.16130247649574314 distance-from-start_min 0.16130247649574314 driven_any_max 10.544408223126233 driven_any_mean 10.544408223126233 driven_any_median 10.544408223126233 driven_any_min 10.544408223126233 driven_lanedir_consec_max -2.7801015017607646 driven_lanedir_consec_mean -2.7801015017607646 driven_lanedir_consec_min -2.7801015017607646 driven_lanedir_max -2.7801015017607646 driven_lanedir_mean -2.7801015017607646 driven_lanedir_median -2.7801015017607646 driven_lanedir_min -2.7801015017607646 in-drivable-lane_max 22.899999999999466 in-drivable-lane_mean 22.899999999999466 in-drivable-lane_min 22.899999999999466 per-episodes details {"loop-000-ego0": {"driven_any": 10.544408223126233, "survival_time": 59.99999999999873, "driven_lanedir": -2.7801015017607646, "in-drivable-lane": 22.899999999999466, "deviation-heading": 28.560889378701336, "distance-from-start": 0.16130247649574314, "deviation-center-line": 3.280554563493571, "driven_lanedir_consec": -2.7801015017607646}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15169
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-2of4 failed no davinci-stage-01-6.2.51
2022-11-24 23:40:45+00:00 2022-11-24 23:41:43+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15167
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-0of4 failed no davinci-stage-01-6.2.51
2022-11-24 23:39:21+00:00 2022-11-24 23:40:17+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15164
1268
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-24 23:37:27+00:00 2022-11-24 23:39:14+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15153
1272
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-01-6.2.51
2022-11-24 23:16:49+00:00 2022-11-24 23:37:02+00:00 0:20:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 54.674999999998704 driven_lanedir_consec_median 0.12251247869641724 deviation-center-line_median 0.4433920965103467
other stats deviation-center-line_max 1.2038527288241243 deviation-center-line_mean 0.5423174087533363 deviation-center-line_min 0.07863271316852748 deviation-heading_max 14.288552729590728 deviation-heading_mean 5.627247694260051 deviation-heading_median 3.416903566880354 deviation-heading_min 1.38663091368877 distance-from-start_max 1.4108418329398955 distance-from-start_mean 0.8799981600642298 distance-from-start_median 0.7992095848737366 distance-from-start_min 0.5107316375695505 driven_any_max 15.326310847370582 driven_any_mean 7.171771192512803 driven_any_median 6.412570219301883 driven_any_min 0.5356334840768605 driven_lanedir_consec_max 0.4413235258740946 driven_lanedir_consec_mean 0.1898162935783138 driven_lanedir_consec_min 0.07291669104632614 driven_lanedir_max 0.4413235258740946 driven_lanedir_mean 0.1804353170531879 driven_lanedir_median 0.1104128284063164 driven_lanedir_min 0.05959208552602435 in-drivable-lane_max 57.749999999998735 in-drivable-lane_mean 52.93749999999879 in-drivable-lane_min 44.649999999999025 per-episodes details {"autolab-000-ego0": {"driven_any": 0.5356334840768605, "survival_time": 59.99999999999873, "driven_lanedir": 0.4413235258740946, "in-drivable-lane": 57.749999999998735, "deviation-heading": 1.38663091368877, "distance-from-start": 0.5107316375695505, "deviation-center-line": 0.07863271316852748, "driven_lanedir_consec": 0.4413235258740946}, "autolab-000-ego1": {"driven_any": 15.326310847370582, "survival_time": 59.99999999999873, "driven_lanedir": 0.05959208552602435, "in-drivable-lane": 44.649999999999025, "deviation-heading": 14.288552729590728, "distance-from-start": 1.4108418329398955, "deviation-center-line": 1.2038527288241243, "driven_lanedir_consec": 0.07291669104632614}, "autolab-000-ego2": {"driven_any": 7.342290201921084, "survival_time": 59.99999999999873, "driven_lanedir": 0.1334588763696649, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.0294981006515846, "distance-from-start": 0.8626308120701035, "deviation-center-line": 0.4429996774431571, "driven_lanedir_consec": 0.14670729988336562}, "autolab-000-ego3": {"driven_any": 5.482850236682682, "survival_time": 59.99999999999873, "driven_lanedir": 0.08736678044296786, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109123, "distance-from-start": 0.7357883576773698, "deviation-center-line": 0.44378451557753634, "driven_lanedir_consec": 0.09831765750946886}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15150
1267
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-24 23:11:52+00:00 2022-11-24 23:16:20+00:00 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.750000000000217 in-drivable-lane_median 16.200000000000195 driven_lanedir_consec_median 0.2676465159268615 deviation-center-line_median 0.7555297758130887
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.0666647982270385 driven_any_mean 6.0666647982270385 driven_any_median 6.0666647982270385 driven_any_min 6.0666647982270385 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.200000000000195 in-drivable-lane_mean 16.200000000000195 in-drivable-lane_min 16.200000000000195 per-episodes details {"loop2-000-ego0": {"driven_any": 6.0666647982270385, "survival_time": 24.750000000000217, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.200000000000195, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 24.750000000000217 survival_time_mean 24.750000000000217 survival_time_min 24.750000000000217
No reset possible 15144
783
Andrea Daniele template-random aido-LF-sim-validation
sim-3of4 aborted no davinci-stage-01-6.2.51
2022-11-24 23:08:41+00:00 2022-11-24 23:11:14+00:00 0:02:33 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The admin aborted the submission.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15140
785
Andrea Daniele template-ros aido-LF-sim-validation
sim-2of4 success no davinci-stage-01-6.2.51
2022-11-24 23:05:17+00:00 2022-11-24 23:08:03+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2706024883376117 survival_time_median 6.999999999999983 deviation-center-line_median 0.0968973987730892 in-drivable-lane_median 5.599999999999983
other stats deviation-center-line_max 0.0968973987730892 deviation-center-line_mean 0.0968973987730892 deviation-center-line_min 0.0968973987730892 deviation-heading_max 0.6188100628735352 deviation-heading_mean 0.6188100628735352 deviation-heading_median 0.6188100628735352 deviation-heading_min 0.6188100628735352 distance-from-start_max 1.7144618795655442 distance-from-start_mean 1.7144618795655442 distance-from-start_median 1.7144618795655442 distance-from-start_min 1.7144618795655442 driven_any_max 1.7510223712783002 driven_any_mean 1.7510223712783002 driven_any_median 1.7510223712783002 driven_any_min 1.7510223712783002 driven_lanedir_consec_max 0.2706024883376117 driven_lanedir_consec_mean 0.2706024883376117 driven_lanedir_consec_min 0.2706024883376117 driven_lanedir_max 0.2706024883376117 driven_lanedir_mean 0.2706024883376117 driven_lanedir_median 0.2706024883376117 driven_lanedir_min 0.2706024883376117 in-drivable-lane_max 5.599999999999983 in-drivable-lane_mean 5.599999999999983 in-drivable-lane_min 5.599999999999983 per-episodes details {"loop2-000-ego0": {"driven_any": 1.7510223712783002, "survival_time": 6.999999999999983, "driven_lanedir": 0.2706024883376117, "in-drivable-lane": 5.599999999999983, "deviation-heading": 0.6188100628735352, "distance-from-start": 1.7144618795655442, "deviation-center-line": 0.0968973987730892, "driven_lanedir_consec": 0.2706024883376117}}simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 6.999999999999983 survival_time_min 6.999999999999983
No reset possible 15137
1273
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-1of4 success no davinci-stage-01-6.2.51
2022-11-24 23:01:38+00:00 2022-11-24 23:04:47+00:00 0:03:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.150000000000137 in-drivable-lane_median 10.600000000000112 driven_lanedir_consec_median 0.2737818968396458 deviation-center-line_median 0.7687309631535428
other stats deviation-center-line_max 0.7687309631535428 deviation-center-line_mean 0.7687309631535428 deviation-center-line_min 0.7687309631535428 deviation-heading_max 5.758343079064915 deviation-heading_mean 5.758343079064915 deviation-heading_median 5.758343079064915 deviation-heading_min 5.758343079064915 distance-from-start_max 0.6736010379604951 distance-from-start_mean 0.6736010379604951 distance-from-start_median 0.6736010379604951 distance-from-start_min 0.6736010379604951 driven_any_max 4.258760700432588 driven_any_mean 4.258760700432588 driven_any_median 4.258760700432588 driven_any_min 4.258760700432588 driven_lanedir_consec_max 0.2737818968396458 driven_lanedir_consec_mean 0.2737818968396458 driven_lanedir_consec_min 0.2737818968396458 driven_lanedir_max 0.25577241289552777 driven_lanedir_mean 0.25577241289552777 driven_lanedir_median 0.25577241289552777 driven_lanedir_min 0.25577241289552777 in-drivable-lane_max 10.600000000000112 in-drivable-lane_mean 10.600000000000112 in-drivable-lane_min 10.600000000000112 per-episodes details {"loop-000-ego0": {"driven_any": 4.258760700432588, "survival_time": 19.150000000000137, "driven_lanedir": 0.25577241289552777, "in-drivable-lane": 10.600000000000112, "deviation-heading": 5.758343079064915, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.7687309631535428, "driven_lanedir_consec": 0.2737818968396458}}simulation-passed 1 survival_time_max 19.150000000000137 survival_time_mean 19.150000000000137 survival_time_min 19.150000000000137
No reset possible 15132
785
Andrea Daniele template-ros aido-LF-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-24 22:59:01+00:00 2022-11-24 23:01:11+00:00 0:02:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.154494248664381 survival_time_median 9.6 deviation-center-line_median 0.06888521992633463 in-drivable-lane_median 8.55
other stats deviation-center-line_max 0.06888521992633463 deviation-center-line_mean 0.06888521992633463 deviation-center-line_min 0.06888521992633463 deviation-heading_max 0.6814195379348543 deviation-heading_mean 0.6814195379348543 deviation-heading_median 0.6814195379348543 deviation-heading_min 0.6814195379348543 distance-from-start_max 2.260443741333641 distance-from-start_mean 2.260443741333641 distance-from-start_median 2.260443741333641 distance-from-start_min 2.260443741333641 driven_any_max 2.549199341575054 driven_any_mean 2.549199341575054 driven_any_median 2.549199341575054 driven_any_min 2.549199341575054 driven_lanedir_consec_max 0.154494248664381 driven_lanedir_consec_mean 0.154494248664381 driven_lanedir_consec_min 0.154494248664381 driven_lanedir_max 0.154494248664381 driven_lanedir_mean 0.154494248664381 driven_lanedir_median 0.154494248664381 driven_lanedir_min 0.154494248664381 in-drivable-lane_max 8.55 in-drivable-lane_mean 8.55 in-drivable-lane_min 8.55 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.549199341575054, "survival_time": 9.6, "driven_lanedir": 0.154494248664381, "in-drivable-lane": 8.55, "deviation-heading": 0.6814195379348543, "distance-from-start": 2.260443741333641, "deviation-center-line": 0.06888521992633463, "driven_lanedir_consec": 0.154494248664381}}simulation-passed 1 survival_time_max 9.6 survival_time_mean 9.6 survival_time_min 9.6
No reset possible 15127
1270
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-3of4 success no davinci-stage-01-6.2.51
2022-11-24 22:54:07+00:00 2022-11-24 22:58:44+00:00 0:04:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2676465159268615 survival_time_median 25.00000000000022 deviation-center-line_median 0.7555297758130887 in-drivable-lane_median 16.4500000000002
other stats deviation-center-line_max 0.7555297758130887 deviation-center-line_mean 0.7555297758130887 deviation-center-line_min 0.7555297758130887 deviation-heading_max 5.523299068383883 deviation-heading_mean 5.523299068383883 deviation-heading_median 5.523299068383883 deviation-heading_min 5.523299068383883 distance-from-start_max 0.796098057853727 distance-from-start_mean 0.796098057853727 distance-from-start_median 0.796098057853727 distance-from-start_min 0.796098057853727 driven_any_max 6.187140538312911 driven_any_mean 6.187140538312911 driven_any_median 6.187140538312911 driven_any_min 6.187140538312911 driven_lanedir_consec_max 0.2676465159268615 driven_lanedir_consec_mean 0.2676465159268615 driven_lanedir_consec_min 0.2676465159268615 driven_lanedir_max 0.24963703198272744 driven_lanedir_mean 0.24963703198272744 driven_lanedir_median 0.24963703198272744 driven_lanedir_min 0.24963703198272744 in-drivable-lane_max 16.4500000000002 in-drivable-lane_mean 16.4500000000002 in-drivable-lane_min 16.4500000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.187140538312911, "survival_time": 25.00000000000022, "driven_lanedir": 0.24963703198272744, "in-drivable-lane": 16.4500000000002, "deviation-heading": 5.523299068383883, "distance-from-start": 0.796098057853727, "deviation-center-line": 0.7555297758130887, "driven_lanedir_consec": 0.2676465159268615}}simulation-passed 1 survival_time_max 25.00000000000022 survival_time_mean 25.00000000000022 survival_time_min 25.00000000000022
No reset possible 15056
1297
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 host-error yes davinci-stage-01-6.2.51
2022-11-24 19:38:21+00:00 2022-11-24 19:39:04+00:00 0:00:43 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d tag 2022_11_24_17_26_06
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible