Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 16656
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-0of3 host-error yes davinci-stage-04-6.2.51
2022-11-28 17:04:57+00:00 2022-11-28 17:04:57+00:00 0:00:00 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16651
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-2of4 host-error yes davinci-stage-04-6.2.51
2022-11-28 17:04:23+00:00 2022-11-28 17:04:24+00:00 0:00:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 877, in get_cr
mkdirs_thread_safe(wd)
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
mkdirs_thread_safe(cast(DirPath, head))
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
os.mkdir(dst, 0o777)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/andrea/evaluations'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16649
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-1of4 timeout yes davinci-stage-04-6.2.51
2022-11-28 03:12:04+00:00 - - - - No reset possible 16647
1700
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 03:10:25+00:00 2022-11-28 03:11:57+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16644
1701
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 03:06:35+00:00 2022-11-28 03:10:03+00:00 0:03:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.200000000000223 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.3557424143249113 deviation-center-line_median 2.2764052687353016
other stats deviation-center-line_max 2.2764052687353016 deviation-center-line_mean 2.2764052687353016 deviation-center-line_min 2.2764052687353016 deviation-heading_max 2.9201829757406066 deviation-heading_mean 2.9201829757406066 deviation-heading_median 2.9201829757406066 deviation-heading_min 2.9201829757406066 distance-from-start_max 1.1340032910142968 distance-from-start_mean 1.1340032910142968 distance-from-start_median 1.1340032910142968 distance-from-start_min 1.1340032910142968 driven_any_max 1.4165963270662665 driven_any_mean 1.4165963270662665 driven_any_median 1.4165963270662665 driven_any_min 1.4165963270662665 driven_lanedir_consec_max 1.3557424143249113 driven_lanedir_consec_mean 1.3557424143249113 driven_lanedir_consec_min 1.3557424143249113 driven_lanedir_max 1.3557424143249113 driven_lanedir_mean 1.3557424143249113 driven_lanedir_median 1.3557424143249113 driven_lanedir_min 1.3557424143249113 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}simulation-passed 1 survival_time_max 25.200000000000223 survival_time_mean 25.200000000000223 survival_time_min 25.200000000000223
No reset possible 16640
1702
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:58:39+00:00 2022-11-28 03:06:29+00:00 0:07:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0916627020116696 deviation-center-line_median 5.917247386091067
other stats deviation-center-line_max 5.917247386091067 deviation-center-line_mean 5.917247386091067 deviation-center-line_min 5.917247386091067 deviation-heading_max 8.389432171221175 deviation-heading_mean 8.389432171221175 deviation-heading_median 8.389432171221175 deviation-heading_min 8.389432171221175 distance-from-start_max 1.030783298044124 distance-from-start_mean 1.030783298044124 distance-from-start_median 1.030783298044124 distance-from-start_min 1.030783298044124 driven_any_max 3.449081983725078 driven_any_mean 3.449081983725078 driven_any_median 3.449081983725078 driven_any_min 3.449081983725078 driven_lanedir_consec_max 2.0916627020116696 driven_lanedir_consec_mean 2.0916627020116696 driven_lanedir_consec_min 2.0916627020116696 driven_lanedir_max 3.204014012014441 driven_lanedir_mean 3.204014012014441 driven_lanedir_median 3.204014012014441 driven_lanedir_min 3.204014012014441 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081983725078, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014012014441, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432171221175, "distance-from-start": 1.030783298044124, "deviation-center-line": 5.917247386091067, "driven_lanedir_consec": 2.0916627020116696}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16631
1704
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:38:56+00:00 2022-11-28 02:58:03+00:00 0:19:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.749999999999955 driven_lanedir_consec_median 2.967583630098515 deviation-center-line_median 4.936499581762261
other stats deviation-center-line_max 5.730573072686608 deviation-center-line_mean 4.869852167143673 deviation-center-line_min 3.875836432363564 deviation-heading_max 12.742085043936966 deviation-heading_mean 11.755117428407974 deviation-heading_median 12.00130779644692 deviation-heading_min 10.275769076801083 distance-from-start_max 2.7363667230349455 distance-from-start_mean 2.401179119880523 distance-from-start_median 2.61282418444398 distance-from-start_min 1.6427013875991858 driven_any_max 3.5075798773472937 driven_any_mean 3.403608315922737 driven_any_median 3.4775792335299394 driven_any_min 3.151694919283776 driven_lanedir_consec_max 3.096555837247597 driven_lanedir_consec_mean 2.687260211745085 driven_lanedir_consec_min 1.7173177495357104 driven_lanedir_max 3.302520401483574 driven_lanedir_mean 3.1893582258787174 driven_lanedir_median 3.236776064167141 driven_lanedir_min 2.9813603736970133 in-drivable-lane_max 3.6999999999998785 in-drivable-lane_mean 2.762499999999936 in-drivable-lane_min 1.8499999999999537 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4685801016173095, "survival_time": 59.99999999999873, "driven_lanedir": 3.2300333077609547, "in-drivable-lane": 3.6999999999998785, "deviation-heading": 10.275769076801083, "distance-from-start": 2.544064021687348, "deviation-center-line": 4.350076895892649, "driven_lanedir_consec": 2.9538068865000175}, "zigzag-000-ego1": {"driven_any": 3.4865783654425693, "survival_time": 59.99999999999873, "driven_lanedir": 3.2435188205733265, "in-drivable-lane": 3.099999999999887, "deviation-heading": 11.389215220096572, "distance-from-start": 2.681584347200612, "deviation-center-line": 5.5229222676318726, "driven_lanedir_consec": 3.096555837247597}, "zigzag-000-ego2": {"driven_any": 3.5075798773472937, "survival_time": 59.99999999999873, "driven_lanedir": 3.302520401483574, "in-drivable-lane": 2.400000000000023, "deviation-heading": 12.61340037279727, "distance-from-start": 1.6427013875991858, "deviation-center-line": 3.875836432363564, "driven_lanedir_consec": 1.7173177495357104}, "zigzag-000-ego3": {"driven_any": 3.151694919283776, "survival_time": 59.99999999999873, "driven_lanedir": 2.9813603736970133, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 12.742085043936966, "distance-from-start": 2.7363667230349455, "deviation-center-line": 5.730573072686608, "driven_lanedir_consec": 2.9813603736970133}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16628
1705
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:36:55+00:00 2022-11-28 02:38:35+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16623
1706
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:30:22+00:00 2022-11-28 02:36:27+00:00 0:06:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.849999999999876 driven_lanedir_consec_median 2.226136954518312 deviation-center-line_median 6.024694972149957
other stats deviation-center-line_max 6.024694972149957 deviation-center-line_mean 6.024694972149957 deviation-center-line_min 6.024694972149957 deviation-heading_max 10.118703616800987 deviation-heading_mean 10.118703616800987 deviation-heading_median 10.118703616800987 deviation-heading_min 10.118703616800987 distance-from-start_max 1.7127730347184449 distance-from-start_mean 1.7127730347184449 distance-from-start_median 1.7127730347184449 distance-from-start_min 1.7127730347184449 driven_any_max 3.434377949467938 driven_any_mean 3.434377949467938 driven_any_median 3.434377949467938 driven_any_min 3.434377949467938 driven_lanedir_consec_max 2.226136954518312 driven_lanedir_consec_mean 2.226136954518312 driven_lanedir_consec_min 2.226136954518312 driven_lanedir_max 3.149126612551262 driven_lanedir_mean 3.149126612551262 driven_lanedir_median 3.149126612551262 driven_lanedir_min 3.149126612551262 in-drivable-lane_max 4.849999999999876 in-drivable-lane_mean 4.849999999999876 in-drivable-lane_min 4.849999999999876 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.434377949467938, "survival_time": 59.99999999999873, "driven_lanedir": 3.149126612551262, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.118703616800987, "distance-from-start": 1.7127730347184449, "deviation-center-line": 6.024694972149957, "driven_lanedir_consec": 2.226136954518312}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16617
1708
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:26:18+00:00 2022-11-28 02:30:08+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.3057932853077427 deviation-center-line_median 7.154226688493768
other stats deviation-center-line_max 7.154226688493768 deviation-center-line_mean 7.154226688493768 deviation-center-line_min 7.154226688493768 deviation-heading_max 5.348097201635609 deviation-heading_mean 5.348097201635609 deviation-heading_median 5.348097201635609 deviation-heading_min 5.348097201635609 distance-from-start_max 1.6303675543068192 distance-from-start_mean 1.6303675543068192 distance-from-start_median 1.6303675543068192 distance-from-start_min 1.6303675543068192 driven_any_max 3.47609109580057 driven_any_mean 3.47609109580057 driven_any_median 3.47609109580057 driven_any_min 3.47609109580057 driven_lanedir_consec_max 3.3057932853077427 driven_lanedir_consec_mean 3.3057932853077427 driven_lanedir_consec_min 3.3057932853077427 driven_lanedir_max 3.3057932853077427 driven_lanedir_mean 3.3057932853077427 driven_lanedir_median 3.3057932853077427 driven_lanedir_min 3.3057932853077427 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16614
1709
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:20:25+00:00 2022-11-28 02:25:49+00:00 0:05:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4226928398281333 deviation-center-line_median 4.174748477462163
other stats deviation-center-line_max 4.174748477462163 deviation-center-line_mean 4.174748477462163 deviation-center-line_min 4.174748477462163 deviation-heading_max 4.533756317111154 deviation-heading_mean 4.533756317111154 deviation-heading_median 4.533756317111154 deviation-heading_min 4.533756317111154 distance-from-start_max 2.2784552815665835 distance-from-start_mean 2.2784552815665835 distance-from-start_median 2.2784552815665835 distance-from-start_min 2.2784552815665835 driven_any_max 3.579587154113982 driven_any_mean 3.579587154113982 driven_any_median 3.579587154113982 driven_any_min 3.579587154113982 driven_lanedir_consec_max 3.4226928398281333 driven_lanedir_consec_mean 3.4226928398281333 driven_lanedir_consec_min 3.4226928398281333 driven_lanedir_max 3.55610753301965 driven_lanedir_mean 3.55610753301965 driven_lanedir_median 3.55610753301965 driven_lanedir_min 3.55610753301965 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16612
1709
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:18:14+00:00 2022-11-28 02:19:56+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16607
1711
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:07:58+00:00 2022-11-28 02:17:38+00:00 0:09:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.499999999999858 driven_lanedir_consec_median 2.073568167625771 deviation-center-line_median 5.586339009536689
other stats deviation-center-line_max 5.586339009536689 deviation-center-line_mean 5.586339009536689 deviation-center-line_min 5.586339009536689 deviation-heading_max 4.940364769457971 deviation-heading_mean 4.940364769457971 deviation-heading_median 4.940364769457971 deviation-heading_min 4.940364769457971 distance-from-start_max 1.7409270883034778 distance-from-start_mean 1.7409270883034778 distance-from-start_median 1.7409270883034778 distance-from-start_min 1.7409270883034778 driven_any_max 3.504586985619137 driven_any_mean 3.504586985619137 driven_any_median 3.504586985619137 driven_any_min 3.504586985619137 driven_lanedir_consec_max 2.073568167625771 driven_lanedir_consec_mean 2.073568167625771 driven_lanedir_consec_min 2.073568167625771 driven_lanedir_max 3.360909384451456 driven_lanedir_mean 3.360909384451456 driven_lanedir_median 3.360909384451456 driven_lanedir_min 3.360909384451456 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 2.499999999999858 in-drivable-lane_min 2.499999999999858 per-episodes details {"4way-000-ego0": {"driven_any": 3.504586985619137, "survival_time": 59.99999999999873, "driven_lanedir": 3.360909384451456, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.940364769457971, "distance-from-start": 1.7409270883034778, "deviation-center-line": 5.586339009536689, "driven_lanedir_consec": 2.073568167625771}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16602
1712
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
sim-0of3 aborted yes davinci-stage-04-6.2.51
2022-11-28 02:05:58+00:00 2022-11-28 02:07:25+00:00 0:01:27 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fc83dfc0e20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fc83dfc0e20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16597
1713
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 02:01:30+00:00 2022-11-28 02:05:19+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 38.69999999999994 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 2.128702834048944 deviation-center-line_median 2.983588623443892
other stats deviation-center-line_max 2.983588623443892 deviation-center-line_mean 2.983588623443892 deviation-center-line_min 2.983588623443892 deviation-heading_max 7.04246757923185 deviation-heading_mean 7.04246757923185 deviation-heading_median 7.04246757923185 deviation-heading_min 7.04246757923185 distance-from-start_max 1.8921505020832197 distance-from-start_mean 1.8921505020832197 distance-from-start_median 1.8921505020832197 distance-from-start_min 1.8921505020832197 driven_any_max 2.2265921855085775 driven_any_mean 2.2265921855085775 driven_any_median 2.2265921855085775 driven_any_min 2.2265921855085775 driven_lanedir_consec_max 2.128702834048944 driven_lanedir_consec_mean 2.128702834048944 driven_lanedir_consec_min 2.128702834048944 driven_lanedir_max 2.128702834048944 driven_lanedir_mean 2.128702834048944 driven_lanedir_median 2.128702834048944 driven_lanedir_min 2.128702834048944 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"autolab-000-ego0": {"driven_any": 2.2265921855085775, "survival_time": 38.69999999999994, "driven_lanedir": 2.128702834048944, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.04246757923185, "distance-from-start": 1.8921505020832197, "deviation-center-line": 2.983588623443892, "driven_lanedir_consec": 2.128702834048944}}simulation-passed 1 survival_time_max 38.69999999999994 survival_time_mean 38.69999999999994 survival_time_min 38.69999999999994
No reset possible 16590
1715
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:56:03+00:00 2022-11-28 02:01:07+00:00 0:05:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.548280526093551 deviation-center-line_median 3.9116147681867446
other stats deviation-center-line_max 3.9116147681867446 deviation-center-line_mean 3.9116147681867446 deviation-center-line_min 3.9116147681867446 deviation-heading_max 4.21820918012117 deviation-heading_mean 4.21820918012117 deviation-heading_median 4.21820918012117 deviation-heading_min 4.21820918012117 distance-from-start_max 2.3398538209611455 distance-from-start_mean 2.3398538209611455 distance-from-start_median 2.3398538209611455 distance-from-start_min 2.3398538209611455 driven_any_max 3.579594786375953 driven_any_mean 3.579594786375953 driven_any_median 3.579594786375953 driven_any_min 3.579594786375953 driven_lanedir_consec_max 3.548280526093551 driven_lanedir_consec_mean 3.548280526093551 driven_lanedir_consec_min 3.548280526093551 driven_lanedir_max 3.5551990211644577 driven_lanedir_mean 3.5551990211644577 driven_lanedir_median 3.5551990211644577 driven_lanedir_min 3.5551990211644577 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.579594786375953, "survival_time": 59.99999999999873, "driven_lanedir": 3.5551990211644577, "in-drivable-lane": 0.0, "deviation-heading": 4.21820918012117, "distance-from-start": 2.3398538209611455, "deviation-center-line": 3.9116147681867446, "driven_lanedir_consec": 3.548280526093551}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16585
1716
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:45:43+00:00 2022-11-28 01:55:37+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.0050106271821506 deviation-center-line_median 4.908963644722344
other stats deviation-center-line_max 6.01198792060873 deviation-center-line_mean 4.593358939184355 deviation-center-line_min 2.5435205466839994 deviation-heading_max 5.727471290631747 deviation-heading_mean 4.526175130231045 deviation-heading_median 4.686700534848095 deviation-heading_min 3.003828160596244 distance-from-start_max 2.5613241003039633 distance-from-start_mean 1.914912599777095 distance-from-start_median 1.98188247541307 distance-from-start_min 1.134561347978277 driven_any_max 3.579580754957026 driven_any_mean 3.2360870781772753 driven_any_median 3.2450849856660264 driven_any_min 2.8745975864200206 driven_lanedir_consec_max 3.211958001358496 driven_lanedir_consec_mean 3.019665595541482 driven_lanedir_consec_min 2.856683126443131 driven_lanedir_max 3.5310621633486874 driven_lanedir_mean 3.181338396476557 driven_lanedir_median 3.1688041281752737 driven_lanedir_min 2.856683166206994 in-drivable-lane_max 2.2000000000000313 in-drivable-lane_mean 0.5500000000000078 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16580
1718
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:40:40+00:00 2022-11-28 01:45:14+00:00 0:04:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.3499999999998806 driven_lanedir_consec_median 2.380746158820441 deviation-center-line_median 6.07518739971563
other stats deviation-center-line_max 6.5629821214913955 deviation-center-line_mean 6.07518739971563 deviation-center-line_min 5.587392677939865 deviation-heading_max 8.266160603781476 deviation-heading_mean 7.316254408081507 deviation-heading_median 7.316254408081507 deviation-heading_min 6.3663482123815385 distance-from-start_max 1.6314589686392718 distance-from-start_mean 1.433307130896814 distance-from-start_median 1.433307130896814 distance-from-start_min 1.235155293154356 driven_any_max 3.4865836169069464 driven_any_mean 3.479150653763286 driven_any_median 3.479150653763286 driven_any_min 3.471717690619625 driven_lanedir_consec_max 3.2882116374610164 driven_lanedir_consec_mean 2.380746158820441 driven_lanedir_consec_min 1.4732806801798657 driven_lanedir_max 3.2882116374610164 driven_lanedir_mean 3.2881134223745017 driven_lanedir_median 3.2881134223745017 driven_lanedir_min 3.2880152072879874 in-drivable-lane_max 3.5999999999997954 in-drivable-lane_mean 3.3499999999998806 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16575
1719
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:31:25+00:00 2022-11-28 01:40:34+00:00 0:09:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204229695892396 deviation-center-line_median 4.903602912090087
other stats deviation-center-line_max 4.903602912090087 deviation-center-line_mean 4.903602912090087 deviation-center-line_min 4.903602912090087 deviation-heading_max 7.744574187082735 deviation-heading_mean 7.744574187082735 deviation-heading_median 7.744574187082735 deviation-heading_min 7.744574187082735 distance-from-start_max 1.206000814743228 distance-from-start_mean 1.206000814743228 distance-from-start_median 1.206000814743228 distance-from-start_min 1.206000814743228 driven_any_max 3.4850840176979623 driven_any_mean 3.4850840176979623 driven_any_median 3.4850840176979623 driven_any_min 3.4850840176979623 driven_lanedir_consec_max 1.4204229695892396 driven_lanedir_consec_mean 1.4204229695892396 driven_lanedir_consec_min 1.4204229695892396 driven_lanedir_max 3.2904978754707774 driven_lanedir_mean 3.2904978754707774 driven_lanedir_median 3.2904978754707774 driven_lanedir_min 3.2904978754707774 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop-000-ego0": {"driven_any": 3.4850840176979623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904978754707774, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574187082735, "distance-from-start": 1.206000814743228, "deviation-center-line": 4.903602912090087, "driven_lanedir_consec": 1.4204229695892396}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16570
1720
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:25:11+00:00 2022-11-28 01:31:11+00:00 0:06:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.099999999999824 driven_lanedir_consec_median 3.094905429410056 deviation-center-line_median 4.472617520975966
other stats deviation-center-line_max 4.472617520975966 deviation-center-line_mean 4.472617520975966 deviation-center-line_min 4.472617520975966 deviation-heading_max 11.268842029535884 deviation-heading_mean 11.268842029535884 deviation-heading_median 11.268842029535884 deviation-heading_min 11.268842029535884 distance-from-start_max 2.5739500581986148 distance-from-start_mean 2.5739500581986148 distance-from-start_median 2.5739500581986148 distance-from-start_min 2.5739500581986148 driven_any_max 3.486579242992935 driven_any_mean 3.486579242992935 driven_any_median 3.486579242992935 driven_any_min 3.486579242992935 driven_lanedir_consec_max 3.094905429410056 driven_lanedir_consec_mean 3.094905429410056 driven_lanedir_consec_min 3.094905429410056 driven_lanedir_max 3.2535717731810343 driven_lanedir_mean 3.2535717731810343 driven_lanedir_median 3.2535717731810343 driven_lanedir_min 3.2535717731810343 in-drivable-lane_max 3.099999999999824 in-drivable-lane_mean 3.099999999999824 in-drivable-lane_min 3.099999999999824 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.486579242992935, "survival_time": 59.99999999999873, "driven_lanedir": 3.2535717731810343, "in-drivable-lane": 3.099999999999824, "deviation-heading": 11.268842029535884, "distance-from-start": 2.5739500581986148, "deviation-center-line": 4.472617520975966, "driven_lanedir_consec": 3.094905429410056}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16565
1721
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:19:53+00:00 2022-11-28 01:25:05+00:00 0:05:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.489526926942431 deviation-center-line_median 5.459978779188341
other stats deviation-center-line_max 5.459978779188341 deviation-center-line_mean 5.459978779188341 deviation-center-line_min 5.459978779188341 deviation-heading_max 11.314241959835243 deviation-heading_mean 11.314241959835243 deviation-heading_median 11.314241959835243 deviation-heading_min 11.314241959835243 distance-from-start_max 3.0851207054617977 distance-from-start_mean 3.0851207054617977 distance-from-start_median 3.0851207054617977 distance-from-start_min 3.0851207054617977 driven_any_max 3.57958884925181 driven_any_mean 3.57958884925181 driven_any_median 3.57958884925181 driven_any_min 3.57958884925181 driven_lanedir_consec_max 3.489526926942431 driven_lanedir_consec_mean 3.489526926942431 driven_lanedir_consec_min 3.489526926942431 driven_lanedir_max 3.489526926942431 driven_lanedir_mean 3.489526926942431 driven_lanedir_median 3.489526926942431 driven_lanedir_min 3.489526926942431 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.57958884925181, "survival_time": 59.99999999999873, "driven_lanedir": 3.489526926942431, "in-drivable-lane": 0.0, "deviation-heading": 11.314241959835243, "distance-from-start": 3.0851207054617977, "deviation-center-line": 5.459978779188341, "driven_lanedir_consec": 3.489526926942431}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16557
1724
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:16:44+00:00 2022-11-28 01:19:39+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.04999999999998 in-drivable-lane_median 4.749999999999984 driven_lanedir_consec_median 0.331229062365487 deviation-center-line_median 0.26973530940385876
other stats deviation-center-line_max 0.26973530940385876 deviation-center-line_mean 0.26973530940385876 deviation-center-line_min 0.26973530940385876 deviation-heading_max 2.5383505748046193 deviation-heading_mean 2.5383505748046193 deviation-heading_median 2.5383505748046193 deviation-heading_min 2.5383505748046193 distance-from-start_max 1.1587848457868677 distance-from-start_mean 1.1587848457868677 distance-from-start_median 1.1587848457868677 distance-from-start_min 1.1587848457868677 driven_any_max 1.158841900114123 driven_any_mean 1.158841900114123 driven_any_median 1.158841900114123 driven_any_min 1.158841900114123 driven_lanedir_consec_max 0.331229062365487 driven_lanedir_consec_mean 0.331229062365487 driven_lanedir_consec_min 0.331229062365487 driven_lanedir_max 0.331229062365487 driven_lanedir_mean 0.331229062365487 driven_lanedir_median 0.331229062365487 driven_lanedir_min 0.331229062365487 in-drivable-lane_max 4.749999999999984 in-drivable-lane_mean 4.749999999999984 in-drivable-lane_min 4.749999999999984 per-episodes details {"4way-000-ego0": {"driven_any": 1.158841900114123, "survival_time": 8.04999999999998, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 4.749999999999984, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}}simulation-passed 1 survival_time_max 8.04999999999998 survival_time_mean 8.04999999999998 survival_time_min 8.04999999999998
No reset possible 16553
1725
Bea Baselines 🐤minimal-agent aido-LFI-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:14:50+00:00 2022-11-28 01:16:23+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16551
1726
Bea Baselines 🐤minimal-agent aido-LF-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:13:00+00:00 2022-11-28 01:14:36+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19694617160956465 survival_time_median 10.450000000000014 deviation-center-line_median 0.1253907294304808 in-drivable-lane_median 8.700000000000014
other stats deviation-center-line_max 0.1253907294304808 deviation-center-line_mean 0.1253907294304808 deviation-center-line_min 0.1253907294304808 deviation-heading_max 0.9520924629376074 deviation-heading_mean 0.9520924629376074 deviation-heading_median 0.9520924629376074 deviation-heading_min 0.9520924629376074 distance-from-start_max 1.5508236376562086 distance-from-start_mean 1.5508236376562086 distance-from-start_median 1.5508236376562086 distance-from-start_min 1.5508236376562086 driven_any_max 1.5511368313112877 driven_any_mean 1.5511368313112877 driven_any_median 1.5511368313112877 driven_any_min 1.5511368313112877 driven_lanedir_consec_max 0.19694617160956465 driven_lanedir_consec_mean 0.19694617160956465 driven_lanedir_consec_min 0.19694617160956465 driven_lanedir_max 0.19694617160956465 driven_lanedir_mean 0.19694617160956465 driven_lanedir_median 0.19694617160956465 driven_lanedir_min 0.19694617160956465 in-drivable-lane_max 8.700000000000014 in-drivable-lane_mean 8.700000000000014 in-drivable-lane_min 8.700000000000014 per-episodes details {"loop2-000-ego0": {"driven_any": 1.5511368313112877, "survival_time": 10.450000000000014, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376074, "distance-from-start": 1.5508236376562086, "deviation-center-line": 0.1253907294304808, "driven_lanedir_consec": 0.19694617160956465}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 10.450000000000014 survival_time_min 10.450000000000014
No reset possible 16544
1727
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:09:08+00:00 2022-11-28 01:12:41+00:00 0:03:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.250000000000025 in-drivable-lane_median 8.525000000000027 driven_lanedir_consec_median 0.3694034459669367 deviation-center-line_median 0.2032026824105824
other stats deviation-center-line_max 0.49385537805641655 deviation-center-line_mean 0.2564840317596989 deviation-center-line_min 0.1256753841612143 deviation-heading_max 2.207424396094566 deviation-heading_mean 1.2068820169473446 deviation-heading_median 0.9361471003737372 deviation-heading_min 0.7478094709473372 distance-from-start_max 1.6837476731392336 distance-from-start_mean 0.85867246141252 distance-from-start_median 0.688920693167693 distance-from-start_min 0.3731007861754605 driven_any_max 1.6838575324025151 driven_any_mean 0.8587081494464717 driven_any_median 0.6889338157826281 driven_any_min 0.3731074338181155 driven_lanedir_consec_max 0.737521974955665 driven_lanedir_consec_mean 0.40900650829720153 driven_lanedir_consec_min 0.15969716629926767 driven_lanedir_max 0.737521974955665 driven_lanedir_mean 0.40900650829720153 driven_lanedir_median 0.3694034459669367 driven_lanedir_min 0.15969716629926767 in-drivable-lane_max 9.800000000000026 in-drivable-lane_mean 8.17500000000003 in-drivable-lane_min 5.850000000000036 per-episodes details {"4way-000-ego0": {"driven_any": 0.3731074338181155, "survival_time": 11.250000000000025, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 9.500000000000025, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.3731007861754605, "deviation-center-line": 0.1256753841612143, "driven_lanedir_consec": 0.1995526730519679}, "4way-000-ego1": {"driven_any": 0.5816642445221152, "survival_time": 11.250000000000025, "driven_lanedir": 0.15969716629926767, "in-drivable-lane": 9.800000000000026, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.5816528382740916, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969716629926767}, "4way-000-ego2": {"driven_any": 0.7962033870431411, "survival_time": 11.250000000000025, "driven_lanedir": 0.5392542188819056, "in-drivable-lane": 7.55000000000003, "deviation-heading": 0.9234722451894284, "distance-from-start": 0.7961885480612942, "deviation-center-line": 0.27078045404289575, "driven_lanedir_consec": 0.5392542188819056}, "4way-000-ego3": {"driven_any": 1.6838575324025151, "survival_time": 11.250000000000025, "driven_lanedir": 0.737521974955665, "in-drivable-lane": 5.850000000000036, "deviation-heading": 2.207424396094566, "distance-from-start": 1.6837476731392336, "deviation-center-line": 0.49385537805641655, "driven_lanedir_consec": 0.737521974955665}}simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 11.250000000000025 survival_time_min 11.250000000000025
No reset possible 16542
1728
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 01:06:20+00:00 2022-11-28 01:08:56+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 10.325000000000047 driven_lanedir_consec_median 0.2454627567044649 deviation-center-line_median 0.20268004628951308
other stats deviation-center-line_max 0.2697354450181819 deviation-center-line_mean 0.20268004628951308 deviation-center-line_min 0.13562464756084422 deviation-heading_max 2.5383505748046193 deviation-heading_mean 1.643080022875978 deviation-heading_median 1.643080022875978 deviation-heading_min 0.7478094709473364 distance-from-start_max 1.9240493840830373 distance-from-start_mean 1.152779949170181 distance-from-start_median 1.152779949170181 distance-from-start_min 0.3815105142573241 driven_any_max 1.9241954407136783 driven_any_mean 1.1528564552862215 driven_any_median 1.1528564552862215 driven_any_min 0.38151746985876434 driven_lanedir_consec_max 0.33122977762117056 driven_lanedir_consec_mean 0.2454627567044649 driven_lanedir_consec_min 0.1596957357877593 driven_lanedir_max 0.33122977762117056 driven_lanedir_mean 0.2454627567044649 driven_lanedir_median 0.2454627567044649 driven_lanedir_min 0.1596957357877593 in-drivable-lane_max 11.250000000000046 in-drivable-lane_mean 10.325000000000047 in-drivable-lane_min 9.40000000000005 per-episodes details {"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}, "loop2-000-ego1": {"driven_any": 0.38151746985876434, "survival_time": 12.700000000000044, "driven_lanedir": 0.1596957357877593, "in-drivable-lane": 11.250000000000046, "deviation-heading": 0.7478094709473364, "distance-from-start": 0.3815105142573241, "deviation-center-line": 0.13562464756084422, "driven_lanedir_consec": 0.1596957357877593}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 16535
1730
Bea Baselines 🐤minimal-agent lx22-modcon
sim success yes davinci-stage-04-6.2.51
2022-11-28 01:01:34+00:00 2022-11-28 01:05:43+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 15.200000000000092 deviation-center-line_median 0.0 driven_lanedir_consec_median 0.0 survival_time_median 15.200000000000092
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 3.705646613157915 distance-from-start_mean 2.336800784178124 distance-from-start_median 2.336800784178124 distance-from-start_min 0.9679549551983332 driven_any_max 3.707570013404081 driven_any_mean 2.33778303094729 driven_any_median 2.33778303094729 driven_any_min 0.9679960484904996 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 23.5000000000002 in-drivable-lane_mean 15.200000000000092 in-drivable-lane_min 6.8999999999999835 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 3.707570013404081, "survival_time": 23.5000000000002, "driven_lanedir": 0.0, "in-drivable-lane": 23.5000000000002, "deviation-heading": 0.0, "distance-from-start": 3.705646613157915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 0.9679960484904996, "survival_time": 6.8999999999999835, "driven_lanedir": 0.0, "in-drivable-lane": 6.8999999999999835, "deviation-heading": 0.0, "distance-from-start": 0.9679549551983332, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 23.5000000000002 survival_time_mean 15.200000000000092 survival_time_min 6.8999999999999835
No reset possible 16531
1734
Bea Baselines 🐤minimal-agent lx22-BV1
sim-0of5 success yes davinci-stage-04-6.2.51
2022-11-28 01:00:06+00:00 2022-11-28 01:01:28+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.38992181148908706
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.38992181148908706 distance-from-start_median 0.38992181148908706 distance-from-start_min 0.38992181148908706 driven_any_max 0.3899290723045018 driven_any_mean 0.3899290723045018 driven_any_median 0.3899290723045018 driven_any_min 0.3899290723045018 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.399999999999996 in-drivable-lane_mean 3.399999999999996 in-drivable-lane_median 3.399999999999996 in-drivable-lane_min 3.399999999999996 per-episodes details {"d30-ego0": {"driven_any": 0.3899290723045018, "survival_time": 3.399999999999996, "driven_lanedir": 0.0, "in-drivable-lane": 3.399999999999996, "deviation-heading": 0.0, "distance-from-start": 0.38992181148908706, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 3.399999999999996 survival_time_median 3.399999999999996 survival_time_min 3.399999999999996
No reset possible 16525
1741
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:57:04+00:00 2022-11-28 00:59:52+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.549999999999988 in-drivable-lane_median 4.149999999999988 driven_lanedir_consec_median 0.1366657585905482 deviation-center-line_median 0.10783820466790534
other stats deviation-center-line_max 0.10783820466790534 deviation-center-line_mean 0.10783820466790534 deviation-center-line_min 0.10783820466790534 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.7476573144701085 distance-from-start_mean 0.7476573144701085 distance-from-start_median 0.7476573144701085 distance-from-start_min 0.7476573144701085 driven_any_max 0.7476698075499906 driven_any_mean 0.7476698075499906 driven_any_median 0.7476698075499906 driven_any_min 0.7476698075499906 driven_lanedir_consec_max 0.1366657585905482 driven_lanedir_consec_mean 0.1366657585905482 driven_lanedir_consec_min 0.1366657585905482 driven_lanedir_max 0.1366657585905482 driven_lanedir_mean 0.1366657585905482 driven_lanedir_median 0.1366657585905482 driven_lanedir_min 0.1366657585905482 in-drivable-lane_max 4.149999999999988 in-drivable-lane_mean 4.149999999999988 in-drivable-lane_min 4.149999999999988 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7476698075499906, "survival_time": 5.549999999999988, "driven_lanedir": 0.1366657585905482, "in-drivable-lane": 4.149999999999988, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7476573144701085, "deviation-center-line": 0.10783820466790534, "driven_lanedir_consec": 0.1366657585905482}}simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 5.549999999999988 survival_time_min 5.549999999999988
No reset possible 16518
1742
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:52:51+00:00 2022-11-28 00:56:14+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666480491623645 deviation-center-line_median 0.1078383533310603
other stats deviation-center-line_max 0.1078383533310603 deviation-center-line_mean 0.1078383533310603 deviation-center-line_min 0.1078383533310603 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 1.6182798682575184 distance-from-start_mean 1.6182798682575184 distance-from-start_median 1.6182798682575184 distance-from-start_min 1.6182798682575184 driven_any_max 1.6183892771013868 driven_any_mean 1.6183892771013868 driven_any_median 1.6183892771013868 driven_any_min 1.6183892771013868 driven_lanedir_consec_max 0.13666480491623645 driven_lanedir_consec_mean 0.13666480491623645 driven_lanedir_consec_min 0.13666480491623645 driven_lanedir_max 0.13666480491623645 driven_lanedir_mean 0.13666480491623645 driven_lanedir_median 0.13666480491623645 driven_lanedir_min 0.13666480491623645 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"4way-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 16513
1744
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:50:45+00:00 2022-11-28 00:52:30+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.30902388815479953 survival_time_median 13.80000000000006 deviation-center-line_median 0.26861568883973136 in-drivable-lane_median 10.700000000000069
other stats deviation-center-line_max 0.26861568883973136 deviation-center-line_mean 0.26861568883973136 deviation-center-line_min 0.26861568883973136 deviation-heading_max 2.499533756017491 deviation-heading_mean 2.499533756017491 deviation-heading_median 2.499533756017491 deviation-heading_min 2.499533756017491 distance-from-start_max 2.107081087129661 distance-from-start_mean 2.107081087129661 distance-from-start_median 2.107081087129661 distance-from-start_min 2.107081087129661 driven_any_max 2.107326449228953 driven_any_mean 2.107326449228953 driven_any_median 2.107326449228953 driven_any_min 2.107326449228953 driven_lanedir_consec_max 0.30902388815479953 driven_lanedir_consec_mean 0.30902388815479953 driven_lanedir_consec_min 0.30902388815479953 driven_lanedir_max 0.30902388815479953 driven_lanedir_mean 0.30902388815479953 driven_lanedir_median 0.30902388815479953 driven_lanedir_min 0.30902388815479953 in-drivable-lane_max 10.700000000000069 in-drivable-lane_mean 10.700000000000069 in-drivable-lane_min 10.700000000000069 per-episodes details {"loop2-000-ego0": {"driven_any": 2.107326449228953, "survival_time": 13.80000000000006, "driven_lanedir": 0.30902388815479953, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.499533756017491, "distance-from-start": 2.107081087129661, "deviation-center-line": 0.26861568883973136, "driven_lanedir_consec": 0.30902388815479953}}simulation-passed 1 survival_time_max 13.80000000000006 survival_time_mean 13.80000000000006 survival_time_min 13.80000000000006
No reset possible 16509
1745
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:49:06+00:00 2022-11-28 00:50:31+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16491
1749
Bea Baselines 🐤template-pytorch aido-LFVI-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:31:49+00:00 2022-11-28 00:48:36+00:00 0:16:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 57.54999999999873 driven_lanedir_consec_median 0.13850466408158146 deviation-center-line_median 0.2282727912767089
other stats deviation-center-line_max 0.2282727912767089 deviation-center-line_mean 0.2282727912767089 deviation-center-line_min 0.2282727912767089 deviation-heading_max 1.99431637293007 deviation-heading_mean 1.99431637293007 deviation-heading_median 1.99431637293007 deviation-heading_min 1.99431637293007 distance-from-start_max 0.4855951064113119 distance-from-start_mean 0.4855951064113119 distance-from-start_median 0.4855951064113119 distance-from-start_min 0.4855951064113119 driven_any_max 5.774620130700305 driven_any_mean 5.774620130700305 driven_any_median 5.774620130700305 driven_any_min 5.774620130700305 driven_lanedir_consec_max 0.13850466408158146 driven_lanedir_consec_mean 0.13850466408158146 driven_lanedir_consec_min 0.13850466408158146 driven_lanedir_max 0.13850466408158146 driven_lanedir_mean 0.13850466408158146 driven_lanedir_median 0.13850466408158146 driven_lanedir_min 0.13850466408158146 in-drivable-lane_max 57.54999999999873 in-drivable-lane_mean 57.54999999999873 in-drivable-lane_min 57.54999999999873 per-episodes details {"udem-000-ego0": {"driven_any": 5.774620130700305, "survival_time": 59.99999999999873, "driven_lanedir": 0.13850466408158146, "in-drivable-lane": 57.54999999999873, "deviation-heading": 1.99431637293007, "distance-from-start": 0.4855951064113119, "deviation-center-line": 0.2282727912767089, "driven_lanedir_consec": 0.13850466408158146}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16489
1750
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:29:53+00:00 2022-11-28 00:31:42+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.7000000000000008 in-drivable-lane_median 0.7500000000000006 driven_lanedir_consec_median 0.040834068069312446 deviation-center-line_median 0.03542858991865786
other stats deviation-center-line_max 0.03542858991865786 deviation-center-line_mean 0.03542858991865786 deviation-center-line_min 0.03542858991865786 deviation-heading_max 0.8725982788012543 deviation-heading_mean 0.8725982788012543 deviation-heading_median 0.8725982788012543 deviation-heading_min 0.8725982788012543 distance-from-start_max 0.11359508318984854 distance-from-start_mean 0.11359508318984854 distance-from-start_median 0.11359508318984854 distance-from-start_min 0.11359508318984854 driven_any_max 0.12001321877729045 driven_any_mean 0.12001321877729045 driven_any_median 0.12001321877729045 driven_any_min 0.12001321877729045 driven_lanedir_consec_max 0.040834068069312446 driven_lanedir_consec_mean 0.040834068069312446 driven_lanedir_consec_min 0.040834068069312446 driven_lanedir_max 0.040834068069312446 driven_lanedir_mean 0.040834068069312446 driven_lanedir_median 0.040834068069312446 driven_lanedir_min 0.040834068069312446 in-drivable-lane_max 0.7500000000000006 in-drivable-lane_mean 0.7500000000000006 in-drivable-lane_min 0.7500000000000006 per-episodes details {"4way-000-ego0": {"driven_any": 0.12001321877729045, "survival_time": 1.7000000000000008, "driven_lanedir": 0.040834068069312446, "in-drivable-lane": 0.7500000000000006, "deviation-heading": 0.8725982788012543, "distance-from-start": 0.11359508318984854, "deviation-center-line": 0.03542858991865786, "driven_lanedir_consec": 0.040834068069312446}}simulation-passed 1 survival_time_max 1.7000000000000008 survival_time_mean 1.7000000000000008 survival_time_min 1.7000000000000008
No reset possible 16487
1750
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:28:01+00:00 2022-11-28 00:29:31+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16483
1751
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-28 00:20:30+00:00 2022-11-28 00:27:55+00:00 0:07:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.3759100499808201 survival_time_median 59.99999999999873 deviation-center-line_median 1.3612175094933507 in-drivable-lane_median 44.74999999999909
other stats deviation-center-line_max 1.3612175094933507 deviation-center-line_mean 1.3612175094933507 deviation-center-line_min 1.3612175094933507 deviation-heading_max 12.039735619937924 deviation-heading_mean 12.039735619937924 deviation-heading_median 12.039735619937924 deviation-heading_min 12.039735619937924 distance-from-start_max 0.5639573919867205 distance-from-start_mean 0.5639573919867205 distance-from-start_median 0.5639573919867205 distance-from-start_min 0.5639573919867205 driven_any_max 6.220141812160496 driven_any_mean 6.220141812160496 driven_any_median 6.220141812160496 driven_any_min 6.220141812160496 driven_lanedir_consec_max 0.3759100499808201 driven_lanedir_consec_mean 0.3759100499808201 driven_lanedir_consec_min 0.3759100499808201 driven_lanedir_max 0.954096014173058 driven_lanedir_mean 0.954096014173058 driven_lanedir_median 0.954096014173058 driven_lanedir_min 0.954096014173058 in-drivable-lane_max 44.74999999999909 in-drivable-lane_mean 44.74999999999909 in-drivable-lane_min 44.74999999999909 per-episodes details {"loop-000-ego0": {"driven_any": 6.220141812160496, "survival_time": 59.99999999999873, "driven_lanedir": 0.954096014173058, "in-drivable-lane": 44.74999999999909, "deviation-heading": 12.039735619937924, "distance-from-start": 0.5639573919867205, "deviation-center-line": 1.3612175094933507, "driven_lanedir_consec": 0.3759100499808201}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16472
1753
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 23:53:44+00:00 2022-11-28 00:20:17+00:00 0:26:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 54.2249999999987 driven_lanedir_consec_median 0.3053281893062856 deviation-center-line_median 0.5833203374448451
other stats deviation-center-line_max 1.046541693404034 deviation-center-line_mean 0.6029077032362445 deviation-center-line_min 0.19844844465125416 deviation-heading_max 12.050504548220994 deviation-heading_mean 5.876284719758338 deviation-heading_median 5.084688243255883 deviation-heading_min 1.285257844300597 distance-from-start_max 1.2570244316015116 distance-from-start_mean 0.9264781001751844 distance-from-start_median 0.9151802800017148 distance-from-start_min 0.6185274090957956 driven_any_max 12.930780982328082 driven_any_mean 8.053519647393623 driven_any_median 7.995416417071243 driven_any_min 3.292464773103923 driven_lanedir_consec_max 1.0173813169393 driven_lanedir_consec_mean 0.4664860626318458 driven_lanedir_consec_min 0.2379065549755119 driven_lanedir_max 1.1185401924107965 driven_lanedir_mean 0.4917757814997199 driven_lanedir_median 0.3053281893062856 driven_lanedir_min 0.2379065549755119 in-drivable-lane_max 57.59999999999873 in-drivable-lane_mean 53.57499999999875 in-drivable-lane_min 48.249999999998906 per-episodes details {"loop-000-ego0": {"driven_any": 12.930780982328082, "survival_time": 59.99999999999873, "driven_lanedir": 1.1185401924107965, "in-drivable-lane": 48.249999999998906, "deviation-heading": 12.050504548220994, "distance-from-start": 1.2570244316015116, "deviation-center-line": 1.046541693404034, "driven_lanedir_consec": 1.0173813169393}, "loop-000-ego1": {"driven_any": 3.292464773103923, "survival_time": 59.99999999999873, "driven_lanedir": 0.2379065549755119, "in-drivable-lane": 53.3499999999987, "deviation-heading": 4.855841736500814, "distance-from-start": 0.6605505669628424, "deviation-center-line": 0.7344782160864097, "driven_lanedir_consec": 0.2379065549755119}, "loop-000-ego2": {"driven_any": 5.447717796478859, "survival_time": 59.99999999999873, "driven_lanedir": 0.35754590689344695, "in-drivable-lane": 55.099999999998694, "deviation-heading": 5.313534750010952, "distance-from-start": 0.6185274090957956, "deviation-center-line": 0.4321624588032806, "driven_lanedir_consec": 0.35754590689344695}, "loop-000-ego3": {"driven_any": 10.543115037663627, "survival_time": 59.99999999999873, "driven_lanedir": 0.25311047171912415, "in-drivable-lane": 57.59999999999873, "deviation-heading": 1.285257844300597, "distance-from-start": 1.1698099930405872, "deviation-center-line": 0.19844844465125416, "driven_lanedir_consec": 0.25311047171912415}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16467
1756
Bea Baselines 🐤template-pytorch lx22-objdet
sim success yes davinci-stage-04-6.2.51
2022-11-27 23:40:07+00:00 2022-11-27 23:53:14+00:00 0:13:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 driven_lanedir_consec_median 1.7435238113133125
other stats deviation-center-line_max 2.4222718364286577 deviation-center-line_mean 1.9712673980056732 deviation-center-line_median 1.9712673980056732 deviation-center-line_min 1.5202629595826886 deviation-heading_max 22.11881496779818 deviation-heading_mean 21.081253069221955 deviation-heading_median 21.081253069221955 deviation-heading_min 20.04369117064573 distance-from-start_max 0.5858599121362782 distance-from-start_mean 0.4228666845049779 distance-from-start_median 0.4228666845049779 distance-from-start_min 0.25987345687367763 driven_any_max 8.815495265488497 driven_any_mean 8.655062665644362 driven_any_median 8.655062665644362 driven_any_min 8.494630065800227 driven_lanedir_consec_max 2.586792353968929 driven_lanedir_consec_mean 1.7435238113133125 driven_lanedir_consec_min 0.9002552686576961 driven_lanedir_max 2.586792353968929 driven_lanedir_mean 2.392016086917392 driven_lanedir_median 2.392016086917392 driven_lanedir_min 2.197239819865855 in-drivable-lane_max 35.49999999999945 in-drivable-lane_mean 33.39999999999937 in-drivable-lane_median 33.39999999999937 in-drivable-lane_min 31.29999999999929 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 8.815495265488497, "survival_time": 59.99999999999873, "driven_lanedir": 2.197239819865855, "in-drivable-lane": 35.49999999999945, "deviation-heading": 20.04369117064573, "distance-from-start": 0.5858599121362782, "deviation-center-line": 1.5202629595826886, "driven_lanedir_consec": 0.9002552686576961}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 8.494630065800227, "survival_time": 59.99999999999873, "driven_lanedir": 2.586792353968929, "in-drivable-lane": 31.29999999999929, "deviation-heading": 22.11881496779818, "distance-from-start": 0.25987345687367763, "deviation-center-line": 2.4222718364286577, "driven_lanedir_consec": 2.586792353968929}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16463
1759
Bea Baselines 🐤template-pytorch lx22-BV1
sim-3of5 success yes davinci-stage-04-6.2.51
2022-11-27 23:36:40+00:00 2022-11-27 23:39:46+00:00 0:03:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.7564012057001293
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.7564012057001293 distance-from-start_median 0.7564012057001293 distance-from-start_min 0.7564012057001293 driven_any_max 3.5372611728592696 driven_any_mean 3.5372611728592696 driven_any_median 3.5372611728592696 driven_any_min 3.5372611728592696 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 16.4500000000001 in-drivable-lane_mean 16.4500000000001 in-drivable-lane_median 16.4500000000001 in-drivable-lane_min 16.4500000000001 per-episodes details {"d50-ego0": {"driven_any": 3.5372611728592696, "survival_time": 16.4500000000001, "driven_lanedir": 0.0, "in-drivable-lane": 16.4500000000001, "deviation-heading": 0.0, "distance-from-start": 0.7564012057001293, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 16.4500000000001 survival_time_mean 16.4500000000001 survival_time_median 16.4500000000001 survival_time_min 16.4500000000001
No reset possible 16460
1759
Bea Baselines 🐤template-pytorch lx22-BV1
sim-4of5 success yes davinci-stage-04-6.2.51
2022-11-27 23:30:36+00:00 2022-11-27 23:36:04+00:00 0:05:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.3734060491711336
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.3734060491711336 distance-from-start_median 0.3734060491711336 distance-from-start_min 0.3734060491711336 driven_any_max 3.741734431333521 driven_any_mean 3.741734431333521 driven_any_median 3.741734431333521 driven_any_min 3.741734431333521 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 32.20000000000031 in-drivable-lane_mean 32.20000000000031 in-drivable-lane_median 32.20000000000031 in-drivable-lane_min 32.20000000000031 per-episodes details {"d60-ego0": {"driven_any": 3.741734431333521, "survival_time": 32.20000000000031, "driven_lanedir": 0.0, "in-drivable-lane": 32.20000000000031, "deviation-heading": 0.0, "distance-from-start": 0.3734060491711336, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 32.20000000000031 survival_time_mean 32.20000000000031 survival_time_median 32.20000000000031 survival_time_min 32.20000000000031
No reset possible 16459
1762
Bea Baselines 🐤template-pytorch aido-hello-sim-validation
sanity-check success yes davinci-stage-04-6.2.51
2022-11-27 23:29:02+00:00 2022-11-27 23:30:11+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.027632425770637292 deviation-center-line_median 0.005650493442286594
other stats deviation-center-line_max 0.005650493442286594 deviation-center-line_mean 0.005650493442286594 deviation-center-line_min 0.005650493442286594 deviation-heading_max 0.28899819294510243 deviation-heading_mean 0.28899819294510243 deviation-heading_median 0.28899819294510243 deviation-heading_min 0.28899819294510243 distance-from-start_max 0.0342140910227398 distance-from-start_mean 0.0342140910227398 distance-from-start_median 0.0342140910227398 distance-from-start_min 0.0342140910227398 driven_any_max 0.03424516593237718 driven_any_mean 0.03424516593237718 driven_any_median 0.03424516593237718 driven_any_min 0.03424516593237718 driven_lanedir_consec_max 0.027632425770637292 driven_lanedir_consec_mean 0.027632425770637292 driven_lanedir_consec_min 0.027632425770637292 driven_lanedir_max 0.027632425770637292 driven_lanedir_mean 0.027632425770637292 driven_lanedir_median 0.027632425770637292 driven_lanedir_min 0.027632425770637292 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03424516593237718, "survival_time": 0.49999999999999994, "driven_lanedir": 0.027632425770637292, "in-drivable-lane": 0.0, "deviation-heading": 0.28899819294510243, "distance-from-start": 0.0342140910227398, "deviation-center-line": 0.005650493442286594, "driven_lanedir_consec": 0.027632425770637292}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16454
1767
Bea Baselines 🐤template-pytorch aido-LFVI-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 23:26:31+00:00 2022-11-27 23:28:50+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.1999999999999966 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5202098026681854 deviation-center-line_median 0.28469869321332153
other stats deviation-center-line_max 0.28469869321332153 deviation-center-line_mean 0.28469869321332153 deviation-center-line_min 0.28469869321332153 deviation-heading_max 1.4713384599492132 deviation-heading_mean 1.4713384599492132 deviation-heading_median 1.4713384599492132 deviation-heading_min 1.4713384599492132 distance-from-start_max 0.5314842199830379 distance-from-start_mean 0.5314842199830379 distance-from-start_median 0.5314842199830379 distance-from-start_min 0.5314842199830379 driven_any_max 0.5746204195748775 driven_any_mean 0.5746204195748775 driven_any_median 0.5746204195748775 driven_any_min 0.5746204195748775 driven_lanedir_consec_max 0.5202098026681854 driven_lanedir_consec_mean 0.5202098026681854 driven_lanedir_consec_min 0.5202098026681854 driven_lanedir_max 0.5202098026681854 driven_lanedir_mean 0.5202098026681854 driven_lanedir_median 0.5202098026681854 driven_lanedir_min 0.5202098026681854 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.5746204195748775, "survival_time": 3.1999999999999966, "driven_lanedir": 0.5202098026681854, "in-drivable-lane": 0.0, "deviation-heading": 1.4713384599492132, "distance-from-start": 0.5314842199830379, "deviation-center-line": 0.28469869321332153, "driven_lanedir_consec": 0.5202098026681854}}simulation-passed 1 survival_time_max 3.1999999999999966 survival_time_mean 3.1999999999999966 survival_time_min 3.1999999999999966
No reset possible 16449
1768
Bea Baselines 🐤template-pytorch aido-LFI-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 23:23:46+00:00 2022-11-27 23:26:23+00:00 0:02:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.049999999999997 in-drivable-lane_median 1.7999999999999967 driven_lanedir_consec_median 0.005965002245357454 deviation-center-line_median 0.009862871605744509
other stats deviation-center-line_max 0.009862871605744509 deviation-center-line_mean 0.009862871605744509 deviation-center-line_min 0.009862871605744509 deviation-heading_max 0.7798878959299526 deviation-heading_mean 0.7798878959299526 deviation-heading_median 0.7798878959299526 deviation-heading_min 0.7798878959299526 distance-from-start_max 0.04161536257062826 distance-from-start_mean 0.04161536257062826 distance-from-start_median 0.04161536257062826 distance-from-start_min 0.04161536257062826 driven_any_max 0.0701048942955869 driven_any_mean 0.0701048942955869 driven_any_median 0.0701048942955869 driven_any_min 0.0701048942955869 driven_lanedir_consec_max 0.005965002245357454 driven_lanedir_consec_mean 0.005965002245357454 driven_lanedir_consec_min 0.005965002245357454 driven_lanedir_max 0.005965002245357454 driven_lanedir_mean 0.005965002245357454 driven_lanedir_median 0.005965002245357454 driven_lanedir_min 0.005965002245357454 in-drivable-lane_max 1.7999999999999967 in-drivable-lane_mean 1.7999999999999967 in-drivable-lane_min 1.7999999999999967 per-episodes details {"4way-000-ego0": {"driven_any": 0.0701048942955869, "survival_time": 3.049999999999997, "driven_lanedir": 0.005965002245357454, "in-drivable-lane": 1.7999999999999967, "deviation-heading": 0.7798878959299526, "distance-from-start": 0.04161536257062826, "deviation-center-line": 0.009862871605744509, "driven_lanedir_consec": 0.005965002245357454}}simulation-passed 1 survival_time_max 3.049999999999997 survival_time_mean 3.049999999999997 survival_time_min 3.049999999999997
No reset possible 16445
1769
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 23:15:43+00:00 2022-11-27 23:23:19+00:00 0:07:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.541275569409125 survival_time_median 59.99999999999873 deviation-center-line_median 1.0652602177813295 in-drivable-lane_median 29.19999999999934
other stats deviation-center-line_max 1.0652602177813295 deviation-center-line_mean 1.0652602177813295 deviation-center-line_min 1.0652602177813295 deviation-heading_max 24.074288606407627 deviation-heading_mean 24.074288606407627 deviation-heading_median 24.074288606407627 deviation-heading_min 24.074288606407627 distance-from-start_max 0.36189997153209463 distance-from-start_mean 0.36189997153209463 distance-from-start_median 0.36189997153209463 distance-from-start_min 0.36189997153209463 driven_any_max 4.47876371612375 driven_any_mean 4.47876371612375 driven_any_median 4.47876371612375 driven_any_min 4.47876371612375 driven_lanedir_consec_max 1.541275569409125 driven_lanedir_consec_mean 1.541275569409125 driven_lanedir_consec_min 1.541275569409125 driven_lanedir_max 1.541275569409125 driven_lanedir_mean 1.541275569409125 driven_lanedir_median 1.541275569409125 driven_lanedir_min 1.541275569409125 in-drivable-lane_max 29.19999999999934 in-drivable-lane_mean 29.19999999999934 in-drivable-lane_min 29.19999999999934 per-episodes details {"loop2-000-ego0": {"driven_any": 4.47876371612375, "survival_time": 59.99999999999873, "driven_lanedir": 1.541275569409125, "in-drivable-lane": 29.19999999999934, "deviation-heading": 24.074288606407627, "distance-from-start": 0.36189997153209463, "deviation-center-line": 1.0652602177813295, "driven_lanedir_consec": 1.541275569409125}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16442
1769
Bea Baselines 🐤template-pytorch aido-LF-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 23:07:15+00:00 2022-11-27 23:15:36+00:00 0:08:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.5774082287249656 survival_time_median 59.99999999999873 deviation-center-line_median 1.716249036203565 in-drivable-lane_median 43.49999999999906
other stats deviation-center-line_max 1.716249036203565 deviation-center-line_mean 1.716249036203565 deviation-center-line_min 1.716249036203565 deviation-heading_max 16.54844533244037 deviation-heading_mean 16.54844533244037 deviation-heading_median 16.54844533244037 deviation-heading_min 16.54844533244037 distance-from-start_max 0.44484250921734575 distance-from-start_mean 0.44484250921734575 distance-from-start_median 0.44484250921734575 distance-from-start_min 0.44484250921734575 driven_any_max 11.582157211871303 driven_any_mean 11.582157211871303 driven_any_median 11.582157211871303 driven_any_min 11.582157211871303 driven_lanedir_consec_max 1.5774082287249656 driven_lanedir_consec_mean 1.5774082287249656 driven_lanedir_consec_min 1.5774082287249656 driven_lanedir_max 1.5774082287249656 driven_lanedir_mean 1.5774082287249656 driven_lanedir_median 1.5774082287249656 driven_lanedir_min 1.5774082287249656 in-drivable-lane_max 43.49999999999906 in-drivable-lane_mean 43.49999999999906 in-drivable-lane_min 43.49999999999906 per-episodes details {"autolab-000-ego0": {"driven_any": 11.582157211871303, "survival_time": 59.99999999999873, "driven_lanedir": 1.5774082287249656, "in-drivable-lane": 43.49999999999906, "deviation-heading": 16.54844533244037, "distance-from-start": 0.44484250921734575, "deviation-center-line": 1.716249036203565, "driven_lanedir_consec": 1.5774082287249656}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16439
1770
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:58:56+00:00 2022-11-27 23:07:07+00:00 0:08:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.950000000000163 in-drivable-lane_median 16.17500000000014 driven_lanedir_consec_median 0.11275702091353024 deviation-center-line_median 0.362249451981345
other stats deviation-center-line_max 3.0586900082527166 deviation-center-line_mean 0.9576386305673004 deviation-center-line_min 0.04736561005379428 deviation-heading_max 29.45850995232479 deviation-heading_mean 9.138712873759442 deviation-heading_median 3.198053287805372 deviation-heading_min 0.7002349671022325 distance-from-start_max 0.31482459861015655 distance-from-start_mean 0.17255392774736517 distance-from-start_median 0.15365818433276085 distance-from-start_min 0.06807474371378244 driven_any_max 3.4337232432599385 driven_any_mean 0.983107940532419 driven_any_median 0.21310865116881025 driven_any_min 0.07249121653211703 driven_lanedir_consec_max 0.9744013979618352 driven_lanedir_consec_mean 0.31061258087773 driven_lanedir_consec_min 0.0425348837220243 driven_lanedir_max 0.9744013979618352 driven_lanedir_mean 0.31061258087773 driven_lanedir_median 0.11275702091353024 driven_lanedir_min 0.0425348837220243 in-drivable-lane_max 19.750000000000163 in-drivable-lane_mean 13.025000000000112 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.25570033909579337, "survival_time": 20.950000000000163, "driven_lanedir": 0.13087467281823528, "in-drivable-lane": 19.25000000000016, "deviation-heading": 1.0383016659938158, "distance-from-start": 0.1569554957382056, "deviation-center-line": 0.04736561005379428, "driven_lanedir_consec": 0.13087467281823528}, "4way-000-ego1": {"driven_any": 0.07249121653211703, "survival_time": 20.950000000000163, "driven_lanedir": 0.0425348837220243, "in-drivable-lane": 0.0, "deviation-heading": 29.45850995232479, "distance-from-start": 0.06807474371378244, "deviation-center-line": 3.0586900082527166, "driven_lanedir_consec": 0.0425348837220243}, "4way-000-ego2": {"driven_any": 0.1705169632418271, "survival_time": 20.950000000000163, "driven_lanedir": 0.0946393690088252, "in-drivable-lane": 19.750000000000163, "deviation-heading": 0.7002349671022325, "distance-from-start": 0.1503608729273161, "deviation-center-line": 0.055653251025076185, "driven_lanedir_consec": 0.0946393690088252}, "4way-000-ego3": {"driven_any": 3.4337232432599385, "survival_time": 20.950000000000163, "driven_lanedir": 0.9744013979618352, "in-drivable-lane": 13.100000000000122, "deviation-heading": 5.357804909616929, "distance-from-start": 0.31482459861015655, "deviation-center-line": 0.6688456529376138, "driven_lanedir_consec": 0.9744013979618352}}simulation-passed 1 survival_time_max 20.950000000000163 survival_time_mean 20.950000000000163 survival_time_min 20.950000000000163
No reset possible 16438
1770
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:56:59+00:00 2022-11-27 22:58:31+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16431
1772
Bea Baselines 🐤template-pytorch aido-LFP-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:46:18+00:00 2022-11-27 22:56:42+00:00 0:10:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 47.19999999999862 driven_lanedir_consec_median 0.2424667470483679 deviation-center-line_median 1.20006250218645
other stats deviation-center-line_max 1.20006250218645 deviation-center-line_mean 1.20006250218645 deviation-center-line_min 1.20006250218645 deviation-heading_max 9.810706055072206 deviation-heading_mean 9.810706055072206 deviation-heading_median 9.810706055072206 deviation-heading_min 9.810706055072206 distance-from-start_max 0.8561109436877137 distance-from-start_mean 0.8561109436877137 distance-from-start_median 0.8561109436877137 distance-from-start_min 0.8561109436877137 driven_any_max 5.990013537123189 driven_any_mean 5.990013537123189 driven_any_median 5.990013537123189 driven_any_min 5.990013537123189 driven_lanedir_consec_max 0.2424667470483679 driven_lanedir_consec_mean 0.2424667470483679 driven_lanedir_consec_min 0.2424667470483679 driven_lanedir_max 0.7347319034741755 driven_lanedir_mean 0.7347319034741755 driven_lanedir_median 0.7347319034741755 driven_lanedir_min 0.7347319034741755 in-drivable-lane_max 47.19999999999862 in-drivable-lane_mean 47.19999999999862 in-drivable-lane_min 47.19999999999862 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.990013537123189, "survival_time": 59.99999999999873, "driven_lanedir": 0.7347319034741755, "in-drivable-lane": 47.19999999999862, "deviation-heading": 9.810706055072206, "distance-from-start": 0.8561109436877137, "deviation-center-line": 1.20006250218645, "driven_lanedir_consec": 0.2424667470483679}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16422
1774
Bea Baselines 🐤template-random aido-LFVI-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:37:37+00:00 2022-11-27 22:45:48+00:00 0:08:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.850000000000275 in-drivable-lane_median 18.900000000000233 driven_lanedir_consec_median 0.25774306587044116 deviation-center-line_median 0.8659891122281899
other stats deviation-center-line_max 0.8659891122281899 deviation-center-line_mean 0.8659891122281899 deviation-center-line_min 0.8659891122281899 deviation-heading_max 7.706889663126838 deviation-heading_mean 7.706889663126838 deviation-heading_median 7.706889663126838 deviation-heading_min 7.706889663126838 distance-from-start_max 0.8626308120701125 distance-from-start_mean 0.8626308120701125 distance-from-start_median 0.8626308120701125 distance-from-start_min 0.8626308120701125 driven_any_max 7.161071358405415 driven_any_mean 7.161071358405415 driven_any_median 7.161071358405415 driven_any_min 7.161071358405415 driven_lanedir_consec_max 0.25774306587044116 driven_lanedir_consec_mean 0.25774306587044116 driven_lanedir_consec_min 0.25774306587044116 driven_lanedir_max 0.2397300056472842 driven_lanedir_mean 0.2397300056472842 driven_lanedir_median 0.2397300056472842 driven_lanedir_min 0.2397300056472842 in-drivable-lane_max 18.900000000000233 in-drivable-lane_mean 18.900000000000233 in-drivable-lane_min 18.900000000000233 per-episodes details {"udem-000-ego0": {"driven_any": 7.161071358405415, "survival_time": 28.850000000000275, "driven_lanedir": 0.2397300056472842, "in-drivable-lane": 18.900000000000233, "deviation-heading": 7.706889663126838, "distance-from-start": 0.8626308120701125, "deviation-center-line": 0.8659891122281899, "driven_lanedir_consec": 0.25774306587044116}}simulation-passed 1 survival_time_max 28.850000000000275 survival_time_mean 28.850000000000275 survival_time_min 28.850000000000275
No reset possible 16420
1775
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:35:43+00:00 2022-11-27 22:37:16+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16416
1776
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:32:32+00:00 2022-11-27 22:35:36+00:00 0:03:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27378584101885495 survival_time_median 20.550000000000157 deviation-center-line_median 0.7687309613328539 in-drivable-lane_median 12.000000000000131
other stats deviation-center-line_max 0.7687309613328539 deviation-center-line_mean 0.7687309613328539 deviation-center-line_min 0.7687309613328539 deviation-heading_max 5.7583430601860695 deviation-heading_mean 5.7583430601860695 deviation-heading_median 5.7583430601860695 deviation-heading_min 5.7583430601860695 distance-from-start_max 0.7357883576773772 distance-from-start_mean 0.7357883576773772 distance-from-start_median 0.7357883576773772 distance-from-start_min 0.7357883576773772 driven_any_max 4.915576034387011 driven_any_mean 4.915576034387011 driven_any_median 4.915576034387011 driven_any_min 4.915576034387011 driven_lanedir_consec_max 0.27378584101885495 driven_lanedir_consec_mean 0.27378584101885495 driven_lanedir_consec_min 0.27378584101885495 driven_lanedir_max 0.2557751649818414 driven_lanedir_mean 0.2557751649818414 driven_lanedir_median 0.2557751649818414 driven_lanedir_min 0.2557751649818414 in-drivable-lane_max 12.000000000000131 in-drivable-lane_mean 12.000000000000131 in-drivable-lane_min 12.000000000000131 per-episodes details {"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}simulation-passed 1 survival_time_max 20.550000000000157 survival_time_mean 20.550000000000157 survival_time_min 20.550000000000157
No reset possible 16407
1778
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 22:12:55+00:00 2022-11-27 22:32:10+00:00 0:19:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.64999999999875 in-drivable-lane_median 52.39999999999873 driven_lanedir_consec_median 0.20841941457351276 deviation-center-line_median 0.6235918393283303
other stats deviation-center-line_max 3.9618906351925345 deviation-center-line_mean 1.3480922472158894 deviation-center-line_min 0.18329467501436195 deviation-heading_max 29.06091202107619 deviation-heading_mean 10.086526110865954 deviation-heading_median 4.852439390352202 deviation-heading_min 1.5803136416832215 distance-from-start_max 1.390232809724702 distance-from-start_mean 0.8610879612709739 distance-from-start_median 0.7658648678412762 distance-from-start_min 0.5223892996766412 driven_any_max 14.859731274916312 driven_any_mean 6.788261723046844 driven_any_median 5.402007576921902 driven_any_min 1.4893004634272606 driven_lanedir_consec_max 0.4727232702196713 driven_lanedir_consec_mean 0.24835079061387844 driven_lanedir_consec_min 0.10384106308881692 driven_lanedir_max 0.4727232702196713 driven_lanedir_mean 0.2405349726449092 driven_lanedir_median 0.19278777863557428 driven_lanedir_min 0.10384106308881692 in-drivable-lane_max 57.149999999998755 in-drivable-lane_mean 41.13749999999905 in-drivable-lane_min 2.599999999999994 per-episodes details {"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}simulation-passed 1 survival_time_max 59.64999999999875 survival_time_mean 59.64999999999875 survival_time_min 59.64999999999875
No reset possible 16398
1783
Bea Baselines 🐤template-random lx22-state-estimation
sim success yes davinci-stage-04-6.2.51
2022-11-27 21:59:23+00:00 2022-11-27 22:12:40+00:00 0:13:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07536801496639489 survival_time_median 59.99999999999873 deviation-center-line_median 0.6735665136853142 in-drivable-lane_median 49.44999999999911
other stats deviation-center-line_max 0.8579388817399466 deviation-center-line_mean 0.6660984451379334 deviation-center-line_min 0.4667899399885391 deviation-heading_max 5.582370303572385 deviation-heading_mean 4.330594699634891 deviation-heading_median 3.851668979994983 deviation-heading_min 3.5577448153373066 distance-from-start_max 1.4108418329399044 distance-from-start_mean 1.2749217352766675 distance-from-start_median 1.4108418329398824 distance-from-start_min 1.0030815399502164 driven_any_max 15.32631084737068 driven_any_mean 13.156722223767504 driven_any_median 15.326310847370546 driven_any_min 8.81754497656128 driven_lanedir_consec_max 0.15436172858886033 driven_lanedir_consec_mean 0.06086423316366729 driven_lanedir_consec_min -0.04713704406425334 driven_lanedir_max 0.13361915084339548 driven_lanedir_mean 0.04596436275685415 driven_lanedir_median 0.06382708081740152 driven_lanedir_min -0.05955314339023454 in-drivable-lane_max 53.2499999999987 in-drivable-lane_mean 44.49999999999929 in-drivable-lane_min 30.80000000000006 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 15.326310847370546, "survival_time": 59.99999999999873, "driven_lanedir": 0.13361915084339548, "in-drivable-lane": 53.2499999999987, "deviation-heading": 3.851668979994983, "distance-from-start": 1.4108418329398824, "deviation-center-line": 0.6735665136853142, "driven_lanedir_consec": 0.15436172858886033}, "LF-zig-zag-001-ego0": {"driven_any": 8.81754497656128, "survival_time": 35.9000000000001, "driven_lanedir": 0.06382708081740152, "in-drivable-lane": 30.80000000000006, "deviation-heading": 3.5577448153373066, "distance-from-start": 1.0030815399502164, "deviation-center-line": 0.4667899399885391, "driven_lanedir_consec": 0.07536801496639489}, "LF-zig-zag-002-ego0": {"driven_any": 15.32631084737068, "survival_time": 59.99999999999873, "driven_lanedir": -0.05955314339023454, "in-drivable-lane": 49.44999999999911, "deviation-heading": 5.582370303572385, "distance-from-start": 1.4108418329399044, "deviation-center-line": 0.8579388817399466, "driven_lanedir_consec": -0.04713704406425334}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 51.96666666666585 survival_time_min 35.9000000000001
No reset possible 16384
1792
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:44:29+00:00 2022-11-27 21:58:49+00:00 0:14:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 55.54999999999898 in-drivable-lane_median 33.999999999999304 driven_lanedir_consec_median 0.23486935510848683 deviation-center-line_median 1.9152361710618249
other stats deviation-center-line_max 1.9152361710618249 deviation-center-line_mean 1.9152361710618249 deviation-center-line_min 1.9152361710618249 deviation-heading_max 18.76264857218657 deviation-heading_mean 18.76264857218657 deviation-heading_median 18.76264857218657 deviation-heading_min 18.76264857218657 distance-from-start_max 1.290574960120657 distance-from-start_mean 1.290574960120657 distance-from-start_median 1.290574960120657 distance-from-start_min 1.290574960120657 driven_any_max 13.766585811745278 driven_any_mean 13.766585811745278 driven_any_median 13.766585811745278 driven_any_min 13.766585811745278 driven_lanedir_consec_max 0.23486935510848683 driven_lanedir_consec_mean 0.23486935510848683 driven_lanedir_consec_min 0.23486935510848683 driven_lanedir_max 0.22765090740773952 driven_lanedir_mean 0.22765090740773952 driven_lanedir_median 0.22765090740773952 driven_lanedir_min 0.22765090740773952 in-drivable-lane_max 33.999999999999304 in-drivable-lane_mean 33.999999999999304 in-drivable-lane_min 33.999999999999304 per-episodes details {"udem-000-ego0": {"driven_any": 13.766585811745278, "survival_time": 55.54999999999898, "driven_lanedir": 0.22765090740773952, "in-drivable-lane": 33.999999999999304, "deviation-heading": 18.76264857218657, "distance-from-start": 1.290574960120657, "deviation-center-line": 1.9152361710618249, "driven_lanedir_consec": 0.23486935510848683}}simulation-passed 1 survival_time_max 55.54999999999898 survival_time_mean 55.54999999999898 survival_time_min 55.54999999999898
No reset possible 16377
1794
Bea Baselines 🐤template-random aido-LF-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:36:08+00:00 2022-11-27 21:44:21+00:00 0:08:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.012435476414101476 survival_time_median 59.99999999999873 deviation-center-line_median 0.5849703750508038 in-drivable-lane_median 53.74999999999868
other stats deviation-center-line_max 0.5849703750508038 deviation-center-line_mean 0.5849703750508038 deviation-center-line_min 0.5849703750508038 deviation-heading_max 4.775258785640045 deviation-heading_mean 4.775258785640045 deviation-heading_median 4.775258785640045 deviation-heading_min 4.775258785640045 distance-from-start_max 1.4108418329398955 distance-from-start_mean 1.4108418329398955 distance-from-start_median 1.4108418329398955 distance-from-start_min 1.4108418329398955 driven_any_max 15.326310847370571 driven_any_mean 15.326310847370571 driven_any_median 15.326310847370571 driven_any_min 15.326310847370571 driven_lanedir_consec_max 0.012435476414101476 driven_lanedir_consec_mean 0.012435476414101476 driven_lanedir_consec_min 0.012435476414101476 driven_lanedir_max 0.01578217614057431 driven_lanedir_mean 0.01578217614057431 driven_lanedir_median 0.01578217614057431 driven_lanedir_min 0.01578217614057431 in-drivable-lane_max 53.74999999999868 in-drivable-lane_mean 53.74999999999868 in-drivable-lane_min 53.74999999999868 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370571, "survival_time": 59.99999999999873, "driven_lanedir": 0.01578217614057431, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258785640045, "distance-from-start": 1.4108418329398955, "deviation-center-line": 0.5849703750508038, "driven_lanedir_consec": 0.012435476414101476}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16374
1795
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:27:21+00:00 2022-11-27 21:35:49+00:00 0:08:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.850000000000104 in-drivable-lane_median 12.125000000000089 driven_lanedir_consec_median 0.0914085509908058 deviation-center-line_median 0.43295730670036126
other stats deviation-center-line_max 0.9740434407320936 deviation-center-line_mean 0.4859958968604682 deviation-center-line_min 0.10402553330905678 deviation-heading_max 11.275693531416076 deviation-heading_mean 4.654809102682379 deviation-heading_median 2.965682219224468 deviation-heading_min 1.412178440864505 distance-from-start_max 0.6736010379604943 distance-from-start_mean 0.3985347917343786 distance-from-start_median 0.4602690644885098 distance-from-start_min 6.280369834735102e-16 driven_any_max 4.057822758459427 driven_any_mean 1.6869445200555797 driven_any_median 1.3449776608814374 driven_any_min 1.6723002649096045e-14 driven_lanedir_consec_max 0.3062479141509611 driven_lanedir_consec_mean 0.12226625403314316 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.3062479141509611 driven_lanedir_mean 0.11925650183156368 driven_lanedir_median 0.08538904658764679 driven_lanedir_min 0.0 in-drivable-lane_max 14.800000000000107 in-drivable-lane_mean 9.76250000000007 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.295525081876566, "survival_time": 16.850000000000104, "driven_lanedir": 0.03283062049203522, "in-drivable-lane": 13.400000000000093, "deviation-heading": 2.548872644626666, "distance-from-start": 0.5461575079396546, "deviation-center-line": 0.3268416966298657, "driven_lanedir_consec": 0.029485112858473883}, "4way-000-ego1": {"driven_any": 1.6723002649096045e-14, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.275693531416076, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.9740434407320936, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 4.057822758459427, "survival_time": 16.850000000000104, "driven_lanedir": 0.13794747268325835, "in-drivable-lane": 10.850000000000088, "deviation-heading": 3.3824917938222696, "distance-from-start": 0.6736010379604943, "deviation-center-line": 0.5390729167708568, "driven_lanedir_consec": 0.15333198912313772}, "4way-000-ego3": {"driven_any": 0.3944302398863089, "survival_time": 16.850000000000104, "driven_lanedir": 0.3062479141509611, "in-drivable-lane": 14.800000000000107, "deviation-heading": 1.412178440864505, "distance-from-start": 0.37438062103736497, "deviation-center-line": 0.10402553330905678, "driven_lanedir_consec": 0.3062479141509611}}simulation-passed 1 survival_time_max 16.850000000000104 survival_time_mean 16.850000000000104 survival_time_min 16.850000000000104
No reset possible 16373
1795
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:25:19+00:00 2022-11-27 21:26:47+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16372
1795
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:23:44+00:00 2022-11-27 21:25:13+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16369
1796
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:15:48+00:00 2022-11-27 21:23:14+00:00 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.99999999999958 in-drivable-lane_median 39.249999999999574 driven_lanedir_consec_median 0.1329316137267978 deviation-center-line_median 0.4769519451920501
other stats deviation-center-line_max 0.627148077892518 deviation-center-line_mean 0.4769519451920501 deviation-center-line_min 0.3267558124915822 deviation-heading_max 4.173256858222429 deviation-heading_mean 3.3650961945019375 deviation-heading_median 3.3650961945019375 deviation-heading_min 2.5569355307814456 distance-from-start_max 1.0442247976691823 distance-from-start_mean 0.7951911528044138 distance-from-start_median 0.7951911528044138 distance-from-start_min 0.5461575079396452 driven_any_max 11.349124250612952 driven_any_mean 6.923556868843365 driven_any_median 6.923556868843365 driven_any_min 2.497989487073778 driven_lanedir_consec_max 0.2397940766790495 driven_lanedir_consec_mean 0.1329316137267978 driven_lanedir_consec_min 0.02606915077454608 driven_lanedir_max 0.2256600500204217 driven_lanedir_mean 0.1275377118421561 driven_lanedir_median 0.1275377118421561 driven_lanedir_min 0.029415373663890465 in-drivable-lane_max 41.54999999999957 in-drivable-lane_mean 39.249999999999574 in-drivable-lane_min 36.94999999999958 per-episodes details {"loop2-000-ego0": {"driven_any": 2.497989487073778, "survival_time": 44.99999999999958, "driven_lanedir": 0.029415373663890465, "in-drivable-lane": 41.54999999999957, "deviation-heading": 2.5569355307814456, "distance-from-start": 0.5461575079396452, "deviation-center-line": 0.3267558124915822, "driven_lanedir_consec": 0.02606915077454608}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}simulation-passed 1 survival_time_max 44.99999999999958 survival_time_mean 44.99999999999958 survival_time_min 44.99999999999958
No reset possible 16366
1797
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:13:21+00:00 2022-11-27 21:15:27+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.300000000000026 in-drivable-lane_median 7.850000000000014 driven_lanedir_consec_median 0.02948472541340319 deviation-center-line_median 0.3268416970813497
other stats deviation-center-line_max 0.3268416970813497 deviation-center-line_mean 0.3268416970813497 deviation-center-line_min 0.3268416970813497 deviation-heading_max 2.548872596322993 deviation-heading_mean 2.548872596322993 deviation-heading_median 2.548872596322993 deviation-heading_min 2.548872596322993 distance-from-start_max 0.5461575079396523 distance-from-start_mean 0.5461575079396523 distance-from-start_median 0.5461575079396523 distance-from-start_min 0.5461575079396523 driven_any_max 2.2681416551684617 driven_any_mean 2.2681416551684617 driven_any_median 2.2681416551684617 driven_any_min 2.2681416551684617 driven_lanedir_consec_max 0.02948472541340319 driven_lanedir_consec_mean 0.02948472541340319 driven_lanedir_consec_min 0.02948472541340319 driven_lanedir_max 0.032831067512037126 driven_lanedir_mean 0.032831067512037126 driven_lanedir_median 0.032831067512037126 driven_lanedir_min 0.032831067512037126 in-drivable-lane_max 7.850000000000014 in-drivable-lane_mean 7.850000000000014 in-drivable-lane_min 7.850000000000014 per-episodes details {"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}simulation-passed 1 survival_time_max 11.300000000000026 survival_time_mean 11.300000000000026 survival_time_min 11.300000000000026
No reset possible 16362
1798
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:10:32+00:00 2022-11-27 21:13:07+00:00 0:02:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.999999999999994 in-drivable-lane_median 1.1999999999999955 driven_lanedir_consec_median 0.6695598998842298 deviation-center-line_median 0.19945788807203577
other stats deviation-center-line_max 0.19945788807203577 deviation-center-line_mean 0.19945788807203577 deviation-center-line_min 0.19945788807203577 deviation-heading_max 1.107372140691835 deviation-heading_mean 1.107372140691835 deviation-heading_median 1.107372140691835 deviation-heading_min 1.107372140691835 distance-from-start_max 0.9002875127689235 distance-from-start_mean 0.9002875127689235 distance-from-start_median 0.9002875127689235 distance-from-start_min 0.9002875127689235 driven_any_max 0.9092438226794856 driven_any_mean 0.9092438226794856 driven_any_median 0.9092438226794856 driven_any_min 0.9092438226794856 driven_lanedir_consec_max 0.6695598998842298 driven_lanedir_consec_mean 0.6695598998842298 driven_lanedir_consec_min 0.6695598998842298 driven_lanedir_max 0.6695598998842298 driven_lanedir_mean 0.6695598998842298 driven_lanedir_median 0.6695598998842298 driven_lanedir_min 0.6695598998842298 in-drivable-lane_max 1.1999999999999955 in-drivable-lane_mean 1.1999999999999955 in-drivable-lane_min 1.1999999999999955 per-episodes details {"autolab-000-ego0": {"driven_any": 0.9092438226794856, "survival_time": 3.999999999999994, "driven_lanedir": 0.6695598998842298, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 1.107372140691835, "distance-from-start": 0.9002875127689235, "deviation-center-line": 0.19945788807203577, "driven_lanedir_consec": 0.6695598998842298}}simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 3.999999999999994 survival_time_min 3.999999999999994
No reset possible 16355
1799
Bea Baselines 🐤template-ros aido-LFVI-sim-validation
sim-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:07:43+00:00 2022-11-27 21:10:25+00:00 0:02:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.999999999999994 in-drivable-lane_median 2.8999999999999932 driven_lanedir_consec_median 0.17004292724378578 deviation-center-line_median 0.0659023145062551
other stats deviation-center-line_max 0.0659023145062551 deviation-center-line_mean 0.0659023145062551 deviation-center-line_min 0.0659023145062551 deviation-heading_max 0.6552066076710106 deviation-heading_mean 0.6552066076710106 deviation-heading_median 0.6552066076710106 deviation-heading_min 0.6552066076710106 distance-from-start_max 0.7559946611355708 distance-from-start_mean 0.7559946611355708 distance-from-start_median 0.7559946611355708 distance-from-start_min 0.7559946611355708 driven_any_max 0.8113082770236631 driven_any_mean 0.8113082770236631 driven_any_median 0.8113082770236631 driven_any_min 0.8113082770236631 driven_lanedir_consec_max 0.17004292724378578 driven_lanedir_consec_mean 0.17004292724378578 driven_lanedir_consec_min 0.17004292724378578 driven_lanedir_max 0.17004292724378578 driven_lanedir_mean 0.17004292724378578 driven_lanedir_median 0.17004292724378578 driven_lanedir_min 0.17004292724378578 in-drivable-lane_max 2.8999999999999932 in-drivable-lane_mean 2.8999999999999932 in-drivable-lane_min 2.8999999999999932 per-episodes details {"4way-000-ego0": {"driven_any": 0.8113082770236631, "survival_time": 3.999999999999994, "driven_lanedir": 0.17004292724378578, "in-drivable-lane": 2.8999999999999932, "deviation-heading": 0.6552066076710106, "distance-from-start": 0.7559946611355708, "deviation-center-line": 0.0659023145062551, "driven_lanedir_consec": 0.17004292724378578}}simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 3.999999999999994 survival_time_min 3.999999999999994
No reset possible 16351
1801
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:05:46+00:00 2022-11-27 21:07:17+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.44613995367332704 survival_time_median 7.049999999999983 deviation-center-line_median 0.1699269997744388 in-drivable-lane_median 4.999999999999982
other stats deviation-center-line_max 0.1699269997744388 deviation-center-line_mean 0.1699269997744388 deviation-center-line_min 0.1699269997744388 deviation-heading_max 0.6567485247910277 deviation-heading_mean 0.6567485247910277 deviation-heading_median 0.6567485247910277 deviation-heading_min 0.6567485247910277 distance-from-start_max 1.656505296040372 distance-from-start_mean 1.656505296040372 distance-from-start_median 1.656505296040372 distance-from-start_min 1.656505296040372 driven_any_max 1.7239821406966729 driven_any_mean 1.7239821406966729 driven_any_median 1.7239821406966729 driven_any_min 1.7239821406966729 driven_lanedir_consec_max 0.44613995367332704 driven_lanedir_consec_mean 0.44613995367332704 driven_lanedir_consec_min 0.44613995367332704 driven_lanedir_max 0.44613995367332704 driven_lanedir_mean 0.44613995367332704 driven_lanedir_median 0.44613995367332704 driven_lanedir_min 0.44613995367332704 in-drivable-lane_max 4.999999999999982 in-drivable-lane_mean 4.999999999999982 in-drivable-lane_min 4.999999999999982 per-episodes details {"loop2-000-ego0": {"driven_any": 1.7239821406966729, "survival_time": 7.049999999999983, "driven_lanedir": 0.44613995367332704, "in-drivable-lane": 4.999999999999982, "deviation-heading": 0.6567485247910277, "distance-from-start": 1.656505296040372, "deviation-center-line": 0.1699269997744388, "driven_lanedir_consec": 0.44613995367332704}}simulation-passed 1 survival_time_max 7.049999999999983 survival_time_mean 7.049999999999983 survival_time_min 7.049999999999983
No reset possible 16346
1801
Bea Baselines 🐤template-ros aido-LF-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:03:22+00:00 2022-11-27 21:05:28+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4561671741612208 survival_time_median 8.09999999999998 deviation-center-line_median 0.1338585147256049 in-drivable-lane_median 6.199999999999979
other stats deviation-center-line_max 0.1338585147256049 deviation-center-line_mean 0.1338585147256049 deviation-center-line_min 0.1338585147256049 deviation-heading_max 0.5884678904052963 deviation-heading_mean 0.5884678904052963 deviation-heading_median 0.5884678904052963 deviation-heading_min 0.5884678904052963 distance-from-start_max 2.136969138574603 distance-from-start_mean 2.136969138574603 distance-from-start_median 2.136969138574603 distance-from-start_min 2.136969138574603 driven_any_max 2.181508362671926 driven_any_mean 2.181508362671926 driven_any_median 2.181508362671926 driven_any_min 2.181508362671926 driven_lanedir_consec_max 0.4561671741612208 driven_lanedir_consec_mean 0.4561671741612208 driven_lanedir_consec_min 0.4561671741612208 driven_lanedir_max 0.4561671741612208 driven_lanedir_mean 0.4561671741612208 driven_lanedir_median 0.4561671741612208 driven_lanedir_min 0.4561671741612208 in-drivable-lane_max 6.199999999999979 in-drivable-lane_mean 6.199999999999979 in-drivable-lane_min 6.199999999999979 per-episodes details {"autolab-000-ego0": {"driven_any": 2.181508362671926, "survival_time": 8.09999999999998, "driven_lanedir": 0.4561671741612208, "in-drivable-lane": 6.199999999999979, "deviation-heading": 0.5884678904052963, "distance-from-start": 2.136969138574603, "deviation-center-line": 0.1338585147256049, "driven_lanedir_consec": 0.4561671741612208}}simulation-passed 1 survival_time_max 8.09999999999998 survival_time_mean 8.09999999999998 survival_time_min 8.09999999999998
No reset possible 16344
1802
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 21:01:25+00:00 2022-11-27 21:03:13+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16340
1803
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:58:33+00:00 2022-11-27 21:01:10+00:00 0:02:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.79999999999998 in-drivable-lane_median 5.199999999999982 driven_lanedir_consec_median 0.3930648638698691 deviation-center-line_median 0.2413572809444457
other stats deviation-center-line_max 0.28431432527840433 deviation-center-line_mean 0.2413572809444457 deviation-center-line_min 0.19840023661048703 deviation-heading_max 1.9115662010849035 deviation-heading_mean 1.7404572542948566 deviation-heading_median 1.7404572542948566 deviation-heading_min 1.5693483075048096 distance-from-start_max 1.6785243001369958 distance-from-start_mean 1.6640185579953417 distance-from-start_median 1.6640185579953417 distance-from-start_min 1.649512815853687 driven_any_max 1.823537943982713 driven_any_mean 1.7558757256869757 driven_any_median 1.7558757256869757 driven_any_min 1.688213507391238 driven_lanedir_consec_max 0.4680280919627047 driven_lanedir_consec_mean 0.3930648638698691 driven_lanedir_consec_min 0.31810163577703354 driven_lanedir_max 0.4680280919627047 driven_lanedir_mean 0.3930648638698691 driven_lanedir_median 0.3930648638698691 driven_lanedir_min 0.31810163577703354 in-drivable-lane_max 5.449999999999982 in-drivable-lane_mean 5.199999999999982 in-drivable-lane_min 4.949999999999982 per-episodes details {"loop2-000-ego0": {"driven_any": 1.688213507391238, "survival_time": 7.79999999999998, "driven_lanedir": 0.31810163577703354, "in-drivable-lane": 5.449999999999982, "deviation-heading": 1.9115662010849035, "distance-from-start": 1.649512815853687, "deviation-center-line": 0.19840023661048703, "driven_lanedir_consec": 0.31810163577703354}, "loop2-000-ego1": {"driven_any": 1.823537943982713, "survival_time": 7.79999999999998, "driven_lanedir": 0.4680280919627047, "in-drivable-lane": 4.949999999999982, "deviation-heading": 1.5693483075048096, "distance-from-start": 1.6785243001369958, "deviation-center-line": 0.28431432527840433, "driven_lanedir_consec": 0.4680280919627047}}simulation-passed 1 survival_time_max 7.79999999999998 survival_time_mean 7.79999999999998 survival_time_min 7.79999999999998
No reset possible 16337
1804
Bea Baselines 🐤template-ros aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:56:23+00:00 2022-11-27 20:58:07+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.5499999999999954 in-drivable-lane_median 2.2499999999999947 driven_lanedir_consec_median 0.2316361480231559 deviation-center-line_median 0.08139079724041116
other stats deviation-center-line_max 0.08139079724041116 deviation-center-line_mean 0.08139079724041116 deviation-center-line_min 0.08139079724041116 deviation-heading_max 0.645295327763397 deviation-heading_mean 0.645295327763397 deviation-heading_median 0.645295327763397 deviation-heading_min 0.645295327763397 distance-from-start_max 0.7141117327806646 distance-from-start_mean 0.7141117327806646 distance-from-start_median 0.7141117327806646 distance-from-start_min 0.7141117327806646 driven_any_max 0.7164767392507335 driven_any_mean 0.7164767392507335 driven_any_median 0.7164767392507335 driven_any_min 0.7164767392507335 driven_lanedir_consec_max 0.2316361480231559 driven_lanedir_consec_mean 0.2316361480231559 driven_lanedir_consec_min 0.2316361480231559 driven_lanedir_max 0.2316361480231559 driven_lanedir_mean 0.2316361480231559 driven_lanedir_median 0.2316361480231559 driven_lanedir_min 0.2316361480231559 in-drivable-lane_max 2.2499999999999947 in-drivable-lane_mean 2.2499999999999947 in-drivable-lane_min 2.2499999999999947 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7164767392507335, "survival_time": 3.5499999999999954, "driven_lanedir": 0.2316361480231559, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 0.645295327763397, "distance-from-start": 0.7141117327806646, "deviation-center-line": 0.08139079724041116, "driven_lanedir_consec": 0.2316361480231559}}simulation-passed 1 survival_time_max 3.5499999999999954 survival_time_mean 3.5499999999999954 survival_time_min 3.5499999999999954
No reset possible 16331
1808
Bea Baselines 🐤template-ros lx22-state-estimation
sim success yes davinci-stage-04-6.2.51
2022-11-27 20:52:56+00:00 2022-11-27 20:56:16+00:00 0:03:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6952804045478427 survival_time_median 10.600000000000016 deviation-center-line_median 0.25658356828260853 in-drivable-lane_median 7.450000000000021
other stats deviation-center-line_max 0.27631522967548794 deviation-center-line_mean 0.2568708817414622 deviation-center-line_min 0.2377138472662902 deviation-heading_max 1.2881811423320058 deviation-heading_mean 0.9360239012900669 deviation-heading_median 1.0821707286159763 deviation-heading_min 0.4377198329222184 distance-from-start_max 2.84026417844585 distance-from-start_mean 2.5282896352690147 distance-from-start_median 2.6983327245954194 distance-from-start_min 2.0462720027657753 driven_any_max 2.866682289234733 driven_any_mean 2.6219247497288714 driven_any_median 2.8128166860655925 driven_any_min 2.186275273886288 driven_lanedir_consec_max 0.8216817833801773 driven_lanedir_consec_mean 0.6990956217668512 driven_lanedir_consec_min 0.5803246773725339 driven_lanedir_max 0.8216817833801773 driven_lanedir_mean 0.6990956217668512 driven_lanedir_median 0.6952804045478427 driven_lanedir_min 0.5803246773725339 in-drivable-lane_max 7.850000000000019 in-drivable-lane_mean 7.00000000000001 in-drivable-lane_min 5.699999999999988 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 2.186275273886288, "survival_time": 8.499999999999986, "driven_lanedir": 0.5803246773725339, "in-drivable-lane": 5.699999999999988, "deviation-heading": 1.2881811423320058, "distance-from-start": 2.0462720027657753, "deviation-center-line": 0.2377138472662902, "driven_lanedir_consec": 0.5803246773725339}, "LF-zig-zag-001-ego0": {"driven_any": 2.866682289234733, "survival_time": 10.700000000000015, "driven_lanedir": 0.6952804045478427, "in-drivable-lane": 7.850000000000019, "deviation-heading": 0.4377198329222184, "distance-from-start": 2.84026417844585, "deviation-center-line": 0.25658356828260853, "driven_lanedir_consec": 0.6952804045478427}, "LF-zig-zag-002-ego0": {"driven_any": 2.8128166860655925, "survival_time": 10.600000000000016, "driven_lanedir": 0.8216817833801773, "in-drivable-lane": 7.450000000000021, "deviation-heading": 1.0821707286159763, "distance-from-start": 2.6983327245954194, "deviation-center-line": 0.27631522967548794, "driven_lanedir_consec": 0.8216817833801773}}simulation-passed 1 survival_time_max 10.700000000000015 survival_time_mean 9.93333333333334 survival_time_min 8.499999999999986
No reset possible 16326
1809
Bea Baselines 🐤template-ros lx22-BV1
sim-3of5 success yes davinci-stage-04-6.2.51
2022-11-27 20:50:30+00:00 2022-11-27 20:52:35+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 2.1062248674716675
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 2.1062248674716675 distance-from-start_median 2.1062248674716675 distance-from-start_min 2.1062248674716675 driven_any_max 2.1282200935834776 driven_any_mean 2.1282200935834776 driven_any_median 2.1282200935834776 driven_any_min 2.1282200935834776 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 8.14999999999998 in-drivable-lane_mean 8.14999999999998 in-drivable-lane_median 8.14999999999998 in-drivable-lane_min 8.14999999999998 per-episodes details {"d50-ego0": {"driven_any": 2.1282200935834776, "survival_time": 8.14999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 8.14999999999998, "deviation-heading": 0.0, "distance-from-start": 2.1062248674716675, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 8.14999999999998 survival_time_mean 8.14999999999998 survival_time_median 8.14999999999998 survival_time_min 8.14999999999998
No reset possible 16321
1816
Bea Baselines 🐤template-ros aido-LFV-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:47:45+00:00 2022-11-27 20:50:09+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.5999999999999845 in-drivable-lane_median 5.699999999999985 driven_lanedir_consec_median 0.1032158683617388 deviation-center-line_median 0.06555060179133754
other stats deviation-center-line_max 0.06555060179133754 deviation-center-line_mean 0.06555060179133754 deviation-center-line_min 0.06555060179133754 deviation-heading_max 0.7727039152203754 deviation-heading_mean 0.7727039152203754 deviation-heading_median 0.7727039152203754 deviation-heading_min 0.7727039152203754 distance-from-start_max 1.176164090862445 distance-from-start_mean 1.176164090862445 distance-from-start_median 1.176164090862445 distance-from-start_min 1.176164090862445 driven_any_max 1.608711254137817 driven_any_mean 1.608711254137817 driven_any_median 1.608711254137817 driven_any_min 1.608711254137817 driven_lanedir_consec_max 0.1032158683617388 driven_lanedir_consec_mean 0.1032158683617388 driven_lanedir_consec_min 0.1032158683617388 driven_lanedir_max 0.1032158683617388 driven_lanedir_mean 0.1032158683617388 driven_lanedir_median 0.1032158683617388 driven_lanedir_min 0.1032158683617388 in-drivable-lane_max 5.699999999999985 in-drivable-lane_mean 5.699999999999985 in-drivable-lane_min 5.699999999999985 per-episodes details {"loop2-000-ego0": {"driven_any": 1.608711254137817, "survival_time": 6.5999999999999845, "driven_lanedir": 0.1032158683617388, "in-drivable-lane": 5.699999999999985, "deviation-heading": 0.7727039152203754, "distance-from-start": 1.176164090862445, "deviation-center-line": 0.06555060179133754, "driven_lanedir_consec": 0.1032158683617388}}simulation-passed 1 survival_time_max 6.5999999999999845 survival_time_mean 6.5999999999999845 survival_time_min 6.5999999999999845
No reset possible 16317
1818
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-2of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:46:01+00:00 2022-11-27 20:47:33+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16308
1820
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-0of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:41:21+00:00 2022-11-27 20:45:29+00:00 0:04:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.550000000000017 in-drivable-lane_median 8.250000000000016 driven_lanedir_consec_median 0.4042599814166285 deviation-center-line_median 0.20507521794457512
other stats deviation-center-line_max 0.6502333567562001 deviation-center-line_mean 0.2823702193960691 deviation-center-line_min 0.06909708493892609 deviation-heading_max 2.1161299442668566 deviation-heading_mean 1.2728648924543309 deviation-heading_median 1.3000525052218384 deviation-heading_min 0.3752246151067888 distance-from-start_max 2.81607039452988 distance-from-start_mean 1.195394920572585 distance-from-start_median 0.8683401729060856 distance-from-start_min 0.22882894194828757 driven_any_max 2.8617835812516614 driven_any_mean 1.2251924847848392 driven_any_median 0.9050480015291836 driven_any_min 0.22889035482932815 driven_lanedir_consec_max 1.3000909886838572 driven_lanedir_consec_mean 0.5563388817592885 driven_lanedir_consec_min 0.1167445755200398 driven_lanedir_max 1.4937992448503312 driven_lanedir_mean 0.6064579907004579 driven_lanedir_median 0.4076440712157303 driven_lanedir_min 0.1167445755200398 in-drivable-lane_max 9.750000000000014 in-drivable-lane_mean 7.737500000000019 in-drivable-lane_min 4.700000000000031 per-episodes details {"udem-000-ego0": {"driven_any": 2.8617835812516614, "survival_time": 10.550000000000017, "driven_lanedir": 1.4937992448503312, "in-drivable-lane": 4.700000000000031, "deviation-heading": 2.095140118777754, "distance-from-start": 2.81607039452988, "deviation-center-line": 0.6502333567562001, "driven_lanedir_consec": 1.3000909886838572}, "udem-000-ego1": {"driven_any": 0.3746646358315487, "survival_time": 10.550000000000017, "driven_lanedir": 0.22013985605158193, "in-drivable-lane": 9.450000000000014, "deviation-heading": 0.3752246151067888, "distance-from-start": 0.3742691700002918, "deviation-center-line": 0.11686538193944718, "driven_lanedir_consec": 0.22013985605158193}, "udem-000-ego2": {"driven_any": 1.4354313672268186, "survival_time": 10.550000000000017, "driven_lanedir": 0.5951482863798787, "in-drivable-lane": 7.050000000000019, "deviation-heading": 2.1161299442668566, "distance-from-start": 1.362411175811879, "deviation-center-line": 0.2932850539497031, "driven_lanedir_consec": 0.588380106781675}, "udem-000-ego3": {"driven_any": 0.22889035482932815, "survival_time": 10.550000000000017, "driven_lanedir": 0.1167445755200398, "in-drivable-lane": 9.750000000000014, "deviation-heading": 0.5049648916659226, "distance-from-start": 0.22882894194828757, "deviation-center-line": 0.06909708493892609, "driven_lanedir_consec": 0.1167445755200398}}simulation-passed 1 survival_time_max 10.550000000000017 survival_time_mean 10.550000000000017 survival_time_min 10.550000000000017
No reset possible 16301
1821
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 20:37:11+00:00 2022-11-27 20:41:12+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.45 in-drivable-lane_median 8.149999999999999 driven_lanedir_consec_median 0.2449519642908477 deviation-center-line_median 0.08822375344516808
other stats deviation-center-line_max 0.10289004926430632 deviation-center-line_mean 0.08262950943623143 deviation-center-line_min 0.05118048159028321 deviation-heading_max 0.9693285480781386 deviation-heading_mean 0.5667337334212621 deviation-heading_median 0.49056964003700854 deviation-heading_min 0.3164671055328928 distance-from-start_max 2.5274428298285487 distance-from-start_mean 1.2702726490111025 distance-from-start_median 1.1101910556286885 distance-from-start_min 0.33326565495848437 driven_any_max 2.5682968028317537 driven_any_mean 1.4343005859629756 driven_any_median 1.4130623563729168 driven_any_min 0.34278082827431494 driven_lanedir_consec_max 0.39334036558251784 driven_lanedir_consec_mean 0.23885807677720292 driven_lanedir_consec_min 0.07218801294459842 driven_lanedir_max 0.39334036558251784 driven_lanedir_mean 0.23885807677720292 driven_lanedir_median 0.2449519642908477 driven_lanedir_min 0.07218801294459842 in-drivable-lane_max 8.8 in-drivable-lane_mean 8.149999999999999 in-drivable-lane_min 7.499999999999998 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.5822927473407549, "survival_time": 9.45, "driven_lanedir": 0.39334036558251784, "in-drivable-lane": 7.499999999999998, "deviation-heading": 0.9693285480781386, "distance-from-start": 0.5710308222316614, "deviation-center-line": 0.10289004926430632, "driven_lanedir_consec": 0.39334036558251784}, "zigzag-000-ego1": {"driven_any": 2.2438319654050787, "survival_time": 9.45, "driven_lanedir": 0.19237345976291653, "in-drivable-lane": 8.5, "deviation-heading": 0.3164671055328928, "distance-from-start": 1.6493512890257152, "deviation-center-line": 0.08791702667684381, "driven_lanedir_consec": 0.19237345976291653}, "zigzag-000-ego2": {"driven_any": 2.5682968028317537, "survival_time": 9.45, "driven_lanedir": 0.29753046881877887, "in-drivable-lane": 7.799999999999998, "deviation-heading": 0.5017957820200564, "distance-from-start": 2.5274428298285487, "deviation-center-line": 0.08853048021349237, "driven_lanedir_consec": 0.29753046881877887}, "zigzag-000-ego3": {"driven_any": 0.34278082827431494, "survival_time": 9.45, "driven_lanedir": 0.07218801294459842, "in-drivable-lane": 8.8, "deviation-heading": 0.47934349805396065, "distance-from-start": 0.33326565495848437, "deviation-center-line": 0.05118048159028321, "driven_lanedir_consec": 0.07218801294459842}}simulation-passed 1 survival_time_max 9.45 survival_time_mean 9.45 survival_time_min 9.45
No reset possible 16295
1848
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success yes davinci-stage-04-6.2.51
2022-11-27 20:31:07+00:00 2022-11-27 20:36:57+00:00 0:05:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 4.670206873031539
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 4.670206873031539 distance-from-start_median 4.670206873031539 distance-from-start_min 4.670206873031539 driven_any_max 4.723037721295593 driven_any_mean 4.723037721295593 driven_any_median 4.723037721295593 driven_any_min 4.723037721295593 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 38.09999999999997 in-drivable-lane_mean 38.09999999999997 in-drivable-lane_median 38.09999999999997 in-drivable-lane_min 38.09999999999997 per-episodes details {"d60-ego0": {"driven_any": 4.723037721295593, "survival_time": 38.09999999999997, "driven_lanedir": 0.0, "in-drivable-lane": 38.09999999999997, "deviation-heading": 0.0, "distance-from-start": 4.670206873031539, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 38.09999999999997 survival_time_mean 38.09999999999997 survival_time_median 38.09999999999997 survival_time_min 38.09999999999997
No reset possible 16290
1845
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-1of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:28:56+00:00 2022-11-27 20:31:01+00:00 0:02:05 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16284
1844
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-2of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:27:32+00:00 2022-11-27 20:28:33+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16279
1845
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-0of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:24:30+00:00 2022-11-27 20:26:49+00:00 0:02:19 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16273
1846
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-3of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:22:07+00:00 2022-11-27 20:24:02+00:00 0:01:55 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16272
1847
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-2of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:21:00+00:00 2022-11-27 20:22:01+00:00 0:01:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16268
1602
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-04-6.2.51
2022-11-27 20:19:30+00:00 2022-11-27 20:20:53+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.39096164187185295
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.39096164187185295 distance-from-start_median 0.39096164187185295 distance-from-start_min 0.39096164187185295 driven_any_max 0.3909616418718541 driven_any_mean 0.3909616418718541 driven_any_median 0.3909616418718541 driven_any_min 0.3909616418718541 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.849999999999998 in-drivable-lane_mean 2.849999999999998 in-drivable-lane_median 2.849999999999998 in-drivable-lane_min 2.849999999999998 per-episodes details {"d30-ego0": {"driven_any": 0.3909616418718541, "survival_time": 2.849999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 2.849999999999998, "deviation-heading": 0.0, "distance-from-start": 0.39096164187185295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.849999999999998 survival_time_mean 2.849999999999998 survival_time_median 2.849999999999998 survival_time_min 2.849999999999998
No reset possible 16264
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-04-6.2.51
2022-11-27 20:17:42+00:00 2022-11-27 20:19:16+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5428113441927771
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5428113441927771 distance-from-start_median 0.5428113441927771 distance-from-start_min 0.5428113441927771 driven_any_max 0.5795602301345484 driven_any_mean 0.5795602301345484 driven_any_median 0.5795602301345484 driven_any_min 0.5795602301345484 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.6499999999999986 in-drivable-lane_mean 2.6499999999999986 in-drivable-lane_median 2.6499999999999986 in-drivable-lane_min 2.6499999999999986 per-episodes details {"d30-ego0": {"driven_any": 0.5795602301345484, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 2.6499999999999986, "deviation-heading": 0.0, "distance-from-start": 0.5428113441927771, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.6499999999999986 survival_time_mean 2.6499999999999986 survival_time_median 2.6499999999999986 survival_time_min 2.6499999999999986
No reset possible 16262
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-04-6.2.51
2022-11-27 20:15:55+00:00 2022-11-27 20:17:29+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.39096164187185295
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.39096164187185295 distance-from-start_median 0.39096164187185295 distance-from-start_min 0.39096164187185295 driven_any_max 0.3909616418718541 driven_any_mean 0.3909616418718541 driven_any_median 0.3909616418718541 driven_any_min 0.3909616418718541 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 2.849999999999998 in-drivable-lane_mean 2.849999999999998 in-drivable-lane_median 2.849999999999998 in-drivable-lane_min 2.849999999999998 per-episodes details {"d30-ego0": {"driven_any": 0.3909616418718541, "survival_time": 2.849999999999998, "driven_lanedir": 0.0, "in-drivable-lane": 2.849999999999998, "deviation-heading": 0.0, "distance-from-start": 0.39096164187185295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 2.849999999999998 survival_time_mean 2.849999999999998 survival_time_median 2.849999999999998 survival_time_min 2.849999999999998
No reset possible 16256
1601
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 aborted no davinci-stage-04-6.2.51
2022-11-27 20:14:22+00:00 2022-11-27 20:15:06+00:00 0:00:44 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16253
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-0of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:12:31+00:00 2022-11-27 20:14:00+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16246
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-1of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:10:18+00:00 2022-11-27 20:11:49+00:00 0:01:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16238
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-1of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:08:11+00:00 2022-11-27 20:09:55+00:00 0:01:44 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16234
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-1of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:05:48+00:00 2022-11-27 20:07:49+00:00 0:02:01 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16228
1550
Bea Baselines 🐤template-tensorflow aido-LF-sim-testing
sim-3of4 failed yes davinci-stage-04-6.2.51
2022-11-27 20:04:15+00:00 2022-11-27 20:05:15+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16217
397
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-testing
sim-3of4 success yes davinci-stage-04-6.2.51
2022-11-27 19:55:21+00:00 2022-11-27 20:04:07+00:00 0:08:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -3.2480955863996375 survival_time_median 59.99999999999873 deviation-center-line_median 2.589145887976697 in-drivable-lane_median 32.2999999999992
other stats deviation-center-line_max 2.589145887976697 deviation-center-line_mean 2.589145887976697 deviation-center-line_min 2.589145887976697 deviation-heading_max 24.553982361842948 deviation-heading_mean 24.553982361842948 deviation-heading_median 24.553982361842948 deviation-heading_min 24.553982361842948 distance-from-start_max 0.16126163061008195 distance-from-start_mean 0.16126163061008195 distance-from-start_median 0.16126163061008195 distance-from-start_min 0.16126163061008195 driven_any_max 12.002247888898491 driven_any_mean 12.002247888898491 driven_any_median 12.002247888898491 driven_any_min 12.002247888898491 driven_lanedir_consec_max -3.2480955863996375 driven_lanedir_consec_mean -3.2480955863996375 driven_lanedir_consec_min -3.2480955863996375 driven_lanedir_max -3.2480955863996375 driven_lanedir_mean -3.2480955863996375 driven_lanedir_median -3.2480955863996375 driven_lanedir_min -3.2480955863996375 in-drivable-lane_max 32.2999999999992 in-drivable-lane_mean 32.2999999999992 in-drivable-lane_min 32.2999999999992 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.002247888898491, "survival_time": 59.99999999999873, "driven_lanedir": -3.2480955863996375, "in-drivable-lane": 32.2999999999992, "deviation-heading": 24.553982361842948, "distance-from-start": 0.16126163061008195, "deviation-center-line": 2.589145887976697, "driven_lanedir_consec": -3.2480955863996375}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16213
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-2of4 failed yes davinci-stage-04-6.2.51
2022-11-27 19:54:14+00:00 2022-11-27 19:55:13+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16209
1532
Bea Baselines 🐤template-tensorflow aido-LF-sim-validation
sim-0of4 timeout yes davinci-stage-04-6.2.51
2022-11-27 19:52:10+00:00 2022-11-27 19:53:46+00:00 0:01:36 Timeout because eval [...] Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16206
1600
Andrea Daniele lx22-modcon lx22-modcon
sim success yes davinci-stage-04-6.2.51
2022-11-27 16:15:29+00:00 2022-11-27 16:25:21+00:00 0:09:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 2.3 deviation-center-line_median 1.838403160954605 driven_lanedir_consec_median 5.8051412472252055 survival_time_median 44.474999999999504
other stats deviation-center-line_max 2.060305946057066 deviation-center-line_mean 1.838403160954605 deviation-center-line_min 1.616500375852144 deviation-heading_max 1.8138826601983544 deviation-heading_mean 1.5100884058812278 deviation-heading_median 1.5100884058812278 deviation-heading_min 1.206294151564101 distance-from-start_max 8.274760282260477 distance-from-start_mean 6.034238552107428 distance-from-start_median 6.034238552107428 distance-from-start_min 3.793716821954381 driven_any_max 8.338214336778261 driven_any_mean 6.1159830758563745 driven_any_median 6.1159830758563745 driven_any_min 3.893751814934488 driven_lanedir_consec_max 8.07209949250169 driven_lanedir_consec_mean 5.8051412472252055 driven_lanedir_consec_min 3.53818300194872 driven_lanedir_max 8.07209949250169 driven_lanedir_mean 5.8051412472252055 driven_lanedir_median 5.8051412472252055 driven_lanedir_min 3.53818300194872 in-drivable-lane_max 2.5999999999999988 in-drivable-lane_mean 2.3 in-drivable-lane_min 2.000000000000001 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 8.338214336778261, "survival_time": 59.99999999999873, "driven_lanedir": 8.07209949250169, "in-drivable-lane": 2.000000000000001, "deviation-heading": 1.206294151564101, "distance-from-start": 8.274760282260477, "deviation-center-line": 1.616500375852144, "driven_lanedir_consec": 8.07209949250169}, "LF-full-loop-001-ego0": {"driven_any": 3.893751814934488, "survival_time": 28.950000000000276, "driven_lanedir": 3.53818300194872, "in-drivable-lane": 2.5999999999999988, "deviation-heading": 1.8138826601983544, "distance-from-start": 3.793716821954381, "deviation-center-line": 2.060305946057066, "driven_lanedir_consec": 3.53818300194872}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 44.474999999999504 survival_time_min 28.950000000000276
No reset possible 16205
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-04-6.2.51
2022-11-27 07:07:10+00:00 2022-11-27 07:08:56+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.4128048065357282
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.4128048065357282 distance-from-start_median 1.4128048065357282 distance-from-start_min 1.4128048065357282 driven_any_max 1.6235365894136486 driven_any_mean 1.6235365894136486 driven_any_median 1.6235365894136486 driven_any_min 1.6235365894136486 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 5.549999999999988 in-drivable-lane_mean 5.549999999999988 in-drivable-lane_median 5.549999999999988 in-drivable-lane_min 5.549999999999988 per-episodes details {"d60-ego0": {"driven_any": 1.6235365894136486, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "distance-from-start": 1.4128048065357282, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 5.549999999999988 survival_time_median 5.549999999999988 survival_time_min 5.549999999999988
No reset possible 16201
1599
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-04-6.2.51
2022-11-27 07:04:55+00:00 2022-11-27 07:06:47+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.874680474434121
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.874680474434121 distance-from-start_median 0.874680474434121 distance-from-start_min 0.874680474434121 driven_any_max 0.9755424830705652 driven_any_mean 0.9755424830705652 driven_any_median 0.9755424830705652 driven_any_min 0.9755424830705652 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 3.7499999999999942 in-drivable-lane_mean 3.7499999999999942 in-drivable-lane_median 3.7499999999999942 in-drivable-lane_min 3.7499999999999942 per-episodes details {"d40-ego0": {"driven_any": 0.9755424830705652, "survival_time": 3.7499999999999942, "driven_lanedir": 0.0, "in-drivable-lane": 3.7499999999999942, "deviation-heading": 0.0, "distance-from-start": 0.874680474434121, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_median 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 16197
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-4of5 success no davinci-stage-04-6.2.51
2022-11-27 03:48:09+00:00 2022-11-27 03:57:24+00:00 0:09:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16186
1592
Andrea Daniele planning-exercise lx22-planning-dd-static-test
step1-1of4 success yes davinci-stage-04-6.2.51
2022-11-27 00:44:48+00:00 2022-11-27 00:49:01+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.0
other stats No reset possible 16163
1590
Andrea Daniele planning-exercise lx22-planning-cc-empty-vali
step1 success yes davinci-stage-04-6.2.51
2022-11-27 00:27:38+00:00 2022-11-27 00:44:34+00:00 0:16:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16157
1584
Andrea Censi exercises_braitenberg lx22-BV1
sim-0of5 success no davinci-stage-04-6.2.51
2022-11-26 23:25:59+00:00 2022-11-26 23:34:50+00:00 0:08:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16141
1581
Andrea Censi planning-exercise lx22-planning-cc-empty-test
step1 success yes davinci-stage-04-6.2.51
2022-11-26 22:34:56+00:00 2022-11-26 22:51:53+00:00 0:16:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16140
1570
Andrea Censi planning-exercise lx22-planning-dd-dynamic-vali
step1-3of4 success yes davinci-stage-04-6.2.51
2022-11-26 22:33:57+00:00 2022-11-26 22:34:50+00:00 0:00:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 0.0 success_ratio 0.0 duration 1000.0 complexity 1000.0 avg_min_distance 0.0
other stats No reset possible 16120
1575
Andrea Censi planning-exercise lx22-planning-cc-empty-vali
step1 success yes davinci-stage-04-6.2.51
2022-11-26 22:14:51+00:00 2022-11-26 22:33:44+00:00 0:18:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes 1.0 success_ratio 1.0 duration 22.0 complexity 8.0 avg_min_distance 0.2626749063171028
other stats No reset possible 16112
1559
Andrea Censi planning-exercise lx22-planning-dd-static-vali
step1-0of4 failed yes davinci-stage-04-6.2.51
2022-11-26 20:59:44+00:00 2022-11-26 21:00:24+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16106
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-1of4 failed yes davinci-stage-04-6.2.51
2022-11-26 20:58:31+00:00 2022-11-26 20:59:11+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16103
1561
Andrea Censi planning-exercise lx22-planning-cc-dynamic-vali
step1-1of4 failed yes davinci-stage-04-6.2.51
2022-11-26 20:57:46+00:00 2022-11-26 20:58:23+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16094
1562
Andrea Censi planning-exercise lx22-planning-cc-static-vali
step1-1of4 failed yes davinci-stage-04-6.2.51
2022-11-26 20:54:06+00:00 2022-11-26 20:57:20+00:00 0:03:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 64, in run_checker
agent_ci._get_node_protocol()
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 101, in _get_node_protocol
msgs = read_reply(
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "checker" aborted with the following error:
error in checker |list[1]
|#0 tuple[2]
| #0 Cannot import the node class
| #1 dict[2]
| │ node_symbol : planner.Planner
| │ tb :
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ | return __import__(name, fromlist=["dummy"])
| │ |ModuleNotFoundError: No module named 'planner'
| │ |
| │ |During handling of the above exception, another exception occurred:
| │ |
| │ |Traceback (most recent call last):
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/launcher.py", line 93, in launcher_main
| │ | node_type = import_name(config.node)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 46, in import_name
| │ | module = import_name(module_name)
| │ | File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 76, in import_name
| │ | raise ValueError(msg)
| │ |ValueError: Cannot import name 'planner'.> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |> During handling of the above exception, another exception occurred:
| │ |>
| │ |> Traceback (most recent call last):
| │ |> File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_import.py", line 17, in import_name
| │ |> return __import__(name, fromlist=["dummy"])
| │ |> ModuleNotFoundError: No module named 'planner'
| │ |>
| │ |
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/dt_planning/planning_checker.py", line 102, in planning_checker_main
sessions = run_checker(
File "/usr/local/lib/python3.8/dist-packages/dt_protocols/checker.py", line 115, in run_checker
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16090
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success no davinci-stage-04-6.2.51
2022-11-26 19:41:57+00:00 2022-11-26 19:50:59+00:00 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16088
1556
Frank (Chude) Qian exercises_braitenberg lx22-BV1
sim-3of5 success no davinci-stage-04-6.2.51
2022-11-26 19:18:12+00:00 2022-11-26 19:27:56+00:00 0:09:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16079
385
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-validation
sim-3of4 host-error no davinci-stage-04-6.2.51
2022-11-25 17:08:18+00:00 2022-11-25 17:12:43+00:00 0:04:25 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-04-6.2.51-job16079-30767, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-04-6.2.51-job16079-30767', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16074
386
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 16:24:14+00:00 2022-11-25 16:33:31+00:00 0:09:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.29999999999934 driven_lanedir_consec_median -3.5382007511568494 deviation-center-line_median 2.155534895328876
other stats deviation-center-line_max 2.155534895328876 deviation-center-line_mean 2.155534895328876 deviation-center-line_min 2.155534895328876 deviation-heading_max 28.109177971221634 deviation-heading_mean 28.109177971221634 deviation-heading_median 28.109177971221634 deviation-heading_min 28.109177971221634 distance-from-start_max 0.16699493954499697 distance-from-start_mean 0.16699493954499697 distance-from-start_median 0.16699493954499697 distance-from-start_min 0.16699493954499697 driven_any_max 11.770966723064996 driven_any_mean 11.770966723064996 driven_any_median 11.770966723064996 driven_any_min 11.770966723064996 driven_lanedir_consec_max -3.5382007511568494 driven_lanedir_consec_mean -3.5382007511568494 driven_lanedir_consec_min -3.5382007511568494 driven_lanedir_max -3.8860437315980407 driven_lanedir_mean -3.8860437315980407 driven_lanedir_median -3.8860437315980407 driven_lanedir_min -3.8860437315980407 in-drivable-lane_max 26.29999999999934 in-drivable-lane_mean 26.29999999999934 in-drivable-lane_min 26.29999999999934 per-episodes details {"autolab-000-ego0": {"driven_any": 11.770966723064996, "survival_time": 59.99999999999873, "driven_lanedir": -3.8860437315980407, "in-drivable-lane": 26.29999999999934, "deviation-heading": 28.109177971221634, "distance-from-start": 0.16699493954499697, "deviation-center-line": 2.155534895328876, "driven_lanedir_consec": -3.5382007511568494}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16068
387
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 16:05:08+00:00 2022-11-25 16:23:58+00:00 0:18:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.899999999999384 driven_lanedir_consec_median -3.813561694412012 deviation-center-line_median 2.5259055294374924
other stats deviation-center-line_max 2.5259055294374924 deviation-center-line_mean 2.5259055294374924 deviation-center-line_min 2.5259055294374924 deviation-heading_max 27.692125463694325 deviation-heading_mean 27.692125463694325 deviation-heading_median 27.692125463694325 deviation-heading_min 27.692125463694325 distance-from-start_max 0.16954551527564377 distance-from-start_mean 0.16954551527564377 distance-from-start_median 0.16954551527564377 distance-from-start_min 0.16954551527564377 driven_any_max 12.78563073005655 driven_any_mean 12.78563073005655 driven_any_median 12.78563073005655 driven_any_min 12.78563073005655 driven_lanedir_consec_max -3.813561694412012 driven_lanedir_consec_mean -3.813561694412012 driven_lanedir_consec_min -3.813561694412012 driven_lanedir_max -4.019571243187794 driven_lanedir_mean -4.019571243187794 driven_lanedir_median -4.019571243187794 driven_lanedir_min -4.019571243187794 in-drivable-lane_max 26.899999999999384 in-drivable-lane_mean 26.899999999999384 in-drivable-lane_min 26.899999999999384 per-episodes details {"autolab-000-ego0": {"driven_any": 12.78563073005655, "survival_time": 59.99999999999873, "driven_lanedir": -4.019571243187794, "in-drivable-lane": 26.899999999999384, "deviation-heading": 27.692125463694325, "distance-from-start": 0.16954551527564377, "deviation-center-line": 2.5259055294374924, "driven_lanedir_consec": -3.813561694412012}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16061
389
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFI-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 15:55:03+00:00 2022-11-25 16:04:53+00:00 0:09:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 24.749999999999403 driven_lanedir_consec_median -3.533513270570616 deviation-center-line_median 2.4505069108760154
other stats deviation-center-line_max 2.4505069108760154 deviation-center-line_mean 2.4505069108760154 deviation-center-line_min 2.4505069108760154 deviation-heading_max 28.678454441635605 deviation-heading_mean 28.678454441635605 deviation-heading_median 28.678454441635605 deviation-heading_min 28.678454441635605 distance-from-start_max 0.2714976624613749 distance-from-start_mean 0.2714976624613749 distance-from-start_median 0.2714976624613749 distance-from-start_min 0.2714976624613749 driven_any_max 12.49280460939561 driven_any_mean 12.49280460939561 driven_any_median 12.49280460939561 driven_any_min 12.49280460939561 driven_lanedir_consec_max -3.533513270570616 driven_lanedir_consec_mean -3.533513270570616 driven_lanedir_consec_min -3.533513270570616 driven_lanedir_max -3.9388829893592865 driven_lanedir_mean -3.9388829893592865 driven_lanedir_median -3.9388829893592865 driven_lanedir_min -3.9388829893592865 in-drivable-lane_max 24.749999999999403 in-drivable-lane_mean 24.749999999999403 in-drivable-lane_min 24.749999999999403 per-episodes details {"4way-000-ego0": {"driven_any": 12.49280460939561, "survival_time": 59.99999999999873, "driven_lanedir": -3.9388829893592865, "in-drivable-lane": 24.749999999999403, "deviation-heading": 28.678454441635605, "distance-from-start": 0.2714976624613749, "deviation-center-line": 2.4505069108760154, "driven_lanedir_consec": -3.533513270570616}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16057
390
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 15:45:16+00:00 2022-11-25 15:54:28+00:00 0:09:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -4.004889580442478 survival_time_median 59.99999999999873 deviation-center-line_median 2.022729808935561 in-drivable-lane_median 26.69999999999947
other stats deviation-center-line_max 2.022729808935561 deviation-center-line_mean 2.022729808935561 deviation-center-line_min 2.022729808935561 deviation-heading_max 28.80814199361772 deviation-heading_mean 28.80814199361772 deviation-heading_median 28.80814199361772 deviation-heading_min 28.80814199361772 distance-from-start_max 0.2200731373728858 distance-from-start_mean 0.2200731373728858 distance-from-start_median 0.2200731373728858 distance-from-start_min 0.2200731373728858 driven_any_max 12.999355216889962 driven_any_mean 12.999355216889962 driven_any_median 12.999355216889962 driven_any_min 12.999355216889962 driven_lanedir_consec_max -4.004889580442478 driven_lanedir_consec_mean -4.004889580442478 driven_lanedir_consec_min -4.004889580442478 driven_lanedir_max -4.322026598602476 driven_lanedir_mean -4.322026598602476 driven_lanedir_median -4.322026598602476 driven_lanedir_min -4.322026598602476 in-drivable-lane_max 26.69999999999947 in-drivable-lane_mean 26.69999999999947 in-drivable-lane_min 26.69999999999947 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.999355216889962, "survival_time": 59.99999999999873, "driven_lanedir": -4.322026598602476, "in-drivable-lane": 26.69999999999947, "deviation-heading": 28.80814199361772, "distance-from-start": 0.2200731373728858, "deviation-center-line": 2.022729808935561, "driven_lanedir_consec": -4.004889580442478}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16055
390
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 15:37:48+00:00 2022-11-25 15:44:43+00:00 0:06:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.9877060037993703 survival_time_median 59.99999999999873 deviation-center-line_median 2.766794410562123 in-drivable-lane_median 22.29999999999947
other stats deviation-center-line_max 2.766794410562123 deviation-center-line_mean 2.766794410562123 deviation-center-line_min 2.766794410562123 deviation-heading_max 28.38818315002097 deviation-heading_mean 28.38818315002097 deviation-heading_median 28.38818315002097 deviation-heading_min 28.38818315002097 distance-from-start_max 0.22426651685453056 distance-from-start_mean 0.22426651685453056 distance-from-start_median 0.22426651685453056 distance-from-start_min 0.22426651685453056 driven_any_max 11.235466745096788 driven_any_mean 11.235466745096788 driven_any_median 11.235466745096788 driven_any_min 11.235466745096788 driven_lanedir_consec_max -2.9877060037993703 driven_lanedir_consec_mean -2.9877060037993703 driven_lanedir_consec_min -2.9877060037993703 driven_lanedir_max -3.4130081922122497 driven_lanedir_mean -3.4130081922122497 driven_lanedir_median -3.4130081922122497 driven_lanedir_min -3.4130081922122497 in-drivable-lane_max 22.29999999999947 in-drivable-lane_mean 22.29999999999947 in-drivable-lane_min 22.29999999999947 per-episodes details {"loop2-000-ego0": {"driven_any": 11.235466745096788, "survival_time": 59.99999999999873, "driven_lanedir": -3.4130081922122497, "in-drivable-lane": 22.29999999999947, "deviation-heading": 28.38818315002097, "distance-from-start": 0.22426651685453056, "deviation-center-line": 2.766794410562123, "driven_lanedir_consec": -2.9877060037993703}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16054
390
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 15:30:46+00:00 2022-11-25 15:37:33+00:00 0:06:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.7071766570970626 survival_time_median 59.99999999999873 deviation-center-line_median 2.6481625513847233 in-drivable-lane_median 22.649999999999476
other stats deviation-center-line_max 2.6481625513847233 deviation-center-line_mean 2.6481625513847233 deviation-center-line_min 2.6481625513847233 deviation-heading_max 30.502624840896836 deviation-heading_mean 30.502624840896836 deviation-heading_median 30.502624840896836 deviation-heading_min 30.502624840896836 distance-from-start_max 0.1847722320018317 distance-from-start_mean 0.1847722320018317 distance-from-start_median 0.1847722320018317 distance-from-start_min 0.1847722320018317 driven_any_max 10.550205936760433 driven_any_mean 10.550205936760433 driven_any_median 10.550205936760433 driven_any_min 10.550205936760433 driven_lanedir_consec_max -2.7071766570970626 driven_lanedir_consec_mean -2.7071766570970626 driven_lanedir_consec_min -2.7071766570970626 driven_lanedir_max -2.7071766570970626 driven_lanedir_mean -2.7071766570970626 driven_lanedir_median -2.7071766570970626 driven_lanedir_min -2.7071766570970626 in-drivable-lane_max 22.649999999999476 in-drivable-lane_mean 22.649999999999476 in-drivable-lane_min 22.649999999999476 per-episodes details {"loop-000-ego0": {"driven_any": 10.550205936760433, "survival_time": 59.99999999999873, "driven_lanedir": -2.7071766570970626, "in-drivable-lane": 22.649999999999476, "deviation-heading": 30.502624840896836, "distance-from-start": 0.1847722320018317, "deviation-center-line": 2.6481625513847233, "driven_lanedir_consec": -2.7071766570970626}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16053
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-1of4 host-error no davinci-stage-04-6.2.51
2022-11-25 15:29:06+00:00 2022-11-25 15:30:31+00:00 0:01:25 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:
error in ego3 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:
error in ego3 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16052
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 15:27:43+00:00 2022-11-25 15:28:58+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16051
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 15:26:06+00:00 2022-11-25 15:27:20+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16047
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 15:12:13+00:00 2022-11-25 15:25:46+00:00 0:13:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.67499999999905 driven_lanedir_consec_median -2.3437703768645712 deviation-center-line_median 2.245086618341837
other stats deviation-center-line_max 2.54185955311821 deviation-center-line_mean 2.245086618341837 deviation-center-line_min 1.9483136835654635 deviation-heading_max 22.96893577405584 deviation-heading_mean 21.59921939887888 deviation-heading_median 21.59921939887888 deviation-heading_min 20.229503023701923 distance-from-start_max 0.1513155133735528 distance-from-start_mean 0.14981604892829598 distance-from-start_median 0.14981604892829598 distance-from-start_min 0.14831658448303917 driven_any_max 11.334956981115536 driven_any_mean 11.08718357283836 driven_any_median 11.08718357283836 driven_any_min 10.839410164561183 driven_lanedir_consec_max -1.7707950714591445 driven_lanedir_consec_mean -2.3437703768645712 driven_lanedir_consec_min -2.916745682269998 driven_lanedir_max -1.7707950714591445 driven_lanedir_mean -2.3437703768645712 driven_lanedir_median -2.3437703768645712 driven_lanedir_min -2.916745682269998 in-drivable-lane_max 39.19999999999889 in-drivable-lane_mean 36.67499999999905 in-drivable-lane_min 34.14999999999922 per-episodes details {"loop2-000-ego0": {"driven_any": 11.334956981115536, "survival_time": 59.99999999999873, "driven_lanedir": -2.916745682269998, "in-drivable-lane": 34.14999999999922, "deviation-heading": 22.96893577405584, "distance-from-start": 0.1513155133735528, "deviation-center-line": 2.54185955311821, "driven_lanedir_consec": -2.916745682269998}, "loop2-000-ego1": {"driven_any": 10.839410164561183, "survival_time": 59.99999999999873, "driven_lanedir": -1.7707950714591445, "in-drivable-lane": 39.19999999999889, "deviation-heading": 20.229503023701923, "distance-from-start": 0.14831658448303917, "deviation-center-line": 1.9483136835654635, "driven_lanedir_consec": -1.7707950714591445}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16044
393
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 15:02:47+00:00 2022-11-25 15:11:52+00:00 0:09:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.949999999998994 driven_lanedir_consec_median -2.223836286705292 deviation-center-line_median 2.314096232029231
other stats deviation-center-line_max 2.314096232029231 deviation-center-line_mean 2.314096232029231 deviation-center-line_min 2.314096232029231 deviation-heading_max 21.30526083074812 deviation-heading_mean 21.30526083074812 deviation-heading_median 21.30526083074812 deviation-heading_min 21.30526083074812 distance-from-start_max 0.14859232677453646 distance-from-start_mean 0.14859232677453646 distance-from-start_median 0.14859232677453646 distance-from-start_min 0.14859232677453646 driven_any_max 10.766044515319376 driven_any_mean 10.766044515319376 driven_any_median 10.766044515319376 driven_any_min 10.766044515319376 driven_lanedir_consec_max -2.223836286705292 driven_lanedir_consec_mean -2.223836286705292 driven_lanedir_consec_min -2.223836286705292 driven_lanedir_max -2.223836286705292 driven_lanedir_mean -2.223836286705292 driven_lanedir_median -2.223836286705292 driven_lanedir_min -2.223836286705292 in-drivable-lane_max 36.949999999998994 in-drivable-lane_mean 36.949999999998994 in-drivable-lane_min 36.949999999998994 per-episodes details {"autolab-000-ego0": {"driven_any": 10.766044515319376, "survival_time": 59.99999999999873, "driven_lanedir": -2.223836286705292, "in-drivable-lane": 36.949999999998994, "deviation-heading": 21.30526083074812, "distance-from-start": 0.14859232677453646, "deviation-center-line": 2.314096232029231, "driven_lanedir_consec": -2.223836286705292}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16026
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 14:34:06+00:00 2022-11-25 15:02:40+00:00 0:28:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 18.57499999999969 driven_lanedir_consec_median -1.846010658314547 deviation-center-line_median 3.980032371532205
other stats deviation-center-line_max 6.98929575680385 deviation-center-line_mean 4.314705914457902 deviation-center-line_min 2.30946315796335 deviation-heading_max 25.808163393699424 deviation-heading_mean 19.864809961825628 deviation-heading_median 22.29330309384092 deviation-heading_min 9.06447026592125 distance-from-start_max 0.1843889262411763 distance-from-start_mean 0.1673067540243908 distance-from-start_median 0.16455785894457442 distance-from-start_min 0.155722371967238 driven_any_max 12.659056632044766 driven_any_mean 7.925184224753106 driven_any_median 8.457849072487003 driven_any_min 2.125982121993652 driven_lanedir_consec_max -0.6086913386374655 driven_lanedir_consec_mean -2.0097432301360243 driven_lanedir_consec_min -3.738260265277538 driven_lanedir_max -0.6086913386374655 driven_lanedir_mean -2.0816357086011905 driven_lanedir_median -1.989795615244879 driven_lanedir_min -3.738260265277538 in-drivable-lane_max 32.1999999999991 in-drivable-lane_mean 18.712499999999626 in-drivable-lane_min 5.50000000000001 per-episodes details {"udem-000-ego0": {"driven_any": 11.72236347122637, "survival_time": 59.99999999999873, "driven_lanedir": -2.276121646445824, "in-drivable-lane": 32.1999999999991, "deviation-heading": 25.29363575331457, "distance-from-start": 0.155722371967238, "deviation-center-line": 2.8205794439178775, "driven_lanedir_consec": -2.276121646445824}, "udem-000-ego1": {"driven_any": 2.125982121993652, "survival_time": 59.99999999999873, "driven_lanedir": -0.6086913386374655, "in-drivable-lane": 5.50000000000001, "deviation-heading": 9.06447026592125, "distance-from-start": 0.1629232008828155, "deviation-center-line": 6.98929575680385, "driven_lanedir_consec": -0.6086913386374655}, "udem-000-ego2": {"driven_any": 5.193334673747636, "survival_time": 59.99999999999873, "driven_lanedir": -1.7034695840439342, "in-drivable-lane": 8.55000000000007, "deviation-heading": 19.292970434367273, "distance-from-start": 0.16619251700633336, "deviation-center-line": 5.139485299146532, "driven_lanedir_consec": -1.4158996701832702}, "udem-000-ego3": {"driven_any": 12.659056632044766, "survival_time": 59.99999999999873, "driven_lanedir": -3.738260265277538, "in-drivable-lane": 28.59999999999931, "deviation-heading": 25.808163393699424, "distance-from-start": 0.1843889262411763, "deviation-center-line": 2.30946315796335, "driven_lanedir_consec": -3.738260265277538}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16021
515
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-validation
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:32:49+00:00 2022-11-25 14:33:43+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16016
516
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-validation
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:30:53+00:00 2022-11-25 14:32:29+00:00 0:01:36 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16011
517
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 14:29:19+00:00 2022-11-25 14:30:47+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16006
518
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 14:27:40+00:00 2022-11-25 14:29:11+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16000
520
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 14:26:04+00:00 2022-11-25 14:27:18+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15996
521
Bea Baselines 🐤baseline-behavior-cloning aido-LFV_multi-sim-testing
sim-0of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:24:19+00:00 2022-11-25 14:25:31+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15992
522
Bea Baselines 🐤baseline-behavior-cloning aido-LFP-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:23:00+00:00 2022-11-25 14:23:57+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15988
523
Bea Baselines 🐤baseline-behavior-cloning aido-LFV-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:21:19+00:00 2022-11-25 14:22:47+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15985
524
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 14:19:43+00:00 2022-11-25 14:21:12+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15982
524
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI-sim-testing
sim-0of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:17:35+00:00 2022-11-25 14:19:09+00:00 0:01:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15979
525
Bea Baselines 🐤baseline-behavior-cloning aido-LFI-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 14:15:30+00:00 2022-11-25 14:17:23+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15977
527
Bea Baselines 🐤baseline-behavior-cloning aido-LFVI_multi-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 14:14:10+00:00 2022-11-25 14:15:22+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15964
530
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 13:57:53+00:00 2022-11-25 14:13:43+00:00 0:15:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5500000000000078 driven_lanedir_consec_median 8.929048316088497 deviation-center-line_median 2.7796329733903673
other stats deviation-center-line_max 2.7796329733903673 deviation-center-line_mean 2.7796329733903673 deviation-center-line_min 2.7796329733903673 deviation-heading_max 14.007235626813827 deviation-heading_mean 14.007235626813827 deviation-heading_median 14.007235626813827 deviation-heading_min 14.007235626813827 distance-from-start_max 4.500191330320018 distance-from-start_mean 4.500191330320018 distance-from-start_median 4.500191330320018 distance-from-start_min 4.500191330320018 driven_any_max 9.517197729862044 driven_any_mean 9.517197729862044 driven_any_median 9.517197729862044 driven_any_min 9.517197729862044 driven_lanedir_consec_max 8.929048316088497 driven_lanedir_consec_mean 8.929048316088497 driven_lanedir_consec_min 8.929048316088497 driven_lanedir_max 8.929048316088497 driven_lanedir_mean 8.929048316088497 driven_lanedir_median 8.929048316088497 driven_lanedir_min 8.929048316088497 in-drivable-lane_max 0.5500000000000078 in-drivable-lane_mean 0.5500000000000078 in-drivable-lane_min 0.5500000000000078 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.517197729862044, "survival_time": 59.99999999999873, "driven_lanedir": 8.929048316088497, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 14.007235626813827, "distance-from-start": 4.500191330320018, "deviation-center-line": 2.7796329733903673, "driven_lanedir_consec": 8.929048316088497}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15956
532
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 13:50:03+00:00 2022-11-25 13:57:25+00:00 0:07:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 8.78963752297264 deviation-center-line_median 2.3963798821505833
other stats deviation-center-line_max 2.3963798821505833 deviation-center-line_mean 2.3963798821505833 deviation-center-line_min 2.3963798821505833 deviation-heading_max 11.52395206526296 deviation-heading_mean 11.52395206526296 deviation-heading_median 11.52395206526296 deviation-heading_min 11.52395206526296 distance-from-start_max 3.4416673581184667 distance-from-start_mean 3.4416673581184667 distance-from-start_median 3.4416673581184667 distance-from-start_min 3.4416673581184667 driven_any_max 9.979959837369176 driven_any_mean 9.979959837369176 driven_any_median 9.979959837369176 driven_any_min 9.979959837369176 driven_lanedir_consec_max 8.78963752297264 driven_lanedir_consec_mean 8.78963752297264 driven_lanedir_consec_min 8.78963752297264 driven_lanedir_max 9.640632820885903 driven_lanedir_mean 9.640632820885903 driven_lanedir_median 9.640632820885903 driven_lanedir_min 9.640632820885903 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 9.979959837369176, "survival_time": 59.99999999999873, "driven_lanedir": 9.640632820885903, "in-drivable-lane": 0.0, "deviation-heading": 11.52395206526296, "distance-from-start": 3.4416673581184667, "deviation-center-line": 2.3963798821505833, "driven_lanedir_consec": 8.78963752297264}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15954
532
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 13:48:28+00:00 2022-11-25 13:49:56+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15952
533
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 13:42:18+00:00 2022-11-25 13:48:15+00:00 0:05:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 9.710555738960784 survival_time_median 59.99999999999873 deviation-center-line_median 4.0921095459761485 in-drivable-lane_median 4.799999999999964
other stats deviation-center-line_max 4.0921095459761485 deviation-center-line_mean 4.0921095459761485 deviation-center-line_min 4.0921095459761485 deviation-heading_max 19.79429971045774 deviation-heading_mean 19.79429971045774 deviation-heading_median 19.79429971045774 deviation-heading_min 19.79429971045774 distance-from-start_max 1.6021697366101249 distance-from-start_mean 1.6021697366101249 distance-from-start_median 1.6021697366101249 distance-from-start_min 1.6021697366101249 driven_any_max 11.701847268688164 driven_any_mean 11.701847268688164 driven_any_median 11.701847268688164 driven_any_min 11.701847268688164 driven_lanedir_consec_max 9.710555738960784 driven_lanedir_consec_mean 9.710555738960784 driven_lanedir_consec_min 9.710555738960784 driven_lanedir_max 9.710555738960784 driven_lanedir_mean 9.710555738960784 driven_lanedir_median 9.710555738960784 driven_lanedir_min 9.710555738960784 in-drivable-lane_max 4.799999999999964 in-drivable-lane_mean 4.799999999999964 in-drivable-lane_min 4.799999999999964 per-episodes details {"loop2-000-ego0": {"driven_any": 11.701847268688164, "survival_time": 59.99999999999873, "driven_lanedir": 9.710555738960784, "in-drivable-lane": 4.799999999999964, "deviation-heading": 19.79429971045774, "distance-from-start": 1.6021697366101249, "deviation-center-line": 4.0921095459761485, "driven_lanedir_consec": 9.710555738960784}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15938
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 13:26:17+00:00 2022-11-25 13:41:54+00:00 0:15:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.70000000000001 driven_lanedir_consec_median 9.289090525581344 deviation-center-line_median 3.4869586555251275
other stats deviation-center-line_max 3.4869586555251275 deviation-center-line_mean 3.4869586555251275 deviation-center-line_min 3.4869586555251275 deviation-heading_max 14.297385270107092 deviation-heading_mean 14.297385270107092 deviation-heading_median 14.297385270107092 deviation-heading_min 14.297385270107092 distance-from-start_max 2.6556166181330827 distance-from-start_mean 2.6556166181330827 distance-from-start_median 2.6556166181330827 distance-from-start_min 2.6556166181330827 driven_any_max 9.87103566844523 driven_any_mean 9.87103566844523 driven_any_median 9.87103566844523 driven_any_min 9.87103566844523 driven_lanedir_consec_max 9.289090525581344 driven_lanedir_consec_mean 9.289090525581344 driven_lanedir_consec_min 9.289090525581344 driven_lanedir_max 9.289090525581344 driven_lanedir_mean 9.289090525581344 driven_lanedir_median 9.289090525581344 driven_lanedir_min 9.289090525581344 in-drivable-lane_max 0.70000000000001 in-drivable-lane_mean 0.70000000000001 in-drivable-lane_min 0.70000000000001 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.87103566844523, "survival_time": 59.99999999999873, "driven_lanedir": 9.289090525581344, "in-drivable-lane": 0.70000000000001, "deviation-heading": 14.297385270107092, "distance-from-start": 2.6556166181330827, "deviation-center-line": 3.4869586555251275, "driven_lanedir_consec": 9.289090525581344}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15931
538
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 13:16:53+00:00 2022-11-25 13:26:04+00:00 0:09:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 37.45000000000001 in-drivable-lane_median 3.049999999999826 driven_lanedir_consec_median 5.6931851014896715 deviation-center-line_median 2.0132525021202374
other stats deviation-center-line_max 2.0132525021202374 deviation-center-line_mean 2.0132525021202374 deviation-center-line_min 2.0132525021202374 deviation-heading_max 10.802312532113078 deviation-heading_mean 10.802312532113078 deviation-heading_median 10.802312532113078 deviation-heading_min 10.802312532113078 distance-from-start_max 1.0948509439279033 distance-from-start_mean 1.0948509439279033 distance-from-start_median 1.0948509439279033 distance-from-start_min 1.0948509439279033 driven_any_max 6.746540874430199 driven_any_mean 6.746540874430199 driven_any_median 6.746540874430199 driven_any_min 6.746540874430199 driven_lanedir_consec_max 5.6931851014896715 driven_lanedir_consec_mean 5.6931851014896715 driven_lanedir_consec_min 5.6931851014896715 driven_lanedir_max 5.713999449258763 driven_lanedir_mean 5.713999449258763 driven_lanedir_median 5.713999449258763 driven_lanedir_min 5.713999449258763 in-drivable-lane_max 3.049999999999826 in-drivable-lane_mean 3.049999999999826 in-drivable-lane_min 3.049999999999826 per-episodes details {"4way-000-ego0": {"driven_any": 6.746540874430199, "survival_time": 37.45000000000001, "driven_lanedir": 5.713999449258763, "in-drivable-lane": 3.049999999999826, "deviation-heading": 10.802312532113078, "distance-from-start": 1.0948509439279033, "deviation-center-line": 2.0132525021202374, "driven_lanedir_consec": 5.6931851014896715}}simulation-passed 1 survival_time_max 37.45000000000001 survival_time_mean 37.45000000000001 survival_time_min 37.45000000000001
No reset possible 15929
538
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 13:15:16+00:00 2022-11-25 13:16:46+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15925
541
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 13:08:02+00:00 2022-11-25 13:15:00+00:00 0:06:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.261250808767954 survival_time_median 59.99999999999873 deviation-center-line_median 2.3986084448572713 in-drivable-lane_median 5.399999999999693
other stats deviation-center-line_max 2.3986084448572713 deviation-center-line_mean 2.3986084448572713 deviation-center-line_min 2.3986084448572713 deviation-heading_max 12.192953082773586 deviation-heading_mean 12.192953082773586 deviation-heading_median 12.192953082773586 deviation-heading_min 12.192953082773586 distance-from-start_max 2.8616040637709887 distance-from-start_mean 2.8616040637709887 distance-from-start_median 2.8616040637709887 distance-from-start_min 2.8616040637709887 driven_any_max 9.657806896801176 driven_any_mean 9.657806896801176 driven_any_median 9.657806896801176 driven_any_min 9.657806896801176 driven_lanedir_consec_max 8.261250808767954 driven_lanedir_consec_mean 8.261250808767954 driven_lanedir_consec_min 8.261250808767954 driven_lanedir_max 8.261250808767954 driven_lanedir_mean 8.261250808767954 driven_lanedir_median 8.261250808767954 driven_lanedir_min 8.261250808767954 in-drivable-lane_max 5.399999999999693 in-drivable-lane_mean 5.399999999999693 in-drivable-lane_min 5.399999999999693 per-episodes details {"autolab-000-ego0": {"driven_any": 9.657806896801176, "survival_time": 59.99999999999873, "driven_lanedir": 8.261250808767954, "in-drivable-lane": 5.399999999999693, "deviation-heading": 12.192953082773586, "distance-from-start": 2.8616040637709887, "deviation-center-line": 2.3986084448572713, "driven_lanedir_consec": 8.261250808767954}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15924
541
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 13:04:53+00:00 2022-11-25 13:07:47+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2424219138112758 survival_time_median 16.6000000000001 deviation-center-line_median 0.5953213139665653 in-drivable-lane_median 7.650000000000103
other stats deviation-center-line_max 0.5953213139665653 deviation-center-line_mean 0.5953213139665653 deviation-center-line_min 0.5953213139665653 deviation-heading_max 3.859102214000461 deviation-heading_mean 3.859102214000461 deviation-heading_median 3.859102214000461 deviation-heading_min 3.859102214000461 distance-from-start_max 1.8705053486241523 distance-from-start_mean 1.8705053486241523 distance-from-start_median 1.8705053486241523 distance-from-start_min 1.8705053486241523 driven_any_max 2.7655113828585036 driven_any_mean 2.7655113828585036 driven_any_median 2.7655113828585036 driven_any_min 2.7655113828585036 driven_lanedir_consec_max 1.2424219138112758 driven_lanedir_consec_mean 1.2424219138112758 driven_lanedir_consec_min 1.2424219138112758 driven_lanedir_max 1.2424219138112758 driven_lanedir_mean 1.2424219138112758 driven_lanedir_median 1.2424219138112758 driven_lanedir_min 1.2424219138112758 in-drivable-lane_max 7.650000000000103 in-drivable-lane_mean 7.650000000000103 in-drivable-lane_min 7.650000000000103 per-episodes details {"loop2-000-ego0": {"driven_any": 2.7655113828585036, "survival_time": 16.6000000000001, "driven_lanedir": 1.2424219138112758, "in-drivable-lane": 7.650000000000103, "deviation-heading": 3.859102214000461, "distance-from-start": 1.8705053486241523, "deviation-center-line": 0.5953213139665653, "driven_lanedir_consec": 1.2424219138112758}}simulation-passed 1 survival_time_max 16.6000000000001 survival_time_mean 16.6000000000001 survival_time_min 16.6000000000001
No reset possible 15919
542
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 13:03:23+00:00 2022-11-25 13:04:42+00:00 0:01:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15915
764
Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194 aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 13:01:52+00:00 2022-11-25 13:03:01+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0130360795954223 deviation-center-line_median 0.006539152591967747
other stats deviation-center-line_max 0.006539152591967747 deviation-center-line_mean 0.006539152591967747 deviation-center-line_min 0.006539152591967747 deviation-heading_max 0.2668726751162729 deviation-heading_mean 0.2668726751162729 deviation-heading_median 0.2668726751162729 deviation-heading_min 0.2668726751162729 distance-from-start_max 0.01508483835506872 distance-from-start_mean 0.01508483835506872 distance-from-start_median 0.01508483835506872 distance-from-start_min 0.01508483835506872 driven_any_max 0.015084877256219438 driven_any_mean 0.015084877256219438 driven_any_median 0.015084877256219438 driven_any_min 0.015084877256219438 driven_lanedir_consec_max 0.0130360795954223 driven_lanedir_consec_mean 0.0130360795954223 driven_lanedir_consec_min 0.0130360795954223 driven_lanedir_max 0.0130360795954223 driven_lanedir_mean 0.0130360795954223 driven_lanedir_median 0.0130360795954223 driven_lanedir_min 0.0130360795954223 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.015084877256219438, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0130360795954223, "in-drivable-lane": 0.0, "deviation-heading": 0.2668726751162729, "distance-from-start": 0.01508483835506872, "deviation-center-line": 0.006539152591967747, "driven_lanedir_consec": 0.0130360795954223}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15909
795
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95 aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 13:00:22+00:00 2022-11-25 13:01:31+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.016432428091082807 deviation-center-line_median 0.005188766970509084
other stats deviation-center-line_max 0.005188766970509084 deviation-center-line_mean 0.005188766970509084 deviation-center-line_min 0.005188766970509084 deviation-heading_max 0.30429452108429295 deviation-heading_mean 0.30429452108429295 deviation-heading_median 0.30429452108429295 deviation-heading_min 0.30429452108429295 distance-from-start_max 0.021318990718837787 distance-from-start_mean 0.021318990718837787 distance-from-start_median 0.021318990718837787 distance-from-start_min 0.021318990718837787 driven_any_max 0.02143997831354508 driven_any_mean 0.02143997831354508 driven_any_median 0.02143997831354508 driven_any_min 0.02143997831354508 driven_lanedir_consec_max 0.016432428091082807 driven_lanedir_consec_mean 0.016432428091082807 driven_lanedir_consec_min 0.016432428091082807 driven_lanedir_max 0.016432428091082807 driven_lanedir_mean 0.016432428091082807 driven_lanedir_median 0.016432428091082807 driven_lanedir_min 0.016432428091082807 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.02143997831354508, "survival_time": 0.49999999999999994, "driven_lanedir": 0.016432428091082807, "in-drivable-lane": 0.0, "deviation-heading": 0.30429452108429295, "distance-from-start": 0.021318990718837787, "deviation-center-line": 0.005188766970509084, "driven_lanedir_consec": 0.016432428091082807}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15905
803
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984ea aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 12:58:52+00:00 2022-11-25 13:00:02+00:00 0:01:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.051142281746290985 deviation-center-line_median 0.006003447377005382
other stats deviation-center-line_max 0.006003447377005382 deviation-center-line_mean 0.006003447377005382 deviation-center-line_min 0.006003447377005382 deviation-heading_max 0.2524906803112451 deviation-heading_mean 0.2524906803112451 deviation-heading_median 0.2524906803112451 deviation-heading_min 0.2524906803112451 distance-from-start_max 0.05737765608663879 distance-from-start_mean 0.05737765608663879 distance-from-start_median 0.05737765608663879 distance-from-start_min 0.05737765608663879 driven_any_max 0.05740384545920925 driven_any_mean 0.05740384545920925 driven_any_median 0.05740384545920925 driven_any_min 0.05740384545920925 driven_lanedir_consec_max 0.051142281746290985 driven_lanedir_consec_mean 0.051142281746290985 driven_lanedir_consec_min 0.051142281746290985 driven_lanedir_max 0.051142281746290985 driven_lanedir_mean 0.051142281746290985 driven_lanedir_median 0.051142281746290985 driven_lanedir_min 0.051142281746290985 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.05740384545920925, "survival_time": 0.49999999999999994, "driven_lanedir": 0.051142281746290985, "in-drivable-lane": 0.0, "deviation-heading": 0.2524906803112451, "distance-from-start": 0.05737765608663879, "deviation-center-line": 0.006003447377005382, "driven_lanedir_consec": 0.051142281746290985}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15903
805
Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1 aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 12:56:52+00:00 2022-11-25 12:58:18+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.01335556380902947 deviation-center-line_median 0.006569755557796278
other stats deviation-center-line_max 0.006569755557796278 deviation-center-line_mean 0.006569755557796278 deviation-center-line_min 0.006569755557796278 deviation-heading_max 0.261068361442008 deviation-heading_mean 0.261068361442008 deviation-heading_median 0.261068361442008 deviation-heading_min 0.261068361442008 distance-from-start_max 0.01507707865478589 distance-from-start_mean 0.01507707865478589 distance-from-start_median 0.01507707865478589 distance-from-start_min 0.01507707865478589 driven_any_max 0.01508440329948094 driven_any_mean 0.01508440329948094 driven_any_median 0.01508440329948094 driven_any_min 0.01508440329948094 driven_lanedir_consec_max 0.01335556380902947 driven_lanedir_consec_mean 0.01335556380902947 driven_lanedir_consec_min 0.01335556380902947 driven_lanedir_max 0.01335556380902947 driven_lanedir_mean 0.01335556380902947 driven_lanedir_median 0.01335556380902947 driven_lanedir_min 0.01335556380902947 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.01508440329948094, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01335556380902947, "in-drivable-lane": 0.0, "deviation-heading": 0.261068361442008, "distance-from-start": 0.01507707865478589, "deviation-center-line": 0.006569755557796278, "driven_lanedir_consec": 0.01335556380902947}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15894
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 12:45:29+00:00 2022-11-25 12:56:25+00:00 0:10:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.304249926437537 deviation-center-line_median 0.1825026183725989
other stats deviation-center-line_max 0.34104251013325637 deviation-center-line_mean 0.20912268674780385 deviation-center-line_min 0.13044300011276103 deviation-heading_max 2.994295582077131 deviation-heading_mean 2.5147400523068573 deviation-heading_median 2.5090088664494945 deviation-heading_min 2.0466468942513076 distance-from-start_max 3.0928237060834363 distance-from-start_mean 2.645965341319192 distance-from-start_median 2.580815039187992 distance-from-start_min 2.329407580817348 driven_any_max 5.8241864351349815 driven_any_mean 4.627603360938423 driven_any_median 4.714304114852396 driven_any_min 3.25761877891392 driven_lanedir_consec_max 5.808142217564284 driven_lanedir_consec_mean 4.417823696659784 driven_lanedir_consec_min 3.254652716199778 driven_lanedir_max 5.808142217564284 driven_lanedir_mean 4.6194454357816355 driven_lanedir_median 4.70749340468124 driven_lanedir_min 3.254652716199778 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 3.25761877891392, "survival_time": 59.99999999999873, "driven_lanedir": 3.254652716199778, "in-drivable-lane": 0.0, "deviation-heading": 2.4432266696129785, "distance-from-start": 2.7016200695021144, "deviation-center-line": 0.1633304587519851, "driven_lanedir_consec": 3.254652716199778}, "udem-001-ego1": {"driven_any": 4.275772003750879, "survival_time": 59.99999999999873, "driven_lanedir": 4.270214821719897, "in-drivable-lane": 0.0, "deviation-heading": 2.994295582077131, "distance-from-start": 3.0928237060834363, "deviation-center-line": 0.13044300011276103, "driven_lanedir_consec": 3.867286559394435}, "udem-001-ego2": {"driven_any": 5.152836225953913, "survival_time": 59.99999999999873, "driven_lanedir": 5.144771987642583, "in-drivable-lane": 0.0, "deviation-heading": 2.0466468942513076, "distance-from-start": 2.329407580817348, "deviation-center-line": 0.20167477799321273, "driven_lanedir_consec": 4.741213293480639}, "udem-001-ego3": {"driven_any": 5.8241864351349815, "survival_time": 59.99999999999873, "driven_lanedir": 5.808142217564284, "in-drivable-lane": 0.0, "deviation-heading": 2.5747910632860105, "distance-from-start": 2.460010008873869, "deviation-center-line": 0.34104251013325637, "driven_lanedir_consec": 5.808142217564284}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15891
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 12:35:25+00:00 2022-11-25 12:45:21+00:00 0:09:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 57.84999999999885 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.884807237005287 deviation-center-line_median 0.15072920516156368
other stats deviation-center-line_max 0.15072920516156368 deviation-center-line_mean 0.15072920516156368 deviation-center-line_min 0.15072920516156368 deviation-heading_max 1.1475940808640654 deviation-heading_mean 1.1475940808640654 deviation-heading_median 1.1475940808640654 deviation-heading_min 1.1475940808640654 distance-from-start_max 2.6948612403356473 distance-from-start_mean 2.6948612403356473 distance-from-start_median 2.6948612403356473 distance-from-start_min 2.6948612403356473 driven_any_max 5.697171922964183 driven_any_mean 5.697171922964183 driven_any_median 5.697171922964183 driven_any_min 5.697171922964183 driven_lanedir_consec_max 4.884807237005287 driven_lanedir_consec_mean 4.884807237005287 driven_lanedir_consec_min 4.884807237005287 driven_lanedir_max 5.693381869716076 driven_lanedir_mean 5.693381869716076 driven_lanedir_median 5.693381869716076 driven_lanedir_min 5.693381869716076 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.697171922964183, "survival_time": 57.84999999999885, "driven_lanedir": 5.693381869716076, "in-drivable-lane": 0.0, "deviation-heading": 1.1475940808640654, "distance-from-start": 2.6948612403356473, "deviation-center-line": 0.15072920516156368, "driven_lanedir_consec": 4.884807237005287}}simulation-passed 1 survival_time_max 57.84999999999885 survival_time_mean 57.84999999999885 survival_time_min 57.84999999999885
No reset possible 15885
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
466 error yes davinci-stage-04-6.2.51
2022-11-25 12:33:36+00:00 2022-11-25 12:35:06+00:00 0:01:30 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7fadb86b6e50>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fadb86b6e50>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15880
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 12:28:04+00:00 2022-11-25 12:33:07+00:00 0:05:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948975282353535
other stats deviation-center-line_max 0.8948975282353535 deviation-center-line_mean 0.8948975282353535 deviation-center-line_min 0.8948975282353535 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.482534153247273e-16 distance-from-start_mean 2.482534153247273e-16 distance-from-start_median 2.482534153247273e-16 distance-from-start_min 2.482534153247273e-16 driven_any_max 2.9790409838966753e-13 driven_any_mean 2.9790409838966753e-13 driven_any_median 2.9790409838966753e-13 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15871
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 12:17:06+00:00 2022-11-25 12:27:54+00:00 0:10:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.527134503811414
other stats deviation-center-line_max 3.468395721180941 deviation-center-line_mean 1.6864438380333175 deviation-center-line_min 0.22311062332950052 deviation-heading_max 37.82293240559152 deviation-heading_mean 15.742347894422767 deviation-heading_median 11.480770321404124 deviation-heading_min 2.184918529291301 distance-from-start_max 3.177442392514494 distance-from-start_mean 0.7943605981286238 distance-from-start_median 7.447602459741819e-16 distance-from-start_min 0.0 driven_any_max 6.082579575597374 driven_any_mean 1.5206448938997903 driven_any_median 8.937122951690024e-13 driven_any_min 0.0 driven_lanedir_consec_max 6.065368636558107 driven_lanedir_consec_mean 1.5163421591395267 driven_lanedir_consec_min 0.0 driven_lanedir_max 6.065368636558107 driven_lanedir_mean 1.5163421591395267 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 6.082579575597374, "survival_time": 59.99999999999873, "driven_lanedir": 6.065368636558107, "in-drivable-lane": 0.0, "deviation-heading": 2.184918529291301, "distance-from-start": 3.177442392514494, "deviation-center-line": 0.2918095725321498, "driven_lanedir_consec": 6.065368636558107}, "udem-000-ego1": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15866
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 12:07:02+00:00 2022-11-25 12:16:58+00:00 0:09:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.40653839040804857
other stats deviation-center-line_max 0.40653839040804857 deviation-center-line_mean 0.40653839040804857 deviation-center-line_min 0.40653839040804857 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 1.1102230246251563e-16 distance-from-start_mean 1.1102230246251563e-16 distance-from-start_median 1.1102230246251563e-16 distance-from-start_min 1.1102230246251563e-16 driven_any_max 1.3322676295501878e-13 driven_any_mean 1.3322676295501878e-13 driven_any_median 1.3322676295501878e-13 driven_any_min 1.3322676295501878e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15861
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 11:57:25+00:00 2022-11-25 12:06:46+00:00 0:09:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.432891091920204 deviation-center-line_median 0.289208824985897
other stats deviation-center-line_max 0.3421554544578389 deviation-center-line_mean 0.28103246849939895 deviation-center-line_min 0.20355676956796287 deviation-heading_max 2.532090128626256 deviation-heading_mean 2.1233379748915846 deviation-heading_median 2.091598288393426 deviation-heading_min 1.77806519415323 distance-from-start_max 3.1537593976013736 distance-from-start_mean 2.7244723642293835 distance-from-start_median 2.704318718385367 distance-from-start_min 2.3354926225454276 driven_any_max 5.681727317187617 driven_any_mean 5.356790518866223 driven_any_median 5.444463301686621 driven_any_min 4.856508154904032 driven_lanedir_consec_max 5.66768880982045 driven_lanedir_consec_mean 5.346200743455493 driven_lanedir_consec_min 4.851331980161115 driven_lanedir_max 5.66768880982045 driven_lanedir_mean 5.346200743455493 driven_lanedir_median 5.432891091920204 driven_lanedir_min 4.851331980161115 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.292009447895602, "survival_time": 59.99999999999873, "driven_lanedir": 5.278658727024759, "in-drivable-lane": 0.0, "deviation-heading": 2.532090128626256, "distance-from-start": 2.693777297091483, "deviation-center-line": 0.295448770789397, "driven_lanedir_consec": 5.278658727024759}, "loop-000-ego1": {"driven_any": 5.596917155477642, "survival_time": 59.99999999999873, "driven_lanedir": 5.5871234568156485, "in-drivable-lane": 0.0, "deviation-heading": 2.16404711059614, "distance-from-start": 2.3354926225454276, "deviation-center-line": 0.3421554544578389, "driven_lanedir_consec": 5.5871234568156485}, "loop-000-ego2": {"driven_any": 4.856508154904032, "survival_time": 59.99999999999873, "driven_lanedir": 4.851331980161115, "in-drivable-lane": 0.0, "deviation-heading": 1.77806519415323, "distance-from-start": 3.1537593976013736, "deviation-center-line": 0.20355676956796287, "driven_lanedir_consec": 4.851331980161115}, "loop-000-ego3": {"driven_any": 5.681727317187617, "survival_time": 59.99999999999873, "driven_lanedir": 5.66768880982045, "in-drivable-lane": 0.0, "deviation-heading": 2.0191494661907115, "distance-from-start": 2.7148601396792507, "deviation-center-line": 0.282968879182397, "driven_lanedir_consec": 5.66768880982045}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15859
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 11:54:04+00:00 2022-11-25 11:56:49+00:00 0:02:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.899999999999991 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.3608923653025524 deviation-center-line_median 0.051213017209835086
other stats deviation-center-line_max 0.051213017209835086 deviation-center-line_mean 0.051213017209835086 deviation-center-line_min 0.051213017209835086 deviation-heading_max 0.6136512740909245 deviation-heading_mean 0.6136512740909245 deviation-heading_median 0.6136512740909245 deviation-heading_min 0.6136512740909245 distance-from-start_max 0.3609304026851721 distance-from-start_mean 0.3609304026851721 distance-from-start_median 0.3609304026851721 distance-from-start_min 0.3609304026851721 driven_any_max 0.3664829367467816 driven_any_mean 0.3664829367467816 driven_any_median 0.3664829367467816 driven_any_min 0.3664829367467816 driven_lanedir_consec_max 0.3608923653025524 driven_lanedir_consec_mean 0.3608923653025524 driven_lanedir_consec_min 0.3608923653025524 driven_lanedir_max 0.3608923653025524 driven_lanedir_mean 0.3608923653025524 driven_lanedir_median 0.3608923653025524 driven_lanedir_min 0.3608923653025524 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.3664829367467816, "survival_time": 4.899999999999991, "driven_lanedir": 0.3608923653025524, "in-drivable-lane": 0.0, "deviation-heading": 0.6136512740909245, "distance-from-start": 0.3609304026851721, "deviation-center-line": 0.051213017209835086, "driven_lanedir_consec": 0.3608923653025524}}simulation-passed 1 survival_time_max 4.899999999999991 survival_time_mean 4.899999999999991 survival_time_min 4.899999999999991
No reset possible 15856
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 11:47:32+00:00 2022-11-25 11:53:37+00:00 0:06:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948975282353535
other stats deviation-center-line_max 0.8948975282353535 deviation-center-line_mean 0.8948975282353535 deviation-center-line_min 0.8948975282353535 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.482534153247273e-16 distance-from-start_mean 2.482534153247273e-16 distance-from-start_median 2.482534153247273e-16 distance-from-start_min 2.482534153247273e-16 driven_any_max 2.9790409838966753e-13 driven_any_mean 2.9790409838966753e-13 driven_any_median 2.9790409838966753e-13 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15852
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 11:44:08+00:00 2022-11-25 11:46:54+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.650000000000087 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3397922837799834 deviation-center-line_median 0.17577830426095897
other stats deviation-center-line_max 0.17577830426095897 deviation-center-line_mean 0.17577830426095897 deviation-center-line_min 0.17577830426095897 deviation-heading_max 1.414000512850352 deviation-heading_mean 1.414000512850352 deviation-heading_median 1.414000512850352 deviation-heading_min 1.414000512850352 distance-from-start_max 0.9953946201002636 distance-from-start_mean 0.9953946201002636 distance-from-start_median 0.9953946201002636 distance-from-start_min 0.9953946201002636 driven_any_max 1.3507304582476738 driven_any_mean 1.3507304582476738 driven_any_median 1.3507304582476738 driven_any_min 1.3507304582476738 driven_lanedir_consec_max 1.3397922837799834 driven_lanedir_consec_mean 1.3397922837799834 driven_lanedir_consec_min 1.3397922837799834 driven_lanedir_max 1.3397922837799834 driven_lanedir_mean 1.3397922837799834 driven_lanedir_median 1.3397922837799834 driven_lanedir_min 1.3397922837799834 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.3507304582476738, "survival_time": 15.650000000000087, "driven_lanedir": 1.3397922837799834, "in-drivable-lane": 0.0, "deviation-heading": 1.414000512850352, "distance-from-start": 0.9953946201002636, "deviation-center-line": 0.17577830426095897, "driven_lanedir_consec": 1.3397922837799834}}simulation-passed 1 survival_time_max 15.650000000000087 survival_time_mean 15.650000000000087 survival_time_min 15.650000000000087
No reset possible 15847
1065
Bea Baselines 🐤baseline-simple-yield aido-hello-sim-state-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 11:42:52+00:00 2022-11-25 11:44:00+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.02249654394867484 deviation-center-line_median 0.0052536287874529785
other stats deviation-center-line_max 0.0052536287874529785 deviation-center-line_mean 0.0052536287874529785 deviation-center-line_min 0.0052536287874529785 deviation-heading_max 0.2537079422480557 deviation-heading_mean 0.2537079422480557 deviation-heading_median 0.2537079422480557 deviation-heading_min 0.2537079422480557 distance-from-start_max 0.025223546623389756 distance-from-start_mean 0.025223546623389756 distance-from-start_median 0.025223546623389756 distance-from-start_min 0.025223546623389756 driven_any_max 0.025243366614066683 driven_any_mean 0.025243366614066683 driven_any_median 0.025243366614066683 driven_any_min 0.025243366614066683 driven_lanedir_consec_max 0.02249654394867484 driven_lanedir_consec_mean 0.02249654394867484 driven_lanedir_consec_min 0.02249654394867484 driven_lanedir_max 0.02249654394867484 driven_lanedir_mean 0.02249654394867484 driven_lanedir_median 0.02249654394867484 driven_lanedir_min 0.02249654394867484 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.025243366614066683, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02249654394867484, "in-drivable-lane": 0.0, "deviation-heading": 0.2537079422480557, "distance-from-start": 0.025223546623389756, "deviation-center-line": 0.0052536287874529785, "driven_lanedir_consec": 0.02249654394867484}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15842
1325
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:41:21+00:00 2022-11-25 11:42:34+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15837
1326
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:39:47+00:00 2022-11-25 11:41:00+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15831
1328
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:38:04+00:00 2022-11-25 11:39:19+00:00 0:01:15 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15827
1329
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-0of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:36:47+00:00 2022-11-25 11:37:59+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15820
1330
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:35:17+00:00 2022-11-25 11:36:15+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15817
1334
Bea Baselines 🐤baseline-RPL-ros lx22-state-estimation
sim failed yes davinci-stage-04-6.2.51
2022-11-25 11:34:12+00:00 2022-11-25 11:35:12+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15811
1335
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-4of5 failed no davinci-stage-04-6.2.51
2022-11-25 11:32:59+00:00 2022-11-25 11:33:57+00:00 0:00:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15806
1342
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:31:24+00:00 2022-11-25 11:32:52+00:00 0:01:28 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15802
1343
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:29:44+00:00 2022-11-25 11:30:56+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15798
1344
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:28:17+00:00 2022-11-25 11:29:31+00:00 0:01:14 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15797
1345
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:27:10+00:00 2022-11-25 11:28:10+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15790
1346
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:25:20+00:00 2022-11-25 11:26:33+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15787
1347
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:23:57+00:00 2022-11-25 11:25:12+00:00 0:01:15 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15783
1348
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:22:17+00:00 2022-11-25 11:23:25+00:00 0:01:08 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15782
1348
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:20:44+00:00 2022-11-25 11:21:44+00:00 0:01:00 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15781
1348
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 11:18:25+00:00 2022-11-25 11:20:23+00:00 0:01:58 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15779
1349
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 11:15:07+00:00 2022-11-25 11:18:02+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.799999999999987 in-drivable-lane_median 0.9499999999999966 driven_lanedir_consec_median 0.5373631508961925 deviation-center-line_median 0.13670263913490427
other stats deviation-center-line_max 0.13670263913490427 deviation-center-line_mean 0.13670263913490427 deviation-center-line_min 0.13670263913490427 deviation-heading_max 1.4879411280714254 deviation-heading_mean 1.4879411280714254 deviation-heading_median 1.4879411280714254 deviation-heading_min 1.4879411280714254 distance-from-start_max 0.5198873028094598 distance-from-start_mean 0.5198873028094598 distance-from-start_median 0.5198873028094598 distance-from-start_min 0.5198873028094598 driven_any_max 0.6253220588730269 driven_any_mean 0.6253220588730269 driven_any_median 0.6253220588730269 driven_any_min 0.6253220588730269 driven_lanedir_consec_max 0.5373631508961925 driven_lanedir_consec_mean 0.5373631508961925 driven_lanedir_consec_min 0.5373631508961925 driven_lanedir_max 0.5373631508961925 driven_lanedir_mean 0.5373631508961925 driven_lanedir_median 0.5373631508961925 driven_lanedir_min 0.5373631508961925 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.9499999999999966 in-drivable-lane_min 0.9499999999999966 per-episodes details {"autolab-000-ego0": {"driven_any": 0.6253220588730269, "survival_time": 5.799999999999987, "driven_lanedir": 0.5373631508961925, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.4879411280714254, "distance-from-start": 0.5198873028094598, "deviation-center-line": 0.13670263913490427, "driven_lanedir_consec": 0.5373631508961925}}simulation-passed 1 survival_time_max 5.799999999999987 survival_time_mean 5.799999999999987 survival_time_min 5.799999999999987
No reset possible 15770
1351
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 11:07:39+00:00 2022-11-25 11:14:39+00:00 0:07:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.599999999999767 driven_lanedir_consec_median 3.736452016264485 deviation-center-line_median 2.865889286665662
other stats deviation-center-line_max 2.865889286665662 deviation-center-line_mean 2.865889286665662 deviation-center-line_min 2.865889286665662 deviation-heading_max 11.571788977657269 deviation-heading_mean 11.571788977657269 deviation-heading_median 11.571788977657269 deviation-heading_min 11.571788977657269 distance-from-start_max 2.0174319242438776 distance-from-start_mean 2.0174319242438776 distance-from-start_median 2.0174319242438776 distance-from-start_min 2.0174319242438776 driven_any_max 7.90780597050609 driven_any_mean 7.90780597050609 driven_any_median 7.90780597050609 driven_any_min 7.90780597050609 driven_lanedir_consec_max 3.736452016264485 driven_lanedir_consec_mean 3.736452016264485 driven_lanedir_consec_min 3.736452016264485 driven_lanedir_max 6.912930753847737 driven_lanedir_mean 6.912930753847737 driven_lanedir_median 6.912930753847737 driven_lanedir_min 6.912930753847737 in-drivable-lane_max 4.599999999999767 in-drivable-lane_mean 4.599999999999767 in-drivable-lane_min 4.599999999999767 per-episodes details {"udem1-000-ego0": {"driven_any": 7.90780597050609, "survival_time": 59.99999999999873, "driven_lanedir": 6.912930753847737, "in-drivable-lane": 4.599999999999767, "deviation-heading": 11.571788977657269, "distance-from-start": 2.0174319242438776, "deviation-center-line": 2.865889286665662, "driven_lanedir_consec": 3.736452016264485}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15767
1352
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 11:02:07+00:00 2022-11-25 11:07:32+00:00 0:05:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.9452977435718175 survival_time_median 59.99999999999873 deviation-center-line_median 4.1924071986336795 in-drivable-lane_median 5.799999999999889
other stats deviation-center-line_max 4.1924071986336795 deviation-center-line_mean 4.1924071986336795 deviation-center-line_min 4.1924071986336795 deviation-heading_max 10.325245906120262 deviation-heading_mean 10.325245906120262 deviation-heading_median 10.325245906120262 deviation-heading_min 10.325245906120262 distance-from-start_max 2.048822654619136 distance-from-start_mean 2.048822654619136 distance-from-start_median 2.048822654619136 distance-from-start_min 2.048822654619136 driven_any_max 7.907828813381925 driven_any_mean 7.907828813381925 driven_any_median 7.907828813381925 driven_any_min 7.907828813381925 driven_lanedir_consec_max 4.9452977435718175 driven_lanedir_consec_mean 4.9452977435718175 driven_lanedir_consec_min 4.9452977435718175 driven_lanedir_max 6.792808692986124 driven_lanedir_mean 6.792808692986124 driven_lanedir_median 6.792808692986124 driven_lanedir_min 6.792808692986124 in-drivable-lane_max 5.799999999999889 in-drivable-lane_mean 5.799999999999889 in-drivable-lane_min 5.799999999999889 per-episodes details {"loop-000-ego0": {"driven_any": 7.907828813381925, "survival_time": 59.99999999999873, "driven_lanedir": 6.792808692986124, "in-drivable-lane": 5.799999999999889, "deviation-heading": 10.325245906120262, "distance-from-start": 2.048822654619136, "deviation-center-line": 4.1924071986336795, "driven_lanedir_consec": 4.9452977435718175}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15760
1354
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 10:51:54+00:00 2022-11-25 11:01:41+00:00 0:09:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.4000000000003 in-drivable-lane_median 13.800000000000166 driven_lanedir_consec_median 1.044896098623329 deviation-center-line_median 0.9091209922301569
other stats deviation-center-line_max 2.9040672869129205 deviation-center-line_mean 1.2179683667621382 deviation-center-line_min 0.14956419567531865 deviation-heading_max 20.74511778740683 deviation-heading_mean 8.062494676122725 deviation-heading_median 5.2919975697353605 deviation-heading_min 0.9208657776133492 distance-from-start_max 2.4348019211038214 distance-from-start_mean 1.0895472147396723 distance-from-start_median 0.8583161916493439 distance-from-start_min 0.20675455455617991 driven_any_max 4.156812362233148 driven_any_mean 1.987739367077879 driven_any_median 1.7935071259214077 driven_any_min 0.20713085423555164 driven_lanedir_consec_max 1.978078754386608 driven_lanedir_consec_mean 1.051978559784601 driven_lanedir_consec_min 0.1400432875051374 driven_lanedir_max 2.750975322874313 driven_lanedir_mean 1.4424479711409188 driven_lanedir_median 1.439386637092113 driven_lanedir_min 0.1400432875051374 in-drivable-lane_max 30.750000000000295 in-drivable-lane_mean 15.137500000000164 in-drivable-lane_min 2.200000000000019 per-episodes details {"loop-000-ego0": {"driven_any": 1.793374252012068, "survival_time": 32.4000000000003, "driven_lanedir": 1.2388671772601965, "in-drivable-lane": 2.200000000000019, "deviation-heading": 20.74511778740683, "distance-from-start": 1.0474981414311515, "deviation-center-line": 2.9040672869129205, "driven_lanedir_consec": 1.169899257888998}, "loop-000-ego1": {"driven_any": 0.20713085423555164, "survival_time": 32.4000000000003, "driven_lanedir": 0.1400432875051374, "in-drivable-lane": 30.750000000000295, "deviation-heading": 0.9208657776133492, "distance-from-start": 0.20675455455617991, "deviation-center-line": 0.14956419567531865, "driven_lanedir_consec": 0.1400432875051374}, "loop-000-ego2": {"driven_any": 1.793639999830747, "survival_time": 32.4000000000003, "driven_lanedir": 1.639906096924029, "in-drivable-lane": 18.800000000000235, "deviation-heading": 2.919708198844249, "distance-from-start": 0.6691342418675363, "deviation-center-line": 0.6665308580354611, "driven_lanedir_consec": 0.9198929393576608}, "loop-000-ego3": {"driven_any": 4.156812362233148, "survival_time": 32.4000000000003, "driven_lanedir": 2.750975322874313, "in-drivable-lane": 8.800000000000097, "deviation-heading": 7.664286940626472, "distance-from-start": 2.4348019211038214, "deviation-center-line": 1.1517111264248527, "driven_lanedir_consec": 1.978078754386608}}simulation-passed 1 survival_time_max 32.4000000000003 survival_time_mean 32.4000000000003 survival_time_min 32.4000000000003
No reset possible 15752
1356
Bea Baselines 🐤baseline-duckietown-ml lx22-modcon
sim success yes davinci-stage-04-6.2.51
2022-11-25 10:35:58+00:00 2022-11-25 10:51:19+00:00 0:15:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 4.99999999999999 deviation-center-line_median 2.315936478823729 driven_lanedir_consec_median 7.277389687713625 survival_time_median 59.99999999999873
other stats deviation-center-line_max 2.861159512720237 deviation-center-line_mean 2.315936478823729 deviation-center-line_min 1.7707134449272208 deviation-heading_max 4.466259032761755 deviation-heading_mean 3.368683114380585 deviation-heading_median 3.368683114380585 deviation-heading_min 2.2711071959994147 distance-from-start_max 7.879734903586813 distance-from-start_mean 7.875929837722931 distance-from-start_median 7.875929837722931 distance-from-start_min 7.872124771859049 driven_any_max 7.92126811992993 driven_any_mean 7.914645722824824 driven_any_median 7.914645722824824 driven_any_min 7.908023325719719 driven_lanedir_consec_max 7.394501639469369 driven_lanedir_consec_mean 7.277389687713625 driven_lanedir_consec_min 7.160277735957881 driven_lanedir_max 7.394501639469369 driven_lanedir_mean 7.277389687713625 driven_lanedir_median 7.277389687713625 driven_lanedir_min 7.160277735957881 in-drivable-lane_max 5.999999999999987 in-drivable-lane_mean 4.99999999999999 in-drivable-lane_min 3.999999999999994 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 7.92126811992993, "survival_time": 59.99999999999873, "driven_lanedir": 7.394501639469369, "in-drivable-lane": 3.999999999999994, "deviation-heading": 4.466259032761755, "distance-from-start": 7.872124771859049, "deviation-center-line": 1.7707134449272208, "driven_lanedir_consec": 7.394501639469369}, "LF-full-loop-001-ego0": {"driven_any": 7.908023325719719, "survival_time": 59.99999999999873, "driven_lanedir": 7.160277735957881, "in-drivable-lane": 5.999999999999987, "deviation-heading": 2.2711071959994147, "distance-from-start": 7.879734903586813, "deviation-center-line": 2.861159512720237, "driven_lanedir_consec": 7.160277735957881}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15738
1367
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 10:17:53+00:00 2022-11-25 10:35:24+00:00 0:17:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 10.799999999999692 driven_lanedir_consec_median 5.692374017206179 deviation-center-line_median 4.525583813402954
other stats deviation-center-line_max 4.525583813402954 deviation-center-line_mean 4.525583813402954 deviation-center-line_min 4.525583813402954 deviation-heading_max 19.406298407990548 deviation-heading_mean 19.406298407990548 deviation-heading_median 19.406298407990548 deviation-heading_min 19.406298407990548 distance-from-start_max 2.272990798573481 distance-from-start_mean 2.272990798573481 distance-from-start_median 2.272990798573481 distance-from-start_min 2.272990798573481 driven_any_max 7.913583934285994 driven_any_mean 7.913583934285994 driven_any_median 7.913583934285994 driven_any_min 7.913583934285994 driven_lanedir_consec_max 5.692374017206179 driven_lanedir_consec_mean 5.692374017206179 driven_lanedir_consec_min 5.692374017206179 driven_lanedir_max 5.692374017206179 driven_lanedir_mean 5.692374017206179 driven_lanedir_median 5.692374017206179 driven_lanedir_min 5.692374017206179 in-drivable-lane_max 10.799999999999692 in-drivable-lane_mean 10.799999999999692 in-drivable-lane_min 10.799999999999692 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.913583934285994, "survival_time": 59.99999999999873, "driven_lanedir": 5.692374017206179, "in-drivable-lane": 10.799999999999692, "deviation-heading": 19.406298407990548, "distance-from-start": 2.272990798573481, "deviation-center-line": 4.525583813402954, "driven_lanedir_consec": 5.692374017206179}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15735
1370
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 10:11:38+00:00 2022-11-25 10:17:27+00:00 0:05:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 6.422656146457873 survival_time_median 59.99999999999873 deviation-center-line_median 3.888669435709433 in-drivable-lane_median 7.099999999999703
other stats deviation-center-line_max 3.888669435709433 deviation-center-line_mean 3.888669435709433 deviation-center-line_min 3.888669435709433 deviation-heading_max 13.613656712589906 deviation-heading_mean 13.613656712589906 deviation-heading_median 13.613656712589906 deviation-heading_min 13.613656712589906 distance-from-start_max 2.785481540401922 distance-from-start_mean 2.785481540401922 distance-from-start_median 2.785481540401922 distance-from-start_min 2.785481540401922 driven_any_max 7.9078039410101955 driven_any_mean 7.9078039410101955 driven_any_median 7.9078039410101955 driven_any_min 7.9078039410101955 driven_lanedir_consec_max 6.422656146457873 driven_lanedir_consec_mean 6.422656146457873 driven_lanedir_consec_min 6.422656146457873 driven_lanedir_max 6.422656146457873 driven_lanedir_mean 6.422656146457873 driven_lanedir_median 6.422656146457873 driven_lanedir_min 6.422656146457873 in-drivable-lane_max 7.099999999999703 in-drivable-lane_mean 7.099999999999703 in-drivable-lane_min 7.099999999999703 per-episodes details {"autolab-000-ego0": {"driven_any": 7.9078039410101955, "survival_time": 59.99999999999873, "driven_lanedir": 6.422656146457873, "in-drivable-lane": 7.099999999999703, "deviation-heading": 13.613656712589906, "distance-from-start": 2.785481540401922, "deviation-center-line": 3.888669435709433, "driven_lanedir_consec": 6.422656146457873}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15732
1370
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 10:09:11+00:00 2022-11-25 10:11:22+00:00 0:02:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2145833337610057 survival_time_median 11.100000000000025 deviation-center-line_median 0.2210201506566556 in-drivable-lane_median 8.650000000000023
other stats deviation-center-line_max 0.2210201506566556 deviation-center-line_mean 0.2210201506566556 deviation-center-line_min 0.2210201506566556 deviation-heading_max 1.443039038914398 deviation-heading_mean 1.443039038914398 deviation-heading_median 1.443039038914398 deviation-heading_min 1.443039038914398 distance-from-start_max 0.9381672670770348 distance-from-start_mean 0.9381672670770348 distance-from-start_median 0.9381672670770348 distance-from-start_min 0.9381672670770348 driven_any_max 1.3223765749040983 driven_any_mean 1.3223765749040983 driven_any_median 1.3223765749040983 driven_any_min 1.3223765749040983 driven_lanedir_consec_max 0.2145833337610057 driven_lanedir_consec_mean 0.2145833337610057 driven_lanedir_consec_min 0.2145833337610057 driven_lanedir_max 0.2152492969369124 driven_lanedir_mean 0.2152492969369124 driven_lanedir_median 0.2152492969369124 driven_lanedir_min 0.2152492969369124 in-drivable-lane_max 8.650000000000023 in-drivable-lane_mean 8.650000000000023 in-drivable-lane_min 8.650000000000023 per-episodes details {"loop2-000-ego0": {"driven_any": 1.3223765749040983, "survival_time": 11.100000000000025, "driven_lanedir": 0.2152492969369124, "in-drivable-lane": 8.650000000000023, "deviation-heading": 1.443039038914398, "distance-from-start": 0.9381672670770348, "deviation-center-line": 0.2210201506566556, "driven_lanedir_consec": 0.2145833337610057}}simulation-passed 1 survival_time_max 11.100000000000025 survival_time_mean 11.100000000000025 survival_time_min 11.100000000000025
No reset possible 15731
1371
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 10:05:56+00:00 2022-11-25 10:08:34+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15730
1371
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 10:03:53+00:00 2022-11-25 10:05:31+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15728
1371
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 09:55:35+00:00 2022-11-25 10:03:43+00:00 0:08:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.550000000000143 in-drivable-lane_median 1.4000000000000146 driven_lanedir_consec_median 0.49321604950767406 deviation-center-line_median 1.98953082591548
other stats deviation-center-line_max 2.6938253664709917 deviation-center-line_mean 1.9926198692355923 deviation-center-line_min 1.297592458640416 deviation-heading_max 24.159371536653165 deviation-heading_mean 12.77961871867726 deviation-heading_median 10.35868407132048 deviation-heading_min 6.241735195414919 distance-from-start_max 1.8293867571337352 distance-from-start_mean 0.7949306146984769 distance-from-start_median 0.4874264737083894 distance-from-start_min 0.3754827542433936 driven_any_max 2.450728116897978 driven_any_mean 1.2110508396397557 driven_any_median 0.990295150586912 driven_any_min 0.41288494048722024 driven_lanedir_consec_max 1.5642843770949415 driven_lanedir_consec_mean 0.7308432716544218 driven_lanedir_consec_min 0.3726566105073972 driven_lanedir_max 1.81769189871418 driven_lanedir_mean 0.8782995828944057 driven_lanedir_median 0.6614249111780228 driven_lanedir_min 0.3726566105073972 in-drivable-lane_max 3.0500000000000025 in-drivable-lane_mean 1.462500000000008 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.381877772311545, "survival_time": 19.550000000000143, "driven_lanedir": 0.7889960550485018, "in-drivable-lane": 3.0500000000000025, "deviation-heading": 13.83029838585822, "distance-from-start": 0.45999168472118457, "deviation-center-line": 1.69585692034152, "driven_lanedir_consec": 0.45257833170780426}, "4way-000-ego1": {"driven_any": 0.5987125288622789, "survival_time": 19.550000000000143, "driven_lanedir": 0.5338537673075439, "in-drivable-lane": 0.0, "deviation-heading": 24.159371536653165, "distance-from-start": 0.5148612626955942, "deviation-center-line": 2.6938253664709917, "driven_lanedir_consec": 0.5338537673075439}, "4way-000-ego2": {"driven_any": 2.450728116897978, "survival_time": 19.550000000000143, "driven_lanedir": 1.81769189871418, "in-drivable-lane": 2.800000000000029, "deviation-heading": 6.887069756782737, "distance-from-start": 1.8293867571337352, "deviation-center-line": 1.297592458640416, "driven_lanedir_consec": 1.5642843770949415}, "4way-000-ego3": {"driven_any": 0.41288494048722024, "survival_time": 19.550000000000143, "driven_lanedir": 0.3726566105073972, "in-drivable-lane": 0.0, "deviation-heading": 6.241735195414919, "distance-from-start": 0.3754827542433936, "deviation-center-line": 2.2832047314894406, "driven_lanedir_consec": 0.3726566105073972}}simulation-passed 1 survival_time_max 19.550000000000143 survival_time_mean 19.550000000000143 survival_time_min 19.550000000000143
No reset possible 15723
1373
Bea Baselines 🐤baseline-duckietown-ml aido-LFP-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 09:50:04+00:00 2022-11-25 09:55:28+00:00 0:05:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.149999999999498 driven_lanedir_consec_median 4.838274527944493 deviation-center-line_median 4.879168208768855
other stats deviation-center-line_max 4.879168208768855 deviation-center-line_mean 4.879168208768855 deviation-center-line_min 4.879168208768855 deviation-heading_max 6.334513307631242 deviation-heading_mean 6.334513307631242 deviation-heading_median 6.334513307631242 deviation-heading_min 6.334513307631242 distance-from-start_max 1.4310595619001365 distance-from-start_mean 1.4310595619001365 distance-from-start_median 1.4310595619001365 distance-from-start_min 1.4310595619001365 driven_any_max 7.907804844645208 driven_any_mean 7.907804844645208 driven_any_median 7.907804844645208 driven_any_min 7.907804844645208 driven_lanedir_consec_max 4.838274527944493 driven_lanedir_consec_mean 4.838274527944493 driven_lanedir_consec_min 4.838274527944493 driven_lanedir_max 4.838274527944493 driven_lanedir_mean 4.838274527944493 driven_lanedir_median 4.838274527944493 driven_lanedir_min 4.838274527944493 in-drivable-lane_max 22.149999999999498 in-drivable-lane_mean 22.149999999999498 in-drivable-lane_min 22.149999999999498 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907804844645208, "survival_time": 59.99999999999873, "driven_lanedir": 4.838274527944493, "in-drivable-lane": 22.149999999999498, "deviation-heading": 6.334513307631242, "distance-from-start": 1.4310595619001365, "deviation-center-line": 4.879168208768855, "driven_lanedir_consec": 4.838274527944493}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15716
1374
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 09:42:18+00:00 2022-11-25 09:49:36+00:00 0:07:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.149999999999931 driven_lanedir_consec_median 6.870968164766345 deviation-center-line_median 2.673979697362703
other stats deviation-center-line_max 2.673979697362703 deviation-center-line_mean 2.673979697362703 deviation-center-line_min 2.673979697362703 deviation-heading_max 10.815547872618202 deviation-heading_mean 10.815547872618202 deviation-heading_median 10.815547872618202 deviation-heading_min 10.815547872618202 distance-from-start_max 1.180846277516737 distance-from-start_mean 1.180846277516737 distance-from-start_median 1.180846277516737 distance-from-start_min 1.180846277516737 driven_any_max 7.90079643283709 driven_any_mean 7.90079643283709 driven_any_median 7.90079643283709 driven_any_min 7.90079643283709 driven_lanedir_consec_max 6.870968164766345 driven_lanedir_consec_mean 6.870968164766345 driven_lanedir_consec_min 6.870968164766345 driven_lanedir_max 6.870968164766345 driven_lanedir_mean 6.870968164766345 driven_lanedir_median 6.870968164766345 driven_lanedir_min 6.870968164766345 in-drivable-lane_max 5.149999999999931 in-drivable-lane_mean 5.149999999999931 in-drivable-lane_min 5.149999999999931 per-episodes details {"loop2-000-ego0": {"driven_any": 7.90079643283709, "survival_time": 59.99999999999873, "driven_lanedir": 6.870968164766345, "in-drivable-lane": 5.149999999999931, "deviation-heading": 10.815547872618202, "distance-from-start": 1.180846277516737, "deviation-center-line": 2.673979697362703, "driven_lanedir_consec": 6.870968164766345}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15713
1376
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 09:39:25+00:00 2022-11-25 09:41:52+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.14999999999998 in-drivable-lane_median 5.9999999999999805 driven_lanedir_consec_median 0.1922115719302815 deviation-center-line_median 0.14802419712751816
other stats deviation-center-line_max 0.14802419712751816 deviation-center-line_mean 0.14802419712751816 deviation-center-line_min 0.14802419712751816 deviation-heading_max 1.1854137271414749 deviation-heading_mean 1.1854137271414749 deviation-heading_median 1.1854137271414749 deviation-heading_min 1.1854137271414749 distance-from-start_max 0.8357934176898612 distance-from-start_mean 0.8357934176898612 distance-from-start_median 0.8357934176898612 distance-from-start_min 0.8357934176898612 driven_any_max 0.9307278770111248 driven_any_mean 0.9307278770111248 driven_any_median 0.9307278770111248 driven_any_min 0.9307278770111248 driven_lanedir_consec_max 0.1922115719302815 driven_lanedir_consec_mean 0.1922115719302815 driven_lanedir_consec_min 0.1922115719302815 driven_lanedir_max 0.1922115719302815 driven_lanedir_mean 0.1922115719302815 driven_lanedir_median 0.1922115719302815 driven_lanedir_min 0.1922115719302815 in-drivable-lane_max 5.9999999999999805 in-drivable-lane_mean 5.9999999999999805 in-drivable-lane_min 5.9999999999999805 per-episodes details {"udem1-000-ego0": {"driven_any": 0.9307278770111248, "survival_time": 8.14999999999998, "driven_lanedir": 0.1922115719302815, "in-drivable-lane": 5.9999999999999805, "deviation-heading": 1.1854137271414749, "distance-from-start": 0.8357934176898612, "deviation-center-line": 0.14802419712751816, "driven_lanedir_consec": 0.1922115719302815}}simulation-passed 1 survival_time_max 8.14999999999998 survival_time_mean 8.14999999999998 survival_time_min 8.14999999999998
No reset possible 15707
1377
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 09:33:41+00:00 2022-11-25 09:39:18+00:00 0:05:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.1776247561754163 survival_time_median 59.99999999999873 deviation-center-line_median 2.1521448786391084 in-drivable-lane_median 40.79999999999904
other stats deviation-center-line_max 2.1521448786391084 deviation-center-line_mean 2.1521448786391084 deviation-center-line_min 2.1521448786391084 deviation-heading_max 6.052157566574608 deviation-heading_mean 6.052157566574608 deviation-heading_median 6.052157566574608 deviation-heading_min 6.052157566574608 distance-from-start_max 1.425063891762866 distance-from-start_mean 1.425063891762866 distance-from-start_median 1.425063891762866 distance-from-start_min 1.425063891762866 driven_any_max 7.907611696681576 driven_any_mean 7.907611696681576 driven_any_median 7.907611696681576 driven_any_min 7.907611696681576 driven_lanedir_consec_max 2.1776247561754163 driven_lanedir_consec_mean 2.1776247561754163 driven_lanedir_consec_min 2.1776247561754163 driven_lanedir_max 2.277966587672002 driven_lanedir_mean 2.277966587672002 driven_lanedir_median 2.277966587672002 driven_lanedir_min 2.277966587672002 in-drivable-lane_max 40.79999999999904 in-drivable-lane_mean 40.79999999999904 in-drivable-lane_min 40.79999999999904 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907611696681576, "survival_time": 59.99999999999873, "driven_lanedir": 2.277966587672002, "in-drivable-lane": 40.79999999999904, "deviation-heading": 6.052157566574608, "distance-from-start": 1.425063891762866, "deviation-center-line": 2.1521448786391084, "driven_lanedir_consec": 2.1776247561754163}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15705
1377
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 09:27:35+00:00 2022-11-25 09:33:32+00:00 0:05:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.768777157280126 survival_time_median 59.99999999999873 deviation-center-line_median 2.647912281093039 in-drivable-lane_median 19.14999999999956
other stats deviation-center-line_max 2.647912281093039 deviation-center-line_mean 2.647912281093039 deviation-center-line_min 2.647912281093039 deviation-heading_max 8.6728251800287 deviation-heading_mean 8.6728251800287 deviation-heading_median 8.6728251800287 deviation-heading_min 8.6728251800287 distance-from-start_max 3.151523682643045 distance-from-start_mean 3.151523682643045 distance-from-start_median 3.151523682643045 distance-from-start_min 3.151523682643045 driven_any_max 7.907782937625951 driven_any_mean 7.907782937625951 driven_any_median 7.907782937625951 driven_any_min 7.907782937625951 driven_lanedir_consec_max 3.768777157280126 driven_lanedir_consec_mean 3.768777157280126 driven_lanedir_consec_min 3.768777157280126 driven_lanedir_max 5.062420051355356 driven_lanedir_mean 5.062420051355356 driven_lanedir_median 5.062420051355356 driven_lanedir_min 5.062420051355356 in-drivable-lane_max 19.14999999999956 in-drivable-lane_mean 19.14999999999956 in-drivable-lane_min 19.14999999999956 per-episodes details {"autolab-000-ego0": {"driven_any": 7.907782937625951, "survival_time": 59.99999999999873, "driven_lanedir": 5.062420051355356, "in-drivable-lane": 19.14999999999956, "deviation-heading": 8.6728251800287, "distance-from-start": 3.151523682643045, "deviation-center-line": 2.647912281093039, "driven_lanedir_consec": 3.768777157280126}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15700
1378
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 09:19:52+00:00 2022-11-25 09:27:03+00:00 0:07:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.400000000000155 in-drivable-lane_median 8.650000000000087 driven_lanedir_consec_median 0.6056086339112295 deviation-center-line_median 0.6803396064296651
other stats deviation-center-line_max 2.2807467289463914 deviation-center-line_mean 0.9475717200780776 deviation-center-line_min 0.1488609385065893 deviation-heading_max 16.745747123059083 deviation-heading_mean 5.841115792233381 deviation-heading_median 2.8436672532229683 deviation-heading_min 0.9313815394285084 distance-from-start_max 1.959629942959358 distance-from-start_mean 0.851730852225229 distance-from-start_median 0.6404083061878002 distance-from-start_min 0.16647685356595787 driven_any_max 2.5637053899081135 driven_any_mean 1.1281677458582262 driven_any_median 0.8908314645181137 driven_any_min 0.1673026644885641 driven_lanedir_consec_max 2.0476083921171617 driven_lanedir_consec_mean 0.8478162797623865 driven_lanedir_consec_min 0.13243945910992494 driven_lanedir_max 2.3028769503347495 driven_lanedir_mean 0.964434828493124 driven_lanedir_median 0.7112114522639109 driven_lanedir_min 0.13243945910992494 in-drivable-lane_max 18.800000000000153 in-drivable-lane_mean 9.225000000000083 in-drivable-lane_min 0.8000000000000114 per-episodes details {"4way-000-ego0": {"driven_any": 1.176236897233896, "survival_time": 20.400000000000155, "driven_lanedir": 0.90040039539358, "in-drivable-lane": 1.4000000000000137, "deviation-heading": 16.745747123059083, "distance-from-start": 0.687464803476208, "deviation-center-line": 2.2807467289463914, "driven_lanedir_consec": 0.6891947586882172}, "4way-000-ego1": {"driven_any": 0.1673026644885641, "survival_time": 20.400000000000155, "driven_lanedir": 0.13243945910992494, "in-drivable-lane": 18.800000000000153, "deviation-heading": 0.9313815394285084, "distance-from-start": 0.16647685356595787, "deviation-center-line": 0.1488609385065893, "driven_lanedir_consec": 0.13243945910992494}, "4way-000-ego2": {"driven_any": 2.5637053899081135, "survival_time": 20.400000000000155, "driven_lanedir": 2.3028769503347495, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 4.510485207702659, "distance-from-start": 1.959629942959358, "deviation-center-line": 1.1099298488050018, "driven_lanedir_consec": 2.0476083921171617}, "4way-000-ego3": {"driven_any": 0.6054260318023315, "survival_time": 20.400000000000155, "driven_lanedir": 0.5220225091342419, "in-drivable-lane": 15.900000000000162, "deviation-heading": 1.176849298743278, "distance-from-start": 0.5933518088993924, "deviation-center-line": 0.2507493640543284, "driven_lanedir_consec": 0.5220225091342419}}simulation-passed 1 survival_time_max 20.400000000000155 survival_time_mean 20.400000000000155 survival_time_min 20.400000000000155
No reset possible 15691
1381
Bea Baselines 🐤baseline-duckietown lx22-modcon
sim success yes davinci-stage-04-6.2.51
2022-11-25 09:04:33+00:00 2022-11-25 09:19:24+00:00 0:14:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 4.749999999999991 deviation-center-line_median 2.222437505730171 driven_lanedir_consec_median 7.315921407382271 survival_time_median 59.99999999999873
other stats deviation-center-line_max 2.6094797108772356 deviation-center-line_mean 2.222437505730171 deviation-center-line_min 1.8353953005831063 deviation-heading_max 3.837517169677545 deviation-heading_mean 3.1307461843068554 deviation-heading_median 3.1307461843068554 deviation-heading_min 2.423975198936166 distance-from-start_max 7.883577522261388 distance-from-start_mean 7.877530319053169 distance-from-start_median 7.877530319053169 distance-from-start_min 7.87148311584495 driven_any_max 7.921281467790121 driven_any_mean 7.914648825189893 driven_any_median 7.914648825189893 driven_any_min 7.908016182589666 driven_lanedir_consec_max 7.43263352348804 driven_lanedir_consec_mean 7.315921407382271 driven_lanedir_consec_min 7.199209291276502 driven_lanedir_max 7.43263352348804 driven_lanedir_mean 7.315921407382271 driven_lanedir_median 7.315921407382271 driven_lanedir_min 7.199209291276502 in-drivable-lane_max 5.699999999999988 in-drivable-lane_mean 4.749999999999991 in-drivable-lane_min 3.7999999999999945 per-episodes details {"LF-full-loop-000-ego0": {"driven_any": 7.921281467790121, "survival_time": 59.99999999999873, "driven_lanedir": 7.43263352348804, "in-drivable-lane": 3.7999999999999945, "deviation-heading": 3.837517169677545, "distance-from-start": 7.883577522261388, "deviation-center-line": 1.8353953005831063, "driven_lanedir_consec": 7.43263352348804}, "LF-full-loop-001-ego0": {"driven_any": 7.908016182589666, "survival_time": 59.99999999999873, "driven_lanedir": 7.199209291276502, "in-drivable-lane": 5.699999999999988, "deviation-heading": 2.423975198936166, "distance-from-start": 7.87148311584495, "deviation-center-line": 2.6094797108772356, "driven_lanedir_consec": 7.199209291276502}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15687
1385
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-1of5 success no davinci-stage-04-6.2.51
2022-11-25 08:55:48+00:00 2022-11-25 09:04:27+00:00 0:08:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15684
1385
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-0of5 success no davinci-stage-04-6.2.51
2022-11-25 08:53:52+00:00 2022-11-25 08:55:22+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.3911136884406331
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.3911136884406331 distance-from-start_median 0.3911136884406331 distance-from-start_min 0.3911136884406331 driven_any_max 0.3930075002402671 driven_any_mean 0.3930075002402671 driven_any_median 0.3930075002402671 driven_any_min 0.3930075002402671 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 4.049999999999994 in-drivable-lane_mean 4.049999999999994 in-drivable-lane_median 4.049999999999994 in-drivable-lane_min 4.049999999999994 per-episodes details {"d30-ego0": {"driven_any": 0.3930075002402671, "survival_time": 4.049999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 4.049999999999994, "deviation-heading": 0.0, "distance-from-start": 0.3911136884406331, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 4.049999999999994 survival_time_mean 4.049999999999994 survival_time_median 4.049999999999994 survival_time_min 4.049999999999994
No reset possible 15682
1388
Bea Baselines 🐤baseline-duckietown aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 08:52:10+00:00 2022-11-25 08:53:24+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.013189187289113002 deviation-center-line_median 0.0065397922395124125
other stats deviation-center-line_max 0.0065397922395124125 deviation-center-line_mean 0.0065397922395124125 deviation-center-line_min 0.0065397922395124125 deviation-heading_max 0.2653584735777632 deviation-heading_mean 0.2653584735777632 deviation-heading_median 0.2653584735777632 deviation-heading_min 0.2653584735777632 distance-from-start_max 0.01507900477346035 distance-from-start_mean 0.01507900477346035 distance-from-start_median 0.01507900477346035 distance-from-start_min 0.01507900477346035 driven_any_max 0.01508444032884055 driven_any_mean 0.01508444032884055 driven_any_median 0.01508444032884055 driven_any_min 0.01508444032884055 driven_lanedir_consec_max 0.013189187289113002 driven_lanedir_consec_mean 0.013189187289113002 driven_lanedir_consec_min 0.013189187289113002 driven_lanedir_max 0.013189187289113002 driven_lanedir_mean 0.013189187289113002 driven_lanedir_median 0.013189187289113002 driven_lanedir_min 0.013189187289113002 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.01508444032884055, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013189187289113002, "in-drivable-lane": 0.0, "deviation-heading": 0.2653584735777632, "distance-from-start": 0.01507900477346035, "deviation-center-line": 0.0065397922395124125, "driven_lanedir_consec": 0.013189187289113002}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15680
1392
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 08:46:35+00:00 2022-11-25 08:52:00+00:00 0:05:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 34.700000000000166 in-drivable-lane_median 12.449999999999973 driven_lanedir_consec_median 1.7921387222841 deviation-center-line_median 2.0967507404864416
other stats deviation-center-line_max 2.0967507404864416 deviation-center-line_mean 2.0967507404864416 deviation-center-line_min 2.0967507404864416 deviation-heading_max 6.59730246859112 deviation-heading_mean 6.59730246859112 deviation-heading_median 6.59730246859112 deviation-heading_min 6.59730246859112 distance-from-start_max 1.350915628114586 distance-from-start_mean 1.350915628114586 distance-from-start_median 1.350915628114586 distance-from-start_min 1.350915628114586 driven_any_max 4.462270237373044 driven_any_mean 4.462270237373044 driven_any_median 4.462270237373044 driven_any_min 4.462270237373044 driven_lanedir_consec_max 1.7921387222841 driven_lanedir_consec_mean 1.7921387222841 driven_lanedir_consec_min 1.7921387222841 driven_lanedir_max 2.6494479742902364 driven_lanedir_mean 2.6494479742902364 driven_lanedir_median 2.6494479742902364 driven_lanedir_min 2.6494479742902364 in-drivable-lane_max 12.449999999999973 in-drivable-lane_mean 12.449999999999973 in-drivable-lane_min 12.449999999999973 per-episodes details {"loop2-000-ego0": {"driven_any": 4.462270237373044, "survival_time": 34.700000000000166, "driven_lanedir": 2.6494479742902364, "in-drivable-lane": 12.449999999999973, "deviation-heading": 6.59730246859112, "distance-from-start": 1.350915628114586, "deviation-center-line": 2.0967507404864416, "driven_lanedir_consec": 1.7921387222841}}simulation-passed 1 survival_time_max 34.700000000000166 survival_time_mean 34.700000000000166 survival_time_min 34.700000000000166
No reset possible 15673
1394
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 08:39:25+00:00 2022-11-25 08:46:21+00:00 0:06:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.649999999999793 driven_lanedir_consec_median 4.119626063193319 deviation-center-line_median 4.088480724584503
other stats deviation-center-line_max 4.088480724584503 deviation-center-line_mean 4.088480724584503 deviation-center-line_min 4.088480724584503 deviation-heading_max 12.450413648484306 deviation-heading_mean 12.450413648484306 deviation-heading_median 12.450413648484306 deviation-heading_min 12.450413648484306 distance-from-start_max 2.227242807906669 distance-from-start_mean 2.227242807906669 distance-from-start_median 2.227242807906669 distance-from-start_min 2.227242807906669 driven_any_max 7.90782655210273 driven_any_mean 7.90782655210273 driven_any_median 7.90782655210273 driven_any_min 7.90782655210273 driven_lanedir_consec_max 4.119626063193319 driven_lanedir_consec_mean 4.119626063193319 driven_lanedir_consec_min 4.119626063193319 driven_lanedir_max 7.0636271381418805 driven_lanedir_mean 7.0636271381418805 driven_lanedir_median 7.0636271381418805 driven_lanedir_min 7.0636271381418805 in-drivable-lane_max 3.649999999999793 in-drivable-lane_mean 3.649999999999793 in-drivable-lane_min 3.649999999999793 per-episodes details {"udem1-000-ego0": {"driven_any": 7.90782655210273, "survival_time": 59.99999999999873, "driven_lanedir": 7.0636271381418805, "in-drivable-lane": 3.649999999999793, "deviation-heading": 12.450413648484306, "distance-from-start": 2.227242807906669, "deviation-center-line": 4.088480724584503, "driven_lanedir_consec": 4.119626063193319}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15669
1395
Bea Baselines 🐤baseline-duckietown aido-LF-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 08:33:22+00:00 2022-11-25 08:38:51+00:00 0:05:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.10024741485305856 survival_time_median 45.799999999999535 deviation-center-line_median 0.10449348900605386 in-drivable-lane_median 44.199999999999534
other stats deviation-center-line_max 0.10449348900605386 deviation-center-line_mean 0.10449348900605386 deviation-center-line_min 0.10449348900605386 deviation-heading_max 1.2438627835416582 deviation-heading_mean 1.2438627835416582 deviation-heading_median 1.2438627835416582 deviation-heading_min 1.2438627835416582 distance-from-start_max 3.3749973878675075 distance-from-start_mean 3.3749973878675075 distance-from-start_median 3.3749973878675075 distance-from-start_min 3.3749973878675075 driven_any_max 5.929553914059976 driven_any_mean 5.929553914059976 driven_any_median 5.929553914059976 driven_any_min 5.929553914059976 driven_lanedir_consec_max 0.10024741485305856 driven_lanedir_consec_mean 0.10024741485305856 driven_lanedir_consec_min 0.10024741485305856 driven_lanedir_max 0.10024741485305856 driven_lanedir_mean 0.10024741485305856 driven_lanedir_median 0.10024741485305856 driven_lanedir_min 0.10024741485305856 in-drivable-lane_max 44.199999999999534 in-drivable-lane_mean 44.199999999999534 in-drivable-lane_min 44.199999999999534 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.929553914059976, "survival_time": 45.799999999999535, "driven_lanedir": 0.10024741485305856, "in-drivable-lane": 44.199999999999534, "deviation-heading": 1.2438627835416582, "distance-from-start": 3.3749973878675075, "deviation-center-line": 0.10449348900605386, "driven_lanedir_consec": 0.10024741485305856}}simulation-passed 1 survival_time_max 45.799999999999535 survival_time_mean 45.799999999999535 survival_time_min 45.799999999999535
No reset possible 15667
1395
Bea Baselines 🐤baseline-duckietown aido-LF-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 08:27:52+00:00 2022-11-25 08:33:14+00:00 0:05:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 6.797015960902462 survival_time_median 59.99999999999873 deviation-center-line_median 2.6011765710793497 in-drivable-lane_median 6.199999999999648
other stats deviation-center-line_max 2.6011765710793497 deviation-center-line_mean 2.6011765710793497 deviation-center-line_min 2.6011765710793497 deviation-heading_max 8.476319442283595 deviation-heading_mean 8.476319442283595 deviation-heading_median 8.476319442283595 deviation-heading_min 8.476319442283595 distance-from-start_max 2.87224522632079 distance-from-start_mean 2.87224522632079 distance-from-start_median 2.87224522632079 distance-from-start_min 2.87224522632079 driven_any_max 7.907819516422021 driven_any_mean 7.907819516422021 driven_any_median 7.907819516422021 driven_any_min 7.907819516422021 driven_lanedir_consec_max 6.797015960902462 driven_lanedir_consec_mean 6.797015960902462 driven_lanedir_consec_min 6.797015960902462 driven_lanedir_max 6.844723941197957 driven_lanedir_mean 6.844723941197957 driven_lanedir_median 6.844723941197957 driven_lanedir_min 6.844723941197957 in-drivable-lane_max 6.199999999999648 in-drivable-lane_mean 6.199999999999648 in-drivable-lane_min 6.199999999999648 per-episodes details {"autolab-000-ego0": {"driven_any": 7.907819516422021, "survival_time": 59.99999999999873, "driven_lanedir": 6.844723941197957, "in-drivable-lane": 6.199999999999648, "deviation-heading": 8.476319442283595, "distance-from-start": 2.87224522632079, "deviation-center-line": 2.6011765710793497, "driven_lanedir_consec": 6.797015960902462}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15665
1396
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 08:24:50+00:00 2022-11-25 08:27:24+00:00 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15662
1396
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 08:18:21+00:00 2022-11-25 08:24:43+00:00 0:06:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.000000000000009 in-drivable-lane_median 1.6999999999999953 driven_lanedir_consec_median 0.48906962484873706 deviation-center-line_median 0.6173250298219506
other stats deviation-center-line_max 1.48987340735174 deviation-center-line_mean 0.7236810400406165 deviation-center-line_min 0.17020069316682498 deviation-heading_max 5.787115413885615 deviation-heading_mean 4.097430658775629 deviation-heading_median 4.659848565593539 deviation-heading_min 1.2829100900298234 distance-from-start_max 0.6187081828095375 distance-from-start_mean 0.5085389266783515 distance-from-start_median 0.5325902286626009 distance-from-start_min 0.35026706657866696 driven_any_max 1.1827944367963457 driven_any_mean 0.84098988852643 driven_any_median 0.9007347936115092 driven_any_min 0.3796955300863558 driven_lanedir_consec_max 0.6438298199371708 driven_lanedir_consec_mean 0.4909600974912527 driven_lanedir_consec_min 0.3418713203303658 driven_lanedir_max 0.7775946901136608 driven_lanedir_mean 0.5784340155011491 driven_lanedir_median 0.597135025780285 driven_lanedir_min 0.3418713203303658 in-drivable-lane_max 5.150000000000016 in-drivable-lane_mean 2.137500000000002 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.99025000003118, "survival_time": 10.000000000000009, "driven_lanedir": 0.6446425824064272, "in-drivable-lane": 1.699999999999994, "deviation-heading": 4.96117753477311, "distance-from-start": 0.6094157250253215, "deviation-center-line": 0.5074764749184153, "driven_lanedir_consec": 0.6438298199371708}, "udem-000-ego1": {"driven_any": 1.1827944367963457, "survival_time": 10.000000000000009, "driven_lanedir": 0.7775946901136608, "in-drivable-lane": 1.6999999999999966, "deviation-heading": 4.358519596413968, "distance-from-start": 0.4557647322998802, "deviation-center-line": 0.7271735847254858, "driven_lanedir_consec": 0.4285117805433314}, "udem-000-ego2": {"driven_any": 0.8112195871918387, "survival_time": 10.000000000000009, "driven_lanedir": 0.5496274691541427, "in-drivable-lane": 5.150000000000016, "deviation-heading": 1.2829100900298234, "distance-from-start": 0.6187081828095375, "deviation-center-line": 0.17020069316682498, "driven_lanedir_consec": 0.5496274691541427}, "udem-000-ego3": {"driven_any": 0.3796955300863558, "survival_time": 10.000000000000009, "driven_lanedir": 0.3418713203303658, "in-drivable-lane": 0.0, "deviation-heading": 5.787115413885615, "distance-from-start": 0.35026706657866696, "deviation-center-line": 1.48987340735174, "driven_lanedir_consec": 0.3418713203303658}}simulation-passed 1 survival_time_max 10.000000000000009 survival_time_mean 10.000000000000009 survival_time_min 10.000000000000009
No reset possible 15659
1397
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 08:14:11+00:00 2022-11-25 08:17:50+00:00 0:03:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.75000000000006 in-drivable-lane_median 2.3999999999999995 driven_lanedir_consec_median 0.9223186471304862 deviation-center-line_median 0.970306719198916
other stats deviation-center-line_max 1.2406292490578297 deviation-center-line_mean 0.970306719198916 deviation-center-line_min 0.6999841893400024 deviation-heading_max 4.49004565214791 deviation-heading_mean 4.124005467207556 deviation-heading_median 4.124005467207556 deviation-heading_min 3.7579652822672007 distance-from-start_max 0.923927682743502 distance-from-start_mean 0.7499400326348766 distance-from-start_median 0.7499400326348766 distance-from-start_min 0.5759523825262511 driven_any_max 1.674158338252044 driven_any_mean 1.6741410756875486 driven_any_median 1.6741410756875486 driven_any_min 1.6741238131230531 driven_lanedir_consec_max 1.24286626899061 driven_lanedir_consec_mean 0.9223186471304862 driven_lanedir_consec_min 0.6017710252703623 driven_lanedir_max 1.24286626899061 driven_lanedir_mean 1.2167207757829153 driven_lanedir_median 1.2167207757829153 driven_lanedir_min 1.1905752825752205 in-drivable-lane_max 2.7000000000000064 in-drivable-lane_mean 2.3999999999999995 in-drivable-lane_min 2.0999999999999925 per-episodes details {"loop2-000-ego0": {"driven_any": 1.674158338252044, "survival_time": 13.75000000000006, "driven_lanedir": 1.1905752825752205, "in-drivable-lane": 2.7000000000000064, "deviation-heading": 4.49004565214791, "distance-from-start": 0.5759523825262511, "deviation-center-line": 0.6999841893400024, "driven_lanedir_consec": 0.6017710252703623}, "loop2-000-ego1": {"driven_any": 1.6741238131230531, "survival_time": 13.75000000000006, "driven_lanedir": 1.24286626899061, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 3.7579652822672007, "distance-from-start": 0.923927682743502, "deviation-center-line": 1.2406292490578297, "driven_lanedir_consec": 1.24286626899061}}simulation-passed 1 survival_time_max 13.75000000000006 survival_time_mean 13.75000000000006 survival_time_min 13.75000000000006
No reset possible 15654
1398
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 08:10:03+00:00 2022-11-25 08:14:04+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.300000000000225 in-drivable-lane_median 1.500000000000013 driven_lanedir_consec_median 2.927520448983847 deviation-center-line_median 1.8731302492483144
other stats deviation-center-line_max 1.8731302492483144 deviation-center-line_mean 1.8731302492483144 deviation-center-line_min 1.8731302492483144 deviation-heading_max 4.262334441942872 deviation-heading_mean 4.262334441942872 deviation-heading_median 4.262334441942872 deviation-heading_min 4.262334441942872 distance-from-start_max 2.2782687514174715 distance-from-start_mean 2.2782687514174715 distance-from-start_median 2.2782687514174715 distance-from-start_min 2.2782687514174715 driven_any_max 3.2077468095785635 driven_any_mean 3.2077468095785635 driven_any_median 3.2077468095785635 driven_any_min 3.2077468095785635 driven_lanedir_consec_max 2.927520448983847 driven_lanedir_consec_mean 2.927520448983847 driven_lanedir_consec_min 2.927520448983847 driven_lanedir_max 2.927520448983847 driven_lanedir_mean 2.927520448983847 driven_lanedir_median 2.927520448983847 driven_lanedir_min 2.927520448983847 in-drivable-lane_max 1.500000000000013 in-drivable-lane_mean 1.500000000000013 in-drivable-lane_min 1.500000000000013 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.2077468095785635, "survival_time": 25.300000000000225, "driven_lanedir": 2.927520448983847, "in-drivable-lane": 1.500000000000013, "deviation-heading": 4.262334441942872, "distance-from-start": 2.2782687514174715, "deviation-center-line": 1.8731302492483144, "driven_lanedir_consec": 2.927520448983847}}simulation-passed 1 survival_time_max 25.300000000000225 survival_time_mean 25.300000000000225 survival_time_min 25.300000000000225
No reset possible 15649
1400
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 08:04:24+00:00 2022-11-25 08:09:50+00:00 0:05:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.599999999999376 in-drivable-lane_median 3.099999999999902 driven_lanedir_consec_median 2.1822085786120473 deviation-center-line_median 4.281969506383752
other stats deviation-center-line_max 4.281969506383752 deviation-center-line_mean 4.281969506383752 deviation-center-line_min 4.281969506383752 deviation-heading_max 8.956926170181262 deviation-heading_mean 8.956926170181262 deviation-heading_median 8.956926170181262 deviation-heading_min 8.956926170181262 distance-from-start_max 1.84932503046977 distance-from-start_mean 1.84932503046977 distance-from-start_median 1.84932503046977 distance-from-start_min 1.84932503046977 driven_any_max 2.760582128240964 driven_any_mean 2.760582128240964 driven_any_median 2.760582128240964 driven_any_min 2.760582128240964 driven_lanedir_consec_max 2.1822085786120473 driven_lanedir_consec_mean 2.1822085786120473 driven_lanedir_consec_min 2.1822085786120473 driven_lanedir_max 2.5502818256429407 driven_lanedir_mean 2.5502818256429407 driven_lanedir_median 2.5502818256429407 driven_lanedir_min 2.5502818256429407 in-drivable-lane_max 3.099999999999902 in-drivable-lane_mean 3.099999999999902 in-drivable-lane_min 3.099999999999902 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}simulation-passed 1 survival_time_max 48.599999999999376 survival_time_mean 48.599999999999376 survival_time_min 48.599999999999376
No reset possible 15643
1401
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 07:54:07+00:00 2022-11-25 08:04:00+00:00 0:09:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.305858702972225 deviation-center-line_median 7.198939676780748
other stats deviation-center-line_max 7.198939676780748 deviation-center-line_mean 7.198939676780748 deviation-center-line_min 7.198939676780748 deviation-heading_max 5.347648671657762 deviation-heading_mean 5.347648671657762 deviation-heading_median 5.347648671657762 deviation-heading_min 5.347648671657762 distance-from-start_max 2.180674072281247 distance-from-start_mean 2.180674072281247 distance-from-start_median 2.180674072281247 distance-from-start_min 2.180674072281247 driven_any_max 3.476091095751902 driven_any_mean 3.476091095751902 driven_any_median 3.476091095751902 driven_any_min 3.476091095751902 driven_lanedir_consec_max 3.305858702972225 driven_lanedir_consec_mean 3.305858702972225 driven_lanedir_consec_min 3.305858702972225 driven_lanedir_max 3.305858702972225 driven_lanedir_mean 3.305858702972225 driven_lanedir_median 3.305858702972225 driven_lanedir_min 3.305858702972225 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"loop-000-ego0": {"driven_any": 3.476091095751902, "survival_time": 59.99999999999873, "driven_lanedir": 3.305858702972225, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.347648671657762, "distance-from-start": 2.180674072281247, "deviation-center-line": 7.198939676780748, "driven_lanedir_consec": 3.305858702972225}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15641
1402
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 07:52:14+00:00 2022-11-25 07:53:47+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15634
1403
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 07:36:03+00:00 2022-11-25 07:51:52+00:00 0:15:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.024999999999956 driven_lanedir_consec_median 2.7186759709641253 deviation-center-line_median 5.862131942992704
other stats deviation-center-line_max 6.8926428573142395 deviation-center-line_mean 5.678345665140167 deviation-center-line_min 4.0964759172610234 deviation-heading_max 8.918457822311643 deviation-heading_mean 7.081123884150349 deviation-heading_median 7.087670971017298 deviation-heading_min 5.2306957722551575 distance-from-start_max 2.8296782642090292 distance-from-start_mean 1.888864829800502 distance-from-start_median 1.639347737745438 distance-from-start_min 1.4470855795021027 driven_any_max 3.524090671773667 driven_any_mean 3.5147133774298376 driven_any_median 3.518834998148701 driven_any_min 3.4970928416482807 driven_lanedir_consec_max 3.391077995430446 driven_lanedir_consec_mean 2.708466243383813 driven_lanedir_consec_min 2.0054350361765554 driven_lanedir_max 3.391077995430446 driven_lanedir_mean 3.3679532290440797 driven_lanedir_median 3.3641150341728117 driven_lanedir_min 3.3525048524002488 in-drivable-lane_max 2.749999999999872 in-drivable-lane_mean 2.162499999999953 in-drivable-lane_min 1.8500000000000263 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5180863448801456, "survival_time": 59.99999999999873, "driven_lanedir": 3.373947912234794, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 6.8453385018692146, "distance-from-start": 1.6666260059194336, "deviation-center-line": 4.0964759172610234, "driven_lanedir_consec": 2.0054350361765554}, "autolab-000-ego1": {"driven_any": 3.524090671773667, "survival_time": 59.99999999999873, "driven_lanedir": 3.391077995430446, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 7.33000344016538, "distance-from-start": 2.8296782642090292, "deviation-center-line": 6.250381576789261, "driven_lanedir_consec": 3.391077995430446}, "autolab-000-ego2": {"driven_any": 3.4970928416482807, "survival_time": 59.99999999999873, "driven_lanedir": 3.354282156110829, "in-drivable-lane": 2.749999999999872, "deviation-heading": 5.2306957722551575, "distance-from-start": 1.612069469571442, "deviation-center-line": 6.8926428573142395, "driven_lanedir_consec": 3.354282156110829}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15629
1405
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 07:30:53+00:00 2022-11-25 07:35:35+00:00 0:04:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4203839696348646 deviation-center-line_median 4.904461575108174
other stats deviation-center-line_max 4.904461575108174 deviation-center-line_mean 4.904461575108174 deviation-center-line_min 4.904461575108174 deviation-heading_max 7.745124892472468 deviation-heading_mean 7.745124892472468 deviation-heading_median 7.745124892472468 deviation-heading_min 7.745124892472468 distance-from-start_max 1.2059816740532263 distance-from-start_mean 1.2059816740532263 distance-from-start_median 1.2059816740532263 distance-from-start_min 1.2059816740532263 driven_any_max 3.485084016237799 driven_any_mean 3.485084016237799 driven_any_median 3.485084016237799 driven_any_min 3.485084016237799 driven_lanedir_consec_max 1.4203839696348646 driven_lanedir_consec_mean 1.4203839696348646 driven_lanedir_consec_min 1.4203839696348646 driven_lanedir_max 3.2905245152042193 driven_lanedir_mean 3.2905245152042193 driven_lanedir_median 3.2905245152042193 driven_lanedir_min 3.2905245152042193 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084016237799, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905245152042193, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124892472468, "distance-from-start": 1.2059816740532263, "deviation-center-line": 4.904461575108174, "driven_lanedir_consec": 1.4203839696348646}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15624
1406
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 07:26:10+00:00 2022-11-25 07:30:26+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.05000000000008 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.6855434087750805 deviation-center-line_median 1.12957986069885
other stats deviation-center-line_max 1.12957986069885 deviation-center-line_mean 1.12957986069885 deviation-center-line_min 1.12957986069885 deviation-heading_max 1.951860613365137 deviation-heading_mean 1.951860613365137 deviation-heading_median 1.951860613365137 deviation-heading_min 1.951860613365137 distance-from-start_max 0.6890064762174344 distance-from-start_mean 0.6890064762174344 distance-from-start_median 0.6890064762174344 distance-from-start_min 0.6890064762174344 driven_any_max 0.8405923695951633 driven_any_mean 0.8405923695951633 driven_any_median 0.8405923695951633 driven_any_min 0.8405923695951633 driven_lanedir_consec_max 0.6855434087750805 driven_lanedir_consec_mean 0.6855434087750805 driven_lanedir_consec_min 0.6855434087750805 driven_lanedir_max 0.8262266008885575 driven_lanedir_mean 0.8262266008885575 driven_lanedir_median 0.8262266008885575 driven_lanedir_min 0.8262266008885575 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.8405923695951633, "survival_time": 15.05000000000008, "driven_lanedir": 0.8262266008885575, "in-drivable-lane": 0.0, "deviation-heading": 1.951860613365137, "distance-from-start": 0.6890064762174344, "deviation-center-line": 1.12957986069885, "driven_lanedir_consec": 0.6855434087750805}}simulation-passed 1 survival_time_max 15.05000000000008 survival_time_mean 15.05000000000008 survival_time_min 15.05000000000008
No reset possible 15622
1406
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 07:24:21+00:00 2022-11-25 07:25:55+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15617
1408
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 07:17:34+00:00 2022-11-25 07:24:06+00:00 0:06:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091626784820886 deviation-center-line_median 5.917240573756968
other stats deviation-center-line_max 5.917240573756968 deviation-center-line_mean 5.917240573756968 deviation-center-line_min 5.917240573756968 deviation-heading_max 8.389433025698892 deviation-heading_mean 8.389433025698892 deviation-heading_median 8.389433025698892 deviation-heading_min 8.389433025698892 distance-from-start_max 1.0307831250305386 distance-from-start_mean 1.0307831250305386 distance-from-start_median 1.0307831250305386 distance-from-start_min 1.0307831250305386 driven_any_max 3.4490819837243656 driven_any_mean 3.4490819837243656 driven_any_median 3.4490819837243656 driven_any_min 3.4490819837243656 driven_lanedir_consec_max 2.091626784820886 driven_lanedir_consec_mean 2.091626784820886 driven_lanedir_consec_min 2.091626784820886 driven_lanedir_max 3.203992280226659 driven_lanedir_mean 3.203992280226659 driven_lanedir_median 3.203992280226659 driven_lanedir_min 3.203992280226659 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15610
1409
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 07:10:11+00:00 2022-11-25 07:16:55+00:00 0:06:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.292103748604663 deviation-center-line_median 4.949281369491427
other stats deviation-center-line_max 4.949281369491427 deviation-center-line_mean 4.949281369491427 deviation-center-line_min 4.949281369491427 deviation-heading_max 5.605546349563034 deviation-heading_mean 5.605546349563034 deviation-heading_median 5.605546349563034 deviation-heading_min 5.605546349563034 distance-from-start_max 2.278496107947562 distance-from-start_mean 2.278496107947562 distance-from-start_median 2.278496107947562 distance-from-start_min 2.278496107947562 driven_any_max 3.5795858026067657 driven_any_mean 3.5795858026067657 driven_any_median 3.5795858026067657 driven_any_min 3.5795858026067657 driven_lanedir_consec_max 3.292103748604663 driven_lanedir_consec_mean 3.292103748604663 driven_lanedir_consec_min 3.292103748604663 driven_lanedir_max 3.53367274833897 driven_lanedir_mean 3.53367274833897 driven_lanedir_median 3.53367274833897 driven_lanedir_min 3.53367274833897 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795858026067657, "survival_time": 59.99999999999873, "driven_lanedir": 3.53367274833897, "in-drivable-lane": 0.0, "deviation-heading": 5.605546349563034, "distance-from-start": 2.278496107947562, "deviation-center-line": 4.949281369491427, "driven_lanedir_consec": 3.292103748604663}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15605
1411
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 06:52:42+00:00 2022-11-25 07:09:36+00:00 0:16:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.749999999999952 driven_lanedir_consec_median 3.3108429130678627 deviation-center-line_median 6.488612341525324
other stats deviation-center-line_max 7.194535652106716 deviation-center-line_mean 6.189132437353033 deviation-center-line_min 4.584769414254769 deviation-heading_max 5.1659907865965735 deviation-heading_mean 4.395400760189543 deviation-heading_median 4.246938088221968 deviation-heading_min 3.921736077717662 distance-from-start_max 2.702654291483946 distance-from-start_mean 2.5000234387240603 distance-from-start_median 2.696936207575508 distance-from-start_min 1.9035670482612792 driven_any_max 3.5795805678303996 driven_any_mean 3.511364143390294 driven_any_median 3.497093152571938 driven_any_min 3.4716897005868983 driven_lanedir_consec_max 3.392650989219845 driven_lanedir_consec_mean 3.3072216022018863 driven_lanedir_consec_min 3.2145495934519746 driven_lanedir_max 3.5546680924349143 driven_lanedir_mean 3.3922512713982065 driven_lanedir_median 3.361057245426797 driven_lanedir_min 3.2922225023043183 in-drivable-lane_max 3.5999999999999623 in-drivable-lane_mean 2.2749999999999666 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795805678303996, "survival_time": 59.99999999999873, "driven_lanedir": 3.5546680924349143, "in-drivable-lane": 0.0, "deviation-heading": 3.933442455386819, "distance-from-start": 1.9035670482612792, "deviation-center-line": 4.584769414254769, "driven_lanedir_consec": 3.2145495934519746}, "4way-000-ego1": {"driven_any": 3.4850923665530997, "survival_time": 59.99999999999873, "driven_lanedir": 3.329463323831407, "in-drivable-lane": 3.1499999999999595, "deviation-heading": 4.560433721057117, "distance-from-start": 2.702654291483946, "deviation-center-line": 7.194535652106716, "driven_lanedir_consec": 3.329463323831407}, "4way-000-ego2": {"driven_any": 3.509093938590777, "survival_time": 59.99999999999873, "driven_lanedir": 3.3926511670221866, "in-drivable-lane": 2.349999999999945, "deviation-heading": 3.921736077717662, "distance-from-start": 2.698831659135408, "deviation-center-line": 6.220267984933724, "driven_lanedir_consec": 3.392650989219845}, "4way-000-ego3": {"driven_any": 3.4716897005868983, "survival_time": 59.99999999999873, "driven_lanedir": 3.2922225023043183, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.1659907865965735, "distance-from-start": 2.695040756015608, "deviation-center-line": 6.756956698116925, "driven_lanedir_consec": 3.2922225023043183}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15603
1411
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 06:50:43+00:00 2022-11-25 06:52:11+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15596
1412
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 06:45:31+00:00 2022-11-25 06:50:36+00:00 0:05:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0916627772105003 deviation-center-line_median 5.917247390668543
other stats deviation-center-line_max 5.917247390668543 deviation-center-line_mean 5.917247390668543 deviation-center-line_min 5.917247390668543 deviation-heading_max 8.389432170044804 deviation-heading_mean 8.389432170044804 deviation-heading_median 8.389432170044804 deviation-heading_min 8.389432170044804 distance-from-start_max 1.030783297990397 distance-from-start_mean 1.030783297990397 distance-from-start_median 1.030783297990397 distance-from-start_min 1.030783297990397 driven_any_max 3.4490819837251045 driven_any_mean 3.4490819837251045 driven_any_median 3.4490819837251045 driven_any_min 3.4490819837251045 driven_lanedir_consec_max 2.0916627772105003 driven_lanedir_consec_mean 2.0916627772105003 driven_lanedir_consec_min 2.0916627772105003 driven_lanedir_max 3.204014087213283 driven_lanedir_mean 3.204014087213283 driven_lanedir_median 3.204014087213283 driven_lanedir_min 3.204014087213283 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4490819837251045, "survival_time": 59.99999999999873, "driven_lanedir": 3.204014087213283, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432170044804, "distance-from-start": 1.030783297990397, "deviation-center-line": 5.917247390668543, "driven_lanedir_consec": 2.0916627772105003}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15593
1414
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 06:41:36+00:00 2022-11-25 06:45:25+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.449999999999882 driven_lanedir_consec_median 3.3057932853077427 deviation-center-line_median 7.154226688493768
other stats deviation-center-line_max 7.154226688493768 deviation-center-line_mean 7.154226688493768 deviation-center-line_min 7.154226688493768 deviation-heading_max 5.348097201635609 deviation-heading_mean 5.348097201635609 deviation-heading_median 5.348097201635609 deviation-heading_min 5.348097201635609 distance-from-start_max 1.6303675543068192 distance-from-start_mean 1.6303675543068192 distance-from-start_median 1.6303675543068192 distance-from-start_min 1.6303675543068192 driven_any_max 3.47609109580057 driven_any_mean 3.47609109580057 driven_any_median 3.47609109580057 driven_any_min 3.47609109580057 driven_lanedir_consec_max 3.3057932853077427 driven_lanedir_consec_mean 3.3057932853077427 driven_lanedir_consec_min 3.3057932853077427 driven_lanedir_max 3.3057932853077427 driven_lanedir_mean 3.3057932853077427 driven_lanedir_median 3.3057932853077427 driven_lanedir_min 3.3057932853077427 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 3.449999999999882 in-drivable-lane_min 3.449999999999882 per-episodes details {"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15591
1415
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 06:39:50+00:00 2022-11-25 06:41:21+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15590
1415
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 06:38:04+00:00 2022-11-25 06:39:41+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15585
1416
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 06:28:18+00:00 2022-11-25 06:37:44+00:00 0:09:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4156597876014327 deviation-center-line_median 5.989789523960853
other stats deviation-center-line_max 8.495537949245412 deviation-center-line_mean 5.971732905101129 deviation-center-line_min 3.411814623237397 deviation-heading_max 5.897113234379067 deviation-heading_mean 4.048666897035051 deviation-heading_median 3.883494575102228 deviation-heading_min 2.53056520355668 distance-from-start_max 2.619089336031859 distance-from-start_mean 2.081728511655291 distance-from-start_median 2.273437348983144 distance-from-start_min 1.1609500126230166 driven_any_max 3.5795929797204047 driven_any_mean 3.0144689618920215 driven_any_median 3.5518420920250877 driven_any_min 1.3745986837975066 driven_lanedir_consec_max 3.4641594614086646 driven_lanedir_consec_mean 2.914869629053038 driven_lanedir_consec_min 1.3639994796006216 driven_lanedir_max 3.558362293690531 driven_lanedir_mean 2.9724232090689076 driven_lanedir_median 3.483665531492239 driven_lanedir_min 1.3639994796006216 in-drivable-lane_max 1.8499999999998948 in-drivable-lane_mean 0.4624999999999737 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.5795929797204047, "survival_time": 59.99999999999873, "driven_lanedir": 3.5411070899715265, "in-drivable-lane": 0.0, "deviation-heading": 5.897113234379067, "distance-from-start": 2.263048461522456, "deviation-center-line": 5.473740300006772, "driven_lanedir_consec": 3.4641594614086646}, "4way-000-ego1": {"driven_any": 3.524094913434593, "survival_time": 59.99999999999873, "driven_lanedir": 3.4262239730129513, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.513531876713755, "distance-from-start": 2.619089336031859, "deviation-center-line": 6.505838747914936, "driven_lanedir_consec": 3.4262237769992145}, "4way-000-ego2": {"driven_any": 3.579589270615582, "survival_time": 59.99999999999873, "driven_lanedir": 3.558362293690531, "in-drivable-lane": 0.0, "deviation-heading": 4.2534572734907, "distance-from-start": 2.2838262364438315, "deviation-center-line": 3.411814623237397, "driven_lanedir_consec": 3.4050957982036514}, "4way-000-ego3": {"driven_any": 1.3745986837975066, "survival_time": 59.99999999999873, "driven_lanedir": 1.3639994796006216, "in-drivable-lane": 0.0, "deviation-heading": 2.53056520355668, "distance-from-start": 1.1609500126230166, "deviation-center-line": 8.495537949245412, "driven_lanedir_consec": 1.3639994796006216}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15578
1419
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 06:23:59+00:00 2022-11-25 06:27:56+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204028644018567 deviation-center-line_median 4.903598525098628
other stats deviation-center-line_max 4.903598525098628 deviation-center-line_mean 4.903598525098628 deviation-center-line_min 4.903598525098628 deviation-heading_max 7.744574599008731 deviation-heading_mean 7.744574599008731 deviation-heading_median 7.744574599008731 deviation-heading_min 7.744574599008731 distance-from-start_max 1.2060007868632094 distance-from-start_mean 1.2060007868632094 distance-from-start_median 1.2060007868632094 distance-from-start_min 1.2060007868632094 driven_any_max 3.485084017697367 driven_any_mean 3.485084017697367 driven_any_median 3.485084017697367 driven_any_min 3.485084017697367 driven_lanedir_consec_max 1.4204028644018567 driven_lanedir_consec_mean 1.4204028644018567 driven_lanedir_consec_min 1.4204028644018567 driven_lanedir_max 3.290525892781009 driven_lanedir_mean 3.290525892781009 driven_lanedir_median 3.290525892781009 driven_lanedir_min 3.290525892781009 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084017697367, "survival_time": 59.99999999999873, "driven_lanedir": 3.290525892781009, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574599008731, "distance-from-start": 1.2060007868632094, "deviation-center-line": 4.903598525098628, "driven_lanedir_consec": 1.4204028644018567}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15572
1420
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 06:19:30+00:00 2022-11-25 06:23:45+00:00 0:04:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.241204615389226 deviation-center-line_median 4.759684198968496
other stats deviation-center-line_max 4.759684198968496 deviation-center-line_mean 4.759684198968496 deviation-center-line_min 4.759684198968496 deviation-heading_max 9.18078892152259 deviation-heading_mean 9.18078892152259 deviation-heading_median 9.18078892152259 deviation-heading_min 9.18078892152259 distance-from-start_max 1.6296054226673595 distance-from-start_mean 1.6296054226673595 distance-from-start_median 1.6296054226673595 distance-from-start_min 1.6296054226673595 driven_any_max 3.519583547683476 driven_any_mean 3.519583547683476 driven_any_median 3.519583547683476 driven_any_min 3.519583547683476 driven_lanedir_consec_max 2.241204615389226 driven_lanedir_consec_mean 2.241204615389226 driven_lanedir_consec_min 2.241204615389226 driven_lanedir_max 3.353584317203001 driven_lanedir_mean 3.353584317203001 driven_lanedir_median 3.353584317203001 driven_lanedir_min 3.353584317203001 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15565
1422
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 06:09:13+00:00 2022-11-25 06:19:08+00:00 0:09:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.04999999999999716 driven_lanedir_consec_median 3.105242381638413 deviation-center-line_median 4.2838554583648385
other stats deviation-center-line_max 6.480635029684861 deviation-center-line_mean 4.233458533023654 deviation-center-line_min 1.8854881856800791 deviation-heading_max 6.074433982916035 deviation-heading_mean 4.437287043141697 deviation-heading_median 4.190213879538641 deviation-heading_min 3.2942864305734707 distance-from-start_max 2.6219633070118125 distance-from-start_mean 2.3834433501492436 distance-from-start_median 2.3769915028957085 distance-from-start_min 2.157827087793745 driven_any_max 3.5765946322989515 driven_any_mean 3.229717557359504 driven_any_median 3.2158432856394445 driven_any_min 2.9105890258601756 driven_lanedir_consec_max 3.4606351955763963 driven_lanedir_consec_mean 3.0987684797264516 driven_lanedir_consec_min 2.723953960052584 driven_lanedir_max 3.5302995839808413 driven_lanedir_mean 3.1848735445261127 driven_lanedir_median 3.161506104690779 driven_lanedir_min 2.8861823847420505 in-drivable-lane_max 1.9499999999998892 in-drivable-lane_mean 0.5124999999999709 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.9105890258601756, "survival_time": 59.99999999999873, "driven_lanedir": 2.8861823847420505, "in-drivable-lane": 0.0, "deviation-heading": 6.074433982916035, "distance-from-start": 2.157827087793745, "deviation-center-line": 3.0576160910267776, "driven_lanedir_consec": 2.723953960052584}, "udem-000-ego1": {"driven_any": 3.521095053928605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4216564650122128, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2942864305734707, "distance-from-start": 2.6219633070118125, "deviation-center-line": 6.480635029684861, "driven_lanedir_consec": 3.4216564650122128}, "udem-000-ego2": {"driven_any": 2.9105915173502845, "survival_time": 59.99999999999873, "driven_lanedir": 2.9013557443693445, "in-drivable-lane": 0.0, "deviation-heading": 3.947864180395224, "distance-from-start": 2.395368409966694, "deviation-center-line": 1.8854881856800791, "driven_lanedir_consec": 2.7888282982646126}, "udem-000-ego3": {"driven_any": 3.5765946322989515, "survival_time": 59.99999999999873, "driven_lanedir": 3.5302995839808413, "in-drivable-lane": 0.09999999999999432, "deviation-heading": 4.432563578682058, "distance-from-start": 2.3586145958247235, "deviation-center-line": 5.5100948257029, "driven_lanedir_consec": 3.4606351955763963}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15559
1423
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 05:59:57+00:00 2022-11-25 06:08:43+00:00 0:08:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.74999999999931 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 2.833004579842016 deviation-center-line_median 4.613202410731162
other stats deviation-center-line_max 4.613202410731162 deviation-center-line_mean 4.613202410731162 deviation-center-line_min 4.613202410731162 deviation-heading_max 2.4939487126008157 deviation-heading_mean 2.4939487126008157 deviation-heading_median 2.4939487126008157 deviation-heading_min 2.4939487126008157 distance-from-start_max 2.3401405715621477 distance-from-start_mean 2.3401405715621477 distance-from-start_median 2.3401405715621477 distance-from-start_min 2.3401405715621477 driven_any_max 2.889596956965826 driven_any_mean 2.889596956965826 driven_any_median 2.889596956965826 driven_any_min 2.889596956965826 driven_lanedir_consec_max 2.833004579842016 driven_lanedir_consec_mean 2.833004579842016 driven_lanedir_consec_min 2.833004579842016 driven_lanedir_max 2.833004579842016 driven_lanedir_mean 2.833004579842016 driven_lanedir_median 2.833004579842016 driven_lanedir_min 2.833004579842016 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 1.0999999999999377 in-drivable-lane_min 1.0999999999999377 per-episodes details {"4way-001-ego0": {"driven_any": 2.889596956965826, "survival_time": 49.74999999999931, "driven_lanedir": 2.833004579842016, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939487126008157, "distance-from-start": 2.3401405715621477, "deviation-center-line": 4.613202410731162, "driven_lanedir_consec": 2.833004579842016}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 15554
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-04-6.2.51
2022-11-25 05:51:37+00:00 2022-11-25 05:59:32+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15548
1424
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 05:42:57+00:00 2022-11-25 05:51:23+00:00 0:08:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.1499999999999257 driven_lanedir_consec_median 3.3746337017701507 deviation-center-line_median 6.057454700328478
other stats deviation-center-line_max 6.384332084814334 deviation-center-line_mean 6.038904654854047 deviation-center-line_min 5.656377133944901 deviation-heading_max 7.471247478120028 deviation-heading_mean 6.581525379111778 deviation-heading_median 6.501228349070126 deviation-heading_min 5.8523973401868306 distance-from-start_max 2.955798853097406 distance-from-start_mean 2.2776980078429148 distance-from-start_median 2.4208015729281067 distance-from-start_min 1.313390032418041 driven_any_max 3.579593246505303 driven_any_mean 3.529302881163586 driven_any_median 3.515090515356918 driven_any_min 3.5074372474352056 driven_lanedir_consec_max 3.525823359544204 driven_lanedir_consec_mean 3.062863916917712 driven_lanedir_consec_min 1.9763649045863416 driven_lanedir_max 3.525823359544204 driven_lanedir_mean 3.4097663351344685 driven_lanedir_median 3.3746337017701507 driven_lanedir_min 3.3639745774533676 in-drivable-lane_max 2.400000000000034 in-drivable-lane_mean 1.6749999999999714 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.5195908422465023, "survival_time": 59.99999999999873, "driven_lanedir": 3.384110905730893, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.471247478120028, "distance-from-start": 2.2087786070849105, "deviation-center-line": 5.794137771901705, "driven_lanedir_consec": 3.384110905730893}, "autolab-000-ego2": {"driven_any": 3.5074372474352056, "survival_time": 59.99999999999873, "driven_lanedir": 3.3639745774533676, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8523973401868306, "distance-from-start": 1.313390032418041, "deviation-center-line": 6.320771628755251, "driven_lanedir_consec": 1.9763649045863416}, "autolab-000-ego3": {"driven_any": 3.5105901884673334, "survival_time": 59.99999999999873, "driven_lanedir": 3.365156497809408, "in-drivable-lane": 2.299999999999965, "deviation-heading": 6.180320457204967, "distance-from-start": 2.6328245387713025, "deviation-center-line": 6.384332084814334, "driven_lanedir_consec": 3.365156497809408}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15544
1425
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 05:36:11+00:00 2022-11-25 05:42:36+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.2655265789104 deviation-center-line_median 7.114511199103643
other stats deviation-center-line_max 7.114511199103643 deviation-center-line_mean 7.114511199103643 deviation-center-line_min 7.114511199103643 deviation-heading_max 5.702635580930089 deviation-heading_mean 5.702635580930089 deviation-heading_median 5.702635580930089 deviation-heading_min 5.702635580930089 distance-from-start_max 1.6303678440695035 distance-from-start_mean 1.6303678440695035 distance-from-start_median 1.6303678440695035 distance-from-start_min 1.6303678440695035 driven_any_max 3.466336917289666 driven_any_mean 3.466336917289666 driven_any_median 3.466336917289666 driven_any_min 3.466336917289666 driven_lanedir_consec_max 3.2655265789104 driven_lanedir_consec_mean 3.2655265789104 driven_lanedir_consec_min 3.2655265789104 driven_lanedir_max 3.2655265789104 driven_lanedir_mean 3.2655265789104 driven_lanedir_median 3.2655265789104 driven_lanedir_min 3.2655265789104 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15539
1427
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 05:30:58+00:00 2022-11-25 05:36:04+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.275400628096487 deviation-center-line_median 5.720691806105115
other stats deviation-center-line_max 5.720691806105115 deviation-center-line_mean 5.720691806105115 deviation-center-line_min 5.720691806105115 deviation-heading_max 5.389911935102068 deviation-heading_mean 5.389911935102068 deviation-heading_median 5.389911935102068 deviation-heading_min 5.389911935102068 distance-from-start_max 1.706973798275489 distance-from-start_mean 1.706973798275489 distance-from-start_median 1.706973798275489 distance-from-start_min 1.706973798275489 driven_any_max 3.5195876689872945 driven_any_mean 3.5195876689872945 driven_any_median 3.5195876689872945 driven_any_min 3.5195876689872945 driven_lanedir_consec_max 2.275400628096487 driven_lanedir_consec_mean 2.275400628096487 driven_lanedir_consec_min 2.275400628096487 driven_lanedir_max 3.387708520229716 driven_lanedir_mean 3.387708520229716 driven_lanedir_median 3.387708520229716 driven_lanedir_min 3.387708520229716 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5195876689872945, "survival_time": 59.99999999999873, "driven_lanedir": 3.387708520229716, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.389911935102068, "distance-from-start": 1.706973798275489, "deviation-center-line": 5.720691806105115, "driven_lanedir_consec": 2.275400628096487}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15533
1430
Bea Baselines 🐤minimal-agent aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 05:27:41+00:00 2022-11-25 05:30:39+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.04999999999998 in-drivable-lane_median 4.749999999999984 driven_lanedir_consec_median 0.331229062365487 deviation-center-line_median 0.26973530940385876
other stats deviation-center-line_max 0.26973530940385876 deviation-center-line_mean 0.26973530940385876 deviation-center-line_min 0.26973530940385876 deviation-heading_max 2.5383505748046193 deviation-heading_mean 2.5383505748046193 deviation-heading_median 2.5383505748046193 deviation-heading_min 2.5383505748046193 distance-from-start_max 1.1587848457868677 distance-from-start_mean 1.1587848457868677 distance-from-start_median 1.1587848457868677 distance-from-start_min 1.1587848457868677 driven_any_max 1.158841900114123 driven_any_mean 1.158841900114123 driven_any_median 1.158841900114123 driven_any_min 1.158841900114123 driven_lanedir_consec_max 0.331229062365487 driven_lanedir_consec_mean 0.331229062365487 driven_lanedir_consec_min 0.331229062365487 driven_lanedir_max 0.331229062365487 driven_lanedir_mean 0.331229062365487 driven_lanedir_median 0.331229062365487 driven_lanedir_min 0.331229062365487 in-drivable-lane_max 4.749999999999984 in-drivable-lane_mean 4.749999999999984 in-drivable-lane_min 4.749999999999984 per-episodes details {"4way-000-ego0": {"driven_any": 1.158841900114123, "survival_time": 8.04999999999998, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 4.749999999999984, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}}simulation-passed 1 survival_time_max 8.04999999999998 survival_time_mean 8.04999999999998 survival_time_min 8.04999999999998
No reset possible 15520
1433
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 05:21:44+00:00 2022-11-25 05:27:26+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.95000000000015 in-drivable-lane_median 15.575000000000143 driven_lanedir_consec_median 0.3010218083101922 deviation-center-line_median 0.3970118868681207
other stats deviation-center-line_max 2.2346112831306932 deviation-center-line_mean 0.7885775545340169 deviation-center-line_min 0.12567516126913286 deviation-heading_max 4.797258948144445 deviation-heading_mean 2.707299691495644 deviation-heading_median 2.642065173445396 deviation-heading_min 0.7478094709473367 distance-from-start_max 3.129125828735781 distance-from-start_mean 1.1662292771696292 distance-from-start_median 0.5771403828427081 distance-from-start_min 0.3815105142573194 driven_any_max 3.129843909463842 driven_any_mean 1.166415544369201 driven_any_median 0.5771503990770468 driven_any_min 0.3815174698588687 driven_lanedir_consec_max 0.7928447585809935 driven_lanedir_consec_mean 0.3886457893287136 driven_lanedir_consec_min 0.15969478211347665 driven_lanedir_max 0.8014890585195535 driven_lanedir_mean 0.39080686431335365 driven_lanedir_median 0.3010218083101922 driven_lanedir_min 0.15969478211347665 in-drivable-lane_max 18.50000000000015 in-drivable-lane_mean 12.412500000000112 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.3815174698588687, "survival_time": 19.95000000000015, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 18.20000000000015, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.3815105142573194, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.7395025092531806, "survival_time": 19.95000000000015, "driven_lanedir": 0.15969478211347665, "in-drivable-lane": 18.50000000000015, "deviation-heading": 0.7478094709473367, "distance-from-start": 0.7394902813305423, "deviation-center-line": 0.13562525098197173, "driven_lanedir_consec": 0.15969478211347665}, "udem-000-ego2": {"driven_any": 0.41479828890091297, "survival_time": 19.95000000000015, "driven_lanedir": 0.4024921356613664, "in-drivable-lane": 0.0, "deviation-heading": 4.797258948144445, "distance-from-start": 0.4147904843548739, "deviation-center-line": 2.2346112831306932, "driven_lanedir_consec": 0.4024921356613664}, "udem-000-ego3": {"driven_any": 3.129843909463842, "survival_time": 19.95000000000015, "driven_lanedir": 0.8014890585195535, "in-drivable-lane": 12.95000000000014, "deviation-heading": 4.335308391332746, "distance-from-start": 3.129125828735781, "deviation-center-line": 0.6583985227542697, "driven_lanedir_consec": 0.7928447585809935}}simulation-passed 1 survival_time_max 19.95000000000015 survival_time_mean 19.95000000000015 survival_time_min 19.95000000000015
No reset possible 15497
1437
Bea Baselines 🐤minimal-agent lx22-objdet
sim success yes davinci-stage-04-6.2.51
2022-11-25 05:09:02+00:00 2022-11-25 05:21:18+00:00 0:12:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 driven_lanedir_consec_median 3.766385412387078
other stats deviation-center-line_max 1.326684653251739 deviation-center-line_mean 1.1145360814864316 deviation-center-line_median 1.1145360814864316 deviation-center-line_min 0.9023875097211244 deviation-heading_max 0.9653478875423056 deviation-heading_mean 0.8614808538844678 deviation-heading_median 0.8614808538844678 deviation-heading_min 0.75761382022663 distance-from-start_max 9.8511235402485 distance-from-start_mean 9.83680867234296 distance-from-start_median 9.83680867234296 distance-from-start_min 9.822493804437425 driven_any_max 9.857519753799252 driven_any_mean 9.843192862723654 driven_any_median 9.843192862723654 driven_any_min 9.828865971648057 driven_lanedir_consec_max 5.116504350759583 driven_lanedir_consec_mean 3.766385412387078 driven_lanedir_consec_min 2.416266474014573 driven_lanedir_max 5.116504350759583 driven_lanedir_mean 3.766385412387078 driven_lanedir_median 3.766385412387078 driven_lanedir_min 2.416266474014573 in-drivable-lane_max 44.99999999999865 in-drivable-lane_mean 36.82499999999853 in-drivable-lane_median 36.82499999999853 in-drivable-lane_min 28.649999999998418 per-episodes details {"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.857519753799252, "survival_time": 59.99999999999873, "driven_lanedir": 5.116504350759583, "in-drivable-lane": 28.649999999998418, "deviation-heading": 0.9653478875423056, "distance-from-start": 9.8511235402485, "deviation-center-line": 1.326684653251739, "driven_lanedir_consec": 5.116504350759583}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 9.828865971648057, "survival_time": 59.99999999999873, "driven_lanedir": 2.416266474014573, "in-drivable-lane": 44.99999999999865, "deviation-heading": 0.75761382022663, "distance-from-start": 9.822493804437425, "deviation-center-line": 0.9023875097211244, "driven_lanedir_consec": 2.416266474014573}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15488
1447
Bea Baselines 🐤minimal-agent aido-LFV-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 05:03:46+00:00 2022-11-25 05:08:43+00:00 0:04:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.950000000000106 in-drivable-lane_median 10.550000000000091 driven_lanedir_consec_median 0.8098306254279477 deviation-center-line_median 0.6056754982599343
other stats deviation-center-line_max 0.6056754982599343 deviation-center-line_mean 0.6056754982599343 deviation-center-line_min 0.6056754982599343 deviation-heading_max 3.6841553172183903 deviation-heading_mean 3.6841553172183903 deviation-heading_median 3.6841553172183903 deviation-heading_min 3.6841553172183903 distance-from-start_max 2.628171879536872 distance-from-start_mean 2.628171879536872 distance-from-start_median 2.628171879536872 distance-from-start_min 2.628171879536872 driven_any_max 2.628857921604552 driven_any_mean 2.628857921604552 driven_any_median 2.628857921604552 driven_any_min 2.628857921604552 driven_lanedir_consec_max 0.8098306254279477 driven_lanedir_consec_mean 0.8098306254279477 driven_lanedir_consec_min 0.8098306254279477 driven_lanedir_max 0.8098306254279477 driven_lanedir_mean 0.8098306254279477 driven_lanedir_median 0.8098306254279477 driven_lanedir_min 0.8098306254279477 in-drivable-lane_max 10.550000000000091 in-drivable-lane_mean 10.550000000000091 in-drivable-lane_min 10.550000000000091 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.628857921604552, "survival_time": 16.950000000000106, "driven_lanedir": 0.8098306254279477, "in-drivable-lane": 10.550000000000091, "deviation-heading": 3.6841553172183903, "distance-from-start": 2.628171879536872, "deviation-center-line": 0.6056754982599343, "driven_lanedir_consec": 0.8098306254279477}}simulation-passed 1 survival_time_max 16.950000000000106 survival_time_mean 16.950000000000106 survival_time_min 16.950000000000106
No reset possible 15481
1448
Bea Baselines 🐤minimal-agent aido-LFVI-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 05:00:11+00:00 2022-11-25 05:03:33+00:00 0:03:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666480491623645 deviation-center-line_median 0.1078383533310603
other stats deviation-center-line_max 0.1078383533310603 deviation-center-line_mean 0.1078383533310603 deviation-center-line_min 0.1078383533310603 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 1.6182798682575184 distance-from-start_mean 1.6182798682575184 distance-from-start_median 1.6182798682575184 distance-from-start_min 1.6182798682575184 driven_any_max 1.6183892771013868 driven_any_mean 1.6183892771013868 driven_any_median 1.6183892771013868 driven_any_min 1.6183892771013868 driven_lanedir_consec_max 0.13666480491623645 driven_lanedir_consec_mean 0.13666480491623645 driven_lanedir_consec_min 0.13666480491623645 driven_lanedir_max 0.13666480491623645 driven_lanedir_mean 0.13666480491623645 driven_lanedir_median 0.13666480491623645 driven_lanedir_min 0.13666480491623645 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"4way-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 15476
1450
Bea Baselines 🐤minimal-agent aido-LF-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 04:57:42+00:00 2022-11-25 04:59:44+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.3224736988087771 survival_time_median 15.250000000000082 deviation-center-line_median 0.2741150615740815 in-drivable-lane_median 12.100000000000056
other stats deviation-center-line_max 0.2741150615740815 deviation-center-line_mean 0.2741150615740815 deviation-center-line_min 0.2741150615740815 deviation-heading_max 2.486301423131022 deviation-heading_mean 2.486301423131022 deviation-heading_median 2.486301423131022 deviation-heading_min 2.486301423131022 distance-from-start_max 2.346684322024178 distance-from-start_mean 2.346684322024178 distance-from-start_median 2.346684322024178 distance-from-start_min 2.346684322024178 driven_any_max 2.3472858269950745 driven_any_mean 2.3472858269950745 driven_any_median 2.3472858269950745 driven_any_min 2.3472858269950745 driven_lanedir_consec_max 0.3224736988087771 driven_lanedir_consec_mean 0.3224736988087771 driven_lanedir_consec_min 0.3224736988087771 driven_lanedir_max 0.3224736988087771 driven_lanedir_mean 0.3224736988087771 driven_lanedir_median 0.3224736988087771 driven_lanedir_min 0.3224736988087771 in-drivable-lane_max 12.100000000000056 in-drivable-lane_mean 12.100000000000056 in-drivable-lane_min 12.100000000000056 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.3472858269950745, "survival_time": 15.250000000000082, "driven_lanedir": 0.3224736988087771, "in-drivable-lane": 12.100000000000056, "deviation-heading": 2.486301423131022, "distance-from-start": 2.346684322024178, "deviation-center-line": 0.2741150615740815, "driven_lanedir_consec": 0.3224736988087771}}simulation-passed 1 survival_time_max 15.250000000000082 survival_time_mean 15.250000000000082 survival_time_min 15.250000000000082
No reset possible 15469
1451
Bea Baselines 🐤minimal-agent aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 04:54:15+00:00 2022-11-25 04:57:28+00:00 0:03:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.79999999999998 in-drivable-lane_median 6.174999999999979 driven_lanedir_consec_median 0.18712389148079245 deviation-center-line_median 0.15973064632096934
other stats deviation-center-line_max 0.25956483782942774 deviation-center-line_mean 0.17171613953350223 deviation-center-line_min 0.1078384276626425 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.7378303653221978 deviation-heading_median 0.7134396501489888 deviation-heading_min 0.5736373181558746 distance-from-start_max 1.1174703819521252 distance-from-start_mean 0.5801993351597357 distance-from-start_median 0.4397243952004576 distance-from-start_min 0.323878168285902 driven_any_max 1.1175260347648366 driven_any_mean 0.5802187299655663 driven_any_median 0.4397328577718137 driven_any_min 0.3238831695538013 driven_lanedir_consec_max 0.6843001798814146 driven_lanedir_consec_mean 0.2932298736878741 driven_lanedir_consec_min 0.11437153190849704 driven_lanedir_max 0.6843001798814146 driven_lanedir_mean 0.2932298736878741 driven_lanedir_median 0.18712389148079245 driven_lanedir_min 0.11437153190849704 in-drivable-lane_max 6.59999999999998 in-drivable-lane_mean 5.549999999999982 in-drivable-lane_min 3.2499999999999885 per-episodes details {"4way-000-ego0": {"driven_any": 0.5146585239873271, "survival_time": 7.79999999999998, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595184, "deviation-center-line": 0.1078384276626425, "driven_lanedir_consec": 0.13666599700910398}, "4way-000-ego1": {"driven_any": 0.3648071915563002, "survival_time": 7.79999999999998, "driven_lanedir": 0.23758178595248092, "in-drivable-lane": 5.94999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139674, "deviation-center-line": 0.20320962418622623, "driven_lanedir_consec": 0.23758178595248092}, "4way-000-ego2": {"driven_any": 1.1175260347648366, "survival_time": 7.79999999999998, "driven_lanedir": 0.6843001798814146, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.6676943794629474, "distance-from-start": 1.1174703819521252, "deviation-center-line": 0.25956483782942774, "driven_lanedir_consec": 0.6843001798814146}, "4way-000-ego3": {"driven_any": 0.3238831695538013, "survival_time": 7.79999999999998, "driven_lanedir": 0.11437153190849704, "in-drivable-lane": 6.59999999999998, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.323878168285902, "deviation-center-line": 0.11625166845571244, "driven_lanedir_consec": 0.11437153190849704}}simulation-passed 1 survival_time_max 7.79999999999998 survival_time_mean 7.79999999999998 survival_time_min 7.79999999999998
No reset possible 15467
1452
Bea Baselines 🐤minimal-agent aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 04:48:54+00:00 2022-11-25 04:54:06+00:00 0:05:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.200000000000069 in-drivable-lane_median 11.000000000000057 driven_lanedir_consec_median 0.3152938274760638 deviation-center-line_median 0.26684016190284265
other stats deviation-center-line_max 0.3356902421161755 deviation-center-line_mean 0.24640550413561532 deviation-center-line_min 0.11625145062060036 deviation-heading_max 2.486301423131022 deviation-heading_mean 1.563252755154394 deviation-heading_median 1.5495075837941936 deviation-heading_min 0.6676944298981667 distance-from-start_max 2.173942193160628 distance-from-start_mean 1.5951256386014727 distance-from-start_median 1.745851963918557 distance-from-start_min 0.7148564334081484 driven_any_max 2.174275713561512 driven_any_mean 1.595266942374297 driven_any_median 1.7459619017485188 driven_any_min 0.7148682524386378 driven_lanedir_consec_max 0.6842972359477595 driven_lanedir_consec_mean 0.3573150593764172 driven_lanedir_consec_min 0.11437534660578176 driven_lanedir_max 0.6842972359477595 driven_lanedir_mean 0.3573150593764172 driven_lanedir_median 0.3152938274760638 driven_lanedir_min 0.11437534660578176 in-drivable-lane_max 13.000000000000068 in-drivable-lane_mean 11.162500000000064 in-drivable-lane_min 9.650000000000077 per-episodes details {"loop-000-ego0": {"driven_any": 2.174275713561512, "survival_time": 14.200000000000069, "driven_lanedir": 0.3224767982503016, "in-drivable-lane": 11.050000000000042, "deviation-heading": 2.486301423131022, "distance-from-start": 2.173942193160628, "deviation-center-line": 0.27411484919814116, "driven_lanedir_consec": 0.3224767982503016}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 14.200000000000069, "driven_lanedir": 0.30811085670182603, "in-drivable-lane": 10.95000000000007, "deviation-heading": 2.339830246753357, "distance-from-start": 1.7251591376367597, "deviation-center-line": 0.3356902421161755, "driven_lanedir_consec": 0.30811085670182603}, "loop-000-ego2": {"driven_any": 1.766654784250807, "survival_time": 14.200000000000069, "driven_lanedir": 0.6842972359477595, "in-drivable-lane": 9.650000000000077, "deviation-heading": 0.6676944298981667, "distance-from-start": 1.7665447902003542, "deviation-center-line": 0.2595654746075442, "driven_lanedir_consec": 0.6842972359477595}, "loop-000-ego3": {"driven_any": 0.7148682524386378, "survival_time": 14.200000000000069, "driven_lanedir": 0.11437534660578176, "in-drivable-lane": 13.000000000000068, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.7148564334081484, "deviation-center-line": 0.11625145062060036, "driven_lanedir_consec": 0.11437534660578176}}simulation-passed 1 survival_time_max 14.200000000000069 survival_time_mean 14.200000000000069 survival_time_min 14.200000000000069
No reset possible 15465
1453
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 04:47:03+00:00 2022-11-25 04:48:26+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.14999999999999 in-drivable-lane_median 3.74999999999999 driven_lanedir_consec_median 0.13665955970746824 deviation-center-line_median 0.10783802485851962
other stats deviation-center-line_max 0.10783802485851962 deviation-center-line_mean 0.10783802485851962 deviation-center-line_min 0.10783802485851962 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 0.6813626821293306 distance-from-start_mean 0.6813626821293306 distance-from-start_median 0.6813626821293306 distance-from-start_min 0.6813626821293306 driven_any_max 0.6813744088473564 driven_any_mean 0.6813744088473564 driven_any_median 0.6813744088473564 driven_any_min 0.6813744088473564 driven_lanedir_consec_max 0.13665955970746824 driven_lanedir_consec_mean 0.13665955970746824 driven_lanedir_consec_min 0.13665955970746824 driven_lanedir_max 0.13665955970746824 driven_lanedir_mean 0.13665955970746824 driven_lanedir_median 0.13665955970746824 driven_lanedir_min 0.13665955970746824 in-drivable-lane_max 3.74999999999999 in-drivable-lane_mean 3.74999999999999 in-drivable-lane_min 3.74999999999999 per-episodes details {"autolab-000-ego0": {"driven_any": 0.6813744088473564, "survival_time": 5.14999999999999, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 3.74999999999999, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.6813626821293306, "deviation-center-line": 0.10783802485851962, "driven_lanedir_consec": 0.13665955970746824}}simulation-passed 1 survival_time_max 5.14999999999999 survival_time_mean 5.14999999999999 survival_time_min 5.14999999999999
No reset possible 15461
1453
Bea Baselines 🐤minimal-agent aido-LFP-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 04:44:41+00:00 2022-11-25 04:46:49+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.85000000000002 in-drivable-lane_median 9.45000000000002 driven_lanedir_consec_median 0.13666480491623578 deviation-center-line_median 0.10783813033632964
other stats deviation-center-line_max 0.10783813033632964 deviation-center-line_mean 0.10783813033632964 deviation-center-line_min 0.10783813033632964 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.9508048428349386 deviation-heading_median 0.9508048428349386 deviation-heading_min 0.9508048428349386 distance-from-start_max 1.6182798682575148 distance-from-start_mean 1.6182798682575148 distance-from-start_median 1.6182798682575148 distance-from-start_min 1.6182798682575148 driven_any_max 1.618389277101394 driven_any_mean 1.618389277101394 driven_any_median 1.618389277101394 driven_any_min 1.618389277101394 driven_lanedir_consec_max 0.13666480491623578 driven_lanedir_consec_mean 0.13666480491623578 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.13666480491623578 driven_lanedir_mean 0.13666480491623578 driven_lanedir_median 0.13666480491623578 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 9.45000000000002 in-drivable-lane_mean 9.45000000000002 in-drivable-lane_min 9.45000000000002 per-episodes details {"loop-000-ego0": {"driven_any": 1.618389277101394, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666480491623578}}simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 10.85000000000002 survival_time_min 10.85000000000002
No reset possible 15460
1454
Bea Baselines 🐤template-pytorch aido-LFV-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 04:42:09+00:00 2022-11-25 04:44:22+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.6499999999999986 in-drivable-lane_median 1.6999999999999984 driven_lanedir_consec_median 0.0971575696065381 deviation-center-line_median 0.04964386005899727
other stats deviation-center-line_max 0.04964386005899727 deviation-center-line_mean 0.04964386005899727 deviation-center-line_min 0.04964386005899727 deviation-heading_max 0.7234086909095354 deviation-heading_mean 0.7234086909095354 deviation-heading_median 0.7234086909095354 deviation-heading_min 0.7234086909095354 distance-from-start_max 0.3930242685624512 distance-from-start_mean 0.3930242685624512 distance-from-start_median 0.3930242685624512 distance-from-start_min 0.3930242685624512 driven_any_max 0.4069524141440449 driven_any_mean 0.4069524141440449 driven_any_median 0.4069524141440449 driven_any_min 0.4069524141440449 driven_lanedir_consec_max 0.0971575696065381 driven_lanedir_consec_mean 0.0971575696065381 driven_lanedir_consec_min 0.0971575696065381 driven_lanedir_max 0.0971575696065381 driven_lanedir_mean 0.0971575696065381 driven_lanedir_median 0.0971575696065381 driven_lanedir_min 0.0971575696065381 in-drivable-lane_max 1.6999999999999984 in-drivable-lane_mean 1.6999999999999984 in-drivable-lane_min 1.6999999999999984 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.4069524141440449, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0971575696065381, "in-drivable-lane": 1.6999999999999984, "deviation-heading": 0.7234086909095354, "distance-from-start": 0.3930242685624512, "deviation-center-line": 0.04964386005899727, "driven_lanedir_consec": 0.0971575696065381}}simulation-passed 1 survival_time_max 2.6499999999999986 survival_time_mean 2.6499999999999986 survival_time_min 2.6499999999999986
No reset possible 15449
1456
Bea Baselines 🐤template-pytorch aido-LFI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 04:31:31+00:00 2022-11-25 04:41:37+00:00 0:10:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 44.84999999999938 driven_lanedir_consec_median 1.529346060424126 deviation-center-line_median 1.3712877373027537
other stats deviation-center-line_max 1.3712877373027537 deviation-center-line_mean 1.3712877373027537 deviation-center-line_min 1.3712877373027537 deviation-heading_max 10.615162620956278 deviation-heading_mean 10.615162620956278 deviation-heading_median 10.615162620956278 deviation-heading_min 10.615162620956278 distance-from-start_max 0.36627249828646713 distance-from-start_mean 0.36627249828646713 distance-from-start_median 0.36627249828646713 distance-from-start_min 0.36627249828646713 driven_any_max 8.898160469131158 driven_any_mean 8.898160469131158 driven_any_median 8.898160469131158 driven_any_min 8.898160469131158 driven_lanedir_consec_max 1.529346060424126 driven_lanedir_consec_mean 1.529346060424126 driven_lanedir_consec_min 1.529346060424126 driven_lanedir_max 1.529346060424126 driven_lanedir_mean 1.529346060424126 driven_lanedir_median 1.529346060424126 driven_lanedir_min 1.529346060424126 in-drivable-lane_max 44.84999999999938 in-drivable-lane_mean 44.84999999999938 in-drivable-lane_min 44.84999999999938 per-episodes details {"udem1-000-ego0": {"driven_any": 8.898160469131158, "survival_time": 59.99999999999873, "driven_lanedir": 1.529346060424126, "in-drivable-lane": 44.84999999999938, "deviation-heading": 10.615162620956278, "distance-from-start": 0.36627249828646713, "deviation-center-line": 1.3712877373027537, "driven_lanedir_consec": 1.529346060424126}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15445
1457
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 04:27:00+00:00 2022-11-25 04:31:09+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1554826936813305 survival_time_median 19.650000000000144 deviation-center-line_median 0.13511342005875163 in-drivable-lane_median 18.150000000000137
other stats deviation-center-line_max 0.13511342005875163 deviation-center-line_mean 0.13511342005875163 deviation-center-line_min 0.13511342005875163 deviation-heading_max 0.9924533579045408 deviation-heading_mean 0.9924533579045408 deviation-heading_median 0.9924533579045408 deviation-heading_min 0.9924533579045408 distance-from-start_max 0.7350157839368916 distance-from-start_mean 0.7350157839368916 distance-from-start_median 0.7350157839368916 distance-from-start_min 0.7350157839368916 driven_any_max 3.5435978836301065 driven_any_mean 3.5435978836301065 driven_any_median 3.5435978836301065 driven_any_min 3.5435978836301065 driven_lanedir_consec_max 0.1554826936813305 driven_lanedir_consec_mean 0.1554826936813305 driven_lanedir_consec_min 0.1554826936813305 driven_lanedir_max 0.1554826936813305 driven_lanedir_mean 0.1554826936813305 driven_lanedir_median 0.1554826936813305 driven_lanedir_min 0.1554826936813305 in-drivable-lane_max 18.150000000000137 in-drivable-lane_mean 18.150000000000137 in-drivable-lane_min 18.150000000000137 per-episodes details {"loop-000-ego0": {"driven_any": 3.5435978836301065, "survival_time": 19.650000000000144, "driven_lanedir": 0.1554826936813305, "in-drivable-lane": 18.150000000000137, "deviation-heading": 0.9924533579045408, "distance-from-start": 0.7350157839368916, "deviation-center-line": 0.13511342005875163, "driven_lanedir_consec": 0.1554826936813305}}simulation-passed 1 survival_time_max 19.650000000000144 survival_time_mean 19.650000000000144 survival_time_min 19.650000000000144
No reset possible 15440
1554
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success no davinci-stage-04-6.2.51
2022-11-25 04:18:41+00:00 2022-11-25 04:26:47+00:00 0:08:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15439
1457
Bea Baselines 🐤template-pytorch aido-LF-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 04:11:53+00:00 2022-11-25 04:18:13+00:00 0:06:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.42315280295927626 survival_time_median 59.99999999999873 deviation-center-line_median 1.408632447137759 in-drivable-lane_median 44.899999999999075
other stats deviation-center-line_max 1.408632447137759 deviation-center-line_mean 1.408632447137759 deviation-center-line_min 1.408632447137759 deviation-heading_max 13.313770539613213 deviation-heading_mean 13.313770539613213 deviation-heading_median 13.313770539613213 deviation-heading_min 13.313770539613213 distance-from-start_max 0.6533800035089757 distance-from-start_mean 0.6533800035089757 distance-from-start_median 0.6533800035089757 distance-from-start_min 0.6533800035089757 driven_any_max 10.595376871147598 driven_any_mean 10.595376871147598 driven_any_median 10.595376871147598 driven_any_min 10.595376871147598 driven_lanedir_consec_max 0.42315280295927626 driven_lanedir_consec_mean 0.42315280295927626 driven_lanedir_consec_min 0.42315280295927626 driven_lanedir_max 1.5581345723328557 driven_lanedir_mean 1.5581345723328557 driven_lanedir_median 1.5581345723328557 driven_lanedir_min 1.5581345723328557 in-drivable-lane_max 44.899999999999075 in-drivable-lane_mean 44.899999999999075 in-drivable-lane_min 44.899999999999075 per-episodes details {"loop2-000-ego0": {"driven_any": 10.595376871147598, "survival_time": 59.99999999999873, "driven_lanedir": 1.5581345723328557, "in-drivable-lane": 44.899999999999075, "deviation-heading": 13.313770539613213, "distance-from-start": 0.6533800035089757, "deviation-center-line": 1.408632447137759, "driven_lanedir_consec": 0.42315280295927626}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15438
1458
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 04:10:09+00:00 2022-11-25 04:11:37+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15437
1458
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-validation
sim-1of4 host-error no davinci-stage-04-6.2.51
2022-11-25 04:07:33+00:00 2022-11-25 04:09:37+00:00 0:02:04 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 390, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15434
1459
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 03:56:41+00:00 2022-11-25 04:07:17+00:00 0:10:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 45.49999999999911 driven_lanedir_consec_median 1.3961645019130744 deviation-center-line_median 1.3881463058026138
other stats deviation-center-line_max 2.6878708487922536 deviation-center-line_mean 1.3881463058026138 deviation-center-line_min 0.08842176281297408 deviation-heading_max 18.48880214202066 deviation-heading_mean 9.55366900088886 deviation-heading_median 9.55366900088886 deviation-heading_min 0.6185358597570592 distance-from-start_max 1.0836623357430886 distance-from-start_mean 0.6967994275543938 distance-from-start_median 0.6967994275543938 distance-from-start_min 0.30993651936569916 driven_any_max 7.1062142492419955 driven_any_mean 3.709432803093973 driven_any_median 3.709432803093973 driven_any_min 0.31265135694595036 driven_lanedir_consec_max 2.6639730304366047 driven_lanedir_consec_mean 1.3961645019130744 driven_lanedir_consec_min 0.12835597338954408 driven_lanedir_max 2.6639730304366047 driven_lanedir_mean 1.3961645019130744 driven_lanedir_median 1.3961645019130744 driven_lanedir_min 0.12835597338954408 in-drivable-lane_max 58.94999999999872 in-drivable-lane_mean 45.49999999999911 in-drivable-lane_min 32.0499999999995 per-episodes details {"loop2-000-ego0": {"driven_any": 7.1062142492419955, "survival_time": 59.99999999999873, "driven_lanedir": 2.6639730304366047, "in-drivable-lane": 32.0499999999995, "deviation-heading": 18.48880214202066, "distance-from-start": 1.0836623357430886, "deviation-center-line": 2.6878708487922536, "driven_lanedir_consec": 2.6639730304366047}, "loop2-000-ego1": {"driven_any": 0.31265135694595036, "survival_time": 59.99999999999873, "driven_lanedir": 0.12835597338954408, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.6185358597570592, "distance-from-start": 0.30993651936569916, "deviation-center-line": 0.08842176281297408, "driven_lanedir_consec": 0.12835597338954408}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15428
1460
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 03:46:52+00:00 2022-11-25 03:56:33+00:00 0:09:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 56.44999999999874 driven_lanedir_consec_median 0.18305529659459577 deviation-center-line_median 0.23899269006304477
other stats deviation-center-line_max 0.23899269006304477 deviation-center-line_mean 0.23899269006304477 deviation-center-line_min 0.23899269006304477 deviation-heading_max 2.8398737934878695 deviation-heading_mean 2.8398737934878695 deviation-heading_median 2.8398737934878695 deviation-heading_min 2.8398737934878695 distance-from-start_max 0.976645522115132 distance-from-start_mean 0.976645522115132 distance-from-start_median 0.976645522115132 distance-from-start_min 0.976645522115132 driven_any_max 6.574021381337734 driven_any_mean 6.574021381337734 driven_any_median 6.574021381337734 driven_any_min 6.574021381337734 driven_lanedir_consec_max 0.18305529659459577 driven_lanedir_consec_mean 0.18305529659459577 driven_lanedir_consec_min 0.18305529659459577 driven_lanedir_max 0.18305529659459577 driven_lanedir_mean 0.18305529659459577 driven_lanedir_median 0.18305529659459577 driven_lanedir_min 0.18305529659459577 in-drivable-lane_max 56.44999999999874 in-drivable-lane_mean 56.44999999999874 in-drivable-lane_min 56.44999999999874 per-episodes details {"autolab-000-ego0": {"driven_any": 6.574021381337734, "survival_time": 59.99999999999873, "driven_lanedir": 0.18305529659459577, "in-drivable-lane": 56.44999999999874, "deviation-heading": 2.8398737934878695, "distance-from-start": 0.976645522115132, "deviation-center-line": 0.23899269006304477, "driven_lanedir_consec": 0.18305529659459577}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15427
1460
Bea Baselines 🐤template-pytorch aido-LFP-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 03:44:58+00:00 2022-11-25 03:46:37+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.25 in-drivable-lane_median 1.1499999999999997 driven_lanedir_consec_median 0.12248439126934808 deviation-center-line_median 0.06884214821091866
other stats deviation-center-line_max 0.06884214821091866 deviation-center-line_mean 0.06884214821091866 deviation-center-line_min 0.06884214821091866 deviation-heading_max 0.7945753899590251 deviation-heading_mean 0.7945753899590251 deviation-heading_median 0.7945753899590251 deviation-heading_min 0.7945753899590251 distance-from-start_max 0.24779518037486783 distance-from-start_mean 0.24779518037486783 distance-from-start_median 0.24779518037486783 distance-from-start_min 0.24779518037486783 driven_any_max 0.25943731488648497 driven_any_mean 0.25943731488648497 driven_any_median 0.25943731488648497 driven_any_min 0.25943731488648497 driven_lanedir_consec_max 0.12248439126934808 driven_lanedir_consec_mean 0.12248439126934808 driven_lanedir_consec_min 0.12248439126934808 driven_lanedir_max 0.12248439126934808 driven_lanedir_mean 0.12248439126934808 driven_lanedir_median 0.12248439126934808 driven_lanedir_min 0.12248439126934808 in-drivable-lane_max 1.1499999999999997 in-drivable-lane_mean 1.1499999999999997 in-drivable-lane_min 1.1499999999999997 per-episodes details {"loop-000-ego0": {"driven_any": 0.25943731488648497, "survival_time": 2.25, "driven_lanedir": 0.12248439126934808, "in-drivable-lane": 1.1499999999999997, "deviation-heading": 0.7945753899590251, "distance-from-start": 0.24779518037486783, "deviation-center-line": 0.06884214821091866, "driven_lanedir_consec": 0.12248439126934808}}simulation-passed 1 survival_time_max 2.25 survival_time_mean 2.25 survival_time_min 2.25
No reset possible 15421
1465
Bea Baselines 🐤template-pytorch lx22-BV1
sim-3of5 success no davinci-stage-04-6.2.51
2022-11-25 03:37:31+00:00 2022-11-25 03:44:32+00:00 0:07:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.2084303266753938
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.2084303266753938 distance-from-start_median 0.2084303266753938 distance-from-start_min 0.2084303266753938 driven_any_max 4.748912990059565 driven_any_mean 4.748912990059565 driven_any_median 4.748912990059565 driven_any_min 4.748912990059565 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 50.199999999999285 in-drivable-lane_mean 50.199999999999285 in-drivable-lane_median 50.199999999999285 in-drivable-lane_min 50.199999999999285 per-episodes details {"d50-ego0": {"driven_any": 4.748912990059565, "survival_time": 50.199999999999285, "driven_lanedir": 0.0, "in-drivable-lane": 50.199999999999285, "deviation-heading": 0.0, "distance-from-start": 0.2084303266753938, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 50.199999999999285 survival_time_mean 50.199999999999285 survival_time_median 50.199999999999285 survival_time_min 50.199999999999285
No reset possible 15418
1465
Bea Baselines 🐤template-pytorch lx22-BV1
sim-1of5 success no davinci-stage-04-6.2.51
2022-11-25 03:34:42+00:00 2022-11-25 03:37:10+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5698308375055094
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5698308375055094 distance-from-start_median 0.5698308375055094 distance-from-start_min 0.5698308375055094 driven_any_max 1.9628907079120048 driven_any_mean 1.9628907079120048 driven_any_median 1.9628907079120048 driven_any_min 1.9628907079120048 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 11.750000000000032 in-drivable-lane_mean 11.750000000000032 in-drivable-lane_median 11.750000000000032 in-drivable-lane_min 11.750000000000032 per-episodes details {"d45-ego0": {"driven_any": 1.9628907079120048, "survival_time": 11.750000000000032, "driven_lanedir": 0.0, "in-drivable-lane": 11.750000000000032, "deviation-heading": 0.0, "distance-from-start": 0.5698308375055094, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 11.750000000000032 survival_time_mean 11.750000000000032 survival_time_median 11.750000000000032 survival_time_min 11.750000000000032
No reset possible 15417
1468
Bea Baselines 🐤template-pytorch aido-hello-sim-validation
sanity-check success no davinci-stage-04-6.2.51
2022-11-25 03:33:25+00:00 2022-11-25 03:34:36+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.024346144257733737 deviation-center-line_median 0.005601787298636326
other stats deviation-center-line_max 0.005601787298636326 deviation-center-line_mean 0.005601787298636326 deviation-center-line_min 0.005601787298636326 deviation-heading_max 0.3075269285536246 deviation-heading_mean 0.3075269285536246 deviation-heading_median 0.3075269285536246 deviation-heading_min 0.3075269285536246 distance-from-start_max 0.03213992781469227 distance-from-start_mean 0.03213992781469227 distance-from-start_median 0.03213992781469227 distance-from-start_min 0.03213992781469227 driven_any_max 0.03228338218125903 driven_any_mean 0.03228338218125903 driven_any_median 0.03228338218125903 driven_any_min 0.03228338218125903 driven_lanedir_consec_max 0.024346144257733737 driven_lanedir_consec_mean 0.024346144257733737 driven_lanedir_consec_min 0.024346144257733737 driven_lanedir_max 0.024346144257733737 driven_lanedir_mean 0.024346144257733737 driven_lanedir_median 0.024346144257733737 driven_lanedir_min 0.024346144257733737 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03228338218125903, "survival_time": 0.49999999999999994, "driven_lanedir": 0.024346144257733737, "in-drivable-lane": 0.0, "deviation-heading": 0.3075269285536246, "distance-from-start": 0.03213992781469227, "deviation-center-line": 0.005601787298636326, "driven_lanedir_consec": 0.024346144257733737}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 15416
1472
Bea Baselines 🐤template-pytorch aido-LFV-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 03:29:12+00:00 2022-11-25 03:33:16+00:00 0:04:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.750000000000018 in-drivable-lane_median 8.450000000000014 driven_lanedir_consec_median 0.18147256668197095 deviation-center-line_median 0.12751849722524336
other stats deviation-center-line_max 0.12751849722524336 deviation-center-line_mean 0.12751849722524336 deviation-center-line_min 0.12751849722524336 deviation-heading_max 1.7967143922263558 deviation-heading_mean 1.7967143922263558 deviation-heading_median 1.7967143922263558 deviation-heading_min 1.7967143922263558 distance-from-start_max 0.26174093482115174 distance-from-start_mean 0.26174093482115174 distance-from-start_median 0.26174093482115174 distance-from-start_min 0.26174093482115174 driven_any_max 1.539262520351819 driven_any_mean 1.539262520351819 driven_any_median 1.539262520351819 driven_any_min 1.539262520351819 driven_lanedir_consec_max 0.18147256668197095 driven_lanedir_consec_mean 0.18147256668197095 driven_lanedir_consec_min 0.18147256668197095 driven_lanedir_max 0.1904001505109525 driven_lanedir_mean 0.1904001505109525 driven_lanedir_median 0.1904001505109525 driven_lanedir_min 0.1904001505109525 in-drivable-lane_max 8.450000000000014 in-drivable-lane_mean 8.450000000000014 in-drivable-lane_min 8.450000000000014 per-episodes details {"loop-000-ego0": {"driven_any": 1.539262520351819, "survival_time": 10.750000000000018, "driven_lanedir": 0.1904001505109525, "in-drivable-lane": 8.450000000000014, "deviation-heading": 1.7967143922263558, "distance-from-start": 0.26174093482115174, "deviation-center-line": 0.12751849722524336, "driven_lanedir_consec": 0.18147256668197095}}simulation-passed 1 survival_time_max 10.750000000000018 survival_time_mean 10.750000000000018 survival_time_min 10.750000000000018
No reset possible 15403
1476
Bea Baselines 🐤template-pytorch aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 03:08:22+00:00 2022-11-25 03:29:04+00:00 0:20:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 55.674999999998704 driven_lanedir_consec_median 0.34576508967272135 deviation-center-line_median 0.4212636353185951
other stats deviation-center-line_max 2.226508144491143 deviation-center-line_mean 0.770122700873575 deviation-center-line_min 0.01145538836596703 deviation-heading_max 23.084689815717837 deviation-heading_mean 7.605001802191307 deviation-heading_median 3.417810225872243 deviation-heading_min 0.4996969413029039 distance-from-start_max 0.8570185958165677 distance-from-start_mean 0.3800993957188042 distance-from-start_median 0.30312974807551174 distance-from-start_min 0.05711949090762563 driven_any_max 8.78556473364672 driven_any_mean 3.216947456801634 driven_any_median 2.007927131663458 driven_any_min 0.06637083023290166 driven_lanedir_consec_max 1.122738474446361 driven_lanedir_consec_mean 0.4594957253294219 driven_lanedir_consec_min 0.023714247525883803 driven_lanedir_max 3.227276262693847 driven_lanedir_mean 1.1137683155817033 driven_lanedir_median 0.6020413760535415 driven_lanedir_min 0.023714247525883803 in-drivable-lane_max 59.09999999999873 in-drivable-lane_mean 49.587499999998954 in-drivable-lane_min 27.89999999999969 per-episodes details {"4way-000-ego0": {"driven_any": 3.9307985684892457, "survival_time": 59.99999999999873, "driven_lanedir": 1.16888774585345, "in-drivable-lane": 52.34999999999869, "deviation-heading": 6.146991917106684, "distance-from-start": 0.8570185958165677, "deviation-center-line": 0.7650969769065914, "driven_lanedir_consec": 1.122738474446361}, "4way-000-ego1": {"driven_any": 0.06637083023290166, "survival_time": 59.99999999999873, "driven_lanedir": 0.03519500625363303, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.6886285346378023, "distance-from-start": 0.05711949090762563, "deviation-center-line": 0.07743029373059884, "driven_lanedir_consec": 0.03519500625363303}, "4way-000-ego2": {"driven_any": 0.08505569483767053, "survival_time": 59.99999999999873, "driven_lanedir": 0.023714247525883803, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.4996969413029039, "distance-from-start": 0.06573359087221857, "deviation-center-line": 0.01145538836596703, "driven_lanedir_consec": 0.023714247525883803}, "4way-000-ego3": {"driven_any": 8.78556473364672, "survival_time": 59.99999999999873, "driven_lanedir": 3.227276262693847, "in-drivable-lane": 27.89999999999969, "deviation-heading": 23.084689815717837, "distance-from-start": 0.540525905278805, "deviation-center-line": 2.226508144491143, "driven_lanedir_consec": 0.6563351730918097}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15394
1477
Bea Baselines 🐤template-pytorch aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 02:44:48+00:00 2022-11-25 03:07:59+00:00 0:23:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.04999999999875 driven_lanedir_consec_median 0.7065503830623663 deviation-center-line_median 0.622524662243883
other stats deviation-center-line_max 1.814263494544616 deviation-center-line_mean 0.800131638600073 deviation-center-line_min 0.14121373536790982 deviation-heading_max 23.62094815322469 deviation-heading_mean 8.235755761821371 deviation-heading_median 4.398053628810916 deviation-heading_min 0.5259676364389662 distance-from-start_max 1.0637662959747425 distance-from-start_mean 0.8323455476115962 distance-from-start_median 0.7791274544945619 distance-from-start_min 0.7073609854825181 driven_any_max 8.07258431686075 driven_any_mean 4.666715695947609 driven_any_median 4.940029362755562 driven_any_min 0.7142197414185635 driven_lanedir_consec_max 1.05616264157413 driven_lanedir_consec_mean 0.7063279409685325 driven_lanedir_consec_min 0.3560483561752674 driven_lanedir_max 1.4306356252348538 driven_lanedir_mean 0.8102659708776969 driven_lanedir_median 0.7271899510503332 driven_lanedir_min 0.3560483561752674 in-drivable-lane_max 57.79999999999873 in-drivable-lane_mean 48.699999999998894 in-drivable-lane_min 30.89999999999933 per-episodes details {"loop-000-ego0": {"driven_any": 5.141657251181424, "survival_time": 59.99999999999873, "driven_lanedir": 0.3560483561752674, "in-drivable-lane": 56.84999999999873, "deviation-heading": 2.06283609837067, "distance-from-start": 0.8242461902335529, "deviation-center-line": 0.21943301039844784, "driven_lanedir_consec": 0.3560483561752674}, "loop-000-ego1": {"driven_any": 4.738401474329699, "survival_time": 59.99999999999873, "driven_lanedir": 1.05616264157413, "in-drivable-lane": 30.89999999999933, "deviation-heading": 23.62094815322469, "distance-from-start": 0.7340087187555708, "deviation-center-line": 1.814263494544616, "driven_lanedir_consec": 1.05616264157413}, "loop-000-ego2": {"driven_any": 0.7142197414185635, "survival_time": 59.99999999999873, "driven_lanedir": 0.3982172605265366, "in-drivable-lane": 57.79999999999873, "deviation-heading": 0.5259676364389662, "distance-from-start": 0.7073609854825181, "deviation-center-line": 0.14121373536790982, "driven_lanedir_consec": 0.3982172605265366}, "loop-000-ego3": {"driven_any": 8.07258431686075, "survival_time": 59.99999999999873, "driven_lanedir": 1.4306356252348538, "in-drivable-lane": 49.24999999999877, "deviation-heading": 6.733271159251163, "distance-from-start": 1.0637662959747425, "deviation-center-line": 1.0256163140893182, "driven_lanedir_consec": 1.014883505598196}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15385
1479
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 02:29:01+00:00 2022-11-25 02:44:23+00:00 0:15:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.69999999999937 in-drivable-lane_median 36.64999999999927 driven_lanedir_consec_median 0.27329071924012593 deviation-center-line_median 0.8940598330260409
other stats deviation-center-line_max 0.8940598330260409 deviation-center-line_mean 0.8940598330260409 deviation-center-line_min 0.8940598330260409 deviation-heading_max 9.653852545002117 deviation-heading_mean 9.653852545002117 deviation-heading_median 9.653852545002117 deviation-heading_min 9.653852545002117 distance-from-start_max 1.1351054760255814 distance-from-start_mean 1.1351054760255814 distance-from-start_median 1.1351054760255814 distance-from-start_min 1.1351054760255814 driven_any_max 12.221812291295889 driven_any_mean 12.221812291295889 driven_any_median 12.221812291295889 driven_any_min 12.221812291295889 driven_lanedir_consec_max 0.27329071924012593 driven_lanedir_consec_mean 0.27329071924012593 driven_lanedir_consec_min 0.27329071924012593 driven_lanedir_max 0.26112935377464863 driven_lanedir_mean 0.26112935377464863 driven_lanedir_median 0.26112935377464863 driven_lanedir_min 0.26112935377464863 in-drivable-lane_max 36.64999999999927 in-drivable-lane_mean 36.64999999999927 in-drivable-lane_min 36.64999999999927 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}simulation-passed 1 survival_time_max 48.69999999999937 survival_time_mean 48.69999999999937 survival_time_min 48.69999999999937
No reset possible 15379
1481
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 02:26:29+00:00 2022-11-25 02:28:35+00:00 0:02:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.3901743521234762 deviation-center-line_median 0.17124897035562428
other stats deviation-center-line_max 0.17124897035562428 deviation-center-line_mean 0.17124897035562428 deviation-center-line_min 0.17124897035562428 deviation-heading_max 1.70314180472416 deviation-heading_mean 1.70314180472416 deviation-heading_median 1.70314180472416 deviation-heading_min 1.70314180472416 distance-from-start_max 0.4028556303039793 distance-from-start_mean 0.4028556303039793 distance-from-start_median 0.4028556303039793 distance-from-start_min 0.4028556303039793 driven_any_max 0.42407645028397256 driven_any_mean 0.42407645028397256 driven_any_median 0.42407645028397256 driven_any_min 0.42407645028397256 driven_lanedir_consec_max 0.3901743521234762 driven_lanedir_consec_mean 0.3901743521234762 driven_lanedir_consec_min 0.3901743521234762 driven_lanedir_max 0.3901743521234762 driven_lanedir_mean 0.3901743521234762 driven_lanedir_median 0.3901743521234762 driven_lanedir_min 0.3901743521234762 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.42407645028397256, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3901743521234762, "in-drivable-lane": 0.9, "deviation-heading": 1.70314180472416, "distance-from-start": 0.4028556303039793, "deviation-center-line": 0.17124897035562428, "driven_lanedir_consec": 0.3901743521234762}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 15377
1481
Bea Baselines 🐤template-random aido-LFI-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 02:24:48+00:00 2022-11-25 02:26:22+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15370
1483
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 02:08:42+00:00 2022-11-25 02:24:32+00:00 0:15:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.19999999999969 driven_lanedir_consec_median 0.1481685404123385 deviation-center-line_median 0.6130052941053471
other stats deviation-center-line_max 6.361236990588696 deviation-center-line_mean 1.968961967548878 deviation-center-line_min 0.28860029139612103 deviation-heading_max 22.59467278731015 deviation-heading_mean 9.325639720688413 deviation-heading_median 6.178891513015082 deviation-heading_min 2.350103069413334 distance-from-start_max 1.0093404360059293 distance-from-start_mean 0.6788871313560756 distance-from-start_median 0.651676229557197 distance-from-start_min 0.40285563030397936 driven_any_max 10.522906217249696 driven_any_mean 4.533111394485939 driven_any_median 3.592731455205004 driven_any_min 0.4240764502840531 driven_lanedir_consec_max 0.3902130173718561 driven_lanedir_consec_mean 0.1975964492168203 driven_lanedir_consec_min 0.10383569867074804 driven_lanedir_max 0.3902130173718561 driven_lanedir_mean 0.18988251265665312 driven_lanedir_median 0.1348795225002798 driven_lanedir_min 0.09955798825419682 in-drivable-lane_max 39.84999999999967 in-drivable-lane_mean 27.787499999999763 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 15364
1484
Bea Baselines 🐤template-random aido-LFV_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 02:00:16+00:00 2022-11-25 02:08:34+00:00 0:08:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 37.09999999999956 driven_lanedir_consec_median 0.23705557260553295 deviation-center-line_median 0.6463758558852182
other stats deviation-center-line_max 0.7555292890833561 deviation-center-line_mean 0.6463758558852182 deviation-center-line_min 0.5372224226870801 deviation-heading_max 5.523299123594233 deviation-heading_mean 5.0377292657796975 deviation-heading_median 5.0377292657796975 deviation-heading_min 4.552159407965162 distance-from-start_max 1.0442247976691843 distance-from-start_mean 0.9534278048696496 distance-from-start_median 0.9534278048696496 distance-from-start_min 0.8626308120701148 driven_any_max 11.376062002465083 driven_any_mean 9.15341861992026 driven_any_median 9.15341861992026 driven_any_min 6.9307752373754345 driven_lanedir_consec_max 0.26764947507969805 driven_lanedir_consec_mean 0.23705557260553295 driven_lanedir_consec_min 0.20646167013136785 driven_lanedir_max 0.2496387990426845 driven_lanedir_mean 0.2213862628967403 driven_lanedir_median 0.2213862628967403 driven_lanedir_min 0.1931337267507961 in-drivable-lane_max 37.649999999999565 in-drivable-lane_mean 37.09999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 15360
1485
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 01:56:15+00:00 2022-11-25 02:00:03+00:00 0:03:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.200000000000195 in-drivable-lane_median 14.65000000000017 driven_lanedir_consec_median 0.2737852330803683 deviation-center-line_median 0.7687318160431588
other stats deviation-center-line_max 0.7687318160431588 deviation-center-line_mean 0.7687318160431588 deviation-center-line_min 0.7687318160431588 deviation-heading_max 5.758343085491201 deviation-heading_mean 5.758343085491201 deviation-heading_median 5.758343085491201 deviation-heading_min 5.758343085491201 distance-from-start_max 0.7357883576773739 distance-from-start_mean 0.7357883576773739 distance-from-start_median 0.7357883576773739 distance-from-start_min 0.7357883576773739 driven_any_max 5.318401064622404 driven_any_mean 5.318401064622404 driven_any_median 5.318401064622404 driven_any_min 5.318401064622404 driven_lanedir_consec_max 0.2737852330803683 driven_lanedir_consec_mean 0.2737852330803683 driven_lanedir_consec_min 0.2737852330803683 driven_lanedir_max 0.2557745570433345 driven_lanedir_mean 0.2557745570433345 driven_lanedir_median 0.2557745570433345 driven_lanedir_min 0.2557745570433345 in-drivable-lane_max 14.65000000000017 in-drivable-lane_mean 14.65000000000017 in-drivable-lane_min 14.65000000000017 per-episodes details {"autolab-000-ego0": {"driven_any": 5.318401064622404, "survival_time": 23.200000000000195, "driven_lanedir": 0.2557745570433345, "in-drivable-lane": 14.65000000000017, "deviation-heading": 5.758343085491201, "distance-from-start": 0.7357883576773739, "deviation-center-line": 0.7687318160431588, "driven_lanedir_consec": 0.2737852330803683}}simulation-passed 1 survival_time_max 23.200000000000195 survival_time_mean 23.200000000000195 survival_time_min 23.200000000000195
No reset possible 15357
1488
Bea Baselines 🐤template-random lx22-visservoing
sim success yes davinci-stage-04-6.2.51
2022-11-25 01:50:24+00:00 2022-11-25 01:56:07+00:00 0:05:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 23.174999999999663 deviation-center-line_median 1.1846435027267537 driven_lanedir_consec_median 0.4119359833831363 survival_time_median 35.84999999999938
other stats deviation-center-line_max 2.053692550333513 deviation-center-line_mean 1.1846435027267537 deviation-center-line_min 0.31559445511999407 deviation-heading_max 15.80459948077375 deviation-heading_mean 9.065579449172477 deviation-heading_median 9.065579449172477 deviation-heading_min 2.326559417571199 distance-from-start_max 1.4108418329398822 distance-from-start_mean 0.9784996704397644 distance-from-start_median 0.9784996704397644 distance-from-start_min 0.5461575079396466 driven_any_max 15.326310847370593 driven_any_mean 8.912150167222187 driven_any_median 8.912150167222187 driven_any_min 2.497989487073779 driven_lanedir_consec_max 0.6105561181479094 driven_lanedir_consec_mean 0.4119359833831363 driven_lanedir_consec_min 0.21331584861836328 driven_lanedir_max 0.5974394680482642 driven_lanedir_mean 0.40241777001121354 driven_lanedir_median 0.40241777001121354 driven_lanedir_min 0.20739607197416288 in-drivable-lane_max 38.19999999999931 in-drivable-lane_mean 23.174999999999663 in-drivable-lane_min 8.150000000000023 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 2.497989487073779, "survival_time": 11.700000000000031, "driven_lanedir": 0.20739607197416288, "in-drivable-lane": 8.150000000000023, "deviation-heading": 2.326559417571199, "distance-from-start": 0.5461575079396466, "deviation-center-line": 0.31559445511999407, "driven_lanedir_consec": 0.21331584861836328}, "LF-small-loop-001-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.5974394680482642, "in-drivable-lane": 38.19999999999931, "deviation-heading": 15.80459948077375, "distance-from-start": 1.4108418329398822, "deviation-center-line": 2.053692550333513, "driven_lanedir_consec": 0.6105561181479094}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 35.84999999999938 survival_time_min 11.700000000000031
No reset possible 15342
1498
Bea Baselines 🐤template-random aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 01:35:40+00:00 2022-11-25 01:50:03+00:00 0:14:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 55.54999999999898 in-drivable-lane_median 33.999999999999304 driven_lanedir_consec_median 0.23486935510848683 deviation-center-line_median 1.9152361710618249
other stats deviation-center-line_max 1.9152361710618249 deviation-center-line_mean 1.9152361710618249 deviation-center-line_min 1.9152361710618249 deviation-heading_max 18.76264857218657 deviation-heading_mean 18.76264857218657 deviation-heading_median 18.76264857218657 deviation-heading_min 18.76264857218657 distance-from-start_max 1.290574960120657 distance-from-start_mean 1.290574960120657 distance-from-start_median 1.290574960120657 distance-from-start_min 1.290574960120657 driven_any_max 13.766585811745278 driven_any_mean 13.766585811745278 driven_any_median 13.766585811745278 driven_any_min 13.766585811745278 driven_lanedir_consec_max 0.23486935510848683 driven_lanedir_consec_mean 0.23486935510848683 driven_lanedir_consec_min 0.23486935510848683 driven_lanedir_max 0.22765090740773952 driven_lanedir_mean 0.22765090740773952 driven_lanedir_median 0.22765090740773952 driven_lanedir_min 0.22765090740773952 in-drivable-lane_max 33.999999999999304 in-drivable-lane_mean 33.999999999999304 in-drivable-lane_min 33.999999999999304 per-episodes details {"udem-000-ego0": {"driven_any": 13.766585811745278, "survival_time": 55.54999999999898, "driven_lanedir": 0.22765090740773952, "in-drivable-lane": 33.999999999999304, "deviation-heading": 18.76264857218657, "distance-from-start": 1.290574960120657, "deviation-center-line": 1.9152361710618249, "driven_lanedir_consec": 0.23486935510848683}}simulation-passed 1 survival_time_max 55.54999999999898 survival_time_mean 55.54999999999898 survival_time_min 55.54999999999898
No reset possible 15329
1502
Bea Baselines 🐤template-random aido-LFV_multi-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 01:12:34+00:00 2022-11-25 01:35:07+00:00 0:22:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.199999999998774 in-drivable-lane_median 51.49999999999876 driven_lanedir_consec_median 0.21853936665470375 deviation-center-line_median 0.6558628477973304
other stats deviation-center-line_max 1.3919847015555789 deviation-center-line_mean 0.81620218081524 deviation-center-line_min 0.56109832611072 deviation-heading_max 9.906601177812297 deviation-heading_mean 5.728605671043064 deviation-heading_median 4.536008719589965 deviation-heading_min 3.9358040671800296 distance-from-start_max 1.3543782763136274 distance-from-start_mean 1.0494456679466913 distance-from-start_median 1.023653168809703 distance-from-start_min 0.7960980578537311 driven_any_max 14.612175482594528 driven_any_mean 10.218740534833987 driven_any_median 10.08333461358712 driven_any_min 6.09611742956719 driven_lanedir_consec_max 0.24555746228952957 driven_lanedir_consec_mean 0.20899163900592865 driven_lanedir_consec_min 0.15333036042477757 driven_lanedir_max 0.2358197494342854 driven_lanedir_mean 0.19479761986375457 driven_lanedir_median 0.2060280026190392 driven_lanedir_min 0.1313147247826545 in-drivable-lane_max 52.39999999999874 in-drivable-lane_mean 50.149999999998734 in-drivable-lane_min 45.19999999999868 per-episodes details {"loop-000-ego0": {"driven_any": 14.612175482594528, "survival_time": 59.199999999998774, "driven_lanedir": 0.2358197494342854, "in-drivable-lane": 45.19999999999868, "deviation-heading": 9.906601177812297, "distance-from-start": 1.3543782763136274, "deviation-center-line": 1.3919847015555789, "driven_lanedir_consec": 0.24555746228952957}, "loop-000-ego1": {"driven_any": 11.349124250612942, "survival_time": 59.199999999998774, "driven_lanedir": 0.22565943649319545, "in-drivable-lane": 51.14999999999877, "deviation-heading": 4.17325696101659, "distance-from-start": 1.0442247976692065, "deviation-center-line": 0.6271479250601518, "driven_lanedir_consec": 0.2397934631518233}, "loop-000-ego2": {"driven_any": 6.09611742956719, "survival_time": 59.199999999998774, "driven_lanedir": 0.1313147247826545, "in-drivable-lane": 52.39999999999874, "deviation-heading": 3.9358040671800296, "distance-from-start": 0.7960980578537311, "deviation-center-line": 0.684577770534509, "driven_lanedir_consec": 0.15333036042477757}, "loop-000-ego3": {"driven_any": 8.817544976561296, "survival_time": 59.199999999998774, "driven_lanedir": 0.18639656874488297, "in-drivable-lane": 51.849999999998744, "deviation-heading": 4.898760478163339, "distance-from-start": 1.0030815399501998, "deviation-center-line": 0.56109832611072, "driven_lanedir_consec": 0.19728527015758424}}simulation-passed 1 survival_time_max 59.199999999998774 survival_time_mean 59.199999999998774 survival_time_min 59.199999999998774
No reset possible 15323
1503
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 01:06:16+00:00 2022-11-25 01:11:59+00:00 0:05:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.7499999999996 driven_lanedir_consec_median 0.054336775833862205 deviation-center-line_median 0.6346586353316823
other stats deviation-center-line_max 0.6346586353316823 deviation-center-line_mean 0.6346586353316823 deviation-center-line_min 0.6346586353316823 deviation-heading_max 5.904235246936354 deviation-heading_mean 5.904235246936354 deviation-heading_median 5.904235246936354 deviation-heading_min 5.904235246936354 distance-from-start_max 1.009340436005913 distance-from-start_mean 1.009340436005913 distance-from-start_median 1.009340436005913 distance-from-start_min 1.009340436005913 driven_any_max 10.522906217249686 driven_any_mean 10.522906217249686 driven_any_median 10.522906217249686 driven_any_min 10.522906217249686 driven_lanedir_consec_max 0.054336775833862205 driven_lanedir_consec_mean 0.054336775833862205 driven_lanedir_consec_min 0.054336775833862205 driven_lanedir_max 0.05768311793249614 driven_lanedir_mean 0.05768311793249614 driven_lanedir_median 0.05768311793249614 driven_lanedir_min 0.05768311793249614 in-drivable-lane_max 35.7499999999996 in-drivable-lane_mean 35.7499999999996 in-drivable-lane_min 35.7499999999996 per-episodes details {"loop-000-ego0": {"driven_any": 10.522906217249686, "survival_time": 43.29999999999968, "driven_lanedir": 0.05768311793249614, "in-drivable-lane": 35.7499999999996, "deviation-heading": 5.904235246936354, "distance-from-start": 1.009340436005913, "deviation-center-line": 0.6346586353316823, "driven_lanedir_consec": 0.054336775833862205}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 15318
1504
Bea Baselines 🐤template-ros aido-LFV-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 01:03:28+00:00 2022-11-25 01:06:10+00:00 0:02:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.649999999999981 in-drivable-lane_median 6.599999999999981 driven_lanedir_consec_median 0.15327655684778208 deviation-center-line_median 0.0644974174496923
other stats deviation-center-line_max 0.0644974174496923 deviation-center-line_mean 0.0644974174496923 deviation-center-line_min 0.0644974174496923 deviation-heading_max 0.6715626050120009 deviation-heading_mean 0.6715626050120009 deviation-heading_median 0.6715626050120009 deviation-heading_min 0.6715626050120009 distance-from-start_max 1.8953799856652844 distance-from-start_mean 1.8953799856652844 distance-from-start_median 1.8953799856652844 distance-from-start_min 1.8953799856652844 driven_any_max 1.930829639230796 driven_any_mean 1.930829639230796 driven_any_median 1.930829639230796 driven_any_min 1.930829639230796 driven_lanedir_consec_max 0.15327655684778208 driven_lanedir_consec_mean 0.15327655684778208 driven_lanedir_consec_min 0.15327655684778208 driven_lanedir_max 0.15327655684778208 driven_lanedir_mean 0.15327655684778208 driven_lanedir_median 0.15327655684778208 driven_lanedir_min 0.15327655684778208 in-drivable-lane_max 6.599999999999981 in-drivable-lane_mean 6.599999999999981 in-drivable-lane_min 6.599999999999981 per-episodes details {"loop-000-ego0": {"driven_any": 1.930829639230796, "survival_time": 7.649999999999981, "driven_lanedir": 0.15327655684778208, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.6715626050120009, "distance-from-start": 1.8953799856652844, "deviation-center-line": 0.0644974174496923, "driven_lanedir_consec": 0.15327655684778208}}simulation-passed 1 survival_time_max 7.649999999999981 survival_time_mean 7.649999999999981 survival_time_min 7.649999999999981
No reset possible 15312
1506
Bea Baselines 🐤template-ros aido-LFI-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 01:00:53+00:00 2022-11-25 01:03:00+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.249999999999993 in-drivable-lane_median 3.3499999999999925 driven_lanedir_consec_median 0.1359775641287699 deviation-center-line_median 0.05348393574028397
other stats deviation-center-line_max 0.05348393574028397 deviation-center-line_mean 0.05348393574028397 deviation-center-line_min 0.05348393574028397 deviation-heading_max 0.6106870497099331 deviation-heading_mean 0.6106870497099331 deviation-heading_median 0.6106870497099331 deviation-heading_min 0.6106870497099331 distance-from-start_max 0.9459491264812796 distance-from-start_mean 0.9459491264812796 distance-from-start_median 0.9459491264812796 distance-from-start_min 0.9459491264812796 driven_any_max 0.9697839443655054 driven_any_mean 0.9697839443655054 driven_any_median 0.9697839443655054 driven_any_min 0.9697839443655054 driven_lanedir_consec_max 0.1359775641287699 driven_lanedir_consec_mean 0.1359775641287699 driven_lanedir_consec_min 0.1359775641287699 driven_lanedir_max 0.1359775641287699 driven_lanedir_mean 0.1359775641287699 driven_lanedir_median 0.1359775641287699 driven_lanedir_min 0.1359775641287699 in-drivable-lane_max 3.3499999999999925 in-drivable-lane_mean 3.3499999999999925 in-drivable-lane_min 3.3499999999999925 per-episodes details {"udem1-000-ego0": {"driven_any": 0.9697839443655054, "survival_time": 4.249999999999993, "driven_lanedir": 0.1359775641287699, "in-drivable-lane": 3.3499999999999925, "deviation-heading": 0.6106870497099331, "distance-from-start": 0.9459491264812796, "deviation-center-line": 0.05348393574028397, "driven_lanedir_consec": 0.1359775641287699}}simulation-passed 1 survival_time_max 4.249999999999993 survival_time_mean 4.249999999999993 survival_time_min 4.249999999999993
No reset possible 15305
1508
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-25 00:56:51+00:00 2022-11-25 01:00:21+00:00 0:03:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.299999999999989 in-drivable-lane_median 3.774999999999989 driven_lanedir_consec_median 0.3449701674084662 deviation-center-line_median 0.1390258374395318
other stats deviation-center-line_max 0.20172978415151016 deviation-center-line_mean 0.1319583612751783 deviation-center-line_min 0.048051986070139434 deviation-heading_max 1.3066826673135543 deviation-heading_mean 0.744500411210149 deviation-heading_median 0.5798111699560544 deviation-heading_min 0.5116966376149327 distance-from-start_max 1.238237717899888 distance-from-start_mean 0.9321746138540572 distance-from-start_median 0.9617436143702334 distance-from-start_min 0.5669735087758746 driven_any_max 1.343391570978007 driven_any_mean 0.9915536842542864 driven_any_median 1.0202407857281168 driven_any_min 0.5823415945829049 driven_lanedir_consec_max 0.5770859377745708 driven_lanedir_consec_mean 0.3480608416830602 driven_lanedir_consec_min 0.12521709414073734 driven_lanedir_max 0.5770859377745708 driven_lanedir_mean 0.3480608416830602 driven_lanedir_median 0.3449701674084662 driven_lanedir_min 0.12521709414073734 in-drivable-lane_max 4.399999999999989 in-drivable-lane_mean 3.67499999999999 in-drivable-lane_min 2.749999999999992 per-episodes details {"4way-000-ego0": {"driven_any": 0.7820507948648737, "survival_time": 5.299999999999989, "driven_lanedir": 0.12521709414073734, "in-drivable-lane": 4.399999999999989, "deviation-heading": 0.6209888948050064, "distance-from-start": 0.7616943150643272, "deviation-center-line": 0.048051986070139434, "driven_lanedir_consec": 0.12521709414073734}, "4way-000-ego1": {"driven_any": 0.5823415945829049, "survival_time": 5.299999999999989, "driven_lanedir": 0.1394579297236529, "in-drivable-lane": 4.349999999999989, "deviation-heading": 0.5386334451071024, "distance-from-start": 0.5669735087758746, "deviation-center-line": 0.08456660557047599, "driven_lanedir_consec": 0.1394579297236529}, "4way-000-ego2": {"driven_any": 1.343391570978007, "survival_time": 5.299999999999989, "driven_lanedir": 0.5770859377745708, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.5116966376149327, "distance-from-start": 1.1617929136761396, "deviation-center-line": 0.20172978415151016, "driven_lanedir_consec": 0.5770859377745708}, "4way-000-ego3": {"driven_any": 1.25843077659136, "survival_time": 5.299999999999989, "driven_lanedir": 0.5504824050932795, "in-drivable-lane": 2.749999999999992, "deviation-heading": 1.3066826673135543, "distance-from-start": 1.238237717899888, "deviation-center-line": 0.1934850693085876, "driven_lanedir_consec": 0.5504824050932795}}simulation-passed 1 survival_time_max 5.299999999999989 survival_time_mean 5.299999999999989 survival_time_min 5.299999999999989
No reset possible 15298
1509
Bea Baselines 🐤template-ros aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 00:53:18+00:00 2022-11-25 00:56:43+00:00 0:03:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.549999999999981 in-drivable-lane_median 5.9999999999999805 driven_lanedir_consec_median 0.3038973503812593 deviation-center-line_median 0.11634124534815216
other stats deviation-center-line_max 0.17609193476546975 deviation-center-line_mean 0.11847337717476449 deviation-center-line_min 0.06511908323728388 deviation-heading_max 0.8691672294566 deviation-heading_mean 0.6677435635371763 deviation-heading_median 0.6254390009737818 deviation-heading_min 0.5509290227445418 distance-from-start_max 1.7683927743011347 distance-from-start_mean 1.1432126401624365 distance-from-start_median 1.2567523555872515 distance-from-start_min 0.2909530751741074 driven_any_max 1.968456748694957 driven_any_mean 1.2398385337035696 driven_any_median 1.3476732545546066 driven_any_min 0.29555087701010824 driven_lanedir_consec_max 0.7732669015340048 driven_lanedir_consec_mean 0.3865628858753864 driven_lanedir_consec_min 0.16518994120502217 driven_lanedir_max 0.7732669015340048 driven_lanedir_mean 0.3865628858753864 driven_lanedir_median 0.3038973503812593 driven_lanedir_min 0.16518994120502217 in-drivable-lane_max 6.499999999999981 in-drivable-lane_mean 5.737499999999982 in-drivable-lane_min 4.449999999999984 per-episodes details {"autolab-000-ego0": {"driven_any": 0.29555087701010824, "survival_time": 7.549999999999981, "driven_lanedir": 0.16518994120502217, "in-drivable-lane": 6.499999999999981, "deviation-heading": 0.6410327785441896, "distance-from-start": 0.2909530751741074, "deviation-center-line": 0.06511908323728388, "driven_lanedir_consec": 0.16518994120502217}, "autolab-000-ego1": {"driven_any": 1.968456748694957, "survival_time": 7.549999999999981, "driven_lanedir": 0.16624174417310078, "in-drivable-lane": 6.499999999999981, "deviation-heading": 0.5509290227445418, "distance-from-start": 1.7683927743011347, "deviation-center-line": 0.09671892258725566, "driven_lanedir_consec": 0.16624174417310078}, "autolab-000-ego2": {"driven_any": 1.096853080591688, "survival_time": 7.549999999999981, "driven_lanedir": 0.44155295658941784, "in-drivable-lane": 5.4999999999999805, "deviation-heading": 0.609845223403374, "distance-from-start": 1.0838856190155215, "deviation-center-line": 0.17609193476546975, "driven_lanedir_consec": 0.44155295658941784}, "autolab-000-ego3": {"driven_any": 1.598493428517525, "survival_time": 7.549999999999981, "driven_lanedir": 0.7732669015340048, "in-drivable-lane": 4.449999999999984, "deviation-heading": 0.8691672294566, "distance-from-start": 1.429619092158982, "deviation-center-line": 0.13596356810904864, "driven_lanedir_consec": 0.7732669015340048}}simulation-passed 1 survival_time_max 7.549999999999981 survival_time_mean 7.549999999999981 survival_time_min 7.549999999999981
No reset possible 15292
1514
Bea Baselines 🐤template-ros lx22-state-estimation
sim success yes davinci-stage-04-6.2.51
2022-11-25 00:49:56+00:00 2022-11-25 00:52:59+00:00 0:03:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6718485392841359 survival_time_median 8.09999999999998 deviation-center-line_median 0.24120125839347137 in-drivable-lane_median 5.599999999999983
other stats deviation-center-line_max 0.4187418456906367 deviation-center-line_mean 0.2575348358399989 deviation-center-line_min 0.11266140343588862 deviation-heading_max 1.1369666467464674 deviation-heading_mean 0.9376935487727742 deviation-heading_median 0.952213774752598 deviation-heading_min 0.723900224819257 distance-from-start_max 2.4078722972534243 distance-from-start_mean 2.0294722755833807 distance-from-start_median 2.0387799592477736 distance-from-start_min 1.6417645702489445 driven_any_max 2.763960318863959 driven_any_mean 2.182215884327482 driven_any_median 2.0995062590775073 driven_any_min 1.6831810750409806 driven_lanedir_consec_max 1.2242586213369155 driven_lanedir_consec_mean 0.8149004221922799 driven_lanedir_consec_min 0.5485941059557882 driven_lanedir_max 1.2242586213369155 driven_lanedir_mean 0.8149004221922799 driven_lanedir_median 0.6718485392841359 driven_lanedir_min 0.5485941059557882 in-drivable-lane_max 6.100000000000023 in-drivable-lane_mean 5.233333333333331 in-drivable-lane_min 3.999999999999986 per-episodes details {"LF-zig-zag-000-ego0": {"driven_any": 1.6831810750409806, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6718485392841359, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.723900224819257, "distance-from-start": 1.6417645702489445, "deviation-center-line": 0.11266140343588862, "driven_lanedir_consec": 0.6718485392841359}, "LF-zig-zag-001-ego0": {"driven_any": 2.763960318863959, "survival_time": 10.450000000000014, "driven_lanedir": 1.2242586213369155, "in-drivable-lane": 6.100000000000023, "deviation-heading": 0.952213774752598, "distance-from-start": 2.4078722972534243, "deviation-center-line": 0.4187418456906367, "driven_lanedir_consec": 1.2242586213369155}, "LF-zig-zag-002-ego0": {"driven_any": 2.0995062590775073, "survival_time": 8.09999999999998, "driven_lanedir": 0.5485941059557882, "in-drivable-lane": 5.599999999999983, "deviation-heading": 1.1369666467464674, "distance-from-start": 2.0387799592477736, "deviation-center-line": 0.24120125839347137, "driven_lanedir_consec": 0.5485941059557882}}simulation-passed 1 survival_time_max 10.450000000000014 survival_time_mean 8.483333333333325 survival_time_min 6.8999999999999835
No reset possible 15286
1515
Bea Baselines 🐤template-ros lx22-BV1
sim-3of5 success no davinci-stage-04-6.2.51
2022-11-25 00:47:41+00:00 2022-11-25 00:49:42+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.5437401173636058
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.5437401173636058 distance-from-start_median 1.5437401173636058 distance-from-start_min 1.5437401173636058 driven_any_max 1.5695315154632516 driven_any_mean 1.5695315154632516 driven_any_median 1.5695315154632516 driven_any_min 1.5695315154632516 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 6.249999999999986 in-drivable-lane_mean 6.249999999999986 in-drivable-lane_median 6.249999999999986 in-drivable-lane_min 6.249999999999986 per-episodes details {"d50-ego0": {"driven_any": 1.5695315154632516, "survival_time": 6.249999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 6.249999999999986, "deviation-heading": 0.0, "distance-from-start": 1.5437401173636058, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 6.249999999999986 survival_time_mean 6.249999999999986 survival_time_median 6.249999999999986 survival_time_min 6.249999999999986
No reset possible 15281
1523
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 00:43:56+00:00 2022-11-25 00:47:17+00:00 0:03:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.999999999999993 in-drivable-lane_median 6.499999999999981 driven_lanedir_consec_median 0.1863779478005123 deviation-center-line_median 0.26304083401538153
other stats deviation-center-line_max 0.26304083401538153 deviation-center-line_mean 0.26304083401538153 deviation-center-line_min 0.26304083401538153 deviation-heading_max 2.7893624348021873 deviation-heading_mean 2.7893624348021873 deviation-heading_median 2.7893624348021873 deviation-heading_min 2.7893624348021873 distance-from-start_max 2.218301255603608 distance-from-start_mean 2.218301255603608 distance-from-start_median 2.218301255603608 distance-from-start_min 2.218301255603608 driven_any_max 2.307392902404519 driven_any_mean 2.307392902404519 driven_any_median 2.307392902404519 driven_any_min 2.307392902404519 driven_lanedir_consec_max 0.1863779478005123 driven_lanedir_consec_mean 0.1863779478005123 driven_lanedir_consec_min 0.1863779478005123 driven_lanedir_max 0.1863779478005123 driven_lanedir_mean 0.1863779478005123 driven_lanedir_median 0.1863779478005123 driven_lanedir_min 0.1863779478005123 in-drivable-lane_max 6.499999999999981 in-drivable-lane_mean 6.499999999999981 in-drivable-lane_min 6.499999999999981 per-episodes details {"udem-000-ego0": {"driven_any": 2.307392902404519, "survival_time": 8.999999999999993, "driven_lanedir": 0.1863779478005123, "in-drivable-lane": 6.499999999999981, "deviation-heading": 2.7893624348021873, "distance-from-start": 2.218301255603608, "deviation-center-line": 0.26304083401538153, "driven_lanedir_consec": 0.1863779478005123}}simulation-passed 1 survival_time_max 8.999999999999993 survival_time_mean 8.999999999999993 survival_time_min 8.999999999999993
No reset possible 15277
1523
Bea Baselines 🐤template-ros aido-LFVI-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 00:42:17+00:00 2022-11-25 00:43:49+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15271
1524
Bea Baselines 🐤template-ros aido-LFI-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 00:40:06+00:00 2022-11-25 00:41:56+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15267
1526
Bea Baselines 🐤template-ros aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 00:37:53+00:00 2022-11-25 00:39:41+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15264
1527
Bea Baselines 🐤template-ros aido-LFV_multi-sim-testing
sim-0of4 success no davinci-stage-04-6.2.51
2022-11-25 00:34:20+00:00 2022-11-25 00:37:39+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.0499999999999865 in-drivable-lane_median 5.099999999999986 driven_lanedir_consec_median 0.15530289071844405 deviation-center-line_median 0.08158360050410748
other stats deviation-center-line_max 0.40015189854233296 deviation-center-line_mean 0.1549249909508287 deviation-center-line_min 0.05638086425276689 deviation-heading_max 0.6667813241693127 deviation-heading_mean 0.44655526376606 deviation-heading_median 0.4449949641384162 deviation-heading_min 0.2294498026180951 distance-from-start_max 1.5008488556661697 distance-from-start_mean 0.772899240261069 distance-from-start_median 0.572651601343879 distance-from-start_min 0.4454449026903484 driven_any_max 1.6168338136260236 driven_any_mean 0.8063398971211644 driven_any_median 0.5810828969810387 driven_any_min 0.4463599808965568 driven_lanedir_consec_max 0.4946436139694823 driven_lanedir_consec_mean 0.22654748868605373 driven_lanedir_consec_min 0.10094055933784452 driven_lanedir_max 0.4946436139694823 driven_lanedir_mean 0.22654748868605373 driven_lanedir_median 0.15530289071844405 driven_lanedir_min 0.10094055933784452 in-drivable-lane_max 5.249999999999987 in-drivable-lane_mean 3.86249999999999 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.4463599808965568, "survival_time": 6.0499999999999865, "driven_lanedir": 0.11140778066139267, "in-drivable-lane": 5.149999999999986, "deviation-heading": 0.6667813241693127, "distance-from-start": 0.4454449026903484, "deviation-center-line": 0.05638086425276689, "driven_lanedir_consec": 0.11140778066139267}, "autolab-000-ego1": {"driven_any": 1.6168338136260236, "survival_time": 6.0499999999999865, "driven_lanedir": 0.19919800077549543, "in-drivable-lane": 5.0499999999999865, "deviation-heading": 0.3468282200220515, "distance-from-start": 1.5008488556661697, "deviation-center-line": 0.09663879082971057, "driven_lanedir_consec": 0.19919800077549543}, "autolab-000-ego2": {"driven_any": 0.4974743856314771, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4946436139694823, "in-drivable-lane": 0.0, "deviation-heading": 0.2294498026180951, "distance-from-start": 0.49657873610451664, "deviation-center-line": 0.40015189854233296, "driven_lanedir_consec": 0.4946436139694823}, "autolab-000-ego3": {"driven_any": 0.6646914083306001, "survival_time": 6.0499999999999865, "driven_lanedir": 0.10094055933784452, "in-drivable-lane": 5.249999999999987, "deviation-heading": 0.5431617082547809, "distance-from-start": 0.6487244665832415, "deviation-center-line": 0.0665284101785044, "driven_lanedir_consec": 0.10094055933784452}}simulation-passed 1 survival_time_max 6.0499999999999865 survival_time_mean 6.0499999999999865 survival_time_min 6.0499999999999865
No reset possible 15258
1528
Bea Baselines 🐤template-ros aido-LFP-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 00:32:03+00:00 2022-11-25 00:34:06+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.799999999999984 in-drivable-lane_median 4.899999999999987 driven_lanedir_consec_median 0.32736513659314515 deviation-center-line_median 0.1592056046507359
other stats deviation-center-line_max 0.1592056046507359 deviation-center-line_mean 0.1592056046507359 deviation-center-line_min 0.1592056046507359 deviation-heading_max 1.5040548844655617 deviation-heading_mean 1.5040548844655617 deviation-heading_median 1.5040548844655617 deviation-heading_min 1.5040548844655617 distance-from-start_max 1.7944009362059865 distance-from-start_mean 1.7944009362059865 distance-from-start_median 1.7944009362059865 distance-from-start_min 1.7944009362059865 driven_any_max 1.8123505003800304 driven_any_mean 1.8123505003800304 driven_any_median 1.8123505003800304 driven_any_min 1.8123505003800304 driven_lanedir_consec_max 0.32736513659314515 driven_lanedir_consec_mean 0.32736513659314515 driven_lanedir_consec_min 0.32736513659314515 driven_lanedir_max 0.32736513659314515 driven_lanedir_mean 0.32736513659314515 driven_lanedir_median 0.32736513659314515 driven_lanedir_min 0.32736513659314515 in-drivable-lane_max 4.899999999999987 in-drivable-lane_mean 4.899999999999987 in-drivable-lane_min 4.899999999999987 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.8123505003800304, "survival_time": 6.799999999999984, "driven_lanedir": 0.32736513659314515, "in-drivable-lane": 4.899999999999987, "deviation-heading": 1.5040548844655617, "distance-from-start": 1.7944009362059865, "deviation-center-line": 0.1592056046507359, "driven_lanedir_consec": 0.32736513659314515}}simulation-passed 1 survival_time_max 6.799999999999984 survival_time_mean 6.799999999999984 survival_time_min 6.799999999999984
No reset possible 15254
1529
Bea Baselines 🐤template-tensorflow aido-LFV-sim-validation
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:30:18+00:00 2022-11-25 00:31:57+00:00 0:01:39 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15249
1530
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-validation
sim-0of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:28:22+00:00 2022-11-25 00:30:02+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15244
1531
Bea Baselines 🐤template-tensorflow aido-LFI-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 00:26:29+00:00 2022-11-25 00:28:01+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15237
1533
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-25 00:24:37+00:00 2022-11-25 00:26:06+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15233
1534
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-validation
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:22:52+00:00 2022-11-25 00:24:21+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15229
1535
Bea Baselines 🐤template-tensorflow aido-LFP-sim-validation
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:21:49+00:00 2022-11-25 00:22:46+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15223
1540
Bea Baselines 🐤template-tensorflow lx22-BV1
sim-3of5 failed no davinci-stage-04-6.2.51
2022-11-25 00:20:22+00:00 2022-11-25 00:21:21+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15215
1547
Bea Baselines 🐤template-tensorflow aido-LFV-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:18:17+00:00 2022-11-25 00:19:46+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15210
1548
Bea Baselines 🐤template-tensorflow aido-LFVI-sim-testing
sim-0of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:16:09+00:00 2022-11-25 00:17:51+00:00 0:01:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15202
1549
Bea Baselines 🐤template-tensorflow aido-LFI-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:14:04+00:00 2022-11-25 00:15:33+00:00 0:01:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15198
1551
Bea Baselines 🐤template-tensorflow aido-LFVI_multi-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:12:22+00:00 2022-11-25 00:13:57+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15196
1552
Bea Baselines 🐤template-tensorflow aido-LFV_multi-sim-testing
sim-2of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:10:38+00:00 2022-11-25 00:12:15+00:00 0:01:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15190
1553
Bea Baselines 🐤template-tensorflow aido-LFP-sim-testing
sim-1of4 failed no davinci-stage-04-6.2.51
2022-11-25 00:08:34+00:00 2022-11-25 00:10:32+00:00 0:01:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15185
1369
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-25 00:04:18+00:00 2022-11-25 00:08:16+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15182
1293
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-1of4 aborted no davinci-stage-04-6.2.51
2022-11-24 23:59:37+00:00 2022-11-25 00:03:54+00:00 0:04:17 KeyboardInterrupt:
T [...] KeyboardInterrupt:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1302, in run_one
heartbeat()
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 749, in heartbeat
raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15181
1293
Bea Baselines 🐤template-random aido-LFVI_multi-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-24 23:57:37+00:00 2022-11-24 23:59:07+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15174
1295
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-24 23:48:52+00:00 2022-11-24 23:57:30+00:00 0:08:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.34999999999917 driven_lanedir_consec_median 0.23799216289173675 deviation-center-line_median 2.122382603135255
other stats deviation-center-line_max 2.122382603135255 deviation-center-line_mean 2.122382603135255 deviation-center-line_min 2.122382603135255 deviation-heading_max 20.52214487263099 deviation-heading_mean 20.52214487263099 deviation-heading_median 20.52214487263099 deviation-heading_min 20.52214487263099 distance-from-start_max 1.4108418329398902 distance-from-start_mean 1.4108418329398902 distance-from-start_median 1.4108418329398902 distance-from-start_min 1.4108418329398902 driven_any_max 15.326310847370609 driven_any_mean 15.326310847370609 driven_any_median 15.326310847370609 driven_any_min 15.326310847370609 driven_lanedir_consec_max 0.23799216289173675 driven_lanedir_consec_mean 0.23799216289173675 driven_lanedir_consec_min 0.23799216289173675 driven_lanedir_max 0.2454177542370326 driven_lanedir_mean 0.2454177542370326 driven_lanedir_median 0.2454177542370326 driven_lanedir_min 0.2454177542370326 in-drivable-lane_max 36.34999999999917 in-drivable-lane_mean 36.34999999999917 in-drivable-lane_min 36.34999999999917 per-episodes details {"zigzag-000-ego0": {"driven_any": 15.326310847370609, "survival_time": 59.99999999999873, "driven_lanedir": 0.2454177542370326, "in-drivable-lane": 36.34999999999917, "deviation-heading": 20.52214487263099, "distance-from-start": 1.4108418329398902, "deviation-center-line": 2.122382603135255, "driven_lanedir_consec": 0.23799216289173675}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 15173
1295
Bea Baselines 🐤template-random aido-LFP-sim-testing
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-24 23:46:19+00:00 2022-11-24 23:48:22+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.300000000000026 in-drivable-lane_median 7.850000000000014 driven_lanedir_consec_median 0.02948472541340319 deviation-center-line_median 0.3268416970813497
other stats deviation-center-line_max 0.3268416970813497 deviation-center-line_mean 0.3268416970813497 deviation-center-line_min 0.3268416970813497 deviation-heading_max 2.548872596322993 deviation-heading_mean 2.548872596322993 deviation-heading_median 2.548872596322993 deviation-heading_min 2.548872596322993 distance-from-start_max 0.5461575079396523 distance-from-start_mean 0.5461575079396523 distance-from-start_median 0.5461575079396523 distance-from-start_min 0.5461575079396523 driven_any_max 2.2681416551684617 driven_any_mean 2.2681416551684617 driven_any_median 2.2681416551684617 driven_any_min 2.2681416551684617 driven_lanedir_consec_max 0.02948472541340319 driven_lanedir_consec_mean 0.02948472541340319 driven_lanedir_consec_min 0.02948472541340319 driven_lanedir_max 0.032831067512037126 driven_lanedir_mean 0.032831067512037126 driven_lanedir_median 0.032831067512037126 driven_lanedir_min 0.032831067512037126 in-drivable-lane_max 7.850000000000014 in-drivable-lane_mean 7.850000000000014 in-drivable-lane_min 7.850000000000014 per-episodes details {"loop2-000-ego0": {"driven_any": 2.2681416551684617, "survival_time": 11.300000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.850000000000014, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}simulation-passed 1 survival_time_max 11.300000000000026 survival_time_mean 11.300000000000026 survival_time_min 11.300000000000026
No reset possible 15160
1271
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-24 23:30:15+00:00 2022-11-24 23:45:56+00:00 0:15:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.29999999999968 in-drivable-lane_median 35.19999999999969 driven_lanedir_consec_median 0.1481685404123385 deviation-center-line_median 0.6130052941053471
other stats deviation-center-line_max 6.361236990588696 deviation-center-line_mean 1.968961967548878 deviation-center-line_min 0.28860029139612103 deviation-heading_max 22.59467278731015 deviation-heading_mean 9.325639720688413 deviation-heading_median 6.178891513015082 deviation-heading_min 2.350103069413334 distance-from-start_max 1.0093404360059293 distance-from-start_mean 0.6788871313560756 distance-from-start_median 0.651676229557197 distance-from-start_min 0.40285563030397936 driven_any_max 10.522906217249696 driven_any_mean 4.533111394485939 driven_any_median 3.592731455205004 driven_any_min 0.4240764502840531 driven_lanedir_consec_max 0.3902130173718561 driven_lanedir_consec_mean 0.1975964492168203 driven_lanedir_consec_min 0.10383569867074804 driven_lanedir_max 0.3902130173718561 driven_lanedir_mean 0.18988251265665312 driven_lanedir_median 0.1348795225002798 driven_lanedir_min 0.09955798825419682 in-drivable-lane_max 39.84999999999967 in-drivable-lane_mean 27.787499999999763 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.4240764502840531, "survival_time": 43.29999999999968, "driven_lanedir": 0.3902130173718561, "in-drivable-lane": 0.9, "deviation-heading": 22.59467278731015, "distance-from-start": 0.40285563030397936, "deviation-center-line": 6.361236990588696, "driven_lanedir_consec": 0.3902130173718561}, "4way-000-ego1": {"driven_any": 10.522906217249696, "survival_time": 43.29999999999968, "driven_lanedir": 0.13630120329834927, "in-drivable-lane": 32.44999999999972, "deviation-heading": 9.32828495552219, "distance-from-start": 1.0093404360059293, "deviation-center-line": 0.7830123872563919, "driven_lanedir_consec": 0.14963153086450776}, "4way-000-ego2": {"driven_any": 4.117732239446985, "survival_time": 43.29999999999968, "driven_lanedir": 0.1334578417022103, "in-drivable-lane": 37.94999999999966, "deviation-heading": 3.0294980705079753, "distance-from-start": 0.6736010379604934, "deviation-center-line": 0.4429982009543024, "driven_lanedir_consec": 0.14670554996016927}, "4way-000-ego3": {"driven_any": 3.067730670963023, "survival_time": 43.29999999999968, "driven_lanedir": 0.09955798825419682, "in-drivable-lane": 39.84999999999967, "deviation-heading": 2.350103069413334, "distance-from-start": 0.6297514211539005, "deviation-center-line": 0.28860029139612103, "driven_lanedir_consec": 0.10383569867074804}}simulation-passed 1 survival_time_max 43.29999999999968 survival_time_mean 43.29999999999968 survival_time_min 43.29999999999968
No reset possible 15159
1271
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-24 23:28:06+00:00 2022-11-24 23:29:42+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15158
1271
Bea Baselines 🐤template-random aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-24 23:26:23+00:00 2022-11-24 23:27:52+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 15146
1267
Bea Baselines 🐤template-random aido-LFV-sim-validation
sim-3of4 success no davinci-stage-04-6.2.51
2022-11-24 23:10:38+00:00 2022-11-24 23:26:01+00:00 0:15:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 48.69999999999937 in-drivable-lane_median 36.64999999999927 driven_lanedir_consec_median 0.27329071924012593 deviation-center-line_median 0.8940598330260409
other stats deviation-center-line_max 0.8940598330260409 deviation-center-line_mean 0.8940598330260409 deviation-center-line_min 0.8940598330260409 deviation-heading_max 9.653852545002117 deviation-heading_mean 9.653852545002117 deviation-heading_median 9.653852545002117 deviation-heading_min 9.653852545002117 distance-from-start_max 1.1351054760255814 distance-from-start_mean 1.1351054760255814 distance-from-start_median 1.1351054760255814 distance-from-start_min 1.1351054760255814 driven_any_max 12.221812291295889 driven_any_mean 12.221812291295889 driven_any_median 12.221812291295889 driven_any_min 12.221812291295889 driven_lanedir_consec_max 0.27329071924012593 driven_lanedir_consec_mean 0.27329071924012593 driven_lanedir_consec_min 0.27329071924012593 driven_lanedir_max 0.26112935377464863 driven_lanedir_mean 0.26112935377464863 driven_lanedir_median 0.26112935377464863 driven_lanedir_min 0.26112935377464863 in-drivable-lane_max 36.64999999999927 in-drivable-lane_mean 36.64999999999927 in-drivable-lane_min 36.64999999999927 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.221812291295889, "survival_time": 48.69999999999937, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 36.64999999999927, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1351054760255814, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}simulation-passed 1 survival_time_max 48.69999999999937 survival_time_mean 48.69999999999937 survival_time_min 48.69999999999937
No reset possible 15145
526
Bea Baselines 🐤baseline-behavior-cloning aido-LF-sim-testing
sim-3of4 failed no davinci-stage-04-6.2.51
2022-11-24 23:09:08+00:00 2022-11-24 23:10:05+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 15141
783
Andrea Daniele template-random aido-LF-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-24 23:05:39+00:00 2022-11-24 23:09:02+00:00 0:03:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27378584101885495 survival_time_median 20.550000000000157 deviation-center-line_median 0.7687309613328539 in-drivable-lane_median 12.000000000000131
other stats deviation-center-line_max 0.7687309613328539 deviation-center-line_mean 0.7687309613328539 deviation-center-line_min 0.7687309613328539 deviation-heading_max 5.7583430601860695 deviation-heading_mean 5.7583430601860695 deviation-heading_median 5.7583430601860695 deviation-heading_min 5.7583430601860695 distance-from-start_max 0.7357883576773772 distance-from-start_mean 0.7357883576773772 distance-from-start_median 0.7357883576773772 distance-from-start_min 0.7357883576773772 driven_any_max 4.915576034387011 driven_any_mean 4.915576034387011 driven_any_median 4.915576034387011 driven_any_min 4.915576034387011 driven_lanedir_consec_max 0.27378584101885495 driven_lanedir_consec_mean 0.27378584101885495 driven_lanedir_consec_min 0.27378584101885495 driven_lanedir_max 0.2557751649818414 driven_lanedir_mean 0.2557751649818414 driven_lanedir_median 0.2557751649818414 driven_lanedir_min 0.2557751649818414 in-drivable-lane_max 12.000000000000131 in-drivable-lane_mean 12.000000000000131 in-drivable-lane_min 12.000000000000131 per-episodes details {"loop2-000-ego0": {"driven_any": 4.915576034387011, "survival_time": 20.550000000000157, "driven_lanedir": 0.2557751649818414, "in-drivable-lane": 12.000000000000131, "deviation-heading": 5.7583430601860695, "distance-from-start": 0.7357883576773772, "deviation-center-line": 0.7687309613328539, "driven_lanedir_consec": 0.27378584101885495}}simulation-passed 1 survival_time_max 20.550000000000157 survival_time_mean 20.550000000000157 survival_time_min 20.550000000000157
No reset possible 15139
1273
Bea Baselines 🐤template-random aido-LFP-sim-validation
sim-2of4 success no davinci-stage-04-6.2.51
2022-11-24 23:02:57+00:00 2022-11-24 23:05:24+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.700000000000088 in-drivable-lane_median 8.100000000000078 driven_lanedir_consec_median 0.27378153863999577 deviation-center-line_median 0.6226670229639317
other stats deviation-center-line_max 0.6226670229639317 deviation-center-line_mean 0.6226670229639317 deviation-center-line_min 0.6226670229639317 deviation-heading_max 4.9776949056766355 deviation-heading_mean 4.9776949056766355 deviation-heading_median 4.9776949056766355 deviation-heading_min 4.9776949056766355 distance-from-start_max 0.6297514211538986 distance-from-start_mean 0.6297514211538986 distance-from-start_median 0.6297514211538986 distance-from-start_min 0.6297514211538986 driven_any_max 3.532822332695487 driven_any_mean 3.532822332695487 driven_any_median 3.532822332695487 driven_any_min 3.532822332695487 driven_lanedir_consec_max 0.27378153863999577 driven_lanedir_consec_mean 0.27378153863999577 driven_lanedir_consec_min 0.27378153863999577 driven_lanedir_max 0.2627748326499355 driven_lanedir_mean 0.2627748326499355 driven_lanedir_median 0.2627748326499355 driven_lanedir_min 0.2627748326499355 in-drivable-lane_max 8.100000000000078 in-drivable-lane_mean 8.100000000000078 in-drivable-lane_min 8.100000000000078 per-episodes details {"loop2-000-ego0": {"driven_any": 3.532822332695487, "survival_time": 15.700000000000088, "driven_lanedir": 0.2627748326499355, "in-drivable-lane": 8.100000000000078, "deviation-heading": 4.9776949056766355, "distance-from-start": 0.6297514211538986, "deviation-center-line": 0.6226670229639317, "driven_lanedir_consec": 0.27378153863999577}}simulation-passed 1 survival_time_max 15.700000000000088 survival_time_mean 15.700000000000088 survival_time_min 15.700000000000088
No reset possible 15135
785
Andrea Daniele template-ros aido-LF-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-24 23:01:06+00:00 2022-11-24 23:02:37+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2806241427905898 survival_time_median 5.349999999999989 deviation-center-line_median 0.10985009332565145 in-drivable-lane_median 3.999999999999989
other stats deviation-center-line_max 0.10985009332565145 deviation-center-line_mean 0.10985009332565145 deviation-center-line_min 0.10985009332565145 deviation-heading_max 0.5863653159439228 deviation-heading_mean 0.5863653159439228 deviation-heading_median 0.5863653159439228 deviation-heading_min 0.5863653159439228 distance-from-start_max 1.2918576942896178 distance-from-start_mean 1.2918576942896178 distance-from-start_median 1.2918576942896178 distance-from-start_min 1.2918576942896178 driven_any_max 1.3055980709925792 driven_any_mean 1.3055980709925792 driven_any_median 1.3055980709925792 driven_any_min 1.3055980709925792 driven_lanedir_consec_max 0.2806241427905898 driven_lanedir_consec_mean 0.2806241427905898 driven_lanedir_consec_min 0.2806241427905898 driven_lanedir_max 0.2806241427905898 driven_lanedir_mean 0.2806241427905898 driven_lanedir_median 0.2806241427905898 driven_lanedir_min 0.2806241427905898 in-drivable-lane_max 3.999999999999989 in-drivable-lane_mean 3.999999999999989 in-drivable-lane_min 3.999999999999989 per-episodes details {"loop-000-ego0": {"driven_any": 1.3055980709925792, "survival_time": 5.349999999999989, "driven_lanedir": 0.2806241427905898, "in-drivable-lane": 3.999999999999989, "deviation-heading": 0.5863653159439228, "distance-from-start": 1.2918576942896178, "deviation-center-line": 0.10985009332565145, "driven_lanedir_consec": 0.2806241427905898}}simulation-passed 1 survival_time_max 5.349999999999989 survival_time_mean 5.349999999999989 survival_time_min 5.349999999999989
No reset possible 15125
1270
Bea Baselines 🐤template-random aido-LF-sim-validation
sim-1of4 success no davinci-stage-04-6.2.51
2022-11-24 22:54:06+00:00 2022-11-24 23:00:50+00:00 0:06:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2701303550718044 survival_time_median 49.74999999999931 deviation-center-line_median 0.8041846674982114 in-drivable-lane_median 40.59999999999928
other stats deviation-center-line_max 0.8041846674982114 deviation-center-line_mean 0.8041846674982114 deviation-center-line_min 0.8041846674982114 deviation-heading_max 6.675380463416964 deviation-heading_mean 6.675380463416964 deviation-heading_median 6.675380463416964 deviation-heading_min 6.675380463416964 distance-from-start_max 1.137627771926658 distance-from-start_mean 1.137627771926658 distance-from-start_median 1.137627771926658 distance-from-start_min 1.137627771926658 driven_any_max 12.45015338279087 driven_any_mean 12.45015338279087 driven_any_median 12.45015338279087 driven_any_min 12.45015338279087 driven_lanedir_consec_max 0.2701303550718044 driven_lanedir_consec_mean 0.2701303550718044 driven_lanedir_consec_min 0.2701303550718044 driven_lanedir_max 0.2521152682910448 driven_lanedir_mean 0.2521152682910448 driven_lanedir_median 0.2521152682910448 driven_lanedir_min 0.2521152682910448 in-drivable-lane_max 40.59999999999928 in-drivable-lane_mean 40.59999999999928 in-drivable-lane_min 40.59999999999928 per-episodes details {"loop-000-ego0": {"driven_any": 12.45015338279087, "survival_time": 49.74999999999931, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 40.59999999999928, "deviation-heading": 6.675380463416964, "distance-from-start": 1.137627771926658, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 15044
1297
Andrea Censi collision-check-exercise lx22-collision-check-vali
step1 host-error yes davinci-stage-04-6.2.51
2022-11-24 19:35:44+00:00 2022-11-24 19:36:26+00:00 0:00:42 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 429, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2022_11_24_17_26_06&fromImage=registry-stage2.duckietown.org%2Fandreacensi%2Faido-submissions: Not Found ("pull access denied for registry-stage2.duckietown.org/andreacensi/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo registry-stage2.duckietown.org/andreacensi/aido-submissions@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d tag 2022_11_24_17_26_06
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull registry-stage2.duckietown.org/andreacensi/aido-submissions:2022_11_24_17_26_06@sha256:840e7105f36db90b5d37324bdcab451125a96c2e8b8f5c02658293c659de9b5d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible