Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17278
1859
Kathryn Hite exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-08-6.2.53
2022-11-30 12:59:06+00:00 2022-11-30 13:06:31+00:00 0:07:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17274
1858
Andrea Daniele exercises_braitenberg lx22-BV1
sim-2of5 success yes davinci-stage-08-6.2.53
2022-11-30 03:42:33+00:00 2022-11-30 03:49:52+00:00 0:07:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17254
386
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-29 14:41:43+00:00 2022-11-29 14:52:28+00:00 0:10:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 27.39999999999924 driven_lanedir_consec_median -3.1149851179836774 deviation-center-line_median 2.7665558581480783
other stats deviation-center-line_max 2.7665558581480783 deviation-center-line_mean 2.7665558581480783 deviation-center-line_min 2.7665558581480783 deviation-heading_max 28.020797112705132 deviation-heading_mean 28.020797112705132 deviation-heading_median 28.020797112705132 deviation-heading_min 28.020797112705132 distance-from-start_max 0.16646745836146215 distance-from-start_mean 0.16646745836146215 distance-from-start_median 0.16646745836146215 distance-from-start_min 0.16646745836146215 driven_any_max 11.814564933428326 driven_any_mean 11.814564933428326 driven_any_median 11.814564933428326 driven_any_min 11.814564933428326 driven_lanedir_consec_max -3.1149851179836774 driven_lanedir_consec_mean -3.1149851179836774 driven_lanedir_consec_min -3.1149851179836774 driven_lanedir_max -3.26733802204314 driven_lanedir_mean -3.26733802204314 driven_lanedir_median -3.26733802204314 driven_lanedir_min -3.26733802204314 in-drivable-lane_max 27.39999999999924 in-drivable-lane_mean 27.39999999999924 in-drivable-lane_min 27.39999999999924 per-episodes details {"autolab-000-ego0": {"driven_any": 11.814564933428326, "survival_time": 59.99999999999873, "driven_lanedir": -3.26733802204314, "in-drivable-lane": 27.39999999999924, "deviation-heading": 28.020797112705132, "distance-from-start": 0.16646745836146215, "deviation-center-line": 2.7665558581480783, "driven_lanedir_consec": -3.1149851179836774}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17239
390
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LF-sim-validation
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-29 14:30:43+00:00 2022-11-29 14:41:08+00:00 0:10:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -3.693438881321668 survival_time_median 59.99999999999873 deviation-center-line_median 2.4553503922994095 in-drivable-lane_median 25.649999999999316
other stats deviation-center-line_max 2.4553503922994095 deviation-center-line_mean 2.4553503922994095 deviation-center-line_min 2.4553503922994095 deviation-heading_max 28.324995189391093 deviation-heading_mean 28.324995189391093 deviation-heading_median 28.324995189391093 deviation-heading_min 28.324995189391093 distance-from-start_max 0.2170680084981405 distance-from-start_mean 0.2170680084981405 distance-from-start_median 0.2170680084981405 distance-from-start_min 0.2170680084981405 driven_any_max 12.336294409711693 driven_any_mean 12.336294409711693 driven_any_median 12.336294409711693 driven_any_min 12.336294409711693 driven_lanedir_consec_max -3.693438881321668 driven_lanedir_consec_mean -3.693438881321668 driven_lanedir_consec_min -3.693438881321668 driven_lanedir_max -4.434724258653148 driven_lanedir_mean -4.434724258653148 driven_lanedir_median -4.434724258653148 driven_lanedir_min -4.434724258653148 in-drivable-lane_max 25.649999999999316 in-drivable-lane_mean 25.649999999999316 in-drivable-lane_min 25.649999999999316 per-episodes details {"autolab-000-ego0": {"driven_any": 12.336294409711693, "survival_time": 59.99999999999873, "driven_lanedir": -4.434724258653148, "in-drivable-lane": 25.649999999999316, "deviation-heading": 28.324995189391093, "distance-from-start": 0.2170680084981405, "deviation-center-line": 2.4553503922994095, "driven_lanedir_consec": -3.693438881321668}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17236
392
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFV_multi-sim-testing
sim-3of4 host-error yes davinci-stage-08-6.2.53
2022-11-29 14:29:17+00:00 2022-11-29 14:30:30+00:00 0:01:13 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17232
391
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-validation
sim-0of4 host-error yes davinci-stage-08-6.2.53
2022-11-29 14:27:45+00:00 2022-11-29 14:29:04+00:00 0:01:19 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17185
398
Bea Baselines 🐤baseline-RL-sim-pytorch aido-LFVI_multi-sim-testing
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-29 14:01:54+00:00 2022-11-29 14:27:25+00:00 0:25:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.47500000000003 driven_lanedir_consec_median -0.8215220025046082 deviation-center-line_median 4.305546563658694
other stats deviation-center-line_max 5.171450978020262 deviation-center-line_mean 4.02137097027396 deviation-center-line_min 2.302939775758191 deviation-heading_max 51.54852365041183 deviation-heading_mean 37.77639908639871 deviation-heading_median 37.21995841671929 deviation-heading_min 25.117155861744457 distance-from-start_max 0.18588748101368505 distance-from-start_mean 0.15097018252610117 distance-from-start_median 0.15088783296052174 distance-from-start_min 0.11621758316967618 driven_any_max 12.513551063996816 driven_any_mean 4.944719751362862 driven_any_median 3.2864427123964366 driven_any_min 0.6924425166617605 driven_lanedir_consec_max -0.08097562554351923 driven_lanedir_consec_mean -1.2372144502765563 driven_lanedir_consec_min -3.224838170553489 driven_lanedir_max -0.08097562554351923 driven_lanedir_mean -1.3912337042022092 driven_lanedir_median -1.129560510355914 driven_lanedir_min -3.224838170553489 in-drivable-lane_max 31.749999999999183 in-drivable-lane_mean 10.92499999999981 in-drivable-lane_min 0.9999999999999964 per-episodes details {"4way-000-ego0": {"driven_any": 1.5810350339117762, "survival_time": 59.99999999999873, "driven_lanedir": -0.4173333373772574, "in-drivable-lane": 3.049999999999989, "deviation-heading": 51.54852365041183, "distance-from-start": 0.1343846756175076, "deviation-center-line": 4.285342187795043, "driven_lanedir_consec": -0.4173583943376329}, "4way-000-ego1": {"driven_any": 0.6924425166617605, "survival_time": 59.99999999999873, "driven_lanedir": -0.08097562554351923, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 47.88331506265053, "distance-from-start": 0.11621758316967618, "deviation-center-line": 5.171450978020262, "driven_lanedir_consec": -0.08097562554351923}, "4way-000-ego2": {"driven_any": 4.991850390881097, "survival_time": 59.99999999999873, "driven_lanedir": -1.8417876833345703, "in-drivable-lane": 7.90000000000007, "deviation-heading": 26.55660177078805, "distance-from-start": 0.16739099030353588, "deviation-center-line": 4.325750939522345, "driven_lanedir_consec": -1.2256856106715834}, "4way-000-ego3": {"driven_any": 12.513551063996816, "survival_time": 59.99999999999873, "driven_lanedir": -3.224838170553489, "in-drivable-lane": 31.749999999999183, "deviation-heading": 25.117155861744457, "distance-from-start": 0.18588748101368505, "deviation-center-line": 2.302939775758191, "driven_lanedir_consec": -3.224838170553489}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17111
528
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-29 13:43:43+00:00 2022-11-29 14:01:20+00:00 0:17:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 55.99999999999896 in-drivable-lane_median 1.1500000000000163 driven_lanedir_consec_median 4.653481495174014 deviation-center-line_median 3.5453797379995837
other stats deviation-center-line_max 3.9824961601847417 deviation-center-line_mean 2.911832862112948 deviation-center-line_min 0.5740758122678834 deviation-heading_max 18.01691450160684 deviation-heading_mean 10.956447853270433 deviation-heading_median 11.07683077000424 deviation-heading_min 3.6552153714664217 distance-from-start_max 2.8170465898074104 distance-from-start_mean 2.3466513922443113 distance-from-start_median 2.3466034401448157 distance-from-start_min 1.8763520988802036 driven_any_max 9.80554921064579 driven_any_mean 5.633608827719401 driven_any_median 5.013841314886996 driven_any_min 2.7012034704578247 driven_lanedir_consec_max 8.88402852401974 driven_lanedir_consec_mean 4.84361781652413 driven_lanedir_consec_min 1.1834797517287534 driven_lanedir_max 8.88402852401974 driven_lanedir_mean 4.84361781652413 driven_lanedir_median 4.653481495174014 driven_lanedir_min 1.1834797517287534 in-drivable-lane_max 47.74999999999896 in-drivable-lane_mean 12.512499999999749 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 9.80554921064579, "survival_time": 55.99999999999896, "driven_lanedir": 8.88402852401974, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 18.01691450160684, "distance-from-start": 2.782681283913034, "deviation-center-line": 3.310825501210877, "driven_lanedir_consec": 8.88402852401974}, "loop-000-ego1": {"driven_any": 4.969918757785727, "survival_time": 55.99999999999896, "driven_lanedir": 4.339192951063964, "in-drivable-lane": 1.500000000000021, "deviation-heading": 11.41085818813874, "distance-from-start": 2.8170465898074104, "deviation-center-line": 3.9824961601847417, "driven_lanedir_consec": 4.339192951063964}, "loop-000-ego2": {"driven_any": 2.7012034704578247, "survival_time": 55.99999999999896, "driven_lanedir": 1.1834797517287534, "in-drivable-lane": 47.74999999999896, "deviation-heading": 3.6552153714664217, "distance-from-start": 1.8763520988802036, "deviation-center-line": 0.5740758122678834, "driven_lanedir_consec": 1.1834797517287534}, "loop-000-ego3": {"driven_any": 5.057763871988264, "survival_time": 55.99999999999896, "driven_lanedir": 4.967770039284064, "in-drivable-lane": 0.0, "deviation-heading": 10.742803351869735, "distance-from-start": 1.9105255963765968, "deviation-center-line": 3.7799339747882903, "driven_lanedir_consec": 4.967770039284064}}simulation-passed 1 survival_time_max 55.99999999999896 survival_time_mean 55.99999999999896 survival_time_min 55.99999999999896
No reset possible 17102
530
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-validation
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-29 13:40:23+00:00 2022-11-29 13:43:21+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.349999999999989 in-drivable-lane_median 0.7499999999999973 driven_lanedir_consec_median 0.7733648767077974 deviation-center-line_median 0.1899345327269107
other stats deviation-center-line_max 0.1899345327269107 deviation-center-line_mean 0.1899345327269107 deviation-center-line_min 0.1899345327269107 deviation-heading_max 1.2762283192199255 deviation-heading_mean 1.2762283192199255 deviation-heading_median 1.2762283192199255 deviation-heading_min 1.2762283192199255 distance-from-start_max 0.7690218536398835 distance-from-start_mean 0.7690218536398835 distance-from-start_median 0.7690218536398835 distance-from-start_min 0.7690218536398835 driven_any_max 0.822608897269373 driven_any_mean 0.822608897269373 driven_any_median 0.822608897269373 driven_any_min 0.822608897269373 driven_lanedir_consec_max 0.7733648767077974 driven_lanedir_consec_mean 0.7733648767077974 driven_lanedir_consec_min 0.7733648767077974 driven_lanedir_max 0.7733648767077974 driven_lanedir_mean 0.7733648767077974 driven_lanedir_median 0.7733648767077974 driven_lanedir_min 0.7733648767077974 in-drivable-lane_max 0.7499999999999973 in-drivable-lane_mean 0.7499999999999973 in-drivable-lane_min 0.7499999999999973 per-episodes details {"autolab-000-ego0": {"driven_any": 0.822608897269373, "survival_time": 5.349999999999989, "driven_lanedir": 0.7733648767077974, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 1.2762283192199255, "distance-from-start": 0.7690218536398835, "deviation-center-line": 0.1899345327269107, "driven_lanedir_consec": 0.7733648767077974}}simulation-passed 1 survival_time_max 5.349999999999989 survival_time_mean 5.349999999999989 survival_time_min 5.349999999999989
No reset possible 17098
531
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-validation
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:38:39+00:00 2022-11-29 13:40:07+00:00 0:01:28 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17093
532
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-validation
sim-2of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:37:02+00:00 2022-11-29 13:38:14+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17089
533
Bea Baselines 🐤baseline-dagger-pytorch aido-LF-sim-validation
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:35:47+00:00 2022-11-29 13:36:56+00:00 0:01:09 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17085
535
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV_multi-sim-testing
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:34:33+00:00 2022-11-29 13:35:40+00:00 0:01:07 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17077
536
Bea Baselines 🐤baseline-dagger-pytorch aido-LFP-sim-testing
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-29 13:28:42+00:00 2022-11-29 13:34:00+00:00 0:05:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.60000000000013 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.381076441760812 deviation-center-line_median 0.904429580871188
other stats deviation-center-line_max 0.904429580871188 deviation-center-line_mean 0.904429580871188 deviation-center-line_min 0.904429580871188 deviation-heading_max 4.509440534394529 deviation-heading_mean 4.509440534394529 deviation-heading_median 4.509440534394529 deviation-heading_min 4.509440534394529 distance-from-start_max 2.1137228662470338 distance-from-start_mean 2.1137228662470338 distance-from-start_median 2.1137228662470338 distance-from-start_min 2.1137228662470338 driven_any_max 2.472079660132866 driven_any_mean 2.472079660132866 driven_any_median 2.472079660132866 driven_any_min 2.472079660132866 driven_lanedir_consec_max 2.381076441760812 driven_lanedir_consec_mean 2.381076441760812 driven_lanedir_consec_min 2.381076441760812 driven_lanedir_max 2.381076441760812 driven_lanedir_mean 2.381076441760812 driven_lanedir_median 2.381076441760812 driven_lanedir_min 2.381076441760812 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.472079660132866, "survival_time": 18.60000000000013, "driven_lanedir": 2.381076441760812, "in-drivable-lane": 0.0, "deviation-heading": 4.509440534394529, "distance-from-start": 2.1137228662470338, "deviation-center-line": 0.904429580871188, "driven_lanedir_consec": 2.381076441760812}}simulation-passed 1 survival_time_max 18.60000000000013 survival_time_mean 18.60000000000013 survival_time_min 18.60000000000013
No reset possible 17076
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:26:56+00:00 2022-11-29 13:28:08+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17075
537
Bea Baselines 🐤baseline-dagger-pytorch aido-LFV-sim-testing
sim-2of4 failed yes davinci-stage-08-6.2.53
2022-11-29 13:24:53+00:00 2022-11-29 13:26:23+00:00 0:01:30 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17071
538
Bea Baselines 🐤baseline-dagger-pytorch aido-LFVI-sim-testing
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-29 13:23:16+00:00 2022-11-29 13:24:47+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 17066
539
Bea Baselines 🐤baseline-dagger-pytorch aido-LFI-sim-testing
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-29 13:21:38+00:00 2022-11-29 13:23:10+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 17055
763
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035 aido-hello-sim-validation
sanity-check success yes davinci-stage-08-6.2.53
2022-11-29 13:19:22+00:00 2022-11-29 13:21:05+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.04443105714988449 deviation-center-line_median 0.006646020040376493
other stats deviation-center-line_max 0.006646020040376493 deviation-center-line_mean 0.006646020040376493 deviation-center-line_min 0.006646020040376493 deviation-heading_max 0.28938500851486354 deviation-heading_mean 0.28938500851486354 deviation-heading_median 0.28938500851486354 deviation-heading_min 0.28938500851486354 distance-from-start_max 0.05504393114718156 distance-from-start_mean 0.05504393114718156 distance-from-start_median 0.05504393114718156 distance-from-start_min 0.05504393114718156 driven_any_max 0.055113764106465186 driven_any_mean 0.055113764106465186 driven_any_median 0.055113764106465186 driven_any_min 0.055113764106465186 driven_lanedir_consec_max 0.04443105714988449 driven_lanedir_consec_mean 0.04443105714988449 driven_lanedir_consec_min 0.04443105714988449 driven_lanedir_max 0.04443105714988449 driven_lanedir_mean 0.04443105714988449 driven_lanedir_median 0.04443105714988449 driven_lanedir_min 0.04443105714988449 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.055113764106465186, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04443105714988449, "in-drivable-lane": 0.0, "deviation-heading": 0.28938500851486354, "distance-from-start": 0.05504393114718156, "deviation-center-line": 0.006646020040376493, "driven_lanedir_consec": 0.04443105714988449}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 17049
795
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95 aido-hello-sim-validation
sanity-check success yes davinci-stage-08-6.2.53
2022-11-29 13:17:39+00:00 2022-11-29 13:19:14+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.03118774341201913 deviation-center-line_median 0.005623137747764201
other stats deviation-center-line_max 0.005623137747764201 deviation-center-line_mean 0.005623137747764201 deviation-center-line_min 0.005623137747764201 deviation-heading_max 0.28525265011380163 deviation-heading_mean 0.28525265011380163 deviation-heading_median 0.28525265011380163 deviation-heading_min 0.28525265011380163 distance-from-start_max 0.03812598749404643 distance-from-start_mean 0.03812598749404643 distance-from-start_median 0.03812598749404643 distance-from-start_min 0.03812598749404643 driven_any_max 0.03818175558549053 driven_any_mean 0.03818175558549053 driven_any_median 0.03818175558549053 driven_any_min 0.03818175558549053 driven_lanedir_consec_max 0.03118774341201913 driven_lanedir_consec_mean 0.03118774341201913 driven_lanedir_consec_min 0.03118774341201913 driven_lanedir_max 0.03118774341201913 driven_lanedir_mean 0.03118774341201913 driven_lanedir_median 0.03118774341201913 driven_lanedir_min 0.03118774341201913 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03818175558549053, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03118774341201913, "in-drivable-lane": 0.0, "deviation-heading": 0.28525265011380163, "distance-from-start": 0.03812598749404643, "deviation-center-line": 0.005623137747764201, "driven_lanedir_consec": 0.03118774341201913}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 17036
1555
Andrea Daniele exercises_braitenberg lx22-BV1
sim-1of5 success yes davinci-stage-08-6.2.53
2022-11-29 13:09:02+00:00 2022-11-29 13:17:31+00:00 0:08:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17024
1557
Andrea Daniele exercises_braitenberg lx22-BV1
sim-3of5 success yes davinci-stage-08-6.2.53
2022-11-29 13:00:04+00:00 2022-11-29 13:08:54+00:00 0:08:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17009
1597
Andrea Daniele exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-08-6.2.53
2022-11-29 12:53:04+00:00 2022-11-29 12:59:50+00:00 0:06:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 17002
1604
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:51:37+00:00 2022-11-29 12:52:50+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16992
1607
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-0of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:50:04+00:00 2022-11-29 12:51:18+00:00 0:01:14 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16982
1609
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-2of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:48:40+00:00 2022-11-29 12:49:43+00:00 0:01:03 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16973
1614
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-0of5 failed yes davinci-stage-08-6.2.53
2022-11-29 12:47:25+00:00 2022-11-29 12:48:28+00:00 0:01:03 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16965
1614
Bea Baselines 🐤baseline-RPL-ros lx22-BV1
sim-4of5 failed yes davinci-stage-08-6.2.53
2022-11-29 12:46:06+00:00 2022-11-29 12:47:05+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16959
1622
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-0of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:44:22+00:00 2022-11-29 12:45:53+00:00 0:01:31 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16951
1624
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-1of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:42:49+00:00 2022-11-29 12:44:09+00:00 0:01:20 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16947
1625
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-0of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:41:25+00:00 2022-11-29 12:42:42+00:00 0:01:17 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16939
1627
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-0of4 failed yes davinci-stage-08-6.2.53
2022-11-29 12:37:27+00:00 2022-11-29 12:40:50+00:00 0:03:23 The container "solut [...] The container "solution-ego0" exited with code 127.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16923
1633
Bea Baselines 🐤baseline-duckietown-ml aido-LFV_multi-sim-validation
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-29 12:22:37+00:00 2022-11-29 12:37:14+00:00 0:14:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 7.152557373046875e-05 deviation-center-line_median 1.5117049755778469
other stats deviation-center-line_max 2.9467758452445567 deviation-center-line_mean 1.5769826255149473 deviation-center-line_min 0.33774470565953923 deviation-heading_max 32.249113233675025 deviation-heading_mean 22.83949643715976 deviation-heading_median 22.597265680122995 deviation-heading_min 13.914341154718024 distance-from-start_max 6.280369834735102e-16 distance-from-start_mean 1.5700924586837752e-16 distance-from-start_median 0.0 distance-from-start_min 0.0 driven_any_max 7.536443801682175e-13 driven_any_mean 1.8841109504205443e-13 driven_any_median 0.0 driven_any_min 0.0 driven_lanedir_consec_max 0.0001430511474609375 driven_lanedir_consec_mean 7.152557373046875e-05 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0001430511474609375 driven_lanedir_mean 7.152557373046875e-05 driven_lanedir_median 7.152557373046875e-05 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8949070851524836, "driven_lanedir_consec": 0.0001430511474609375}, "loop-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.1285028660032097, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 0.0, "deviation-center-line": 2.9467758452445567, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.33774470565953923, "driven_lanedir_consec": 0.0001430511474609375}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16910
1637
Bea Baselines 🐤baseline-duckietown-ml lx22-visservoing
sim success yes davinci-stage-08-6.2.53
2022-11-29 12:13:34+00:00 2022-11-29 12:22:23+00:00 0:08:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median 0.0 deviation-center-line_median 0.8923084795475021 driven_lanedir_consec_median 2.5749206500336182e-05 survival_time_median 59.99999999999873
other stats deviation-center-line_max 0.8923090875148936 deviation-center-line_mean 0.8923084795475021 deviation-center-line_min 0.8923078715801107 deviation-heading_max 1.4695762799782753e-14 deviation-heading_mean 7.347881399891377e-15 deviation-heading_median 7.347881399891377e-15 deviation-heading_min 0.0 distance-from-start_max 0.0 distance-from-start_mean 0.0 distance-from-start_median 0.0 distance-from-start_min 0.0 driven_any_max 0.0 driven_any_mean 0.0 driven_any_median 0.0 driven_any_min 0.0 driven_lanedir_consec_max 2.5749206500336182e-05 driven_lanedir_consec_mean 2.5749206500336182e-05 driven_lanedir_consec_min 2.5749206500336182e-05 driven_lanedir_max 2.5749206500336182e-05 driven_lanedir_mean 2.5749206500336182e-05 driven_lanedir_median 2.5749206500336182e-05 driven_lanedir_min 2.5749206500336182e-05 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-small-loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.5749206500336182e-05, "in-drivable-lane": 0.0, "deviation-heading": 1.4695762799782753e-14, "distance-from-start": 0.0, "deviation-center-line": 0.8923090875148936, "driven_lanedir_consec": 2.5749206500336182e-05}, "LF-small-loop-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.5749206500336182e-05, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.8923078715801107, "driven_lanedir_consec": 2.5749206500336182e-05}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16902
1646
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-testing
sim-2of4 success yes davinci-stage-08-6.2.53
2022-11-29 12:05:42+00:00 2022-11-29 12:13:22+00:00 0:07:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065134212579011
other stats deviation-center-line_max 0.4065134212579011 deviation-center-line_mean 0.4065134212579011 deviation-center-line_min 0.4065134212579011 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 2.7755575615628914e-17 distance-from-start_mean 2.7755575615628914e-17 distance-from-start_median 2.7755575615628914e-17 distance-from-start_min 2.7755575615628914e-17 driven_any_max 3.3306690738754696e-14 driven_any_mean 3.3306690738754696e-14 driven_any_median 3.3306690738754696e-14 driven_any_min 3.3306690738754696e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16893
1648
Bea Baselines 🐤baseline-duckietown-ml aido-LFI-sim-testing
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-29 11:57:23+00:00 2022-11-29 12:05:01+00:00 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4064993438632703
other stats deviation-center-line_max 0.4064993438632703 deviation-center-line_mean 0.4064993438632703 deviation-center-line_min 0.4064993438632703 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 9.155133597044477e-16 distance-from-start_mean 9.155133597044477e-16 distance-from-start_median 9.155133597044477e-16 distance-from-start_min 9.155133597044477e-16 driven_any_max 1.0986160316453499e-12 driven_any_mean 1.0986160316453499e-12 driven_any_median 1.0986160316453499e-12 driven_any_min 1.0986160316453499e-12 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.4064993438632703, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16878
1639
Bea Baselines 🐤baseline-duckietown-ml lx22-BV1
sim-2of5 host-error yes davinci-stage-08-6.2.53
2022-11-28 21:40:34+00:00 2022-11-28 21:53:16+00:00 0:12:42 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
response.begin()
File "/usr/lib/python3.8/http/client.py", line 316, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
raise value
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 121, in docker_pull
image = client.images.get(get_complete_tag(br2))
File "/usr/local/lib/python3.8/dist-packages/docker/models/images.py", line 335, in get
return self.prepare_model(self.client.api.inspect_image(name))
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 252, in inspect_image
self._get(self._url("/images/{0}/json", image)), True
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
return self.request("GET", url, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
aws_object.load()
File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
response = action(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
response = getattr(parent.meta.client, operation_name)(*args, **params)
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
http, parsed_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
return self._send_request(request_dict, operation_model)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
while self._needs_retry(
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
responses = self._event_emitter.emit(
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
return self._emitter.emit(aliased_event_name, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
return self._emit(event_name, kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
response = handler(**kwargs)
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
if self._checker(**checker_kwargs):
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
should_retry = self._should_retry(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
return self._checker(attempt_number, response, caught_exception)
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
checker_response = checker(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
return self._check_caught_exception(
File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
raise caught_exception
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
http_response = self._send(request)
File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
return self.http_session.send(request)
File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/4acc797b76711d48cbd7317348a7a533c875d098aa6c345735ce3a48c6b5a03a"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16867
1647
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI-sim-testing
sim-0of4 timeout yes davinci-stage-08-6.2.53
2022-11-28 19:36:43+00:00 - - - - No reset possible 16844
1653
Bea Baselines 🐤baseline-duckietown aido-LFV-sim-validation
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-28 19:16:46+00:00 2022-11-28 19:36:29+00:00 0:19:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.79999999999874 in-drivable-lane_median 16.600000000000044 driven_lanedir_consec_median 3.899779146052007 deviation-center-line_median 3.477708608270985
other stats deviation-center-line_max 3.477708608270985 deviation-center-line_mean 3.477708608270985 deviation-center-line_min 3.477708608270985 deviation-heading_max 17.84484379181876 deviation-heading_mean 17.84484379181876 deviation-heading_median 17.84484379181876 deviation-heading_min 17.84484379181876 distance-from-start_max 2.1715851496637915 distance-from-start_mean 2.1715851496637915 distance-from-start_median 2.1715851496637915 distance-from-start_min 2.1715851496637915 driven_any_max 7.794094284025869 driven_any_mean 7.794094284025869 driven_any_median 7.794094284025869 driven_any_min 7.794094284025869 driven_lanedir_consec_max 3.899779146052007 driven_lanedir_consec_mean 3.899779146052007 driven_lanedir_consec_min 3.899779146052007 driven_lanedir_max 4.797305206900326 driven_lanedir_mean 4.797305206900326 driven_lanedir_median 4.797305206900326 driven_lanedir_min 4.797305206900326 in-drivable-lane_max 16.600000000000044 in-drivable-lane_mean 16.600000000000044 in-drivable-lane_min 16.600000000000044 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.794094284025869, "survival_time": 59.79999999999874, "driven_lanedir": 4.797305206900326, "in-drivable-lane": 16.600000000000044, "deviation-heading": 17.84484379181876, "distance-from-start": 2.1715851496637915, "deviation-center-line": 3.477708608270985, "driven_lanedir_consec": 3.899779146052007}}simulation-passed 1 survival_time_max 59.79999999999874 survival_time_mean 59.79999999999874 survival_time_min 59.79999999999874
No reset possible 16840
1654
Bea Baselines 🐤baseline-duckietown aido-LFVI-sim-validation
sim-2of4 success yes davinci-stage-08-6.2.53
2022-11-28 19:14:20+00:00 2022-11-28 19:16:21+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16830
1656
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-28 19:07:50+00:00 2022-11-28 19:14:00+00:00 0:06:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.8285038944945935 survival_time_median 59.99999999999873 deviation-center-line_median 3.642722126269238 in-drivable-lane_median 4.249999999999889
other stats deviation-center-line_max 3.642722126269238 deviation-center-line_mean 3.642722126269238 deviation-center-line_min 3.642722126269238 deviation-heading_max 10.679045566881594 deviation-heading_mean 10.679045566881594 deviation-heading_median 10.679045566881594 deviation-heading_min 10.679045566881594 distance-from-start_max 2.057330360436987 distance-from-start_mean 2.057330360436987 distance-from-start_median 2.057330360436987 distance-from-start_min 2.057330360436987 driven_any_max 7.907867781999718 driven_any_mean 7.907867781999718 driven_any_median 7.907867781999718 driven_any_min 7.907867781999718 driven_lanedir_consec_max 4.8285038944945935 driven_lanedir_consec_mean 4.8285038944945935 driven_lanedir_consec_min 4.8285038944945935 driven_lanedir_max 7.03520279972628 driven_lanedir_mean 7.03520279972628 driven_lanedir_median 7.03520279972628 driven_lanedir_min 7.03520279972628 in-drivable-lane_max 4.249999999999889 in-drivable-lane_mean 4.249999999999889 in-drivable-lane_min 4.249999999999889 per-episodes details {"loop-000-ego0": {"driven_any": 7.907867781999718, "survival_time": 59.99999999999873, "driven_lanedir": 7.03520279972628, "in-drivable-lane": 4.249999999999889, "deviation-heading": 10.679045566881594, "distance-from-start": 2.057330360436987, "deviation-center-line": 3.642722126269238, "driven_lanedir_consec": 4.8285038944945935}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16824
1657
Bea Baselines 🐤baseline-duckietown aido-LFVI_multi-sim-validation
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-28 19:05:35+00:00 2022-11-28 19:07:31+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16818
1659
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-28 19:01:28+00:00 2022-11-28 19:05:28+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.80000000000029 in-drivable-lane_median 0.9999999999999976 driven_lanedir_consec_median 3.521615492692299 deviation-center-line_median 2.6036507154536497
other stats deviation-center-line_max 2.6036507154536497 deviation-center-line_mean 2.6036507154536497 deviation-center-line_min 2.6036507154536497 deviation-heading_max 5.904872263386404 deviation-heading_mean 5.904872263386404 deviation-heading_median 5.904872263386404 deviation-heading_min 5.904872263386404 distance-from-start_max 2.011743621108002 distance-from-start_mean 2.011743621108002 distance-from-start_median 2.011743621108002 distance-from-start_min 2.011743621108002 driven_any_max 3.8052016795805614 driven_any_mean 3.8052016795805614 driven_any_median 3.8052016795805614 driven_any_min 3.8052016795805614 driven_lanedir_consec_max 3.521615492692299 driven_lanedir_consec_mean 3.521615492692299 driven_lanedir_consec_min 3.521615492692299 driven_lanedir_max 3.521615492692299 driven_lanedir_mean 3.521615492692299 driven_lanedir_median 3.521615492692299 driven_lanedir_min 3.521615492692299 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.9999999999999976 in-drivable-lane_min 0.9999999999999976 per-episodes details {"loop-000-ego0": {"driven_any": 3.8052016795805614, "survival_time": 29.80000000000029, "driven_lanedir": 3.521615492692299, "in-drivable-lane": 0.9999999999999976, "deviation-heading": 5.904872263386404, "distance-from-start": 2.011743621108002, "deviation-center-line": 2.6036507154536497, "driven_lanedir_consec": 3.521615492692299}}simulation-passed 1 survival_time_max 29.80000000000029 survival_time_mean 29.80000000000029 survival_time_min 29.80000000000029
No reset possible 16817
1659
Bea Baselines 🐤baseline-duckietown aido-LFP-sim-validation
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:58:37+00:00 2022-11-28 19:01:03+00:00 0:02:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.450000000000028 in-drivable-lane_median 0.9000000000000039 driven_lanedir_consec_median 1.212607488054101 deviation-center-line_median 0.59567667517759
other stats deviation-center-line_max 0.59567667517759 deviation-center-line_mean 0.59567667517759 deviation-center-line_min 0.59567667517759 deviation-heading_max 2.2927680187792574 deviation-heading_mean 2.2927680187792574 deviation-heading_median 2.2927680187792574 deviation-heading_min 2.2927680187792574 distance-from-start_max 1.166525006811424 distance-from-start_mean 1.166525006811424 distance-from-start_median 1.166525006811424 distance-from-start_min 1.166525006811424 driven_any_max 1.3755123265727172 driven_any_mean 1.3755123265727172 driven_any_median 1.3755123265727172 driven_any_min 1.3755123265727172 driven_lanedir_consec_max 1.212607488054101 driven_lanedir_consec_mean 1.212607488054101 driven_lanedir_consec_min 1.212607488054101 driven_lanedir_max 1.212607488054101 driven_lanedir_mean 1.212607488054101 driven_lanedir_median 1.212607488054101 driven_lanedir_min 1.212607488054101 in-drivable-lane_max 0.9000000000000039 in-drivable-lane_mean 0.9000000000000039 in-drivable-lane_min 0.9000000000000039 per-episodes details {"autolab-000-ego0": {"driven_any": 1.3755123265727172, "survival_time": 11.450000000000028, "driven_lanedir": 1.212607488054101, "in-drivable-lane": 0.9000000000000039, "deviation-heading": 2.2927680187792574, "distance-from-start": 1.166525006811424, "deviation-center-line": 0.59567667517759, "driven_lanedir_consec": 1.212607488054101}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 16810
1664
Bea Baselines 🐤baseline-duckietown lx22-BV1
sim-2of5 success yes davinci-stage-08-6.2.53
2022-11-28 18:53:12+00:00 2022-11-28 18:58:29+00:00 0:05:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 4.2899011348662155
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 4.2899011348662155 distance-from-start_median 4.2899011348662155 distance-from-start_min 4.2899011348662155 driven_any_max 4.747959089487622 driven_any_mean 4.747959089487622 driven_any_median 4.747959089487622 driven_any_min 4.747959089487622 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 36.85000000000005 in-drivable-lane_mean 36.85000000000005 in-drivable-lane_median 36.85000000000005 in-drivable-lane_min 36.85000000000005 per-episodes details {"d40-ego0": {"driven_any": 4.747959089487622, "survival_time": 36.85000000000005, "driven_lanedir": 0.0, "in-drivable-lane": 36.85000000000005, "deviation-heading": 0.0, "distance-from-start": 4.2899011348662155, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 36.85000000000005 survival_time_mean 36.85000000000005 survival_time_median 36.85000000000005 survival_time_min 36.85000000000005
No reset possible 16807
1667
Bea Baselines 🐤baseline-duckietown aido-hello-sim-validation
sanity-check success yes davinci-stage-08-6.2.53
2022-11-28 18:51:24+00:00 2022-11-28 18:52:40+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.013010188468504548 deviation-center-line_median 0.0065267581022494
other stats deviation-center-line_max 0.0065267581022494 deviation-center-line_mean 0.0065267581022494 deviation-center-line_min 0.0065267581022494 deviation-heading_max 0.26822023821330093 deviation-heading_mean 0.26822023821330093 deviation-heading_median 0.26822023821330093 deviation-heading_min 0.26822023821330093 distance-from-start_max 0.01508439628659429 distance-from-start_mean 0.01508439628659429 distance-from-start_median 0.01508439628659429 distance-from-start_min 0.01508439628659429 driven_any_max 0.015084841166674247 driven_any_mean 0.015084841166674247 driven_any_median 0.015084841166674247 driven_any_min 0.015084841166674247 driven_lanedir_consec_max 0.013010188468504548 driven_lanedir_consec_mean 0.013010188468504548 driven_lanedir_consec_min 0.013010188468504548 driven_lanedir_max 0.013010188468504548 driven_lanedir_mean 0.013010188468504548 driven_lanedir_median 0.013010188468504548 driven_lanedir_min 0.013010188468504548 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.015084841166674247, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013010188468504548, "in-drivable-lane": 0.0, "deviation-heading": 0.26822023821330093, "distance-from-start": 0.01508439628659429, "deviation-center-line": 0.0065267581022494, "driven_lanedir_consec": 0.013010188468504548}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 16797
1673
Bea Baselines 🐤baseline-duckietown aido-LFI-sim-testing
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:46:51+00:00 2022-11-28 18:51:04+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 27.05000000000025 in-drivable-lane_median 5.050000000000059 driven_lanedir_consec_median 1.704047824871458 deviation-center-line_median 2.2188163917818313
other stats deviation-center-line_max 2.2188163917818313 deviation-center-line_mean 2.2188163917818313 deviation-center-line_min 2.2188163917818313 deviation-heading_max 6.435291833325582 deviation-heading_mean 6.435291833325582 deviation-heading_median 6.435291833325582 deviation-heading_min 6.435291833325582 distance-from-start_max 1.482914350339111 distance-from-start_mean 1.482914350339111 distance-from-start_median 1.482914350339111 distance-from-start_min 1.482914350339111 driven_any_max 3.439921093501486 driven_any_mean 3.439921093501486 driven_any_median 3.439921093501486 driven_any_min 3.439921093501486 driven_lanedir_consec_max 1.704047824871458 driven_lanedir_consec_mean 1.704047824871458 driven_lanedir_consec_min 1.704047824871458 driven_lanedir_max 2.576526145578437 driven_lanedir_mean 2.576526145578437 driven_lanedir_median 2.576526145578437 driven_lanedir_min 2.576526145578437 in-drivable-lane_max 5.050000000000059 in-drivable-lane_mean 5.050000000000059 in-drivable-lane_min 5.050000000000059 per-episodes details {"4way-000-ego0": {"driven_any": 3.439921093501486, "survival_time": 27.05000000000025, "driven_lanedir": 2.576526145578437, "in-drivable-lane": 5.050000000000059, "deviation-heading": 6.435291833325582, "distance-from-start": 1.482914350339111, "deviation-center-line": 2.2188163917818313, "driven_lanedir_consec": 1.704047824871458}}simulation-passed 1 survival_time_max 27.05000000000025 survival_time_mean 27.05000000000025 survival_time_min 27.05000000000025
No reset possible 16783
1676
Bea Baselines 🐤baseline-duckietown aido-LFV_multi-sim-testing
sim-2of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:37:17+00:00 2022-11-28 18:46:46+00:00 0:09:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.7749999999999844 driven_lanedir_consec_median 7.257245169742525 deviation-center-line_median 4.342123357420131
other stats deviation-center-line_max 4.904693534897254 deviation-center-line_mean 4.342123357420131 deviation-center-line_min 3.779553179943007 deviation-heading_max 10.244721571046128 deviation-heading_mean 9.556271778231023 deviation-heading_median 9.556271778231023 deviation-heading_min 8.867821985415919 distance-from-start_max 1.0336058457710484 distance-from-start_mean 1.0167567102503186 distance-from-start_median 1.0167567102503186 distance-from-start_min 0.9999075747295888 driven_any_max 7.914296292697402 driven_any_mean 7.718466291435783 driven_any_median 7.718466291435783 driven_any_min 7.522636290174165 driven_lanedir_consec_max 7.512551779758537 driven_lanedir_consec_mean 7.257245169742525 driven_lanedir_consec_min 7.001938559726514 driven_lanedir_max 7.619971271040319 driven_lanedir_mean 7.36451079876 driven_lanedir_median 7.36451079876 driven_lanedir_min 7.109050326479681 in-drivable-lane_max 1.0 in-drivable-lane_mean 0.7749999999999844 in-drivable-lane_min 0.5499999999999687 per-episodes details {"loop2-000-ego0": {"driven_any": 7.522636290174165, "survival_time": 59.99999999999873, "driven_lanedir": 7.109050326479681, "in-drivable-lane": 1.0, "deviation-heading": 10.244721571046128, "distance-from-start": 0.9999075747295888, "deviation-center-line": 4.904693534897254, "driven_lanedir_consec": 7.001938559726514}, "loop2-000-ego1": {"driven_any": 7.914296292697402, "survival_time": 59.99999999999873, "driven_lanedir": 7.619971271040319, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 8.867821985415919, "distance-from-start": 1.0336058457710484, "deviation-center-line": 3.779553179943007, "driven_lanedir_consec": 7.512551779758537}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16771
1852
Andrea Censi exercises_braitenberg lx22-BV1
sim-0of5 success yes davinci-stage-08-6.2.53
2022-11-28 18:27:28+00:00 2022-11-28 18:37:04+00:00 0:09:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.668917750556934e-17
other stats deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.668917750556934e-17 distance-from-start_median 5.668917750556934e-17 distance-from-start_min 5.668917750556934e-17 driven_any_max 6.802701300668135e-14 driven_any_mean 6.802701300668135e-14 driven_any_median 6.802701300668135e-14 driven_any_min 6.802701300668135e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 59.99999999999873 in-drivable-lane_mean 59.99999999999873 in-drivable-lane_median 59.99999999999873 in-drivable-lane_min 59.99999999999873 per-episodes details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_median 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16763
1679
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:21:15+00:00 2022-11-28 18:26:53+00:00 0:05:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.560422051338984 deviation-center-line_median 0.27120156757925695
other stats deviation-center-line_max 0.27120156757925695 deviation-center-line_mean 0.27120156757925695 deviation-center-line_min 0.27120156757925695 deviation-heading_max 2.2601023015918167 deviation-heading_mean 2.2601023015918167 deviation-heading_median 2.2601023015918167 deviation-heading_min 2.2601023015918167 distance-from-start_max 2.771434789584769 distance-from-start_mean 2.771434789584769 distance-from-start_median 2.771434789584769 distance-from-start_min 2.771434789584769 driven_any_max 5.976806373273059 driven_any_mean 5.976806373273059 driven_any_median 5.976806373273059 driven_any_min 5.976806373273059 driven_lanedir_consec_max 5.560422051338984 driven_lanedir_consec_mean 5.560422051338984 driven_lanedir_consec_min 5.560422051338984 driven_lanedir_max 5.964295771107123 driven_lanedir_mean 5.964295771107123 driven_lanedir_median 5.964295771107123 driven_lanedir_min 5.964295771107123 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 5.976806373273059, "survival_time": 59.99999999999873, "driven_lanedir": 5.964295771107123, "in-drivable-lane": 0.0, "deviation-heading": 2.2601023015918167, "distance-from-start": 2.771434789584769, "deviation-center-line": 0.27120156757925695, "driven_lanedir_consec": 5.560422051338984}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16757
1682
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
sim-1of3 error yes davinci-stage-08-6.2.53
2022-11-28 18:17:53+00:00 2022-11-28 18:20:08+00:00 0:02:15 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│ anns: dict[7]
│ │ configuration : RobotConfiguration
│ │ color : str
│ │ description : str
│ │ controllable : bool
│ │ protocol : Optional[ProtocolDesc ]
│ │ dynamics : str
│ │ dynamics_params : Dict[str,Any ]
│ T: str
│ known: [color, configuration, controllable, description, protocol]
│ f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f969d5ace20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f969d5ace20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│ │ scenario_name : str
│ │ environment : Any
│ │ player_robots : List[str]
│ │ robots : Dict[str,ScenarioRobotSpec]
│ │ duckies : Dict[str,ScenarioDuckieSpec]
│ │ payload_yaml : str
│ expect_type: Dict[str,ScenarioRobotSpec]
│ ann_K: Dict[str,ScenarioRobotSpec]
│ K_name: Scenario
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
episodes0 = get_episodes_from_dirs(config.scenarios)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
scenario = cast(Scenario, object_from_ipce(config_, Scenario))
File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│ mj: dict[6]
│ │ payload_yaml : ''
│ │ player_robots : [ego0, ego1, ego2, ego3]
│ │ scenario_name : LFV_multi-state-4way-000
│ │ robots :
│ │ dict[4]
│ │ │ ego0 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego0
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 3.19, y : 1.276, theta_deg : 180.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego1 :
│ │ │ dict[5]
│ │ │ │ color : green
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego1
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 2.175, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego2 :
│ │ │ dict[5]
│ │ │ │ color : blue
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego2
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 2.75, y : 3.074, theta_deg : 90.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ │ ego3 :
│ │ │ dict[5]
│ │ │ │ color : red
│ │ │ │ protocol : PROTOCOL_STATE
│ │ │ │ description : Playable robot ego3
│ │ │ │ controllable : True
│ │ │ │ configuration : {pose : {x : 1.914, y : 2.7492, theta_deg : 0.0} , velocity : {x : 0.0, y : 0.0, theta_deg : 0.0} }
│ │ duckies : {}
│ │ environment :
│ │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│ │ |# Designed to test the 4-way intersection tile and traffic light
│ │ |tiles:
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |- [floor, curve_left/W , straight/W, 3way_left/W , straight/W, curve_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/N , asphalt , straight/N, floor]
│ │ |- [floor, 3way_left/S , straight/W, 4way , straight/E, 3way_left/N, floor]
│ │ |- [floor, straight/S , asphalt , straight/S , asphalt , straight/N, floor]
│ │ |- [floor, curve_left/S , straight/E, 3way_left/E , straight/E, curve_left/E, floor]
│ │ |- [floor, floor, floor, floor, floor, floor, floor]
│ │ |
│ │ |objects:
│ │ | trafficlight:
│ │ | kind: trafficlight
│ │ | place:
│ │ | tile: [3,3]
│ │ | relative:
│ │ | ~SE2Transform:
│ │ | p: [-0.18,-0.18]
│ │ | theta_deg: 135
│ │ | height: 0.4
│ │ | optional: true
│ │ |
│ │ |tile_size: 0.585
│ │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16749
1684
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-0of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:12:57+00:00 2022-11-28 18:17:36+00:00 0:04:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.6173794793891885 deviation-center-line_median 0.3790863571459804
other stats deviation-center-line_max 0.3790863571459804 deviation-center-line_mean 0.3790863571459804 deviation-center-line_min 0.3790863571459804 deviation-heading_max 2.844192295741865 deviation-heading_mean 2.844192295741865 deviation-heading_median 2.844192295741865 deviation-heading_min 2.844192295741865 distance-from-start_max 2.723986924723346 distance-from-start_mean 2.723986924723346 distance-from-start_median 2.723986924723346 distance-from-start_min 2.723986924723346 driven_any_max 5.636243490208466 driven_any_mean 5.636243490208466 driven_any_median 5.636243490208466 driven_any_min 5.636243490208466 driven_lanedir_consec_max 5.6173794793891885 driven_lanedir_consec_mean 5.6173794793891885 driven_lanedir_consec_min 5.6173794793891885 driven_lanedir_max 5.6173794793891885 driven_lanedir_mean 5.6173794793891885 driven_lanedir_median 5.6173794793891885 driven_lanedir_min 5.6173794793891885 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16737
1687
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-2of4 success yes davinci-stage-08-6.2.53
2022-11-28 18:01:25+00:00 2022-11-28 18:12:38+00:00 0:11:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.40652749865251103
other stats deviation-center-line_max 0.40652749865251103 deviation-center-line_mean 0.40652749865251103 deviation-center-line_min 0.40652749865251103 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.40652749865251103, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16723
1690
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-28 17:50:57+00:00 2022-11-28 18:01:00+00:00 0:10:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.268486692511211 deviation-center-line_median 0.2677582178916847
other stats deviation-center-line_max 0.2677582178916847 deviation-center-line_mean 0.2677582178916847 deviation-center-line_min 0.2677582178916847 deviation-heading_max 2.3862148122965765 deviation-heading_mean 2.3862148122965765 deviation-heading_median 2.3862148122965765 deviation-heading_min 2.3862148122965765 distance-from-start_max 3.215326192663788 distance-from-start_mean 3.215326192663788 distance-from-start_median 3.215326192663788 distance-from-start_min 3.215326192663788 driven_any_max 5.282829526436911 driven_any_mean 5.282829526436911 driven_any_median 5.282829526436911 driven_any_min 5.282829526436911 driven_lanedir_consec_max 5.268486692511211 driven_lanedir_consec_mean 5.268486692511211 driven_lanedir_consec_min 5.268486692511211 driven_lanedir_max 5.268486692511211 driven_lanedir_mean 5.268486692511211 driven_lanedir_median 5.268486692511211 driven_lanedir_min 5.268486692511211 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.282829526436911, "survival_time": 59.99999999999873, "driven_lanedir": 5.268486692511211, "in-drivable-lane": 0.0, "deviation-heading": 2.3862148122965765, "distance-from-start": 3.215326192663788, "deviation-center-line": 0.2677582178916847, "driven_lanedir_consec": 5.268486692511211}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 16719
1691
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-1of4 success yes davinci-stage-08-6.2.53
2022-11-28 17:48:38+00:00 2022-11-28 17:50:25+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.499999999999986 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7152019553352842 deviation-center-line_median 0.09388648296550528
other stats deviation-center-line_max 0.09388648296550528 deviation-center-line_mean 0.09388648296550528 deviation-center-line_min 0.09388648296550528 deviation-heading_max 0.944239660915932 deviation-heading_mean 0.944239660915932 deviation-heading_median 0.944239660915932 deviation-heading_min 0.944239660915932 distance-from-start_max 0.7152240362894687 distance-from-start_mean 0.7152240362894687 distance-from-start_median 0.7152240362894687 distance-from-start_min 0.7152240362894687 driven_any_max 0.7257895926659109 driven_any_mean 0.7257895926659109 driven_any_median 0.7257895926659109 driven_any_min 0.7257895926659109 driven_lanedir_consec_max 0.7152019553352842 driven_lanedir_consec_mean 0.7152019553352842 driven_lanedir_consec_min 0.7152019553352842 driven_lanedir_max 0.7152019553352842 driven_lanedir_mean 0.7152019553352842 driven_lanedir_median 0.7152019553352842 driven_lanedir_min 0.7152019553352842 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.7257895926659109, "survival_time": 8.499999999999986, "driven_lanedir": 0.7152019553352842, "in-drivable-lane": 0.0, "deviation-heading": 0.944239660915932, "distance-from-start": 0.7152240362894687, "deviation-center-line": 0.09388648296550528, "driven_lanedir_consec": 0.7152019553352842}}simulation-passed 1 survival_time_max 8.499999999999986 survival_time_mean 8.499999999999986 survival_time_min 8.499999999999986
No reset possible 16716
1693
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-2of4 success yes davinci-stage-08-6.2.53
2022-11-28 17:46:30+00:00 2022-11-28 17:48:19+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16714
1693
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-28 17:44:49+00:00 2022-11-28 17:46:23+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 16700
1695
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-3of4 success yes davinci-stage-08-6.2.53
2022-11-28 17:35:08+00:00 2022-11-28 17:44:42+00:00 0:09:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.8916689297600247 deviation-center-line_median 5.681440925821353
other stats deviation-center-line_max 5.681440925821353 deviation-center-line_mean 5.681440925821353 deviation-center-line_min 5.681440925821353 deviation-heading_max 11.493741379653043 deviation-heading_mean 11.493741379653043 deviation-heading_median 11.493741379653043 deviation-heading_min 11.493741379653043 distance-from-start_max 2.522916946842169 distance-from-start_mean 2.522916946842169 distance-from-start_median 2.522916946842169 distance-from-start_min 2.522916946842169 driven_any_max 3.4265750568184306 driven_any_mean 3.4265750568184306 driven_any_median 3.4265750568184306 driven_any_min 3.4265750568184306 driven_lanedir_consec_max 2.8916689297600247 driven_lanedir_consec_mean 2.8916689297600247 driven_lanedir_consec_min 2.8916689297600247 driven_lanedir_max 3.0974169287243676 driven_lanedir_mean 3.0974169287243676 driven_lanedir_median 3.0974169287243676 driven_lanedir_min 3.0974169287243676 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4265750568184306, "survival_time": 59.99999999999873, "driven_lanedir": 3.0974169287243676, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.493741379653043, "distance-from-start": 2.522916946842169, "deviation-center-line": 5.681440925821353, "driven_lanedir_consec": 2.8916689297600247}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible