Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 7484803Bea Baselines challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984ea aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-012021-11-06 20:07:48+00:00 2021-11-06 20:11:18+00:00 0:03:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.05012812782398557 deviation-center-line_median 0.006183811986424075
other stats deviation-center-line_max 0.006183811986424075 deviation-center-line_mean 0.006183811986424075 deviation-center-line_min 0.006183811986424075 deviation-heading_max 0.2538899413619584 deviation-heading_mean 0.2538899413619584 deviation-heading_median 0.2538899413619584 deviation-heading_min 0.2538899413619584 distance-from-start_max 0.05583197755851184 distance-from-start_mean 0.05583197755851184 distance-from-start_median 0.05583197755851184 distance-from-start_min 0.05583197755851184 driven_any_max 0.055942182981586805 driven_any_mean 0.055942182981586805 driven_any_median 0.055942182981586805 driven_any_min 0.055942182981586805 driven_lanedir_consec_max 0.05012812782398557 driven_lanedir_consec_mean 0.05012812782398557 driven_lanedir_consec_min 0.05012812782398557 driven_lanedir_max 0.05012812782398557 driven_lanedir_mean 0.05012812782398557 driven_lanedir_median 0.05012812782398557 driven_lanedir_min 0.05012812782398557 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.055942182981586805, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05012812782398557, "in-drivable-lane": 0.0, "deviation-heading": 0.2538899413619584, "distance-from-start": 0.05583197755851184, "deviation-center-line": 0.006183811986424075, "driven_lanedir_consec": 0.05012812782398557}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 7483802Bea Baselines challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551 aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-012021-11-04 06:28:26+00:00 2021-11-04 06:34:19+00:00 0:05:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.010008401910581275 deviation-center-line_median 0.00573715072971882
other stats deviation-center-line_max 0.00573715072971882 deviation-center-line_mean 0.00573715072971882 deviation-center-line_min 0.00573715072971882 deviation-heading_max 0.3410071559157052 deviation-heading_mean 0.3410071559157052 deviation-heading_median 0.3410071559157052 deviation-heading_min 0.3410071559157052 distance-from-start_max 0.015776464545847833 distance-from-start_mean 0.015776464545847833 distance-from-start_median 0.015776464545847833 distance-from-start_min 0.015776464545847833 driven_any_max 0.015976037486025052 driven_any_mean 0.015976037486025052 driven_any_median 0.015976037486025052 driven_any_min 0.015976037486025052 driven_lanedir_consec_max 0.010008401910581275 driven_lanedir_consec_mean 0.010008401910581275 driven_lanedir_consec_min 0.010008401910581275 driven_lanedir_max 0.010008401910581275 driven_lanedir_mean 0.010008401910581275 driven_lanedir_median 0.010008401910581275 driven_lanedir_min 0.010008401910581275 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.015976037486025052, "survival_time": 0.49999999999999994, "driven_lanedir": 0.010008401910581275, "in-drivable-lane": 0.0, "deviation-heading": 0.3410071559157052, "distance-from-start": 0.015776464545847833, "deviation-center-line": 0.00573715072971882, "driven_lanedir_consec": 0.010008401910581275}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 7481802Bea Baselines challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551 aido-hello-sim-validationsanity-check timeout no gpu-staging-spot-0-012021-11-04 01:41:31+00:00 - - - - No reset possible 7476800Andrea Daniele template-tensorflow aido-LF-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 15:37:44+00:00 2021-11-03 15:38:38+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7472801Andrea Daniele template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-03 15:31:36+00:00 2021-11-03 15:37:30+00:00 0:05:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7464385Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-validationsim-1of4 host-error no gpu-staging-spot-0-012021-11-03 08:54:22+00:00 2021-11-03 08:55:58+00:00 0:01:36 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7462385Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 08:46:25+00:00 2021-11-03 08:54:03+00:00 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 23.549999999999407 driven_lanedir_consec_median -2.80816981929656 deviation-center-line_median 3.1705909319874266
other stats deviation-center-line_max 3.2031501595747427 deviation-center-line_mean 3.1705909319874266 deviation-center-line_min 3.1380317044001105 deviation-heading_max 27.38750038269329 deviation-heading_mean 27.17853414459518 deviation-heading_median 27.17853414459518 deviation-heading_min 26.969567906497073 distance-from-start_max 0.243028520096987 distance-from-start_mean 0.23113979033453097 distance-from-start_median 0.23113979033453097 distance-from-start_min 0.21925106057207497 driven_any_max 10.789718515953489 driven_any_mean 10.78179782988968 driven_any_median 10.78179782988968 driven_any_min 10.773877143825874 driven_lanedir_consec_max -2.7940012989555862 driven_lanedir_consec_mean -2.80816981929656 driven_lanedir_consec_min -2.822338339637534 driven_lanedir_max -2.822338339637534 driven_lanedir_mean -2.995569372201296 driven_lanedir_median -2.995569372201296 driven_lanedir_min -3.168800404765059 in-drivable-lane_max 24.49999999999946 in-drivable-lane_mean 23.549999999999407 in-drivable-lane_min 22.599999999999355 per-episodes details {"loop2-000-ego0": {"driven_any": 10.789718515953489, "survival_time": 59.99999999999873, "driven_lanedir": -3.168800404765059, "in-drivable-lane": 22.599999999999355, "deviation-heading": 27.38750038269329, "distance-from-start": 0.21925106057207497, "deviation-center-line": 3.2031501595747427, "driven_lanedir_consec": -2.7940012989555862}, "loop2-000-ego1": {"driven_any": 10.773877143825874, "survival_time": 59.99999999999873, "driven_lanedir": -2.822338339637534, "in-drivable-lane": 24.49999999999946, "deviation-heading": 26.969567906497073, "distance-from-start": 0.243028520096987, "deviation-center-line": 3.1380317044001105, "driven_lanedir_consec": -2.822338339637534}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7458386Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 08:39:26+00:00 2021-11-03 08:45:55+00:00 0:06:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 31.149999999999203 driven_lanedir_consec_median -3.5570680926229317 deviation-center-line_median 2.2365736079010836
other stats deviation-center-line_max 2.2365736079010836 deviation-center-line_mean 2.2365736079010836 deviation-center-line_min 2.2365736079010836 deviation-heading_max 24.13916814827827 deviation-heading_mean 24.13916814827827 deviation-heading_median 24.13916814827827 deviation-heading_min 24.13916814827827 distance-from-start_max 0.16616534133609628 distance-from-start_mean 0.16616534133609628 distance-from-start_median 0.16616534133609628 distance-from-start_min 0.16616534133609628 driven_any_max 12.746372744802825 driven_any_mean 12.746372744802825 driven_any_median 12.746372744802825 driven_any_min 12.746372744802825 driven_lanedir_consec_max -3.5570680926229317 driven_lanedir_consec_mean -3.5570680926229317 driven_lanedir_consec_min -3.5570680926229317 driven_lanedir_max -4.041994106797747 driven_lanedir_mean -4.041994106797747 driven_lanedir_median -4.041994106797747 driven_lanedir_min -4.041994106797747 in-drivable-lane_max 31.149999999999203 in-drivable-lane_mean 31.149999999999203 in-drivable-lane_min 31.149999999999203 per-episodes details {"autolab-000-ego0": {"driven_any": 12.746372744802825, "survival_time": 59.99999999999873, "driven_lanedir": -4.041994106797747, "in-drivable-lane": 31.149999999999203, "deviation-heading": 24.13916814827827, "distance-from-start": 0.16616534133609628, "deviation-center-line": 2.2365736079010836, "driven_lanedir_consec": -3.5570680926229317}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7450388Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 08:26:47+00:00 2021-11-03 08:38:59+00:00 0:12:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.849999999999365 driven_lanedir_consec_median -4.632800236253587 deviation-center-line_median 2.0066191591132463
other stats deviation-center-line_max 2.0066191591132463 deviation-center-line_mean 2.0066191591132463 deviation-center-line_min 2.0066191591132463 deviation-heading_max 25.884470990658972 deviation-heading_mean 25.884470990658972 deviation-heading_median 25.884470990658972 deviation-heading_min 25.884470990658972 distance-from-start_max 0.20992347458909583 distance-from-start_mean 0.20992347458909583 distance-from-start_median 0.20992347458909583 distance-from-start_min 0.20992347458909583 driven_any_max 14.840455501333906 driven_any_mean 14.840455501333906 driven_any_median 14.840455501333906 driven_any_min 14.840455501333906 driven_lanedir_consec_max -4.632800236253587 driven_lanedir_consec_mean -4.632800236253587 driven_lanedir_consec_min -4.632800236253587 driven_lanedir_max -5.6294751831716425 driven_lanedir_mean -5.6294751831716425 driven_lanedir_median -5.6294751831716425 driven_lanedir_min -5.6294751831716425 in-drivable-lane_max 26.849999999999365 in-drivable-lane_mean 26.849999999999365 in-drivable-lane_min 26.849999999999365 per-episodes details {"udem-000-ego0": {"driven_any": 14.840455501333906, "survival_time": 59.99999999999873, "driven_lanedir": -5.6294751831716425, "in-drivable-lane": 26.849999999999365, "deviation-heading": 25.884470990658972, "distance-from-start": 0.20992347458909583, "deviation-center-line": 2.0066191591132463, "driven_lanedir_consec": -4.632800236253587}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7445389Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 08:19:49+00:00 2021-11-03 08:26:35+00:00 0:06:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 33.499999999999076 driven_lanedir_consec_median -1.6021686322953823 deviation-center-line_median 2.444340439693278
other stats deviation-center-line_max 2.444340439693278 deviation-center-line_mean 2.444340439693278 deviation-center-line_min 2.444340439693278 deviation-heading_max 24.583716964437503 deviation-heading_mean 24.583716964437503 deviation-heading_median 24.583716964437503 deviation-heading_min 24.583716964437503 distance-from-start_max 0.16942181368384898 distance-from-start_mean 0.16942181368384898 distance-from-start_median 0.16942181368384898 distance-from-start_min 0.16942181368384898 driven_any_max 9.671117801508784 driven_any_mean 9.671117801508784 driven_any_median 9.671117801508784 driven_any_min 9.671117801508784 driven_lanedir_consec_max -1.6021686322953823 driven_lanedir_consec_mean -1.6021686322953823 driven_lanedir_consec_min -1.6021686322953823 driven_lanedir_max -1.649422903932289 driven_lanedir_mean -1.649422903932289 driven_lanedir_median -1.649422903932289 driven_lanedir_min -1.649422903932289 in-drivable-lane_max 33.499999999999076 in-drivable-lane_mean 33.499999999999076 in-drivable-lane_min 33.499999999999076 per-episodes details {"udem1-000-ego0": {"driven_any": 9.671117801508784, "survival_time": 59.99999999999873, "driven_lanedir": -1.649422903932289, "in-drivable-lane": 33.499999999999076, "deviation-heading": 24.583716964437503, "distance-from-start": 0.16942181368384898, "deviation-center-line": 2.444340439693278, "driven_lanedir_consec": -1.6021686322953823}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7440390Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 08:15:22+00:00 2021-11-03 08:19:35+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.996460545989977 survival_time_median 46.69999999999949 deviation-center-line_median 2.219537288371418 in-drivable-lane_median 20.49999999999969
other stats deviation-center-line_max 2.219537288371418 deviation-center-line_mean 2.219537288371418 deviation-center-line_min 2.219537288371418 deviation-heading_max 20.44778400167749 deviation-heading_mean 20.44778400167749 deviation-heading_median 20.44778400167749 deviation-heading_min 20.44778400167749 distance-from-start_max 0.14904572809798686 distance-from-start_mean 0.14904572809798686 distance-from-start_median 0.14904572809798686 distance-from-start_min 0.14904572809798686 driven_any_max 8.01798574810038 driven_any_mean 8.01798574810038 driven_any_median 8.01798574810038 driven_any_min 8.01798574810038 driven_lanedir_consec_max -1.996460545989977 driven_lanedir_consec_mean -1.996460545989977 driven_lanedir_consec_min -1.996460545989977 driven_lanedir_max -2.0528335801210833 driven_lanedir_mean -2.0528335801210833 driven_lanedir_median -2.0528335801210833 driven_lanedir_min -2.0528335801210833 in-drivable-lane_max 20.49999999999969 in-drivable-lane_mean 20.49999999999969 in-drivable-lane_min 20.49999999999969 per-episodes details {"loop-000-ego0": {"driven_any": 8.01798574810038, "survival_time": 46.69999999999949, "driven_lanedir": -2.0528335801210833, "in-drivable-lane": 20.49999999999969, "deviation-heading": 20.44778400167749, "distance-from-start": 0.14904572809798686, "deviation-center-line": 2.219537288371418, "driven_lanedir_consec": -1.996460545989977}}simulation-passed 1 survival_time_max 46.69999999999949 survival_time_mean 46.69999999999949 survival_time_min 46.69999999999949
No reset possible 7436390Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 08:09:20+00:00 2021-11-03 08:15:02+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -3.4145395561275427 survival_time_median 59.99999999999873 deviation-center-line_median 2.396298174117818 in-drivable-lane_median 24.54999999999947
other stats deviation-center-line_max 2.396298174117818 deviation-center-line_mean 2.396298174117818 deviation-center-line_min 2.396298174117818 deviation-heading_max 27.48911618933342 deviation-heading_mean 27.48911618933342 deviation-heading_median 27.48911618933342 deviation-heading_min 27.48911618933342 distance-from-start_max 0.30246804451949477 distance-from-start_mean 0.30246804451949477 distance-from-start_median 0.30246804451949477 distance-from-start_min 0.30246804451949477 driven_any_max 11.937880372054057 driven_any_mean 11.937880372054057 driven_any_median 11.937880372054057 driven_any_min 11.937880372054057 driven_lanedir_consec_max -3.4145395561275427 driven_lanedir_consec_mean -3.4145395561275427 driven_lanedir_consec_min -3.4145395561275427 driven_lanedir_max -3.560544598998088 driven_lanedir_mean -3.560544598998088 driven_lanedir_median -3.560544598998088 driven_lanedir_min -3.560544598998088 in-drivable-lane_max 24.54999999999947 in-drivable-lane_mean 24.54999999999947 in-drivable-lane_min 24.54999999999947 per-episodes details {"autolab-000-ego0": {"driven_any": 11.937880372054057, "survival_time": 59.99999999999873, "driven_lanedir": -3.560544598998088, "in-drivable-lane": 24.54999999999947, "deviation-heading": 27.48911618933342, "distance-from-start": 0.30246804451949477, "deviation-center-line": 2.396298174117818, "driven_lanedir_consec": -3.4145395561275427}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7435391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-1of4 host-error no gpu-staging-spot-0-012021-11-03 08:07:56+00:00 2021-11-03 08:09:12+00:00 0:01:16 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7434391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-0of4 host-error no gpu-staging-spot-0-012021-11-03 08:06:23+00:00 2021-11-03 08:07:36+00:00 0:01:13 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:
error in ego0 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7433391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 08:04:53+00:00 2021-11-03 08:06:11+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7432391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 08:03:30+00:00 2021-11-03 08:04:47+00:00 0:01:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7411398Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 07:41:16+00:00 2021-11-03 08:03:16+00:00 0:22:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 24.69999999999939 driven_lanedir_consec_median -3.1473647992471214 deviation-center-line_median 2.8849600353824423
other stats deviation-center-line_max 4.138591177554047 deviation-center-line_mean 3.0420131798095165 deviation-center-line_min 2.259541470919133 deviation-heading_max 29.258421001549006 deviation-heading_mean 25.364840405771115 deviation-heading_median 25.93655311713897 deviation-heading_min 20.32783438725751 distance-from-start_max 0.2914835440982413 distance-from-start_mean 0.19924600884974555 distance-from-start_median 0.17725609500133432 distance-from-start_min 0.15098830129807228 driven_any_max 12.932424354455389 driven_any_mean 10.12974270348809 driven_any_median 11.635137152807328 driven_any_min 4.316272153882314 driven_lanedir_consec_max -1.2875152527845184 driven_lanedir_consec_mean -2.8348746214893095 driven_lanedir_consec_min -3.757253634678477 driven_lanedir_max -1.285168166528145 driven_lanedir_mean -2.854502483898763 driven_lanedir_median -3.187794067194215 driven_lanedir_min -3.757253634678477 in-drivable-lane_max 32.39999999999925 in-drivable-lane_mean 22.537499999999525 in-drivable-lane_min 8.35000000000006 per-episodes details {"udem-000-ego0": {"driven_any": 4.316272153882314, "survival_time": 59.99999999999873, "driven_lanedir": -1.285168166528145, "in-drivable-lane": 8.35000000000006, "deviation-heading": 20.32783438725751, "distance-from-start": 0.15098830129807228, "deviation-center-line": 4.138591177554047, "driven_lanedir_consec": -1.2875152527845184}, "udem-000-ego1": {"driven_any": 11.884684336868627, "survival_time": 59.99999999999873, "driven_lanedir": -3.232589390083507, "in-drivable-lane": 23.39999999999943, "deviation-heading": 28.16901956052336, "distance-from-start": 0.1917006799383564, "deviation-center-line": 3.088508728212045, "driven_lanedir_consec": -3.232589390083507}, "udem-000-ego2": {"driven_any": 11.38558996874603, "survival_time": 59.99999999999873, "driven_lanedir": -3.1429987443049225, "in-drivable-lane": 32.39999999999925, "deviation-heading": 23.70408667375458, "distance-from-start": 0.16281151006431227, "deviation-center-line": 2.6814113425528396, "driven_lanedir_consec": -3.062140208410736}, "udem-000-ego3": {"driven_any": 12.932424354455389, "survival_time": 59.99999999999873, "driven_lanedir": -3.757253634678477, "in-drivable-lane": 25.999999999999357, "deviation-heading": 29.258421001549006, "distance-from-start": 0.2914835440982413, "deviation-center-line": 2.259541470919133, "driven_lanedir_consec": -3.757253634678477}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7407515Bea Baselines baseline-behavior-cloning aido-LFP-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-03 07:39:57+00:00 2021-11-03 07:40:50+00:00 0:00:53 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7401516Bea Baselines baseline-behavior-cloning aido-LFV-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-11-03 07:38:14+00:00 2021-11-03 07:39:38+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7396517Bea Baselines baseline-behavior-cloning aido-LFVI-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 07:36:27+00:00 2021-11-03 07:38:00+00:00 0:01:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7390518Bea Baselines baseline-behavior-cloning aido-LFI-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 07:34:31+00:00 2021-11-03 07:35:55+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7363528Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 07:18:06+00:00 2021-11-03 07:34:18+00:00 0:16:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 9.08757285550254 deviation-center-line_median 3.2848056329663375
other stats deviation-center-line_max 3.583850580096196 deviation-center-line_mean 3.233256422265649 deviation-center-line_min 2.7795638430337255 deviation-heading_max 15.347729304875571 deviation-heading_mean 14.266346879980116 deviation-heading_median 14.150064340782276 deviation-heading_min 13.417529533480336 distance-from-start_max 4.489128804141646 distance-from-start_mean 3.83343161083928 distance-from-start_median 3.79390402572126 distance-from-start_min 3.2567895877729542 driven_any_max 10.12071569490703 driven_any_mean 9.562976170051977 driven_any_median 9.56718488015478 driven_any_min 8.996819224991317 driven_lanedir_consec_max 9.579472338687737 driven_lanedir_consec_mean 9.102145320598172 driven_lanedir_consec_min 8.653963232699866 driven_lanedir_max 9.579472338687737 driven_lanedir_mean 9.102145320598172 driven_lanedir_median 9.08757285550254 driven_lanedir_min 8.653963232699866 in-drivable-lane_max 0.649999999999963 in-drivable-lane_mean 0.16249999999999076 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 10.12071569490703, "survival_time": 59.99999999999873, "driven_lanedir": 9.579472338687737, "in-drivable-lane": 0.0, "deviation-heading": 15.347729304875571, "distance-from-start": 3.830680714999032, "deviation-center-line": 3.0037394915440037, "driven_lanedir_consec": 9.579472338687737}, "zigzag-000-ego1": {"driven_any": 8.996819224991317, "survival_time": 59.99999999999873, "driven_lanedir": 8.653963232699866, "in-drivable-lane": 0.0, "deviation-heading": 13.987175154586726, "distance-from-start": 3.2567895877729542, "deviation-center-line": 3.565871774388671, "driven_lanedir_consec": 8.653963232699866}, "zigzag-000-ego2": {"driven_any": 9.57306387211526, "survival_time": 59.99999999999873, "driven_lanedir": 9.091655461395089, "in-drivable-lane": 0.0, "deviation-heading": 14.312953526977823, "distance-from-start": 3.757127336443488, "deviation-center-line": 2.7795638430337255, "driven_lanedir_consec": 9.091655461395089}, "zigzag-000-ego3": {"driven_any": 9.5613058881943, "survival_time": 59.99999999999873, "driven_lanedir": 9.083490249609994, "in-drivable-lane": 0.649999999999963, "deviation-heading": 13.417529533480336, "distance-from-start": 4.489128804141646, "deviation-center-line": 3.583850580096196, "driven_lanedir_consec": 9.083490249609994}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7351530Bea Baselines baseline-dagger-pytorch aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 07:05:28+00:00 2021-11-03 07:17:47+00:00 0:12:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.90000000000002 driven_lanedir_consec_median 8.22367224071635 deviation-center-line_median 2.460974352564828
other stats deviation-center-line_max 2.460974352564828 deviation-center-line_mean 2.460974352564828 deviation-center-line_min 2.460974352564828 deviation-heading_max 12.16527380947872 deviation-heading_mean 12.16527380947872 deviation-heading_median 12.16527380947872 deviation-heading_min 12.16527380947872 distance-from-start_max 4.5661432851069925 distance-from-start_mean 4.5661432851069925 distance-from-start_median 4.5661432851069925 distance-from-start_min 4.5661432851069925 driven_any_max 9.019437147213784 driven_any_mean 9.019437147213784 driven_any_median 9.019437147213784 driven_any_min 9.019437147213784 driven_lanedir_consec_max 8.22367224071635 driven_lanedir_consec_mean 8.22367224071635 driven_lanedir_consec_min 8.22367224071635 driven_lanedir_max 8.22367224071635 driven_lanedir_mean 8.22367224071635 driven_lanedir_median 8.22367224071635 driven_lanedir_min 8.22367224071635 in-drivable-lane_max 1.90000000000002 in-drivable-lane_mean 1.90000000000002 in-drivable-lane_min 1.90000000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.019437147213784, "survival_time": 59.99999999999873, "driven_lanedir": 8.22367224071635, "in-drivable-lane": 1.90000000000002, "deviation-heading": 12.16527380947872, "distance-from-start": 4.5661432851069925, "deviation-center-line": 2.460974352564828, "driven_lanedir_consec": 8.22367224071635}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7349531Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 07:03:27+00:00 2021-11-03 07:05:17+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7346532Bea Baselines baseline-dagger-pytorch aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 07:01:31+00:00 2021-11-03 07:03:09+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7336532Bea Baselines baseline-dagger-pytorch aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:59:52+00:00 2021-11-03 07:01:24+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7306535Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:46:35+00:00 2021-11-03 06:59:39+00:00 0:13:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1000000000000076 driven_lanedir_consec_median 5.277706687106961 deviation-center-line_median 2.8253514763448107
other stats deviation-center-line_max 3.2147142574613827 deviation-center-line_mean 2.433691040710438 deviation-center-line_min 0.8693469526907485 deviation-heading_max 37.82293240559152 deviation-heading_mean 20.407103022616724 deviation-heading_median 16.036095446328325 deviation-heading_min 11.73328879221872 distance-from-start_max 2.816062516091878 distance-from-start_mean 1.715088272380319 distance-from-start_median 2.0221452867146987 distance-from-start_min 2.482534153247273e-16 driven_any_max 10.739230596032517 driven_any_mean 5.8213204499970175 driven_any_median 6.2730256019776265 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 9.669733629107052 driven_lanedir_consec_mean 5.056286750830244 driven_lanedir_consec_min 0.0 driven_lanedir_max 9.669733629107052 driven_lanedir_mean 5.056286750830244 driven_lanedir_median 5.277706687106961 driven_lanedir_min 0.0 in-drivable-lane_max 5.800000000000004 in-drivable-lane_mean 2.000000000000005 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 10.692269473608954, "survival_time": 59.99999999999873, "driven_lanedir": 8.74043540300033, "in-drivable-lane": 5.800000000000004, "deviation-heading": 16.96305377601752, "distance-from-start": 2.816062516091878, "deviation-center-line": 2.888240331959969, "driven_lanedir_consec": 8.74043540300033}, "loop-000-ego1": {"driven_any": 10.739230596032517, "survival_time": 59.99999999999873, "driven_lanedir": 9.669733629107052, "in-drivable-lane": 2.2000000000000153, "deviation-heading": 15.109137116639127, "distance-from-start": 2.637721252692864, "deviation-center-line": 3.2147142574613827, "driven_lanedir_consec": 9.669733629107052}, "loop-000-ego2": {"driven_any": 1.853781730346298, "survival_time": 59.99999999999873, "driven_lanedir": 1.814977971213592, "in-drivable-lane": 0.0, "deviation-heading": 11.73328879221872, "distance-from-start": 1.4065693207365335, "deviation-center-line": 0.8693469526907485, "driven_lanedir_consec": 1.814977971213592}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7304536Bea Baselines baseline-dagger-pytorch aido-LFP-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:44:09+00:00 2021-11-03 06:46:23+00:00 0:02:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.20000000000008 in-drivable-lane_median 0.9999999999999992 driven_lanedir_consec_median 2.326990573615572 deviation-center-line_median 0.7773976029187782
other stats deviation-center-line_max 0.7773976029187782 deviation-center-line_mean 0.7773976029187782 deviation-center-line_min 0.7773976029187782 deviation-heading_max 4.7395772789100254 deviation-heading_mean 4.7395772789100254 deviation-heading_median 4.7395772789100254 deviation-heading_min 4.7395772789100254 distance-from-start_max 1.998343984994168 distance-from-start_mean 1.998343984994168 distance-from-start_median 1.998343984994168 distance-from-start_min 1.998343984994168 driven_any_max 2.727532575901371 driven_any_mean 2.727532575901371 driven_any_median 2.727532575901371 driven_any_min 2.727532575901371 driven_lanedir_consec_max 2.326990573615572 driven_lanedir_consec_mean 2.326990573615572 driven_lanedir_consec_min 2.326990573615572 driven_lanedir_max 2.326990573615572 driven_lanedir_mean 2.326990573615572 driven_lanedir_median 2.326990573615572 driven_lanedir_min 2.326990573615572 in-drivable-lane_max 0.9999999999999992 in-drivable-lane_mean 0.9999999999999992 in-drivable-lane_min 0.9999999999999992 per-episodes details {"loop-000-ego0": {"driven_any": 2.727532575901371, "survival_time": 15.20000000000008, "driven_lanedir": 2.326990573615572, "in-drivable-lane": 0.9999999999999992, "deviation-heading": 4.7395772789100254, "distance-from-start": 1.998343984994168, "deviation-center-line": 0.7773976029187782, "driven_lanedir_consec": 2.326990573615572}}simulation-passed 1 survival_time_max 15.20000000000008 survival_time_mean 15.20000000000008 survival_time_min 15.20000000000008
No reset possible 7298536Bea Baselines baseline-dagger-pytorch aido-LFP-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-03 06:42:34+00:00 2021-11-03 06:43:57+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.349999999999989 in-drivable-lane_median 0.5000000000000002 driven_lanedir_consec_median 0.4839317933320264 deviation-center-line_median 0.3258798015284152
other stats deviation-center-line_max 0.3258798015284152 deviation-center-line_mean 0.3258798015284152 deviation-center-line_min 0.3258798015284152 deviation-heading_max 2.382888417200621 deviation-heading_mean 2.382888417200621 deviation-heading_median 2.382888417200621 deviation-heading_min 2.382888417200621 distance-from-start_max 0.5357209273725807 distance-from-start_mean 0.5357209273725807 distance-from-start_median 0.5357209273725807 distance-from-start_min 0.5357209273725807 driven_any_max 0.6417215724416234 driven_any_mean 0.6417215724416234 driven_any_median 0.6417215724416234 driven_any_min 0.6417215724416234 driven_lanedir_consec_max 0.4839317933320264 driven_lanedir_consec_mean 0.4839317933320264 driven_lanedir_consec_min 0.4839317933320264 driven_lanedir_max 0.4839317933320264 driven_lanedir_mean 0.4839317933320264 driven_lanedir_median 0.4839317933320264 driven_lanedir_min 0.4839317933320264 in-drivable-lane_max 0.5000000000000002 in-drivable-lane_mean 0.5000000000000002 in-drivable-lane_min 0.5000000000000002 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6417215724416234, "survival_time": 5.349999999999989, "driven_lanedir": 0.4839317933320264, "in-drivable-lane": 0.5000000000000002, "deviation-heading": 2.382888417200621, "distance-from-start": 0.5357209273725807, "deviation-center-line": 0.3258798015284152, "driven_lanedir_consec": 0.4839317933320264}}simulation-passed 1 survival_time_max 5.349999999999989 survival_time_mean 5.349999999999989 survival_time_min 5.349999999999989
No reset possible 7290539Bea Baselines baseline-dagger-pytorch aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 06:39:42+00:00 2021-11-03 06:42:26+00:00 0:02:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.550000000000143 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.231182421539206 deviation-center-line_median 1.0918998276705665
other stats deviation-center-line_max 1.0918998276705665 deviation-center-line_mean 1.0918998276705665 deviation-center-line_min 1.0918998276705665 deviation-heading_max 4.94970951173447 deviation-heading_mean 4.94970951173447 deviation-heading_median 4.94970951173447 deviation-heading_min 4.94970951173447 distance-from-start_max 1.9372395161869271 distance-from-start_mean 1.9372395161869271 distance-from-start_median 1.9372395161869271 distance-from-start_min 1.9372395161869271 driven_any_max 3.3859084187149113 driven_any_mean 3.3859084187149113 driven_any_median 3.3859084187149113 driven_any_min 3.3859084187149113 driven_lanedir_consec_max 3.231182421539206 driven_lanedir_consec_mean 3.231182421539206 driven_lanedir_consec_min 3.231182421539206 driven_lanedir_max 3.249496832349814 driven_lanedir_mean 3.249496832349814 driven_lanedir_median 3.249496832349814 driven_lanedir_min 3.249496832349814 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 3.3859084187149113, "survival_time": 19.550000000000143, "driven_lanedir": 3.249496832349814, "in-drivable-lane": 0.0, "deviation-heading": 4.94970951173447, "distance-from-start": 1.9372395161869271, "deviation-center-line": 1.0918998276705665, "driven_lanedir_consec": 3.231182421539206}}simulation-passed 1 survival_time_max 19.550000000000143 survival_time_mean 19.550000000000143 survival_time_min 19.550000000000143
No reset possible 7247542Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 06:23:37+00:00 2021-11-03 06:39:35+00:00 0:15:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.823553741889105 deviation-center-line_median 3.983458236637881
other stats deviation-center-line_max 6.281333849933507 deviation-center-line_mean 4.1652294977199205 deviation-center-line_min 2.4126676676704104 deviation-heading_max 23.28477073765129 deviation-heading_mean 14.818382674060697 deviation-heading_median 14.49827068330578 deviation-heading_min 6.992218591979942 distance-from-start_max 3.2421457322943077 distance-from-start_mean 1.8938290325931733 distance-from-start_median 1.6571975684111 distance-from-start_min 1.0187752612561856 driven_any_max 10.843645749118274 driven_any_mean 6.432563128452722 driven_any_median 6.184763659394429 driven_any_min 2.517079445903755 driven_lanedir_consec_max 9.541691919121511 driven_lanedir_consec_mean 5.815132727418242 driven_lanedir_consec_min 2.0717315067732467 driven_lanedir_max 10.099384406013364 driven_lanedir_mean 6.1051233866269135 driven_lanedir_median 5.9439438169521095 driven_lanedir_min 2.4332215065900686 in-drivable-lane_max 0.7500000000000107 in-drivable-lane_mean 0.18750000000000264 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 10.843645749118274, "survival_time": 59.99999999999873, "driven_lanedir": 10.099384406013364, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 15.033903746248717, "distance-from-start": 3.2421457322943077, "deviation-center-line": 3.461834441485266, "driven_lanedir_consec": 9.541691919121511}, "4way-000-ego1": {"driven_any": 7.206361565084911, "survival_time": 59.99999999999873, "driven_lanedir": 6.916640123768451, "in-drivable-lane": 0.0, "deviation-heading": 13.962637620362845, "distance-from-start": 1.0187752612561856, "deviation-center-line": 4.505082031790495, "driven_lanedir_consec": 6.916625695253271}, "4way-000-ego2": {"driven_any": 2.517079445903755, "survival_time": 59.99999999999873, "driven_lanedir": 2.4332215065900686, "in-drivable-lane": 0.0, "deviation-heading": 23.28477073765129, "distance-from-start": 2.000072882370798, "deviation-center-line": 6.281333849933507, "driven_lanedir_consec": 2.0717315067732467}, "4way-000-ego3": {"driven_any": 5.163165753703948, "survival_time": 59.99999999999873, "driven_lanedir": 4.971247510135768, "in-drivable-lane": 0.0, "deviation-heading": 6.992218591979942, "distance-from-start": 1.314322254451402, "deviation-center-line": 2.4126676676704104, "driven_lanedir_consec": 4.730481788524941}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7231544Bea Baselines baseline-dagger-pytorch aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-012021-11-03 06:19:49+00:00 2021-11-03 06:23:23+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.01240368263050562 deviation-center-line_median 0.006339758837127676
other stats deviation-center-line_max 0.006339758837127676 deviation-center-line_mean 0.006339758837127676 deviation-center-line_min 0.006339758837127676 deviation-heading_max 0.23577623897437733 deviation-heading_mean 0.23577623897437733 deviation-heading_median 0.23577623897437733 deviation-heading_min 0.23577623897437733 distance-from-start_max 0.013393119767342844 distance-from-start_mean 0.013393119767342844 distance-from-start_median 0.013393119767342844 distance-from-start_min 0.013393119767342844 driven_any_max 0.01344564436245346 driven_any_mean 0.01344564436245346 driven_any_median 0.01344564436245346 driven_any_min 0.01344564436245346 driven_lanedir_consec_max 0.01240368263050562 driven_lanedir_consec_mean 0.01240368263050562 driven_lanedir_consec_min 0.01240368263050562 driven_lanedir_max 0.01240368263050562 driven_lanedir_mean 0.01240368263050562 driven_lanedir_median 0.01240368263050562 driven_lanedir_min 0.01240368263050562 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.01344564436245346, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01240368263050562, "in-drivable-lane": 0.0, "deviation-heading": 0.23577623897437733, "distance-from-start": 0.013393119767342844, "deviation-center-line": 0.006339758837127676, "driven_lanedir_consec": 0.01240368263050562}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 7216603Bea Baselines template-ros aido-LFV_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:15:52+00:00 2021-11-03 06:19:29+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.30000000000004 in-drivable-lane_median 10.40000000000004 driven_lanedir_consec_median 0.4645810263027971 deviation-center-line_median 0.11915433500317996
other stats deviation-center-line_max 0.3517527138124399 deviation-center-line_mean 0.16772731670644905 deviation-center-line_min 0.08084788300699636 deviation-heading_max 0.6165754921748776 deviation-heading_mean 0.5377992315769108 deviation-heading_median 0.5404502957197896 deviation-heading_min 0.45372084269318613 distance-from-start_max 2.8891124806336617 distance-from-start_mean 1.4879256435504082 distance-from-start_median 1.0968250344820896 distance-from-start_min 0.8689400246037917 driven_any_max 3.399882211474631 driven_any_mean 1.6251244866226495 driven_any_median 1.1135314374702556 driven_any_min 0.8735528600754561 driven_lanedir_consec_max 1.024552423882178 driven_lanedir_consec_mean 0.5293746126706552 driven_lanedir_consec_min 0.1637839741948488 driven_lanedir_max 1.024552423882178 driven_lanedir_mean 0.5293746126706552 driven_lanedir_median 0.4645810263027971 driven_lanedir_min 0.1637839741948488 in-drivable-lane_max 11.40000000000004 in-drivable-lane_mean 10.175000000000042 in-drivable-lane_min 8.500000000000046 per-episodes details {"loop-000-ego0": {"driven_any": 0.9223063808234252, "survival_time": 12.30000000000004, "driven_lanedir": 0.21985466391812425, "in-drivable-lane": 11.10000000000004, "deviation-heading": 0.6165754921748776, "distance-from-start": 0.900670700943192, "deviation-center-line": 0.09073224147586344, "driven_lanedir_consec": 0.21985466391812425}, "loop-000-ego1": {"driven_any": 1.3047564941170855, "survival_time": 12.30000000000004, "driven_lanedir": 0.1637839741948488, "in-drivable-lane": 11.40000000000004, "deviation-heading": 0.45372084269318613, "distance-from-start": 1.292979368020987, "deviation-center-line": 0.08084788300699636, "driven_lanedir_consec": 0.1637839741948488}, "loop-000-ego2": {"driven_any": 3.399882211474631, "survival_time": 12.30000000000004, "driven_lanedir": 1.024552423882178, "in-drivable-lane": 8.500000000000046, "deviation-heading": 0.5849318607208999, "distance-from-start": 2.8891124806336617, "deviation-center-line": 0.3517527138124399, "driven_lanedir_consec": 1.024552423882178}, "loop-000-ego3": {"driven_any": 0.8735528600754561, "survival_time": 12.30000000000004, "driven_lanedir": 0.7093073886874699, "in-drivable-lane": 9.700000000000042, "deviation-heading": 0.49596873071867936, "distance-from-start": 0.8689400246037917, "deviation-center-line": 0.1475764285304965, "driven_lanedir_consec": 0.7093073886874699}}simulation-passed 1 survival_time_max 12.30000000000004 survival_time_mean 12.30000000000004 survival_time_min 12.30000000000004
No reset possible 7205603Bea Baselines template-ros aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 06:13:35+00:00 2021-11-03 06:15:39+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.449999999999985 in-drivable-lane_median 4.624999999999986 driven_lanedir_consec_median 0.4380226559458686 deviation-center-line_median 0.161272327556864
other stats deviation-center-line_max 0.21076931021864215 deviation-center-line_mean 0.161272327556864 deviation-center-line_min 0.11177534489508582 deviation-heading_max 0.6986206179038541 deviation-heading_mean 0.5750139833674159 deviation-heading_median 0.5750139833674159 deviation-heading_min 0.45140734883097766 distance-from-start_max 1.6692010701866025 distance-from-start_mean 1.2501592869192517 distance-from-start_median 1.2501592869192517 distance-from-start_min 0.8311175036519008 driven_any_max 1.6816214189491343 driven_any_mean 1.2691191491630072 driven_any_median 1.2691191491630072 driven_any_min 0.8566168793768796 driven_lanedir_consec_max 0.6293903756356735 driven_lanedir_consec_mean 0.4380226559458686 driven_lanedir_consec_min 0.24665493625606372 driven_lanedir_max 0.6293903756356735 driven_lanedir_mean 0.4380226559458686 driven_lanedir_median 0.4380226559458686 driven_lanedir_min 0.24665493625606372 in-drivable-lane_max 5.299999999999985 in-drivable-lane_mean 4.624999999999986 in-drivable-lane_min 3.949999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 0.8566168793768796, "survival_time": 6.449999999999985, "driven_lanedir": 0.6293903756356735, "in-drivable-lane": 3.949999999999986, "deviation-heading": 0.6986206179038541, "distance-from-start": 0.8311175036519008, "deviation-center-line": 0.21076931021864215, "driven_lanedir_consec": 0.6293903756356735}, "loop2-000-ego1": {"driven_any": 1.6816214189491343, "survival_time": 6.449999999999985, "driven_lanedir": 0.24665493625606372, "in-drivable-lane": 5.299999999999985, "deviation-heading": 0.45140734883097766, "distance-from-start": 1.6692010701866025, "deviation-center-line": 0.11177534489508582, "driven_lanedir_consec": 0.24665493625606372}}simulation-passed 1 survival_time_max 6.449999999999985 survival_time_mean 6.449999999999985 survival_time_min 6.449999999999985
No reset possible 7194605Bea Baselines template-ros aido-LFV-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 06:11:35+00:00 2021-11-03 06:13:20+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.6999999999999984 in-drivable-lane_median 1.7499999999999982 driven_lanedir_consec_median 0.17567108855863944 deviation-center-line_median 0.05565839718607983
other stats deviation-center-line_max 0.05565839718607983 deviation-center-line_mean 0.05565839718607983 deviation-center-line_min 0.05565839718607983 deviation-heading_max 0.5647419933054036 deviation-heading_mean 0.5647419933054036 deviation-heading_median 0.5647419933054036 deviation-heading_min 0.5647419933054036 distance-from-start_max 0.5434922908718933 distance-from-start_mean 0.5434922908718933 distance-from-start_median 0.5434922908718933 distance-from-start_min 0.5434922908718933 driven_any_max 0.5495071168784819 driven_any_mean 0.5495071168784819 driven_any_median 0.5495071168784819 driven_any_min 0.5495071168784819 driven_lanedir_consec_max 0.17567108855863944 driven_lanedir_consec_mean 0.17567108855863944 driven_lanedir_consec_min 0.17567108855863944 driven_lanedir_max 0.17567108855863944 driven_lanedir_mean 0.17567108855863944 driven_lanedir_median 0.17567108855863944 driven_lanedir_min 0.17567108855863944 in-drivable-lane_max 1.7499999999999982 in-drivable-lane_mean 1.7499999999999982 in-drivable-lane_min 1.7499999999999982 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5495071168784819, "survival_time": 2.6999999999999984, "driven_lanedir": 0.17567108855863944, "in-drivable-lane": 1.7499999999999982, "deviation-heading": 0.5647419933054036, "distance-from-start": 0.5434922908718933, "deviation-center-line": 0.05565839718607983, "driven_lanedir_consec": 0.17567108855863944}}simulation-passed 1 survival_time_max 2.6999999999999984 survival_time_mean 2.6999999999999984 survival_time_min 2.6999999999999984
No reset possible 7176610Bea Baselines template-ros aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:07:43+00:00 2021-11-03 06:11:27+00:00 0:03:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.800000000000018 in-drivable-lane_median 8.225000000000023 driven_lanedir_consec_median 0.19882231798206695 deviation-center-line_median 0.22775755336056533
other stats deviation-center-line_max 0.497243271731349 deviation-center-line_mean 0.26293561155118556 deviation-center-line_min 0.09898406775226253 deviation-heading_max 6.808127833006696 deviation-heading_mean 2.1746910385707503 deviation-heading_median 0.7623757991027919 deviation-heading_min 0.36588472307072034 distance-from-start_max 2.8503021263116275 distance-from-start_mean 1.460360343621726 distance-from-start_median 1.4955696240876382 distance-from-start_min 2.482534153247273e-16 driven_any_max 2.993449773397161 driven_any_mean 1.52584908814401 driven_any_median 1.554973289589413 driven_any_min 5.362273771014096e-14 driven_lanedir_consec_max 0.959559000115979 driven_lanedir_consec_mean 0.33930090902002824 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.959559000115979 driven_lanedir_mean 0.33930090902002824 driven_lanedir_median 0.19882231798206695 driven_lanedir_min 0.0 in-drivable-lane_max 9.800000000000018 in-drivable-lane_mean 6.562500000000016 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 2.993449773397161, "survival_time": 10.800000000000018, "driven_lanedir": 0.19677045158094564, "in-drivable-lane": 9.45000000000002, "deviation-heading": 1.086242314793381, "distance-from-start": 2.8503021263116275, "deviation-center-line": 0.11520517459312912, "driven_lanedir_consec": 0.19677045158094564}, "loop-000-ego1": {"driven_any": 1.251835990484875, "survival_time": 10.800000000000018, "driven_lanedir": 0.20087418438318827, "in-drivable-lane": 9.800000000000018, "deviation-heading": 0.36588472307072034, "distance-from-start": 1.2261594233817656, "deviation-center-line": 0.09898406775226253, "driven_lanedir_consec": 0.20087418438318827}, "loop-000-ego2": {"driven_any": 1.858110588693951, "survival_time": 10.800000000000018, "driven_lanedir": 0.959559000115979, "in-drivable-lane": 7.000000000000024, "deviation-heading": 0.4385092834122027, "distance-from-start": 1.764979824793511, "deviation-center-line": 0.34030993212800154, "driven_lanedir_consec": 0.959559000115979}, "loop-000-ego3": {"driven_any": 5.362273771014096e-14, "survival_time": 10.800000000000018, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 6.808127833006696, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.497243271731349, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 10.800000000000018 survival_time_mean 10.800000000000018 survival_time_min 10.800000000000018
No reset possible 7170608Bea Baselines template-ros aido-LF-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 06:05:53+00:00 2021-11-03 06:07:30+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1946345821564366 survival_time_median 10.050000000000008 deviation-center-line_median 0.1449707381349213 in-drivable-lane_median 8.050000000000011
other stats deviation-center-line_max 0.1449707381349213 deviation-center-line_mean 0.1449707381349213 deviation-center-line_min 0.1449707381349213 deviation-heading_max 2.018300960498825 deviation-heading_mean 2.018300960498825 deviation-heading_median 2.018300960498825 deviation-heading_min 2.018300960498825 distance-from-start_max 2.5633574363377862 distance-from-start_mean 2.5633574363377862 distance-from-start_median 2.5633574363377862 distance-from-start_min 2.5633574363377862 driven_any_max 2.698371738986825 driven_any_mean 2.698371738986825 driven_any_median 2.698371738986825 driven_any_min 2.698371738986825 driven_lanedir_consec_max 0.1946345821564366 driven_lanedir_consec_mean 0.1946345821564366 driven_lanedir_consec_min 0.1946345821564366 driven_lanedir_max 0.1970730133493872 driven_lanedir_mean 0.1970730133493872 driven_lanedir_median 0.1970730133493872 driven_lanedir_min 0.1970730133493872 in-drivable-lane_max 8.050000000000011 in-drivable-lane_mean 8.050000000000011 in-drivable-lane_min 8.050000000000011 per-episodes details {"loop-000-ego0": {"driven_any": 2.698371738986825, "survival_time": 10.050000000000008, "driven_lanedir": 0.1970730133493872, "in-drivable-lane": 8.050000000000011, "deviation-heading": 2.018300960498825, "distance-from-start": 2.5633574363377862, "deviation-center-line": 0.1449707381349213, "driven_lanedir_consec": 0.1946345821564366}}simulation-passed 1 survival_time_max 10.050000000000008 survival_time_mean 10.050000000000008 survival_time_min 10.050000000000008
No reset possible 7168609Bea Baselines template-ros aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 06:04:24+00:00 2021-11-03 06:05:40+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7160613Bea Baselines template-ros aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 06:01:49+00:00 2021-11-03 06:04:17+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.999999999999994 in-drivable-lane_median 3.1499999999999937 driven_lanedir_consec_median 0.10692657937236394 deviation-center-line_median 0.05502447639469707
other stats deviation-center-line_max 0.05502447639469707 deviation-center-line_mean 0.05502447639469707 deviation-center-line_min 0.05502447639469707 deviation-heading_max 0.6540051273448816 deviation-heading_mean 0.6540051273448816 deviation-heading_median 0.6540051273448816 deviation-heading_min 0.6540051273448816 distance-from-start_max 0.8625107596168414 distance-from-start_mean 0.8625107596168414 distance-from-start_median 0.8625107596168414 distance-from-start_min 0.8625107596168414 driven_any_max 0.9086420907200226 driven_any_mean 0.9086420907200226 driven_any_median 0.9086420907200226 driven_any_min 0.9086420907200226 driven_lanedir_consec_max 0.10692657937236394 driven_lanedir_consec_mean 0.10692657937236394 driven_lanedir_consec_min 0.10692657937236394 driven_lanedir_max 0.10692657937236394 driven_lanedir_mean 0.10692657937236394 driven_lanedir_median 0.10692657937236394 driven_lanedir_min 0.10692657937236394 in-drivable-lane_max 3.1499999999999937 in-drivable-lane_mean 3.1499999999999937 in-drivable-lane_min 3.1499999999999937 per-episodes details {"4way-000-ego0": {"driven_any": 0.9086420907200226, "survival_time": 3.999999999999994, "driven_lanedir": 0.10692657937236394, "in-drivable-lane": 3.1499999999999937, "deviation-heading": 0.6540051273448816, "distance-from-start": 0.8625107596168414, "deviation-center-line": 0.05502447639469707, "driven_lanedir_consec": 0.10692657937236394}}simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 3.999999999999994 survival_time_min 3.999999999999994
No reset possible 7146613Bea Baselines template-ros aido-LFVI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 05:58:42+00:00 2021-11-03 06:01:28+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.299999999999983 in-drivable-lane_median 5.299999999999989 driven_lanedir_consec_median 0.6051308565374107 deviation-center-line_median 0.2873410766939655
other stats deviation-center-line_max 0.2873410766939655 deviation-center-line_mean 0.2873410766939655 deviation-center-line_min 0.2873410766939655 deviation-heading_max 1.9993691290730873 deviation-heading_mean 1.9993691290730873 deviation-heading_median 1.9993691290730873 deviation-heading_min 1.9993691290730873 distance-from-start_max 2.258848547847379 distance-from-start_mean 2.258848547847379 distance-from-start_median 2.258848547847379 distance-from-start_min 2.258848547847379 driven_any_max 2.3014134163692903 driven_any_mean 2.3014134163692903 driven_any_median 2.3014134163692903 driven_any_min 2.3014134163692903 driven_lanedir_consec_max 0.6051308565374107 driven_lanedir_consec_mean 0.6051308565374107 driven_lanedir_consec_min 0.6051308565374107 driven_lanedir_max 0.6051308565374107 driven_lanedir_mean 0.6051308565374107 driven_lanedir_median 0.6051308565374107 driven_lanedir_min 0.6051308565374107 in-drivable-lane_max 5.299999999999989 in-drivable-lane_mean 5.299999999999989 in-drivable-lane_min 5.299999999999989 per-episodes details {"udem-000-ego0": {"driven_any": 2.3014134163692903, "survival_time": 8.299999999999983, "driven_lanedir": 0.6051308565374107, "in-drivable-lane": 5.299999999999989, "deviation-heading": 1.9993691290730873, "distance-from-start": 2.258848547847379, "deviation-center-line": 0.2873410766939655, "driven_lanedir_consec": 0.6051308565374107}}simulation-passed 1 survival_time_max 8.299999999999983 survival_time_mean 8.299999999999983 survival_time_min 8.299999999999983
No reset possible 7140614Bea Baselines template-ros aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 05:56:56+00:00 2021-11-03 05:58:28+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7135615Bea Baselines template-ros aido-LF-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 05:54:36+00:00 2021-11-03 05:56:30+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.21937318911476875 survival_time_median 12.150000000000038 deviation-center-line_median 0.18113988718261467 in-drivable-lane_median 9.950000000000042
other stats deviation-center-line_max 0.18113988718261467 deviation-center-line_mean 0.18113988718261467 deviation-center-line_min 0.18113988718261467 deviation-heading_max 2.240140568670565 deviation-heading_mean 2.240140568670565 deviation-heading_median 2.240140568670565 deviation-heading_min 2.240140568670565 distance-from-start_max 2.872651170694217 distance-from-start_mean 2.872651170694217 distance-from-start_median 2.872651170694217 distance-from-start_min 2.872651170694217 driven_any_max 3.331606672878445 driven_any_mean 3.331606672878445 driven_any_median 3.331606672878445 driven_any_min 3.331606672878445 driven_lanedir_consec_max 0.21937318911476875 driven_lanedir_consec_mean 0.21937318911476875 driven_lanedir_consec_min 0.21937318911476875 driven_lanedir_max 0.24332069734209735 driven_lanedir_mean 0.24332069734209735 driven_lanedir_median 0.24332069734209735 driven_lanedir_min 0.24332069734209735 in-drivable-lane_max 9.950000000000042 in-drivable-lane_mean 9.950000000000042 in-drivable-lane_min 9.950000000000042 per-episodes details {"autolab-000-ego0": {"driven_any": 3.331606672878445, "survival_time": 12.150000000000038, "driven_lanedir": 0.24332069734209735, "in-drivable-lane": 9.950000000000042, "deviation-heading": 2.240140568670565, "distance-from-start": 2.872651170694217, "deviation-center-line": 0.18113988718261467, "driven_lanedir_consec": 0.21937318911476875}}simulation-passed 1 survival_time_max 12.150000000000038 survival_time_mean 12.150000000000038 survival_time_min 12.150000000000038
No reset possible 7128616Bea Baselines template-ros aido-LFVI_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 05:51:32+00:00 2021-11-03 05:54:05+00:00 0:02:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.14999999999999 in-drivable-lane_median 2.774999999999994 driven_lanedir_consec_median 0.2919799945416204 deviation-center-line_median 0.2420474236655563
other stats deviation-center-line_max 0.59526452379992 deviation-center-line_mean 0.28503364471854303 deviation-center-line_min 0.06077520774313964 deviation-heading_max 2.6565535907645614 deviation-heading_mean 1.2899963258929787 deviation-heading_median 1.0661695769353314 deviation-heading_min 0.37109255893669085 distance-from-start_max 1.023954831313195 distance-from-start_mean 0.6366643849422237 distance-from-start_median 0.5775180076179878 distance-from-start_min 0.3676666932197241 driven_any_max 1.3138286596455786 driven_any_mean 0.7106464245897492 driven_any_median 0.5801290433440911 driven_any_min 0.36849895202523647 driven_lanedir_consec_max 0.6652888326726285 driven_lanedir_consec_mean 0.33245219096877676 driven_lanedir_consec_min 0.08055994211923778 driven_lanedir_max 0.6652914535809198 driven_lanedir_mean 0.3324528461958496 driven_lanedir_median 0.2919799945416204 driven_lanedir_min 0.08055994211923778 in-drivable-lane_max 4.39999999999999 in-drivable-lane_mean 2.4874999999999945 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.3138286596455786, "survival_time": 5.14999999999999, "driven_lanedir": 0.6652914535809198, "in-drivable-lane": 1.399999999999999, "deviation-heading": 2.6565535907645614, "distance-from-start": 1.023954831313195, "deviation-center-line": 0.379711637241768, "driven_lanedir_consec": 0.6652888326726285}, "4way-000-ego1": {"driven_any": 0.36849895202523647, "survival_time": 5.14999999999999, "driven_lanedir": 0.2000670273669347, "in-drivable-lane": 4.14999999999999, "deviation-heading": 0.37109255893669085, "distance-from-start": 0.3676666932197241, "deviation-center-line": 0.10438321008934456, "driven_lanedir_consec": 0.2000670273669347}, "4way-000-ego2": {"driven_any": 0.3967515568396375, "survival_time": 5.14999999999999, "driven_lanedir": 0.3838929617163061, "in-drivable-lane": 0.0, "deviation-heading": 1.5839369442194178, "distance-from-start": 0.39406324593575337, "deviation-center-line": 0.59526452379992, "driven_lanedir_consec": 0.3838929617163061}, "4way-000-ego3": {"driven_any": 0.7635065298485448, "survival_time": 5.14999999999999, "driven_lanedir": 0.08055994211923778, "in-drivable-lane": 4.39999999999999, "deviation-heading": 0.5484022096512451, "distance-from-start": 0.7609727693002223, "deviation-center-line": 0.06077520774313964, "driven_lanedir_consec": 0.08055994211923778}}simulation-passed 1 survival_time_max 5.14999999999999 survival_time_mean 5.14999999999999 survival_time_min 5.14999999999999
No reset possible 7101625Bea Baselines baseline-duckietown aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 05:37:38+00:00 2021-11-03 05:51:25+00:00 0:13:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 43.074999999998894 driven_lanedir_consec_median 0.9494567470731744 deviation-center-line_median 1.3264106585807267
other stats deviation-center-line_max 2.4568535044851805 deviation-center-line_mean 1.3786698177594858 deviation-center-line_min 0.40500444939130986 deviation-heading_max 8.736510670553015 deviation-heading_mean 4.131789267609728 deviation-heading_median 3.322637367366968 deviation-heading_min 1.145371665151958 distance-from-start_max 4.064136633981858 distance-from-start_mean 1.5866250392987014 distance-from-start_median 0.9973714266722656 distance-from-start_min 0.28762066986841595 driven_any_max 7.914007346879525 driven_any_mean 3.066432012316862 driven_any_median 1.6608303319093238 driven_any_min 1.0300600385692749 driven_lanedir_consec_max 2.5453667670309073 driven_lanedir_consec_mean 1.1739201230945178 driven_lanedir_consec_min 0.2514002312008152 driven_lanedir_max 3.0829253739896942 driven_lanedir_mean 1.387754649029528 driven_lanedir_median 0.9494567470731744 driven_lanedir_min 0.5691797279820698 in-drivable-lane_max 53.54999999999875 in-drivable-lane_mean 34.92499999999913 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.0300600385692749, "survival_time": 59.99999999999873, "driven_lanedir": 0.5691797279820698, "in-drivable-lane": 53.54999999999875, "deviation-heading": 4.754215487669521, "distance-from-start": 0.28762066986841595, "deviation-center-line": 0.5791152667666034, "driven_lanedir_consec": 0.2514002312008152}, "autolab-000-ego1": {"driven_any": 2.2913328147791963, "survival_time": 59.99999999999873, "driven_lanedir": 0.8695435478882656, "in-drivable-lane": 52.49999999999875, "deviation-heading": 1.8910592470644152, "distance-from-start": 0.9650100151525276, "deviation-center-line": 0.40500444939130986, "driven_lanedir_consec": 0.8695435478882656}, "autolab-000-ego2": {"driven_any": 1.0303278490394516, "survival_time": 59.99999999999873, "driven_lanedir": 1.029369946258083, "in-drivable-lane": 0.0, "deviation-heading": 1.145371665151958, "distance-from-start": 1.0297328381920037, "deviation-center-line": 2.07370605039485, "driven_lanedir_consec": 1.029369946258083}, "autolab-000-ego3": {"driven_any": 7.914007346879525, "survival_time": 59.99999999999873, "driven_lanedir": 3.0829253739896942, "in-drivable-lane": 33.64999999999904, "deviation-heading": 8.736510670553015, "distance-from-start": 4.064136633981858, "deviation-center-line": 2.4568535044851805, "driven_lanedir_consec": 2.5453667670309073}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7075646Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 05:18:28+00:00 2021-11-03 05:37:19+00:00 0:18:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 48.399999999998826 driven_lanedir_consec_median 0.3747514003779232 deviation-center-line_median 1.108729078686169
other stats deviation-center-line_max 2.5528152224566107 deviation-center-line_mean 1.2555627509501115 deviation-center-line_min 0.25197762397149814 deviation-heading_max 21.251138604286417 deviation-heading_mean 11.108717978953292 deviation-heading_median 10.287650295089374 deviation-heading_min 2.6084327213479983 distance-from-start_max 0.5540960575013886 distance-from-start_mean 0.4519070021932735 distance-from-start_median 0.5107281988097797 distance-from-start_min 0.23207555365214627 driven_any_max 9.786370427703329 driven_any_mean 4.600956365566386 driven_any_median 3.926512953123405 driven_any_min 0.7644291283154071 driven_lanedir_consec_max 0.8013486638511657 driven_lanedir_consec_mean 0.434912813182584 driven_lanedir_consec_min 0.18879978812332365 driven_lanedir_max 1.2219370324362788 driven_lanedir_mean 0.7196088857712923 driven_lanedir_median 0.7338493612627836 driven_lanedir_min 0.18879978812332365 in-drivable-lane_max 56.59999999999874 in-drivable-lane_mean 46.57499999999896 in-drivable-lane_min 32.89999999999944 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7644291283154071, "survival_time": 59.99999999999873, "driven_lanedir": 0.18879978812332365, "in-drivable-lane": 56.59999999999874, "deviation-heading": 2.6084327213479983, "distance-from-start": 0.23207555365214627, "deviation-center-line": 0.25197762397149814, "driven_lanedir_consec": 0.18879978812332365}, "zigzag-000-ego1": {"driven_any": 4.151433900456305, "survival_time": 59.99999999999873, "driven_lanedir": 1.2219370324362788, "in-drivable-lane": 32.89999999999944, "deviation-heading": 21.251138604286417, "distance-from-start": 0.5124758763800512, "deviation-center-line": 2.5528152224566107, "driven_lanedir_consec": 0.8013486638511657}, "zigzag-000-ego2": {"driven_any": 3.701592005790504, "survival_time": 59.99999999999873, "driven_lanedir": 0.5934084598726206, "in-drivable-lane": 48.24999999999864, "deviation-heading": 9.648389817822585, "distance-from-start": 0.5089805212395082, "deviation-center-line": 1.005613442426864, "driven_lanedir_consec": 0.24138142567927012}, "zigzag-000-ego3": {"driven_any": 9.786370427703329, "survival_time": 59.99999999999873, "driven_lanedir": 0.8742902626529465, "in-drivable-lane": 48.54999999999902, "deviation-heading": 10.926910772356164, "distance-from-start": 0.5540960575013886, "deviation-center-line": 1.2118447149454743, "driven_lanedir_consec": 0.5081213750765763}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7072647Bea Baselines template-pytorch aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 05:16:45+00:00 2021-11-03 05:18:21+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.3499999999999925 in-drivable-lane_median 3.1499999999999924 driven_lanedir_consec_median 0.1171556047316078 deviation-center-line_median 0.07482601829083321
other stats deviation-center-line_max 0.07482601829083321 deviation-center-line_mean 0.07482601829083321 deviation-center-line_min 0.07482601829083321 deviation-heading_max 0.8915233502033632 deviation-heading_mean 0.8915233502033632 deviation-heading_median 0.8915233502033632 deviation-heading_min 0.8915233502033632 distance-from-start_max 0.6373495204355714 distance-from-start_mean 0.6373495204355714 distance-from-start_median 0.6373495204355714 distance-from-start_min 0.6373495204355714 driven_any_max 0.759232346874082 driven_any_mean 0.759232346874082 driven_any_median 0.759232346874082 driven_any_min 0.759232346874082 driven_lanedir_consec_max 0.1171556047316078 driven_lanedir_consec_mean 0.1171556047316078 driven_lanedir_consec_min 0.1171556047316078 driven_lanedir_max 0.1171556047316078 driven_lanedir_mean 0.1171556047316078 driven_lanedir_median 0.1171556047316078 driven_lanedir_min 0.1171556047316078 in-drivable-lane_max 3.1499999999999924 in-drivable-lane_mean 3.1499999999999924 in-drivable-lane_min 3.1499999999999924 per-episodes details {"autolab-000-ego0": {"driven_any": 0.759232346874082, "survival_time": 4.3499999999999925, "driven_lanedir": 0.1171556047316078, "in-drivable-lane": 3.1499999999999924, "deviation-heading": 0.8915233502033632, "distance-from-start": 0.6373495204355714, "deviation-center-line": 0.07482601829083321, "driven_lanedir_consec": 0.1171556047316078}}simulation-passed 1 survival_time_max 4.3499999999999925 survival_time_mean 4.3499999999999925 survival_time_min 4.3499999999999925
No reset possible 7066647Bea Baselines template-pytorch aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 05:13:40+00:00 2021-11-03 05:16:32+00:00 0:02:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.000000000000135 in-drivable-lane_median 9.400000000000071 driven_lanedir_consec_median 0.595094691724813 deviation-center-line_median 0.23776614986231315
other stats deviation-center-line_max 0.23776614986231315 deviation-center-line_mean 0.23776614986231315 deviation-center-line_min 0.23776614986231315 deviation-heading_max 7.540708100058239 deviation-heading_mean 7.540708100058239 deviation-heading_median 7.540708100058239 deviation-heading_min 7.540708100058239 distance-from-start_max 0.19900981215137376 distance-from-start_mean 0.19900981215137376 distance-from-start_median 0.19900981215137376 distance-from-start_min 0.19900981215137376 driven_any_max 1.630315497150016 driven_any_mean 1.630315497150016 driven_any_median 1.630315497150016 driven_any_min 1.630315497150016 driven_lanedir_consec_max 0.595094691724813 driven_lanedir_consec_mean 0.595094691724813 driven_lanedir_consec_min 0.595094691724813 driven_lanedir_max 0.595094691724813 driven_lanedir_mean 0.595094691724813 driven_lanedir_median 0.595094691724813 driven_lanedir_min 0.595094691724813 in-drivable-lane_max 9.400000000000071 in-drivable-lane_mean 9.400000000000071 in-drivable-lane_min 9.400000000000071 per-episodes details {"loop-000-ego0": {"driven_any": 1.630315497150016, "survival_time": 19.000000000000135, "driven_lanedir": 0.595094691724813, "in-drivable-lane": 9.400000000000071, "deviation-heading": 7.540708100058239, "distance-from-start": 0.19900981215137376, "deviation-center-line": 0.23776614986231315, "driven_lanedir_consec": 0.595094691724813}}simulation-passed 1 survival_time_max 19.000000000000135 survival_time_mean 19.000000000000135 survival_time_min 19.000000000000135
No reset possible 7060648Bea Baselines template-pytorch aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 05:09:21+00:00 2021-11-03 05:13:14+00:00 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.40000000000004 in-drivable-lane_median 9.200000000000031 driven_lanedir_consec_median 0.673925730374551 deviation-center-line_median 0.19887368461010765
other stats deviation-center-line_max 0.19887368461010765 deviation-center-line_mean 0.19887368461010765 deviation-center-line_min 0.19887368461010765 deviation-heading_max 1.590858024520225 deviation-heading_mean 1.590858024520225 deviation-heading_median 1.590858024520225 deviation-heading_min 1.590858024520225 distance-from-start_max 0.8881800873832948 distance-from-start_mean 0.8881800873832948 distance-from-start_median 0.8881800873832948 distance-from-start_min 0.8881800873832948 driven_any_max 3.132545744421655 driven_any_mean 3.132545744421655 driven_any_median 3.132545744421655 driven_any_min 3.132545744421655 driven_lanedir_consec_max 0.673925730374551 driven_lanedir_consec_mean 0.673925730374551 driven_lanedir_consec_min 0.673925730374551 driven_lanedir_max 0.673925730374551 driven_lanedir_mean 0.673925730374551 driven_lanedir_median 0.673925730374551 driven_lanedir_min 0.673925730374551 in-drivable-lane_max 9.200000000000031 in-drivable-lane_mean 9.200000000000031 in-drivable-lane_min 9.200000000000031 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.132545744421655, "survival_time": 12.40000000000004, "driven_lanedir": 0.673925730374551, "in-drivable-lane": 9.200000000000031, "deviation-heading": 1.590858024520225, "distance-from-start": 0.8881800873832948, "deviation-center-line": 0.19887368461010765, "driven_lanedir_consec": 0.673925730374551}}simulation-passed 1 survival_time_max 12.40000000000004 survival_time_mean 12.40000000000004 survival_time_min 12.40000000000004
No reset possible 7039652Bea Baselines template-pytorch aido-LFVI_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 04:54:42+00:00 2021-11-03 05:09:09+00:00 0:14:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 58.49999999999873 driven_lanedir_consec_median 0.15474598593753186 deviation-center-line_median 0.08617998596263193
other stats deviation-center-line_max 1.384584591659574 deviation-center-line_mean 0.40765201601471873 deviation-center-line_min 0.07366350047403723 deviation-heading_max 11.809228606635214 deviation-heading_mean 3.5998252361028067 deviation-heading_median 0.9321068820558548 deviation-heading_min 0.7258585736643018 distance-from-start_max 0.4749417709287769 distance-from-start_mean 0.2728567512009893 distance-from-start_median 0.2170688106273022 distance-from-start_min 0.18234761262057592 driven_any_max 8.702320285313627 driven_any_mean 2.4726458531737685 driven_any_median 0.4744822140697222 driven_any_min 0.23929869924200292 driven_lanedir_consec_max 0.6177811744304487 driven_lanedir_consec_mean 0.24982434302189785 driven_lanedir_consec_min 0.0720242257820789 driven_lanedir_max 0.6419317796033566 driven_lanedir_mean 0.2558619943151248 driven_lanedir_median 0.15474598593753186 driven_lanedir_min 0.0720242257820789 in-drivable-lane_max 58.89999999999873 in-drivable-lane_mean 56.26249999999878 in-drivable-lane_min 49.14999999999896 per-episodes details {"udem-000-ego0": {"driven_any": 8.702320285313627, "survival_time": 59.99999999999873, "driven_lanedir": 0.6419317796033566, "in-drivable-lane": 49.14999999999896, "deviation-heading": 11.809228606635214, "distance-from-start": 0.22804290765117136, "deviation-center-line": 1.384584591659574, "driven_lanedir_consec": 0.6177811744304487}, "udem-000-ego1": {"driven_any": 0.2503530311222078, "survival_time": 59.99999999999873, "driven_lanedir": 0.0720242257820789, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.8876963224570398, "distance-from-start": 0.20609471360343304, "deviation-center-line": 0.09510650091885704, "driven_lanedir_consec": 0.0720242257820789}, "udem-000-ego2": {"driven_any": 0.23929869924200292, "survival_time": 59.99999999999873, "driven_lanedir": 0.10877275788603535, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.97651744165467, "distance-from-start": 0.18234761262057592, "deviation-center-line": 0.07366350047403723, "driven_lanedir_consec": 0.10877275788603535}, "udem-000-ego3": {"driven_any": 0.6986113970172364, "survival_time": 59.99999999999873, "driven_lanedir": 0.20071921398902837, "in-drivable-lane": 58.39999999999873, "deviation-heading": 0.7258585736643018, "distance-from-start": 0.4749417709287769, "deviation-center-line": 0.07725347100640681, "driven_lanedir_consec": 0.20071921398902837}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7017653Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 04:40:19+00:00 2021-11-03 04:54:30+00:00 0:14:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 45.42499999999901 driven_lanedir_consec_median 0.5498602090950884 deviation-center-line_median 1.7651968744573874
other stats deviation-center-line_max 2.856610838101028 deviation-center-line_mean 1.6347316332224957 deviation-center-line_min 0.15192194587418056 deviation-heading_max 37.82293240559152 deviation-heading_mean 15.167105033723203 deviation-heading_median 11.19335114399855 deviation-heading_min 0.4587854413041966 distance-from-start_max 1.8624081666338224 distance-from-start_mean 0.6282243897786149 distance-from-start_median 0.3252446962403184 distance-from-start_min 2.482534153247273e-16 driven_any_max 7.057141833059833 driven_any_mean 3.6247006354282783 driven_any_median 3.7208303543264902 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 1.2598299509423458 driven_lanedir_consec_mean 0.5898875922831306 driven_lanedir_consec_min 0.0 driven_lanedir_max 1.2598299509423458 driven_lanedir_mean 0.5945349514166001 driven_lanedir_median 0.5591549273620273 driven_lanedir_min 0.0 in-drivable-lane_max 57.29999999999873 in-drivable-lane_mean 37.037499999999184 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 7.057141833059833, "survival_time": 59.99999999999873, "driven_lanedir": 0.469475642220456, "in-drivable-lane": 51.8499999999988, "deviation-heading": 7.72873252930023, "distance-from-start": 0.4148315469402606, "deviation-center-line": 0.7679311281851225, "driven_lanedir_consec": 0.4508862056865781}, "loop-000-ego1": {"driven_any": 5.401224974100675, "survival_time": 59.99999999999873, "driven_lanedir": 1.2598299509423458, "in-drivable-lane": 38.99999999999922, "deviation-heading": 14.657969758696868, "distance-from-start": 0.23565784554037625, "deviation-center-line": 2.856610838101028, "driven_lanedir_consec": 1.2598299509423458}, "loop-000-ego2": {"driven_any": 2.040435734552305, "survival_time": 59.99999999999873, "driven_lanedir": 0.6488342125035986, "in-drivable-lane": 57.29999999999873, "deviation-heading": 0.4587854413041966, "distance-from-start": 1.8624081666338224, "deviation-center-line": 0.15192194587418056, "driven_lanedir_consec": 0.6488342125035986}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7014654Bea Baselines template-pytorch aido-LFP-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 04:38:14+00:00 2021-11-03 04:39:42+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.649999999999995 in-drivable-lane_median 1.2499999999999956 driven_lanedir_consec_median 0.33186960842209356 deviation-center-line_median 0.19678173857810805
other stats deviation-center-line_max 0.19678173857810805 deviation-center-line_mean 0.19678173857810805 deviation-center-line_min 0.19678173857810805 deviation-heading_max 1.5874348101927531 deviation-heading_mean 1.5874348101927531 deviation-heading_median 1.5874348101927531 deviation-heading_min 1.5874348101927531 distance-from-start_max 0.3813716517058012 distance-from-start_mean 0.3813716517058012 distance-from-start_median 0.3813716517058012 distance-from-start_min 0.3813716517058012 driven_any_max 0.6131193475128175 driven_any_mean 0.6131193475128175 driven_any_median 0.6131193475128175 driven_any_min 0.6131193475128175 driven_lanedir_consec_max 0.33186960842209356 driven_lanedir_consec_mean 0.33186960842209356 driven_lanedir_consec_min 0.33186960842209356 driven_lanedir_max 0.33186960842209356 driven_lanedir_mean 0.33186960842209356 driven_lanedir_median 0.33186960842209356 driven_lanedir_min 0.33186960842209356 in-drivable-lane_max 1.2499999999999956 in-drivable-lane_mean 1.2499999999999956 in-drivable-lane_min 1.2499999999999956 per-episodes details {"autolab-000-ego0": {"driven_any": 0.6131193475128175, "survival_time": 3.649999999999995, "driven_lanedir": 0.33186960842209356, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 1.5874348101927531, "distance-from-start": 0.3813716517058012, "deviation-center-line": 0.19678173857810805, "driven_lanedir_consec": 0.33186960842209356}}simulation-passed 1 survival_time_max 3.649999999999995 survival_time_mean 3.649999999999995 survival_time_min 3.649999999999995
No reset possible 6996657Bea Baselines template-pytorch aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 04:30:21+00:00 2021-11-03 04:37:42+00:00 0:07:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 43.299999999999 driven_lanedir_consec_median 0.7408683530840907 deviation-center-line_median 2.004104911072737
other stats deviation-center-line_max 2.004104911072737 deviation-center-line_mean 2.004104911072737 deviation-center-line_min 2.004104911072737 deviation-heading_max 14.469746079846407 deviation-heading_mean 14.469746079846407 deviation-heading_median 14.469746079846407 deviation-heading_min 14.469746079846407 distance-from-start_max 0.3832596201125293 distance-from-start_mean 0.3832596201125293 distance-from-start_median 0.3832596201125293 distance-from-start_min 0.3832596201125293 driven_any_max 5.429129660156233 driven_any_mean 5.429129660156233 driven_any_median 5.429129660156233 driven_any_min 5.429129660156233 driven_lanedir_consec_max 0.7408683530840907 driven_lanedir_consec_mean 0.7408683530840907 driven_lanedir_consec_min 0.7408683530840907 driven_lanedir_max 0.8669565367812151 driven_lanedir_mean 0.8669565367812151 driven_lanedir_median 0.8669565367812151 driven_lanedir_min 0.8669565367812151 in-drivable-lane_max 43.299999999999 in-drivable-lane_mean 43.299999999999 in-drivable-lane_min 43.299999999999 per-episodes details {"udem1-000-ego0": {"driven_any": 5.429129660156233, "survival_time": 59.99999999999873, "driven_lanedir": 0.8669565367812151, "in-drivable-lane": 43.299999999999, "deviation-heading": 14.469746079846407, "distance-from-start": 0.3832596201125293, "deviation-center-line": 2.004104911072737, "driven_lanedir_consec": 0.7408683530840907}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6991657Bea Baselines template-pytorch aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 04:28:31+00:00 2021-11-03 04:30:03+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6987659Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 04:27:09+00:00 2021-11-03 04:28:23+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6980660Bea Baselines template-tensorflow aido-LFV_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 04:25:50+00:00 2021-11-03 04:27:02+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6976661Bea Baselines template-tensorflow aido-LFP-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 04:24:34+00:00 2021-11-03 04:25:30+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6972661Bea Baselines template-tensorflow aido-LFP-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-03 04:23:23+00:00 2021-11-03 04:24:20+00:00 0:00:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6968663Bea Baselines template-tensorflow aido-LFVI-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-03 04:21:38+00:00 2021-11-03 04:23:12+00:00 0:01:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6964663Bea Baselines template-tensorflow aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 04:19:48+00:00 2021-11-03 04:21:33+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6955664Bea Baselines template-tensorflow aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 04:17:56+00:00 2021-11-03 04:19:30+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6952665Bea Baselines template-tensorflow aido-LF-sim-validationsim-2of4 failed no gpu-staging-spot-0-012021-11-03 04:16:49+00:00 2021-11-03 04:17:44+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6947666Bea Baselines template-tensorflow aido-LFVI_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 04:15:10+00:00 2021-11-03 04:16:28+00:00 0:01:18 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6944667Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-11-03 04:13:49+00:00 2021-11-03 04:15:02+00:00 0:01:13 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6939670Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-11-03 04:11:57+00:00 2021-11-03 04:13:42+00:00 0:01:45 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6934793Andrea Daniele template-tensorflow aido-LF-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-03 04:10:39+00:00 2021-11-03 04:11:32+00:00 0:00:53 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6924793Andrea Daniele template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-03 04:07:39+00:00 2021-11-03 04:10:15+00:00 0:02:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6899732Bea Baselines baseline-duckietown-ml aido-LFV_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 03:55:39+00:00 2021-11-03 04:07:32+00:00 0:11:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5117008645384518
other stats deviation-center-line_max 2.9467867370001506 deviation-center-line_mean 1.5769805699952473 deviation-center-line_min 0.33773381390393437 deviation-heading_max 32.249113233675025 deviation-heading_mean 22.83949643715976 deviation-heading_median 22.59726568012299 deviation-heading_min 13.914341154718024 distance-from-start_max 3.1401849173675503e-16 distance-from-start_mean 1.4056797676537055e-16 distance-from-start_median 1.2412670766236366e-16 distance-from-start_min 0.0 driven_any_max 3.7682219008410875e-13 driven_any_mean 1.6868157211844408e-13 driven_any_median 1.4895204919483376e-13 driven_any_min 0.0 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.1285028660032066, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 0.0, "deviation-center-line": 2.9467867370001506, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 0.33773381390393437, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6894704Bea Baselines template-random aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 03:51:47+00:00 2021-11-03 03:55:21+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.26764947507969805 deviation-center-line_median 0.7555292890833561
other stats deviation-center-line_max 0.7555292890833561 deviation-center-line_mean 0.7555292890833561 deviation-center-line_min 0.7555292890833561 deviation-heading_max 5.523299123594233 deviation-heading_mean 5.523299123594233 deviation-heading_median 5.523299123594233 deviation-heading_min 5.523299123594233 distance-from-start_max 1.0442247976691843 distance-from-start_mean 1.0442247976691843 distance-from-start_median 1.0442247976691843 distance-from-start_min 1.0442247976691843 driven_any_max 11.376062002465083 driven_any_mean 11.376062002465083 driven_any_median 11.376062002465083 driven_any_min 11.376062002465083 driven_lanedir_consec_max 0.26764947507969805 driven_lanedir_consec_mean 0.26764947507969805 driven_lanedir_consec_min 0.26764947507969805 driven_lanedir_max 0.2496387990426845 driven_lanedir_mean 0.2496387990426845 driven_lanedir_median 0.2496387990426845 driven_lanedir_min 0.2496387990426845 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 6876739Bea Baselines baseline-duckietown-ml aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-03 03:39:59+00:00 2021-11-03 03:51:29+00:00 0:11:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5844880209937626
other stats deviation-center-line_max 3.468400757620591 deviation-center-line_mean 1.715124244963702 deviation-center-line_min 0.22312018024669147 deviation-heading_max 40.967332753486225 deviation-heading_mean 25.437951450471505 deviation-heading_median 28.06618021079834 deviation-heading_min 4.652112626803105 distance-from-start_max 4.965068306494546e-16 distance-from-start_mean 3.0415125785996837e-16 distance-from-start_median 3.4617131258739496e-16 distance-from-start_min 2.7755575615628914e-17 driven_any_max 5.95808196779335e-13 driven_any_mean 3.649815094319581e-13 driven_any_median 4.154055751048713e-13 driven_any_min 3.3306690738754696e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.406513421257873, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005157, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 3.468400757620591, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803105, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.22312018024669147, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6872708Bea Baselines template-random aido-LF-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 03:34:10+00:00 2021-11-03 03:39:46+00:00 0:05:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.27329071924012593 survival_time_median 49.74999999999931 deviation-center-line_median 0.8940598330260409 in-drivable-lane_median 37.69999999999921
other stats deviation-center-line_max 0.8940598330260409 deviation-center-line_mean 0.8940598330260409 deviation-center-line_min 0.8940598330260409 deviation-heading_max 9.653852545002117 deviation-heading_mean 9.653852545002117 deviation-heading_median 9.653852545002117 deviation-heading_min 9.653852545002117 distance-from-start_max 1.1376277719266703 distance-from-start_mean 1.1376277719266703 distance-from-start_median 1.1376277719266703 distance-from-start_min 1.1376277719266703 driven_any_max 12.450153382790822 driven_any_mean 12.450153382790822 driven_any_median 12.450153382790822 driven_any_min 12.450153382790822 driven_lanedir_consec_max 0.27329071924012593 driven_lanedir_consec_mean 0.27329071924012593 driven_lanedir_consec_min 0.27329071924012593 driven_lanedir_max 0.26112935377464863 driven_lanedir_mean 0.26112935377464863 driven_lanedir_median 0.26112935377464863 driven_lanedir_min 0.26112935377464863 in-drivable-lane_max 37.69999999999921 in-drivable-lane_mean 37.69999999999921 in-drivable-lane_min 37.69999999999921 per-episodes details {"zigzag-000-ego0": {"driven_any": 12.450153382790822, "survival_time": 49.74999999999931, "driven_lanedir": 0.26112935377464863, "in-drivable-lane": 37.69999999999921, "deviation-heading": 9.653852545002117, "distance-from-start": 1.1376277719266703, "deviation-center-line": 0.8940598330260409, "driven_lanedir_consec": 0.27329071924012593}}simulation-passed 1 survival_time_max 49.74999999999931 survival_time_mean 49.74999999999931 survival_time_min 49.74999999999931
No reset possible 6862710Bea Baselines template-random aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 03:28:08+00:00 2021-11-03 03:33:50+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 44.99999999999958 in-drivable-lane_median 33.97499999999953 driven_lanedir_consec_median 0.24267935143511904 deviation-center-line_median 1.0095663665177188
other stats deviation-center-line_max 1.3919846551429198 deviation-center-line_mean 1.0095663665177188 deviation-center-line_min 0.627148077892518 deviation-heading_max 9.906601266560886 deviation-heading_mean 7.039929062391657 deviation-heading_median 7.039929062391657 deviation-heading_min 4.173256858222429 distance-from-start_max 1.0442247976691823 distance-from-start_mean 1.0267826168375516 distance-from-start_median 1.0267826168375516 distance-from-start_min 1.0093404360059206 driven_any_max 11.349124250612952 driven_any_mean 10.84517670046137 driven_any_median 10.84517670046137 driven_any_min 10.341229150309788 driven_lanedir_consec_max 0.24556462619118857 driven_lanedir_consec_mean 0.24267935143511904 driven_lanedir_consec_min 0.2397940766790495 driven_lanedir_max 0.2358258971661935 driven_lanedir_mean 0.2307429735933076 driven_lanedir_median 0.2307429735933076 driven_lanedir_min 0.2256600500204217 in-drivable-lane_max 36.94999999999958 in-drivable-lane_mean 33.97499999999953 in-drivable-lane_min 30.999999999999485 per-episodes details {"loop2-000-ego0": {"driven_any": 10.341229150309788, "survival_time": 44.99999999999958, "driven_lanedir": 0.2358258971661935, "in-drivable-lane": 30.999999999999485, "deviation-heading": 9.906601266560886, "distance-from-start": 1.0093404360059206, "deviation-center-line": 1.3919846551429198, "driven_lanedir_consec": 0.24556462619118857}, "loop2-000-ego1": {"driven_any": 11.349124250612952, "survival_time": 44.99999999999958, "driven_lanedir": 0.2256600500204217, "in-drivable-lane": 36.94999999999958, "deviation-heading": 4.173256858222429, "distance-from-start": 1.0442247976691823, "deviation-center-line": 0.627148077892518, "driven_lanedir_consec": 0.2397940766790495}}simulation-passed 1 survival_time_max 44.99999999999958 survival_time_mean 44.99999999999958 survival_time_min 44.99999999999958
No reset possible 6855711Bea Baselines template-random aido-LFP-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-03 03:24:07+00:00 2021-11-03 03:27:53+00:00 0:03:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.70000000000028 in-drivable-lane_median 26.450000000000227 driven_lanedir_consec_median 0.01242473178359728 deviation-center-line_median 0.584969651111141
other stats deviation-center-line_max 0.584969651111141 deviation-center-line_mean 0.584969651111141 deviation-center-line_min 0.584969651111141 deviation-heading_max 4.775258874675082 deviation-heading_mean 4.775258874675082 deviation-heading_median 4.775258874675082 deviation-heading_min 4.775258874675082 distance-from-start_max 0.9340577697896082 distance-from-start_mean 0.9340577697896082 distance-from-start_median 0.9340577697896082 distance-from-start_min 0.9340577697896082 driven_any_max 8.108127605402737 driven_any_mean 8.108127605402737 driven_any_median 8.108127605402737 driven_any_min 8.108127605402737 driven_lanedir_consec_max 0.01242473178359728 driven_lanedir_consec_mean 0.01242473178359728 driven_lanedir_consec_min 0.01242473178359728 driven_lanedir_max 0.015771073882231215 driven_lanedir_mean 0.015771073882231215 driven_lanedir_median 0.015771073882231215 driven_lanedir_min 0.015771073882231215 in-drivable-lane_max 26.450000000000227 in-drivable-lane_mean 26.450000000000227 in-drivable-lane_min 26.450000000000227 per-episodes details {"autolab-000-ego0": {"driven_any": 8.108127605402737, "survival_time": 32.70000000000028, "driven_lanedir": 0.015771073882231215, "in-drivable-lane": 26.450000000000227, "deviation-heading": 4.775258874675082, "distance-from-start": 0.9340577697896082, "deviation-center-line": 0.584969651111141, "driven_lanedir_consec": 0.01242473178359728}}simulation-passed 1 survival_time_max 32.70000000000028 survival_time_mean 32.70000000000028 survival_time_min 32.70000000000028
No reset possible 6853713Bea Baselines template-random aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-03 03:22:18+00:00 2021-11-03 03:23:51+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6846714Bea Baselines template-random aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 03:19:59+00:00 2021-11-03 03:21:59+00:00 0:02:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.899999999999994 in-drivable-lane_median 2.399999999999994 driven_lanedir_consec_median 0.022350163233605613 deviation-center-line_median 0.026643428344150132
other stats deviation-center-line_max 0.026643428344150132 deviation-center-line_mean 0.026643428344150132 deviation-center-line_min 0.026643428344150132 deviation-heading_max 1.126574172093021 deviation-heading_mean 1.126574172093021 deviation-heading_median 1.126574172093021 deviation-heading_min 1.126574172093021 distance-from-start_max 0.48917230594954225 distance-from-start_mean 0.48917230594954225 distance-from-start_median 0.48917230594954225 distance-from-start_min 0.48917230594954225 driven_any_max 0.5134230938905342 driven_any_mean 0.5134230938905342 driven_any_median 0.5134230938905342 driven_any_min 0.5134230938905342 driven_lanedir_consec_max 0.022350163233605613 driven_lanedir_consec_mean 0.022350163233605613 driven_lanedir_consec_min 0.022350163233605613 driven_lanedir_max 0.022350163233605613 driven_lanedir_mean 0.022350163233605613 driven_lanedir_median 0.022350163233605613 driven_lanedir_min 0.022350163233605613 in-drivable-lane_max 2.399999999999994 in-drivable-lane_mean 2.399999999999994 in-drivable-lane_min 2.399999999999994 per-episodes details {"udem1-000-ego0": {"driven_any": 0.5134230938905342, "survival_time": 3.899999999999994, "driven_lanedir": 0.022350163233605613, "in-drivable-lane": 2.399999999999994, "deviation-heading": 1.126574172093021, "distance-from-start": 0.48917230594954225, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350163233605613}}simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 3.899999999999994 survival_time_min 3.899999999999994
No reset possible 6828738Bea Baselines baseline-duckietown-ml aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 03:07:39+00:00 2021-11-03 03:19:53+00:00 0:12:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.511704717596742
other stats deviation-center-line_max 2.946772659605511 deviation-center-line_mean 1.5769817001146265 deviation-center-line_min 0.3377447056595108 deviation-heading_max 32.249113233675025 deviation-heading_mean 22.83949643715976 deviation-heading_median 22.59726568012299 deviation-heading_min 13.914341154718024 distance-from-start_max 4.965068306494546e-16 distance-from-start_mean 2.2127122231706483e-16 distance-from-start_median 1.6653345369377348e-16 distance-from-start_min 5.551115123125783e-17 driven_any_max 5.95808196779335e-13 driven_any_mean 2.6552546678047523e-13 driven_any_median 1.9984014443252818e-13 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.128506051642319, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.946772659605511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.3377447056595108, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6809746Bea Baselines baseline-duckietown-ml aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 02:52:54+00:00 2021-11-03 03:07:25+00:00 0:14:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5844918740520562
other stats deviation-center-line_max 3.468395721180941 deviation-center-line_mean 1.7151225231536382 deviation-center-line_min 0.22311062332950052 deviation-heading_max 40.967332753486254 deviation-heading_mean 25.437951450471505 deviation-heading_median 28.066180210798333 deviation-heading_min 4.652112626803104 distance-from-start_max 4.965068306494546e-16 distance-from-start_mean 3.1321156654383563e-16 distance-from-start_median 3.5041414214731503e-16 distance-from-start_min 5.551115123125783e-17 driven_any_max 5.95808196779335e-13 driven_any_mean 3.758538798526001e-13 driven_any_median 4.2049697057677814e-13 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 3.08086889333481e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.5673907444456745e-16, "deviation-center-line": 2.7624594350906873, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6786769Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 02:38:13+00:00 2021-11-03 02:51:51+00:00 0:13:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.6500000000000048 driven_lanedir_consec_median 2.241707143332959 deviation-center-line_median 4.29958744369884
other stats deviation-center-line_max 5.802271685901664 deviation-center-line_mean 4.012503672315909 deviation-center-line_min 1.648568115964293 deviation-heading_max 52.95907871722521 deviation-heading_mean 21.15178287757437 deviation-heading_median 13.390696940819474 deviation-heading_min 4.8666589114333085 distance-from-start_max 3.084659760451892 distance-from-start_mean 1.5815177563074294 distance-from-start_median 1.2620578100497626 distance-from-start_min 0.7172956446783004 driven_any_max 7.91427242944162 driven_any_mean 4.628208963956911 driven_any_median 4.628188696291674 driven_any_min 1.3421860338026748 driven_lanedir_consec_max 3.553812806087284 driven_lanedir_consec_mean 2.1994190047686035 driven_lanedir_consec_min 0.7604489263212109 driven_lanedir_max 7.357378723461656 driven_lanedir_mean 4.01188870881919 driven_lanedir_median 3.8603722637374833 driven_lanedir_min 0.969431584340138 in-drivable-lane_max 6.249999999999942 in-drivable-lane_mean 2.4874999999999874 in-drivable-lane_min 0.3999999999999986 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.342253304660854, "survival_time": 59.99999999999873, "driven_lanedir": 1.1378511839777103, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 4.8666589114333085, "distance-from-start": 0.7172956446783004, "deviation-center-line": 1.648568115964293, "driven_lanedir_consec": 0.7604489263212109}, "zigzag-000-ego1": {"driven_any": 1.3421860338026748, "survival_time": 59.99999999999873, "driven_lanedir": 0.969431584340138, "in-drivable-lane": 2.1000000000000094, "deviation-heading": 52.95907871722521, "distance-from-start": 0.925318058151975, "deviation-center-line": 5.802271685901664, "driven_lanedir_consec": 0.969431584340138}, "zigzag-000-ego2": {"driven_any": 7.91427242944162, "survival_time": 59.99999999999873, "driven_lanedir": 7.357378723461656, "in-drivable-lane": 1.2000000000000002, "deviation-heading": 12.196964064379136, "distance-from-start": 3.084659760451892, "deviation-center-line": 4.09152197166534, "driven_lanedir_consec": 3.5139827023257806}, "zigzag-000-ego3": {"driven_any": 7.914124087922494, "survival_time": 59.99999999999873, "driven_lanedir": 6.582893343497256, "in-drivable-lane": 6.249999999999942, "deviation-heading": 14.584429817259812, "distance-from-start": 1.5987975619475503, "deviation-center-line": 4.507652915732339, "driven_lanedir_consec": 3.553812806087284}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6780770Bea Baselines baseline-RPL-ros aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 02:35:35+00:00 2021-11-03 02:37:48+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.450000000000028 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3205762609517406 deviation-center-line_median 0.6540418826210589
other stats deviation-center-line_max 0.6540418826210589 deviation-center-line_mean 0.6540418826210589 deviation-center-line_min 0.6540418826210589 deviation-heading_max 2.641084711538687 deviation-heading_mean 2.641084711538687 deviation-heading_median 2.641084711538687 deviation-heading_min 2.641084711538687 distance-from-start_max 1.1680908803143983 distance-from-start_mean 1.1680908803143983 distance-from-start_median 1.1680908803143983 distance-from-start_min 1.1680908803143983 driven_any_max 1.3688616824537814 driven_any_mean 1.3688616824537814 driven_any_median 1.3688616824537814 driven_any_min 1.3688616824537814 driven_lanedir_consec_max 1.3205762609517406 driven_lanedir_consec_mean 1.3205762609517406 driven_lanedir_consec_min 1.3205762609517406 driven_lanedir_max 1.3205762609517406 driven_lanedir_mean 1.3205762609517406 driven_lanedir_median 1.3205762609517406 driven_lanedir_min 1.3205762609517406 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.3688616824537814, "survival_time": 11.450000000000028, "driven_lanedir": 1.3205762609517406, "in-drivable-lane": 0.0, "deviation-heading": 2.641084711538687, "distance-from-start": 1.1680908803143983, "deviation-center-line": 0.6540418826210589, "driven_lanedir_consec": 1.3205762609517406}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 6769772Bea Baselines baseline-RPL-ros aido-LFVI-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-03 02:24:52+00:00 2021-11-03 02:35:09+00:00 0:10:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.549999999999894 driven_lanedir_consec_median 6.48231519148273 deviation-center-line_median 4.85922720628305
other stats deviation-center-line_max 4.85922720628305 deviation-center-line_mean 4.85922720628305 deviation-center-line_min 4.85922720628305 deviation-heading_max 8.635461161742251 deviation-heading_mean 8.635461161742251 deviation-heading_median 8.635461161742251 deviation-heading_min 8.635461161742251 distance-from-start_max 2.5555924022071466 distance-from-start_mean 2.5555924022071466 distance-from-start_median 2.5555924022071466 distance-from-start_min 2.5555924022071466 driven_any_max 7.914299325631166 driven_any_mean 7.914299325631166 driven_any_median 7.914299325631166 driven_any_min 7.914299325631166 driven_lanedir_consec_max 6.48231519148273 driven_lanedir_consec_mean 6.48231519148273 driven_lanedir_consec_min 6.48231519148273 driven_lanedir_max 7.2580085144325555 driven_lanedir_mean 7.2580085144325555 driven_lanedir_median 7.2580085144325555 driven_lanedir_min 7.2580085144325555 in-drivable-lane_max 3.549999999999894 in-drivable-lane_mean 3.549999999999894 in-drivable-lane_min 3.549999999999894 per-episodes details {"4way-000-ego0": {"driven_any": 7.914299325631166, "survival_time": 59.99999999999873, "driven_lanedir": 7.2580085144325555, "in-drivable-lane": 3.549999999999894, "deviation-heading": 8.635461161742251, "distance-from-start": 2.5555924022071466, "deviation-center-line": 4.85922720628305, "driven_lanedir_consec": 6.48231519148273}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6765773Bea Baselines baseline-RPL-ros aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-03 02:23:00+00:00 2021-11-03 02:24:33+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6760773Bea Baselines baseline-RPL-ros aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-03 02:20:52+00:00 2021-11-03 02:22:48+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6748775Bea Baselines baseline-RPL-ros aido-LFVI_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-03 02:11:00+00:00 2021-11-03 02:20:26+00:00 0:09:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 40.899999999999814 in-drivable-lane_median 5.225000000000037 driven_lanedir_consec_median 0.7793360565552059 deviation-center-line_median 2.6846859284286237
other stats deviation-center-line_max 4.583075242748134 deviation-center-line_mean 2.5819915128081017 deviation-center-line_min 0.3755189516270257 deviation-heading_max 12.300266045623736 deviation-heading_mean 5.976572542144457 deviation-heading_median 5.1397998905348885 deviation-heading_min 1.3264243418843151 distance-from-start_max 3.224908300850846 distance-from-start_mean 1.290033356983063 distance-from-start_median 0.653169829842239 distance-from-start_min 0.6288854673969286 driven_any_max 5.2856232341583045 driven_any_mean 2.1438387910091605 driven_any_median 1.2259938282764669 driven_any_min 0.8377442733254037 driven_lanedir_consec_max 3.792846914722583 driven_lanedir_consec_mean 1.5070719559819528 driven_lanedir_consec_min 0.6767687960948169 driven_lanedir_max 3.81148727866705 driven_lanedir_mean 1.5828354136740597 driven_lanedir_median 0.8551000738306866 driven_lanedir_min 0.8096542283678151 in-drivable-lane_max 33.99999999999983 in-drivable-lane_mean 11.112499999999976 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 5.2856232341583045, "survival_time": 40.899999999999814, "driven_lanedir": 3.81148727866705, "in-drivable-lane": 9.600000000000076, "deviation-heading": 7.22279843658388, "distance-from-start": 3.224908300850846, "deviation-center-line": 2.0300719378960688, "driven_lanedir_consec": 3.792846914722583}, "udem-000-ego1": {"driven_any": 0.8377442733254037, "survival_time": 40.899999999999814, "driven_lanedir": 0.8096542283678151, "in-drivable-lane": 0.0, "deviation-heading": 3.0568013444858977, "distance-from-start": 0.6288854673969286, "deviation-center-line": 4.583075242748134, "driven_lanedir_consec": 0.8067915382048673}, "udem-000-ego2": {"driven_any": 1.07658317310727, "survival_time": 40.899999999999814, "driven_lanedir": 0.8876208334860898, "in-drivable-lane": 0.849999999999997, "deviation-heading": 12.300266045623736, "distance-from-start": 0.6501383441221839, "deviation-center-line": 3.3392999189611783, "driven_lanedir_consec": 0.7518805749055444}, "udem-000-ego3": {"driven_any": 1.3754044834456636, "survival_time": 40.899999999999814, "driven_lanedir": 0.8225793141752834, "in-drivable-lane": 33.99999999999983, "deviation-heading": 1.3264243418843151, "distance-from-start": 0.6562013155622941, "deviation-center-line": 0.3755189516270257, "driven_lanedir_consec": 0.6767687960948169}}simulation-passed 1 survival_time_max 40.899999999999814 survival_time_mean 40.899999999999814 survival_time_min 40.899999999999814
No reset possible 6741776Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-03 01:59:45+00:00 2021-11-03 02:10:34+00:00 0:10:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 17.149999999999604 driven_lanedir_consec_median 4.06291424154091 deviation-center-line_median 5.691054151681719
other stats deviation-center-line_max 6.082485283771941 deviation-center-line_mean 5.691054151681719 deviation-center-line_min 5.299623019591498 deviation-heading_max 7.516262705096625 deviation-heading_mean 7.193236772567342 deviation-heading_median 7.193236772567342 deviation-heading_min 6.87021084003806 distance-from-start_max 1.413885554302638 distance-from-start_mean 1.173640965053175 distance-from-start_median 1.173640965053175 distance-from-start_min 0.9333963758037118 driven_any_max 7.907568862003536 driven_any_mean 7.907504312702413 driven_any_median 7.907504312702413 driven_any_min 7.907439763401288 driven_lanedir_consec_max 5.6030196041732445 driven_lanedir_consec_mean 4.06291424154091 driven_lanedir_consec_min 2.522808878908575 driven_lanedir_max 5.6030196041732445 driven_lanedir_mean 5.472999438492885 driven_lanedir_median 5.472999438492885 driven_lanedir_min 5.342979272812526 in-drivable-lane_max 17.899999999999547 in-drivable-lane_mean 17.149999999999604 in-drivable-lane_min 16.39999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907568862003536, "survival_time": 59.99999999999873, "driven_lanedir": 5.342979272812526, "in-drivable-lane": 17.899999999999547, "deviation-heading": 7.516262705096625, "distance-from-start": 1.413885554302638, "deviation-center-line": 5.299623019591498, "driven_lanedir_consec": 2.522808878908575}, "loop2-000-ego1": {"driven_any": 7.907439763401288, "survival_time": 59.99999999999873, "driven_lanedir": 5.6030196041732445, "in-drivable-lane": 16.39999999999966, "deviation-heading": 6.87021084003806, "distance-from-start": 0.9333963758037118, "deviation-center-line": 6.082485283771941, "driven_lanedir_consec": 5.6030196041732445}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6676776Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-0of4 timeout no gpu-staging-spot-0-012021-11-02 23:52:30+00:00 - - - - No reset possible 6664778Bea Baselines baseline-RPL-ros aido-LFV-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-02 23:44:38+00:00 2021-11-02 23:52:11+00:00 0:07:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.74999999999988 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.095777007960866 deviation-center-line_median 1.3879347159051303
other stats deviation-center-line_max 1.3879347159051303 deviation-center-line_mean 1.3879347159051303 deviation-center-line_min 1.3879347159051303 deviation-heading_max 3.669534013839666 deviation-heading_mean 3.669534013839666 deviation-heading_median 3.669534013839666 deviation-heading_min 3.669534013839666 distance-from-start_max 2.0216388945365527 distance-from-start_mean 2.0216388945365527 distance-from-start_median 2.0216388945365527 distance-from-start_min 2.0216388945365527 driven_any_max 5.132995177814148 driven_any_mean 5.132995177814148 driven_any_median 5.132995177814148 driven_any_min 5.132995177814148 driven_lanedir_consec_max 5.095777007960866 driven_lanedir_consec_mean 5.095777007960866 driven_lanedir_consec_min 5.095777007960866 driven_lanedir_max 5.095777007960866 driven_lanedir_mean 5.095777007960866 driven_lanedir_median 5.095777007960866 driven_lanedir_min 5.095777007960866 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.132995177814148, "survival_time": 39.74999999999988, "driven_lanedir": 5.095777007960866, "in-drivable-lane": 0.0, "deviation-heading": 3.669534013839666, "distance-from-start": 2.0216388945365527, "deviation-center-line": 1.3879347159051303, "driven_lanedir_consec": 5.095777007960866}}simulation-passed 1 survival_time_max 39.74999999999988 survival_time_mean 39.74999999999988 survival_time_min 39.74999999999988
No reset possible 6657779Bea Baselines baseline-RPL-ros aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 23:40:55+00:00 2021-11-02 23:44:06+00:00 0:03:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.750000000000004 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.112416838929652 deviation-center-line_median 0.6193224963164083
other stats deviation-center-line_max 0.6193224963164083 deviation-center-line_mean 0.6193224963164083 deviation-center-line_min 0.6193224963164083 deviation-heading_max 1.9962723501964628 deviation-heading_mean 1.9962723501964628 deviation-heading_median 1.9962723501964628 deviation-heading_min 1.9962723501964628 distance-from-start_max 0.873328778697188 distance-from-start_mean 0.873328778697188 distance-from-start_median 0.873328778697188 distance-from-start_min 0.873328778697188 driven_any_max 1.1497976388700653 driven_any_mean 1.1497976388700653 driven_any_median 1.1497976388700653 driven_any_min 1.1497976388700653 driven_lanedir_consec_max 1.112416838929652 driven_lanedir_consec_mean 1.112416838929652 driven_lanedir_consec_min 1.112416838929652 driven_lanedir_max 1.112416838929652 driven_lanedir_mean 1.112416838929652 driven_lanedir_median 1.112416838929652 driven_lanedir_min 1.112416838929652 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.1497976388700653, "survival_time": 9.750000000000004, "driven_lanedir": 1.112416838929652, "in-drivable-lane": 0.0, "deviation-heading": 1.9962723501964628, "distance-from-start": 0.873328778697188, "deviation-center-line": 0.6193224963164083, "driven_lanedir_consec": 1.112416838929652}}simulation-passed 1 survival_time_max 9.750000000000004 survival_time_mean 9.750000000000004 survival_time_min 9.750000000000004
No reset possible 6654780Bea Baselines baseline-RPL-ros aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 23:39:14+00:00 2021-11-02 23:40:48+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6652780Bea Baselines baseline-RPL-ros aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-02 23:36:10+00:00 2021-11-02 23:38:48+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.950000000000006 in-drivable-lane_median 5.250000000000015 driven_lanedir_consec_median 0.5340009918153892 deviation-center-line_median 0.33056005207914724
other stats deviation-center-line_max 0.33056005207914724 deviation-center-line_mean 0.33056005207914724 deviation-center-line_min 0.33056005207914724 deviation-heading_max 1.3614137731103009 deviation-heading_mean 1.3614137731103009 deviation-heading_median 1.3614137731103009 deviation-heading_min 1.3614137731103009 distance-from-start_max 1.0261665939173978 distance-from-start_mean 1.0261665939173978 distance-from-start_median 1.0261665939173978 distance-from-start_min 1.0261665939173978 driven_any_max 1.1630639543869592 driven_any_mean 1.1630639543869592 driven_any_median 1.1630639543869592 driven_any_min 1.1630639543869592 driven_lanedir_consec_max 0.5340009918153892 driven_lanedir_consec_mean 0.5340009918153892 driven_lanedir_consec_min 0.5340009918153892 driven_lanedir_max 0.5340009918153892 driven_lanedir_mean 0.5340009918153892 driven_lanedir_median 0.5340009918153892 driven_lanedir_min 0.5340009918153892 in-drivable-lane_max 5.250000000000015 in-drivable-lane_mean 5.250000000000015 in-drivable-lane_min 5.250000000000015 per-episodes details {"udem1-000-ego0": {"driven_any": 1.1630639543869592, "survival_time": 9.950000000000006, "driven_lanedir": 0.5340009918153892, "in-drivable-lane": 5.250000000000015, "deviation-heading": 1.3614137731103009, "distance-from-start": 1.0261665939173978, "deviation-center-line": 0.33056005207914724, "driven_lanedir_consec": 0.5340009918153892}}simulation-passed 1 survival_time_max 9.950000000000006 survival_time_mean 9.950000000000006 survival_time_min 9.950000000000006
No reset possible 6642781Bea Baselines baseline-RPL-ros aido-LF-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 23:30:46+00:00 2021-11-02 23:36:02+00:00 0:05:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 5.279493421566142 survival_time_median 59.99999999999873 deviation-center-line_median 3.5952743514898167 in-drivable-lane_median 15.39999999999984
other stats deviation-center-line_max 3.5952743514898167 deviation-center-line_mean 3.5952743514898167 deviation-center-line_min 3.5952743514898167 deviation-heading_max 12.711522134512798 deviation-heading_mean 12.711522134512798 deviation-heading_median 12.711522134512798 deviation-heading_min 12.711522134512798 distance-from-start_max 3.103714923048385 distance-from-start_mean 3.103714923048385 distance-from-start_median 3.103714923048385 distance-from-start_min 3.103714923048385 driven_any_max 7.90762914973155 driven_any_mean 7.90762914973155 driven_any_median 7.90762914973155 driven_any_min 7.90762914973155 driven_lanedir_consec_max 5.279493421566142 driven_lanedir_consec_mean 5.279493421566142 driven_lanedir_consec_min 5.279493421566142 driven_lanedir_max 5.394074340935259 driven_lanedir_mean 5.394074340935259 driven_lanedir_median 5.394074340935259 driven_lanedir_min 5.394074340935259 in-drivable-lane_max 15.39999999999984 in-drivable-lane_mean 15.39999999999984 in-drivable-lane_min 15.39999999999984 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.90762914973155, "survival_time": 59.99999999999873, "driven_lanedir": 5.394074340935259, "in-drivable-lane": 15.39999999999984, "deviation-heading": 12.711522134512798, "distance-from-start": 3.103714923048385, "deviation-center-line": 3.5952743514898167, "driven_lanedir_consec": 5.279493421566142}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6629791Bea Baselines challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71d aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-012021-11-02 23:24:27+00:00 2021-11-02 23:30:31+00:00 0:06:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.005683038826684639 deviation-center-line_median 0.007273899044341616
other stats deviation-center-line_max 0.007273899044341616 deviation-center-line_mean 0.007273899044341616 deviation-center-line_min 0.007273899044341616 deviation-heading_max 0.26671613552588 deviation-heading_mean 0.26671613552588 deviation-heading_median 0.26671613552588 deviation-heading_min 0.26671613552588 distance-from-start_max 0.006499103643439944 distance-from-start_mean 0.006499103643439944 distance-from-start_median 0.006499103643439944 distance-from-start_min 0.006499103643439944 driven_any_max 0.006499983032245362 driven_any_mean 0.006499983032245362 driven_any_median 0.006499983032245362 driven_any_min 0.006499983032245362 driven_lanedir_consec_max 0.005683038826684639 driven_lanedir_consec_mean 0.005683038826684639 driven_lanedir_consec_min 0.005683038826684639 driven_lanedir_max 0.005683038826684639 driven_lanedir_mean 0.005683038826684639 driven_lanedir_median 0.005683038826684639 driven_lanedir_min 0.005683038826684639 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.006499983032245362, "survival_time": 0.49999999999999994, "driven_lanedir": 0.005683038826684639, "in-drivable-lane": 0.0, "deviation-heading": 0.26671613552588, "distance-from-start": 0.006499103643439944, "deviation-center-line": 0.007273899044341616, "driven_lanedir_consec": 0.005683038826684639}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 6569635Bea Baselines minimal-agent-full aido-LFI-full-sim-validationsim-0of4 timeout no gpu-staging-spot-0-012021-11-02 21:28:41+00:00 - - - - No reset possible 6558636Bea Baselines minimal-agent-full aido-LFV_multi-full-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-02 21:21:42+00:00 2021-11-02 21:28:33+00:00 0:06:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1249999999999662 driven_lanedir_consec_median 1.4456503520453423 deviation-center-line_median 5.2165714063097
other stats deviation-center-line_max 5.528679809125458 deviation-center-line_mean 5.2165714063097 deviation-center-line_min 4.904463003493942 deviation-heading_max 8.48735406391615 deviation-heading_mean 8.116239531071809 deviation-heading_median 8.116239531071809 deviation-heading_min 7.7451249982274675 distance-from-start_max 1.242743835742773 distance-from-start_mean 1.2243627584318864 distance-from-start_median 1.2243627584318864 distance-from-start_min 1.205981681121 driven_any_max 3.4865832572710787 driven_any_mean 3.4858336367538625 driven_any_median 3.4858336367538625 driven_any_min 3.4850840162366463 driven_lanedir_consec_max 1.4708900970780958 driven_lanedir_consec_mean 1.4456503520453423 driven_lanedir_consec_min 1.4204106070125888 driven_lanedir_max 3.2904966241055256 driven_lanedir_mean 3.288148700061684 driven_lanedir_median 3.288148700061684 driven_lanedir_min 3.285800776017842 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1249999999999662 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4850840162366463, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904966241055256, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7451249982274675, "distance-from-start": 1.205981681121, "deviation-center-line": 4.904463003493942, "driven_lanedir_consec": 1.4204106070125888}, "loop2-000-ego1": {"driven_any": 3.4865832572710787, "survival_time": 59.99999999999873, "driven_lanedir": 3.285800776017842, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.48735406391615, "distance-from-start": 1.242743835742773, "deviation-center-line": 5.528679809125458, "driven_lanedir_consec": 1.4708900970780958}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6546638Bea Baselines minimal-agent-full aido-LF-full-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-02 21:16:42+00:00 2021-11-02 21:21:36+00:00 0:04:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.899999999999892 driven_lanedir_consec_median 3.4064017085173024 deviation-center-line_median 5.159547195134336
other stats deviation-center-line_max 5.159547195134336 deviation-center-line_mean 5.159547195134336 deviation-center-line_min 5.159547195134336 deviation-heading_max 7.059107453483629 deviation-heading_mean 7.059107453483629 deviation-heading_median 7.059107453483629 deviation-heading_min 7.059107453483629 distance-from-start_max 2.2176127614009804 distance-from-start_mean 2.2176127614009804 distance-from-start_median 2.2176127614009804 distance-from-start_min 2.2176127614009804 driven_any_max 3.532579606984127 driven_any_mean 3.532579606984127 driven_any_median 3.532579606984127 driven_any_min 3.532579606984127 driven_lanedir_consec_max 3.4064017085173024 driven_lanedir_consec_mean 3.4064017085173024 driven_lanedir_consec_min 3.4064017085173024 driven_lanedir_max 3.4064017085173024 driven_lanedir_mean 3.4064017085173024 driven_lanedir_median 3.4064017085173024 driven_lanedir_min 3.4064017085173024 in-drivable-lane_max 1.899999999999892 in-drivable-lane_mean 1.899999999999892 in-drivable-lane_min 1.899999999999892 per-episodes details {"autolab-000-ego0": {"driven_any": 3.532579606984127, "survival_time": 59.99999999999873, "driven_lanedir": 3.4064017085173024, "in-drivable-lane": 1.899999999999892, "deviation-heading": 7.059107453483629, "distance-from-start": 2.2176127614009804, "deviation-center-line": 5.159547195134336, "driven_lanedir_consec": 3.4064017085173024}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6538639Bea Baselines minimal-agent-full aido-LFVI-full-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 21:12:48+00:00 2021-11-02 21:16:28+00:00 0:03:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.6855199039137942 deviation-center-line_median 1.1151363222094262
other stats deviation-center-line_max 1.1151363222094262 deviation-center-line_mean 1.1151363222094262 deviation-center-line_min 1.1151363222094262 deviation-heading_max 1.8997107406045024 deviation-heading_mean 1.8997107406045024 deviation-heading_median 1.8997107406045024 deviation-heading_min 1.8997107406045024 distance-from-start_max 0.6890064417552494 distance-from-start_mean 0.6890064417552494 distance-from-start_median 0.6890064417552494 distance-from-start_min 0.6890064417552494 driven_any_max 0.8255923756486474 driven_any_mean 0.8255923756486474 driven_any_median 0.8255923756486474 driven_any_min 0.8255923756486474 driven_lanedir_consec_max 0.6855199039137942 driven_lanedir_consec_mean 0.6855199039137942 driven_lanedir_consec_min 0.6855199039137942 driven_lanedir_max 0.8113565710261739 driven_lanedir_mean 0.8113565710261739 driven_lanedir_median 0.8113565710261739 driven_lanedir_min 0.8113565710261739 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.8255923756486474, "survival_time": 14.800000000000075, "driven_lanedir": 0.8113565710261739, "in-drivable-lane": 0.0, "deviation-heading": 1.8997107406045024, "distance-from-start": 0.6890064417552494, "deviation-center-line": 1.1151363222094262, "driven_lanedir_consec": 0.6855199039137942}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 6513789Andrea Daniele template-pytorch aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-02 21:04:08+00:00 2021-11-02 21:12:41+00:00 0:08:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1418187334825034 survival_time_median 59.99999999999873 deviation-center-line_median 2.0980131405776508 in-drivable-lane_median 37.099999999998936
other stats deviation-center-line_max 2.0980131405776508 deviation-center-line_mean 2.0980131405776508 deviation-center-line_min 2.0980131405776508 deviation-heading_max 19.814748489649276 deviation-heading_mean 19.814748489649276 deviation-heading_median 19.814748489649276 deviation-heading_min 19.814748489649276 distance-from-start_max 0.29409573609284534 distance-from-start_mean 0.29409573609284534 distance-from-start_median 0.29409573609284534 distance-from-start_min 0.29409573609284534 driven_any_max 5.708833071994149 driven_any_mean 5.708833071994149 driven_any_median 5.708833071994149 driven_any_min 5.708833071994149 driven_lanedir_consec_max 1.1418187334825034 driven_lanedir_consec_mean 1.1418187334825034 driven_lanedir_consec_min 1.1418187334825034 driven_lanedir_max 1.2699319342414794 driven_lanedir_mean 1.2699319342414794 driven_lanedir_median 1.2699319342414794 driven_lanedir_min 1.2699319342414794 in-drivable-lane_max 37.099999999998936 in-drivable-lane_mean 37.099999999998936 in-drivable-lane_min 37.099999999998936 per-episodes details {"autolab-000-ego0": {"driven_any": 5.708833071994149, "survival_time": 59.99999999999873, "driven_lanedir": 1.2699319342414794, "in-drivable-lane": 37.099999999998936, "deviation-heading": 19.814748489649276, "distance-from-start": 0.29409573609284534, "deviation-center-line": 2.0980131405776508, "driven_lanedir_consec": 1.1418187334825034}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6509641Bea Baselines minimal-agent-full aido-LFV-full-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 21:00:57+00:00 2021-11-02 21:03:49+00:00 0:02:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.70000000000006 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.746673767524618 deviation-center-line_median 0.7161949626619292
other stats deviation-center-line_max 0.7161949626619292 deviation-center-line_mean 0.7161949626619292 deviation-center-line_min 0.7161949626619292 deviation-heading_max 2.160741888859268 deviation-heading_mean 2.160741888859268 deviation-heading_median 2.160741888859268 deviation-heading_min 2.160741888859268 distance-from-start_max 0.7031149433813478 distance-from-start_mean 0.7031149433813478 distance-from-start_median 0.7031149433813478 distance-from-start_min 0.7031149433813478 driven_any_max 0.7595982247497333 driven_any_mean 0.7595982247497333 driven_any_median 0.7595982247497333 driven_any_min 0.7595982247497333 driven_lanedir_consec_max 0.746673767524618 driven_lanedir_consec_mean 0.746673767524618 driven_lanedir_consec_min 0.746673767524618 driven_lanedir_max 0.746673767524618 driven_lanedir_mean 0.746673767524618 driven_lanedir_median 0.746673767524618 driven_lanedir_min 0.746673767524618 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7595982247497333, "survival_time": 13.70000000000006, "driven_lanedir": 0.746673767524618, "in-drivable-lane": 0.0, "deviation-heading": 2.160741888859268, "distance-from-start": 0.7031149433813478, "deviation-center-line": 0.7161949626619292, "driven_lanedir_consec": 0.746673767524618}}simulation-passed 1 survival_time_max 13.70000000000006 survival_time_mean 13.70000000000006 survival_time_min 13.70000000000006
No reset possible 6493643Bea Baselines minimal-agent-full aido-LFV_multi-full-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-02 20:47:52+00:00 2021-11-02 21:00:30+00:00 0:12:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.9999999999999576 driven_lanedir_consec_median 2.9816913027353795 deviation-center-line_median 5.999212563454321
other stats deviation-center-line_max 6.279828591515402 deviation-center-line_mean 5.898869522988079 deviation-center-line_min 5.317224373528271 deviation-heading_max 6.908636787901559 deviation-heading_mean 5.00526214896848 deviation-heading_median 5.3059869154988375 deviation-heading_min 2.5004379769746863 distance-from-start_max 2.7163807174982693 distance-from-start_mean 1.9474863406043583 distance-from-start_median 2.133877457590029 distance-from-start_min 0.8058097297391079 driven_any_max 3.579596890608956 driven_any_mean 3.1367153053144774 driven_any_median 3.497838330840156 driven_any_min 1.971587668968642 driven_lanedir_consec_max 3.554363389555085 driven_lanedir_consec_mean 2.5612811119723276 driven_lanedir_consec_min 0.7273784528634657 driven_lanedir_max 3.554363389555085 driven_lanedir_mean 3.017264448780624 driven_lanedir_median 3.337488631463687 driven_lanedir_min 1.839717142640037 in-drivable-lane_max 3.449999999999882 in-drivable-lane_mean 1.8624999999999492 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 1.971587668968642, "survival_time": 59.99999999999873, "driven_lanedir": 1.839717142640037, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.390348197280299, "distance-from-start": 0.8058097297391079, "deviation-center-line": 5.7223527739429985, "driven_lanedir_consec": 0.7273784528634657}, "loop-000-ego1": {"driven_any": 3.579596890608956, "survival_time": 59.99999999999873, "driven_lanedir": 3.554363389555085, "in-drivable-lane": 0.0, "deviation-heading": 2.5004379769746863, "distance-from-start": 2.7163807174982693, "deviation-center-line": 6.279828591515402, "driven_lanedir_consec": 3.554363389555085}, "loop-000-ego2": {"driven_any": 3.4760913988195017, "survival_time": 59.99999999999873, "driven_lanedir": 3.307439986272721, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.221625633717376, "distance-from-start": 2.1876553732781443, "deviation-center-line": 6.2760723529656435, "driven_lanedir_consec": 3.307439986272721}, "loop-000-ego3": {"driven_any": 3.51958526286081, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675372766546534, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908636787901559, "distance-from-start": 2.080099541901913, "deviation-center-line": 5.317224373528271, "driven_lanedir_consec": 2.6559426191980378}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6481680Bea Baselines baseline-simple-yield aido-LF-state-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 20:43:11+00:00 2021-11-02 20:47:45+00:00 0:04:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median -0.0002213201227618811 deviation-center-line_median 0.4065062534344534
other stats deviation-center-line_max 0.4065062534344534 deviation-center-line_mean 0.4065062534344534 deviation-center-line_min 0.4065062534344534 deviation-heading_max 40.96738790126906 deviation-heading_mean 40.96738790126906 deviation-heading_median 40.96738790126906 deviation-heading_min 40.96738790126906 distance-from-start_max 6.280369834735102e-16 distance-from-start_mean 6.280369834735102e-16 distance-from-start_median 6.280369834735102e-16 distance-from-start_min 6.280369834735102e-16 driven_any_max 7.536443801682175e-13 driven_any_mean 7.536443801682175e-13 driven_any_median 7.536443801682175e-13 driven_any_min 7.536443801682175e-13 driven_lanedir_consec_max -0.0002213201227618811 driven_lanedir_consec_mean -0.0002213201227618811 driven_lanedir_consec_min -0.0002213201227618811 driven_lanedir_max -0.0002213201227618811 driven_lanedir_mean -0.0002213201227618811 driven_lanedir_median -0.0002213201227618811 driven_lanedir_min -0.0002213201227618811 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.0002213201227618811, "in-drivable-lane": 0.0, "deviation-heading": 40.96738790126906, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.4065062534344534, "driven_lanedir_consec": -0.0002213201227618811}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6465676Bea Baselines baseline-simple-yield aido-LFVI_multi-state-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-02 20:33:07+00:00 2021-11-02 20:42:43+00:00 0:09:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.9345733957247475 deviation-center-line_median 0.1495255122147401
other stats deviation-center-line_max 1.0816161636507569 deviation-center-line_mean 0.3677032911639634 deviation-center-line_min 0.09014597657561622 deviation-heading_max 7.662512790853319 deviation-heading_mean 2.8003090495633742 deviation-heading_median 1.3383485799995245 deviation-heading_min 0.8620262474011284 distance-from-start_max 2.328675391154607 distance-from-start_mean 1.768545897067653 distance-from-start_median 1.8943393617573885 distance-from-start_min 0.9568294736012292 driven_any_max 5.743174255101718 driven_any_mean 2.8303400578667937 driven_any_median 2.141544029418139 driven_any_min 1.2950979175291768 driven_lanedir_consec_max 5.737782330849534 driven_lanedir_consec_mean 2.72368023429597 driven_lanedir_consec_min 1.2877918148848522 driven_lanedir_max 5.737782401111865 driven_lanedir_mean 2.8244219785143843 driven_lanedir_median 2.1360568490304095 driven_lanedir_min 1.2877918148848522 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.2950979175291768, "survival_time": 59.99999999999873, "driven_lanedir": 1.2877918148848522, "in-drivable-lane": 0.0, "deviation-heading": 1.3173151367489415, "distance-from-start": 0.9568294736012292, "deviation-center-line": 0.1343792570180741, "driven_lanedir_consec": 1.2877918148848522}, "4way-000-ego1": {"driven_any": 1.793822470316908, "survival_time": 59.99999999999873, "driven_lanedir": 1.785553264636787, "in-drivable-lane": 0.0, "deviation-heading": 7.662512790853319, "distance-from-start": 1.7715478688511692, "deviation-center-line": 1.0816161636507569, "driven_lanedir_consec": 1.382586358025463}, "4way-000-ego2": {"driven_any": 5.743174255101718, "survival_time": 59.99999999999873, "driven_lanedir": 5.737782401111865, "in-drivable-lane": 0.0, "deviation-heading": 1.3593820232501066, "distance-from-start": 2.328675391154607, "deviation-center-line": 0.16467176741140607, "driven_lanedir_consec": 5.737782330849534}, "4way-000-ego3": {"driven_any": 2.48926558851937, "survival_time": 59.99999999999873, "driven_lanedir": 2.486560433424032, "in-drivable-lane": 0.0, "deviation-heading": 0.8620262474011284, "distance-from-start": 2.0171308546636073, "deviation-center-line": 0.09014597657561622, "driven_lanedir_consec": 2.486560433424032}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6453683Bea Baselines baseline-simple-yield aido-LFVI-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 20:22:38+00:00 2021-11-02 20:32:34+00:00 0:09:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.619340458553207 deviation-center-line_median 0.29362362810082904
other stats deviation-center-line_max 0.29362362810082904 deviation-center-line_mean 0.29362362810082904 deviation-center-line_min 0.29362362810082904 deviation-heading_max 2.404267084079743 deviation-heading_mean 2.404267084079743 deviation-heading_median 2.404267084079743 deviation-heading_min 2.404267084079743 distance-from-start_max 2.3421142281734313 distance-from-start_mean 2.3421142281734313 distance-from-start_median 2.3421142281734313 distance-from-start_min 2.3421142281734313 driven_any_max 4.634748572927819 driven_any_mean 4.634748572927819 driven_any_median 4.634748572927819 driven_any_min 4.634748572927819 driven_lanedir_consec_max 4.619340458553207 driven_lanedir_consec_mean 4.619340458553207 driven_lanedir_consec_min 4.619340458553207 driven_lanedir_max 4.6193404722652875 driven_lanedir_mean 4.6193404722652875 driven_lanedir_median 4.6193404722652875 driven_lanedir_min 4.6193404722652875 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 4.634748572927819, "survival_time": 59.99999999999873, "driven_lanedir": 4.6193404722652875, "in-drivable-lane": 0.0, "deviation-heading": 2.404267084079743, "distance-from-start": 2.3421142281734313, "deviation-center-line": 0.29362362810082904, "driven_lanedir_consec": 4.619340458553207}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6436680Bea Baselines baseline-simple-yield aido-LF-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 20:18:35+00:00 2021-11-02 20:22:32+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.6173794793891885 deviation-center-line_median 0.3790863571459804
other stats deviation-center-line_max 0.3790863571459804 deviation-center-line_mean 0.3790863571459804 deviation-center-line_min 0.3790863571459804 deviation-heading_max 2.844192295741865 deviation-heading_mean 2.844192295741865 deviation-heading_median 2.844192295741865 deviation-heading_min 2.844192295741865 distance-from-start_max 2.723986924723346 distance-from-start_mean 2.723986924723346 distance-from-start_median 2.723986924723346 distance-from-start_min 2.723986924723346 driven_any_max 5.636243490208466 driven_any_mean 5.636243490208466 driven_any_median 5.636243490208466 driven_any_min 5.636243490208466 driven_lanedir_consec_max 5.6173794793891885 driven_lanedir_consec_mean 5.6173794793891885 driven_lanedir_consec_min 5.6173794793891885 driven_lanedir_max 5.6173794793891885 driven_lanedir_mean 5.6173794793891885 driven_lanedir_median 5.6173794793891885 driven_lanedir_min 5.6173794793891885 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6430683Bea Baselines baseline-simple-yield aido-LFVI-state-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 20:05:56+00:00 2021-11-02 20:18:09+00:00 0:12:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.57254251112803 deviation-center-line_median 0.3023078005735761
other stats deviation-center-line_max 0.3023078005735761 deviation-center-line_mean 0.3023078005735761 deviation-center-line_min 0.3023078005735761 deviation-heading_max 1.9428208342834787 deviation-heading_mean 1.9428208342834787 deviation-heading_median 1.9428208342834787 deviation-heading_min 1.9428208342834787 distance-from-start_max 2.475080487701063 distance-from-start_mean 2.475080487701063 distance-from-start_median 2.475080487701063 distance-from-start_min 2.475080487701063 driven_any_max 5.745302788245269 driven_any_mean 5.745302788245269 driven_any_median 5.745302788245269 driven_any_min 5.745302788245269 driven_lanedir_consec_max 5.57254251112803 driven_lanedir_consec_mean 5.57254251112803 driven_lanedir_consec_min 5.57254251112803 driven_lanedir_max 5.734875658069805 driven_lanedir_mean 5.734875658069805 driven_lanedir_median 5.734875658069805 driven_lanedir_min 5.734875658069805 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.745302788245269, "survival_time": 59.99999999999873, "driven_lanedir": 5.734875658069805, "in-drivable-lane": 0.0, "deviation-heading": 1.9428208342834787, "distance-from-start": 2.475080487701063, "deviation-center-line": 0.3023078005735761, "driven_lanedir_consec": 5.57254251112803}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6414682Bea Baselines baseline-simple-yield aido-LFVI_multi-state-sim-testingsim-1of4 timeout no gpu-staging-spot-0-012021-11-02 19:52:33+00:00 - - - - No reset possible 6399685Bea Baselines baseline-simple-yield aido-LFV-state-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-02 19:42:33+00:00 2021-11-02 19:52:27+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949424300958599
other stats deviation-center-line_max 0.8949424300958599 deviation-center-line_mean 0.8949424300958599 deviation-center-line_min 0.8949424300958599 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 3.3306690738754696e-16 distance-from-start_mean 3.3306690738754696e-16 distance-from-start_median 3.3306690738754696e-16 distance-from-start_min 3.3306690738754696e-16 driven_any_max 3.9968028886505635e-13 driven_any_mean 3.9968028886505635e-13 driven_any_median 3.9968028886505635e-13 driven_any_min 3.9968028886505635e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6394687Bea Baselines baseline-simple-yield aido-LFP-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 19:39:54+00:00 2021-11-02 19:42:07+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 22.20000000000018 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.7931242458645529 deviation-center-line_median 0.1961591864911841
other stats deviation-center-line_max 0.1961591864911841 deviation-center-line_mean 0.1961591864911841 deviation-center-line_min 0.1961591864911841 deviation-heading_max 1.690974780395429 deviation-heading_mean 1.690974780395429 deviation-heading_median 1.690974780395429 deviation-heading_min 1.690974780395429 distance-from-start_max 1.4244240674089024 distance-from-start_mean 1.4244240674089024 distance-from-start_median 1.4244240674089024 distance-from-start_min 1.4244240674089024 driven_any_max 1.805900837286754 driven_any_mean 1.805900837286754 driven_any_median 1.805900837286754 driven_any_min 1.805900837286754 driven_lanedir_consec_max 1.7931242458645529 driven_lanedir_consec_mean 1.7931242458645529 driven_lanedir_consec_min 1.7931242458645529 driven_lanedir_max 1.7931242458645529 driven_lanedir_mean 1.7931242458645529 driven_lanedir_median 1.7931242458645529 driven_lanedir_min 1.7931242458645529 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.805900837286754, "survival_time": 22.20000000000018, "driven_lanedir": 1.7931242458645529, "in-drivable-lane": 0.0, "deviation-heading": 1.690974780395429, "distance-from-start": 1.4244240674089024, "deviation-center-line": 0.1961591864911841, "driven_lanedir_consec": 1.7931242458645529}}simulation-passed 1 survival_time_max 22.20000000000018 survival_time_mean 22.20000000000018 survival_time_min 22.20000000000018
No reset possible 6381720Bea Baselines minimal-agent-state aido-LFVI-state-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-02 19:30:51+00:00 2021-11-02 19:39:47+00:00 0:08:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4352327805345304 deviation-center-line_median 3.4976585818458954
other stats deviation-center-line_max 3.4976585818458954 deviation-center-line_mean 3.4976585818458954 deviation-center-line_min 3.4976585818458954 deviation-heading_max 4.543459809816395 deviation-heading_mean 4.543459809816395 deviation-heading_median 4.543459809816395 deviation-heading_min 4.543459809816395 distance-from-start_max 2.277929298279453 distance-from-start_mean 2.277929298279453 distance-from-start_median 2.277929298279453 distance-from-start_min 2.277929298279453 driven_any_max 3.579588783619006 driven_any_mean 3.579588783619006 driven_any_median 3.579588783619006 driven_any_min 3.579588783619006 driven_lanedir_consec_max 3.4352327805345304 driven_lanedir_consec_mean 3.4352327805345304 driven_lanedir_consec_min 3.4352327805345304 driven_lanedir_max 3.5560705587675905 driven_lanedir_mean 3.5560705587675905 driven_lanedir_median 3.5560705587675905 driven_lanedir_min 3.5560705587675905 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579588783619006, "survival_time": 59.99999999999873, "driven_lanedir": 3.5560705587675905, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809816395, "distance-from-start": 2.277929298279453, "deviation-center-line": 3.4976585818458954, "driven_lanedir_consec": 3.4352327805345304}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6364721Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-validation285 success yes gpu-staging-spot-0-012021-11-02 19:22:17+00:00 2021-11-02 19:30:25+00:00 0:08:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.3499999999998895 driven_lanedir_consec_median 2.2675849461568647 deviation-center-line_median 5.560918027752658
other stats deviation-center-line_max 5.665543834003993 deviation-center-line_mean 5.3727149067087066 deviation-center-line_min 4.703479737325517 deviation-heading_max 10.454471793859122 deviation-heading_mean 9.605748204053755 deviation-heading_median 9.670620842366962 deviation-heading_min 8.627279337621992 distance-from-start_max 3.0406853340722217 distance-from-start_mean 2.0347241290700784 distance-from-start_median 2.024381858976593 distance-from-start_min 1.0494474642549068 driven_any_max 3.5795904164549563 driven_any_mean 3.481407758763025 driven_any_median 3.4491559187079543 driven_any_min 3.447728781181236 driven_lanedir_consec_max 3.500351716832338 driven_lanedir_consec_mean 2.3551359976981656 driven_lanedir_consec_min 1.385022381646594 driven_lanedir_max 3.500351716832338 driven_lanedir_mean 3.2651576913078557 driven_lanedir_median 3.1933040571981905 driven_lanedir_min 3.173670934002705 in-drivable-lane_max 4.399999999999963 in-drivable-lane_mean 3.2749999999999355 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081931990942, "survival_time": 59.99999999999873, "driven_lanedir": 3.2020361174014584, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279337621992, "distance-from-start": 1.0494474642549068, "deviation-center-line": 5.586766604699417, "driven_lanedir_consec": 1.385022381646594}, "zigzag-000-ego1": {"driven_any": 3.447728781181236, "survival_time": 59.99999999999873, "driven_lanedir": 3.173670934002705, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.454471793859122, "distance-from-start": 1.5345351360434751, "deviation-center-line": 5.665543834003993, "driven_lanedir_consec": 1.63302491241896}, "zigzag-000-ego2": {"driven_any": 3.5795904164549563, "survival_time": 59.99999999999873, "driven_lanedir": 3.500351716832338, "in-drivable-lane": 0.0, "deviation-heading": 9.518767283173348, "distance-from-start": 3.0406853340722217, "deviation-center-line": 4.703479737325517, "driven_lanedir_consec": 3.500351716832338}, "zigzag-000-ego3": {"driven_any": 3.4492299054249664, "survival_time": 59.99999999999873, "driven_lanedir": 3.184571996994922, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.822474401560571, "distance-from-start": 2.5142285819097103, "deviation-center-line": 5.535069450805898, "driven_lanedir_consec": 2.9021449798947696}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6358723Bea Baselines minimal-agent-state aido-LF-state-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-02 19:18:55+00:00 2021-11-02 19:22:05+00:00 0:03:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 40.04999999999986 in-drivable-lane_median 2.5000000000000098 driven_lanedir_consec_median 1.160366146360421 deviation-center-line_median 2.940039735198709
other stats deviation-center-line_max 2.940039735198709 deviation-center-line_mean 2.940039735198709 deviation-center-line_min 2.940039735198709 deviation-heading_max 9.167157492761987 deviation-heading_mean 9.167157492761987 deviation-heading_median 9.167157492761987 deviation-heading_min 9.167157492761987 distance-from-start_max 1.1396211983149378 distance-from-start_mean 1.1396211983149378 distance-from-start_median 1.1396211983149378 distance-from-start_min 1.1396211983149378 driven_any_max 2.265732411375476 driven_any_mean 2.265732411375476 driven_any_median 2.265732411375476 driven_any_min 2.265732411375476 driven_lanedir_consec_max 1.160366146360421 driven_lanedir_consec_mean 1.160366146360421 driven_lanedir_consec_min 1.160366146360421 driven_lanedir_max 2.08337576497627 driven_lanedir_mean 2.08337576497627 driven_lanedir_median 2.08337576497627 driven_lanedir_min 2.08337576497627 in-drivable-lane_max 2.5000000000000098 in-drivable-lane_mean 2.5000000000000098 in-drivable-lane_min 2.5000000000000098 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.265732411375476, "survival_time": 40.04999999999986, "driven_lanedir": 2.08337576497627, "in-drivable-lane": 2.5000000000000098, "deviation-heading": 9.167157492761987, "distance-from-start": 1.1396211983149378, "deviation-center-line": 2.940039735198709, "driven_lanedir_consec": 1.160366146360421}}simulation-passed 1 survival_time_max 40.04999999999986 survival_time_mean 40.04999999999986 survival_time_min 40.04999999999986
No reset possible 6346397Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-02 19:09:00+00:00 2021-11-02 19:18:48+00:00 0:09:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.03473806546569 survival_time_median 59.99999999999873 deviation-center-line_median 3.0481658378565464 in-drivable-lane_median 31.399999999998865
other stats deviation-center-line_max 3.0481658378565464 deviation-center-line_mean 3.0481658378565464 deviation-center-line_min 3.0481658378565464 deviation-heading_max 22.440152184362276 deviation-heading_mean 22.440152184362276 deviation-heading_median 22.440152184362276 deviation-heading_min 22.440152184362276 distance-from-start_max 0.1641508375050317 distance-from-start_mean 0.1641508375050317 distance-from-start_median 0.1641508375050317 distance-from-start_min 0.1641508375050317 driven_any_max 9.354712716316069 driven_any_mean 9.354712716316069 driven_any_median 9.354712716316069 driven_any_min 9.354712716316069 driven_lanedir_consec_max -1.03473806546569 driven_lanedir_consec_mean -1.03473806546569 driven_lanedir_consec_min -1.03473806546569 driven_lanedir_max -1.03473806546569 driven_lanedir_mean -1.03473806546569 driven_lanedir_median -1.03473806546569 driven_lanedir_min -1.03473806546569 in-drivable-lane_max 31.399999999998865 in-drivable-lane_mean 31.399999999998865 in-drivable-lane_min 31.399999999998865 per-episodes details {"loop-000-ego0": {"driven_any": 9.354712716316069, "survival_time": 59.99999999999873, "driven_lanedir": -1.03473806546569, "in-drivable-lane": 31.399999999998865, "deviation-heading": 22.440152184362276, "distance-from-start": 0.1641508375050317, "deviation-center-line": 3.0481658378565464, "driven_lanedir_consec": -1.03473806546569}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6300397Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-testingsim-1of4 timeout no gpu-staging-spot-0-012021-11-02 18:21:13+00:00 - - - - No reset possible 6298526Bea Baselines baseline-behavior-cloning aido-LF-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-11-02 18:19:57+00:00 2021-11-02 18:20:52+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6295526Bea Baselines baseline-behavior-cloning aido-LF-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-11-02 18:18:14+00:00 2021-11-02 18:19:25+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6285672Bea Baselines template-tensorflow aido-LF-sim-testingsim-3of4 failed no gpu-staging-spot-0-012021-11-02 18:16:52+00:00 2021-11-02 18:17:48+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6276715Bea Baselines template-random aido-LF-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-02 18:13:40+00:00 2021-11-02 18:16:41+00:00 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.05434655099627461 survival_time_median 27.600000000000257 deviation-center-line_median 0.634658591949439 in-drivable-lane_median 20.050000000000185
other stats deviation-center-line_max 0.634658591949439 deviation-center-line_mean 0.634658591949439 deviation-center-line_min 0.634658591949439 deviation-heading_max 5.904235246936352 deviation-heading_mean 5.904235246936352 deviation-heading_median 5.904235246936352 deviation-heading_min 5.904235246936352 distance-from-start_max 0.7960980578537318 distance-from-start_mean 0.7960980578537318 distance-from-start_median 0.7960980578537318 distance-from-start_min 0.7960980578537318 driven_any_max 6.576498432956264 driven_any_mean 6.576498432956264 driven_any_median 6.576498432956264 driven_any_min 6.576498432956264 driven_lanedir_consec_max 0.05434655099627461 driven_lanedir_consec_mean 0.05434655099627461 driven_lanedir_consec_min 0.05434655099627461 driven_lanedir_max 0.05769325072273146 driven_lanedir_mean 0.05769325072273146 driven_lanedir_median 0.05769325072273146 driven_lanedir_min 0.05769325072273146 in-drivable-lane_max 20.050000000000185 in-drivable-lane_mean 20.050000000000185 in-drivable-lane_min 20.050000000000185 per-episodes details {"autolab-000-ego0": {"driven_any": 6.576498432956264, "survival_time": 27.600000000000257, "driven_lanedir": 0.05769325072273146, "in-drivable-lane": 20.050000000000185, "deviation-heading": 5.904235246936352, "distance-from-start": 0.7960980578537318, "deviation-center-line": 0.634658591949439, "driven_lanedir_consec": 0.05434655099627461}}simulation-passed 1 survival_time_max 27.600000000000257 survival_time_mean 27.600000000000257 survival_time_min 27.600000000000257
No reset possible 6273731Bea Baselines minimal-agent-state aido-hello-sim-state-validationsanity-check success no gpu-staging-spot-0-012021-11-02 18:12:10+00:00 2021-11-02 18:13:34+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.01010041184137167 deviation-center-line_median 0.006374441191151069
other stats deviation-center-line_max 0.006374441191151069 deviation-center-line_mean 0.006374441191151069 deviation-center-line_min 0.006374441191151069 deviation-heading_max 0.2614212407761816 deviation-heading_mean 0.2614212407761816 deviation-heading_median 0.2614212407761816 deviation-heading_min 0.2614212407761816 distance-from-start_max 0.011536496219628762 distance-from-start_mean 0.011536496219628762 distance-from-start_median 0.011536496219628762 distance-from-start_min 0.011536496219628762 driven_any_max 0.01153864640232521 driven_any_mean 0.01153864640232521 driven_any_median 0.01153864640232521 driven_any_min 0.01153864640232521 driven_lanedir_consec_max 0.01010041184137167 driven_lanedir_consec_mean 0.01010041184137167 driven_lanedir_consec_min 0.01010041184137167 driven_lanedir_max 0.01010041184137167 driven_lanedir_mean 0.01010041184137167 driven_lanedir_median 0.01010041184137167 driven_lanedir_min 0.01010041184137167 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.01153864640232521, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01010041184137167, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761816, "distance-from-start": 0.011536496219628762, "deviation-center-line": 0.006374441191151069, "driven_lanedir_consec": 0.01010041184137167}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 6267690Bea Baselines minimal-agent aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-02 18:10:27+00:00 2021-11-02 18:12:04+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 9.40000000000005 driven_lanedir_consec_median 0.33122977762117056 deviation-center-line_median 0.2697354450181819
other stats deviation-center-line_max 0.2697354450181819 deviation-center-line_mean 0.2697354450181819 deviation-center-line_min 0.2697354450181819 deviation-heading_max 2.5383505748046193 deviation-heading_mean 2.5383505748046193 deviation-heading_median 2.5383505748046193 deviation-heading_min 2.5383505748046193 distance-from-start_max 1.9240493840830373 distance-from-start_mean 1.9240493840830373 distance-from-start_median 1.9240493840830373 distance-from-start_min 1.9240493840830373 driven_any_max 1.9241954407136783 driven_any_mean 1.9241954407136783 driven_any_median 1.9241954407136783 driven_any_min 1.9241954407136783 driven_lanedir_consec_max 0.33122977762117056 driven_lanedir_consec_mean 0.33122977762117056 driven_lanedir_consec_min 0.33122977762117056 driven_lanedir_max 0.33122977762117056 driven_lanedir_mean 0.33122977762117056 driven_lanedir_median 0.33122977762117056 driven_lanedir_min 0.33122977762117056 in-drivable-lane_max 9.40000000000005 in-drivable-lane_mean 9.40000000000005 in-drivable-lane_min 9.40000000000005 per-episodes details {"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 6240385Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 05:43:33+00:00 2021-11-01 05:51:16+00:00 0:07:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.249999999999265 driven_lanedir_consec_median -2.2482409841644917 deviation-center-line_median 3.2952654549368128
other stats deviation-center-line_max 3.5928016288219458 deviation-center-line_mean 3.2952654549368128 deviation-center-line_min 2.99772928105168 deviation-heading_max 26.70381668878483 deviation-heading_mean 26.669899966896345 deviation-heading_median 26.669899966896345 deviation-heading_min 26.635983245007864 distance-from-start_max 0.25758798336269173 distance-from-start_mean 0.24794017538725513 distance-from-start_median 0.24794017538725513 distance-from-start_min 0.23829236741181853 driven_any_max 11.062736065912024 driven_any_mean 10.690192349635607 driven_any_median 10.690192349635607 driven_any_min 10.317648633359196 driven_lanedir_consec_max -2.171732299869598 driven_lanedir_consec_mean -2.2482409841644917 driven_lanedir_consec_min -2.324749668459386 driven_lanedir_max -2.171732299869598 driven_lanedir_mean -2.4081922133041314 driven_lanedir_median -2.4081922133041314 driven_lanedir_min -2.6446521267386647 in-drivable-lane_max 28.099999999999177 in-drivable-lane_mean 26.249999999999265 in-drivable-lane_min 24.399999999999352 per-episodes details {"loop2-000-ego0": {"driven_any": 11.062736065912024, "survival_time": 59.99999999999873, "driven_lanedir": -2.6446521267386647, "in-drivable-lane": 28.099999999999177, "deviation-heading": 26.635983245007864, "distance-from-start": 0.23829236741181853, "deviation-center-line": 2.99772928105168, "driven_lanedir_consec": -2.324749668459386}, "loop2-000-ego1": {"driven_any": 10.317648633359196, "survival_time": 59.99999999999873, "driven_lanedir": -2.171732299869598, "in-drivable-lane": 24.399999999999352, "deviation-heading": 26.70381668878483, "distance-from-start": 0.25758798336269173, "deviation-center-line": 3.5928016288219458, "driven_lanedir_consec": -2.171732299869598}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6236386Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 05:38:20+00:00 2021-11-01 05:43:14+00:00 0:04:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 35.349999999999056 driven_lanedir_consec_median -2.910152269329583 deviation-center-line_median 1.9709550275928065
other stats deviation-center-line_max 1.9709550275928065 deviation-center-line_mean 1.9709550275928065 deviation-center-line_min 1.9709550275928065 deviation-heading_max 21.337289612545028 deviation-heading_mean 21.337289612545028 deviation-heading_median 21.337289612545028 deviation-heading_min 21.337289612545028 distance-from-start_max 0.16374932570170933 distance-from-start_mean 0.16374932570170933 distance-from-start_median 0.16374932570170933 distance-from-start_min 0.16374932570170933 driven_any_max 11.586259245990556 driven_any_mean 11.586259245990556 driven_any_median 11.586259245990556 driven_any_min 11.586259245990556 driven_lanedir_consec_max -2.910152269329583 driven_lanedir_consec_mean -2.910152269329583 driven_lanedir_consec_min -2.910152269329583 driven_lanedir_max -3.0817863534437167 driven_lanedir_mean -3.0817863534437167 driven_lanedir_median -3.0817863534437167 driven_lanedir_min -3.0817863534437167 in-drivable-lane_max 35.349999999999056 in-drivable-lane_mean 35.349999999999056 in-drivable-lane_min 35.349999999999056 per-episodes details {"loop2-000-ego0": {"driven_any": 11.586259245990556, "survival_time": 59.99999999999873, "driven_lanedir": -3.0817863534437167, "in-drivable-lane": 35.349999999999056, "deviation-heading": 21.337289612545028, "distance-from-start": 0.16374932570170933, "deviation-center-line": 1.9709550275928065, "driven_lanedir_consec": -2.910152269329583}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6221391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 05:16:39+00:00 2021-11-01 05:38:06+00:00 0:21:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.849999999999383 driven_lanedir_consec_median -4.119293231194919 deviation-center-line_median 2.9117028003329826
other stats deviation-center-line_max 5.419204198875926 deviation-center-line_mean 3.312318568379507 deviation-center-line_min 2.006664473976137 deviation-heading_max 29.522367962591453 deviation-heading_mean 25.05771074762602 deviation-heading_median 25.022748497579904 deviation-heading_min 20.662978032752807 distance-from-start_max 0.2070815308716943 distance-from-start_mean 0.17599620843732686 distance-from-start_median 0.16732908476179362 distance-from-start_min 0.16224513335402593 driven_any_max 14.54495606927702 driven_any_mean 12.50110764541585 driven_any_median 13.504286764865974 driven_any_min 8.450900982654439 driven_lanedir_consec_max -2.5185921207333335 driven_lanedir_consec_mean -3.810356903196552 driven_lanedir_consec_min -4.484249029663037 driven_lanedir_max -2.5185921207333335 driven_lanedir_mean -4.606524548353123 driven_lanedir_median -4.680951661230191 driven_lanedir_min -6.545602750218777 in-drivable-lane_max 30.84999999999933 in-drivable-lane_mean 23.62499999999951 in-drivable-lane_min 17.949999999999953 per-episodes details {"4way-000-ego0": {"driven_any": 14.265441573531811, "survival_time": 59.99999999999873, "driven_lanedir": -5.0077604710450245, "in-drivable-lane": 26.199999999999445, "deviation-heading": 26.940105608128455, "distance-from-start": 0.2070815308716943, "deviation-center-line": 2.006664473976137, "driven_lanedir_consec": -4.364217791170905}, "4way-000-ego1": {"driven_any": 8.450900982654439, "survival_time": 59.99999999999873, "driven_lanedir": -2.5185921207333335, "in-drivable-lane": 17.949999999999953, "deviation-heading": 20.662978032752807, "distance-from-start": 0.16224513335402593, "deviation-center-line": 5.419204198875926, "driven_lanedir_consec": -2.5185921207333335}, "4way-000-ego2": {"driven_any": 14.54495606927702, "survival_time": 59.99999999999873, "driven_lanedir": -6.545602750218777, "in-drivable-lane": 19.49999999999932, "deviation-heading": 29.522367962591453, "distance-from-start": 0.1695059249975797, "deviation-center-line": 3.412702017539836, "driven_lanedir_consec": -4.484249029663037}, "4way-000-ego3": {"driven_any": 12.743131956200132, "survival_time": 59.99999999999873, "driven_lanedir": -4.354142851415356, "in-drivable-lane": 30.84999999999933, "deviation-heading": 23.105391387031357, "distance-from-start": 0.16515224452600755, "deviation-center-line": 2.410703583126129, "driven_lanedir_consec": -3.874368671218933}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6208392Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-01 05:00:58+00:00 2021-11-01 05:16:32+00:00 0:15:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 29.1999999999993 driven_lanedir_consec_median -2.826095723197641 deviation-center-line_median 2.5807087080157367
other stats deviation-center-line_max 3.347675880257921 deviation-center-line_mean 2.6582486769087503 deviation-center-line_min 2.1239014113456065 deviation-heading_max 37.82293240559152 deviation-heading_mean 27.927450321506647 deviation-heading_median 25.919075635735243 deviation-heading_min 22.04871760896457 distance-from-start_max 0.1976556086009199 distance-from-start_mean 0.133068756818121 distance-from-start_median 0.16730970933578193 distance-from-start_min 2.482534153247273e-16 driven_any_max 12.53550996986409 driven_any_mean 8.962550638880453 driven_any_median 11.657346292828713 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean -2.2950038062468257 driven_lanedir_consec_min -3.527823778592021 driven_lanedir_max 0.0 driven_lanedir_mean -2.3400720722451807 driven_lanedir_median -2.916232255194351 driven_lanedir_min -3.527823778592021 in-drivable-lane_max 35.04999999999914 in-drivable-lane_mean 23.362499999999436 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 11.931676627508535, "survival_time": 59.99999999999873, "driven_lanedir": -2.6353446174201167, "in-drivable-lane": 33.64999999999911, "deviation-heading": 23.52759836667299, "distance-from-start": 0.16708215421439546, "deviation-center-line": 2.398954795301821, "driven_lanedir_consec": -2.6353446174201167}, "loop-000-ego1": {"driven_any": 12.53550996986409, "survival_time": 59.99999999999873, "driven_lanedir": -3.527823778592021, "in-drivable-lane": 24.74999999999949, "deviation-heading": 28.310552904797497, "distance-from-start": 0.1976556086009199, "deviation-center-line": 3.347675880257921, "driven_lanedir_consec": -3.527823778592021}, "loop-000-ego2": {"driven_any": 11.38301595814889, "survival_time": 59.99999999999873, "driven_lanedir": -3.1971198929685847, "in-drivable-lane": 35.04999999999914, "deviation-heading": 22.04871760896457, "distance-from-start": 0.16753726445716843, "deviation-center-line": 2.1239014113456065, "driven_lanedir_consec": -3.016846828975165}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6203393Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-01 04:54:26+00:00 2021-11-01 05:00:28+00:00 0:06:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.8499999999995 driven_lanedir_consec_median -2.9946664396589 deviation-center-line_median 3.6013448433796316
other stats deviation-center-line_max 3.6013448433796316 deviation-center-line_mean 3.6013448433796316 deviation-center-line_min 3.6013448433796316 deviation-heading_max 28.052086176669725 deviation-heading_mean 28.052086176669725 deviation-heading_median 28.052086176669725 deviation-heading_min 28.052086176669725 distance-from-start_max 0.1593709799609358 distance-from-start_mean 0.1593709799609358 distance-from-start_median 0.1593709799609358 distance-from-start_min 0.1593709799609358 driven_any_max 11.558769566165717 driven_any_mean 11.558769566165717 driven_any_median 11.558769566165717 driven_any_min 11.558769566165717 driven_lanedir_consec_max -2.9946664396589 driven_lanedir_consec_mean -2.9946664396589 driven_lanedir_consec_min -2.9946664396589 driven_lanedir_max -2.9946664396589 driven_lanedir_mean -2.9946664396589 driven_lanedir_median -2.9946664396589 driven_lanedir_min -2.9946664396589 in-drivable-lane_max 22.8499999999995 in-drivable-lane_mean 22.8499999999995 in-drivable-lane_min 22.8499999999995 per-episodes details {"loop-000-ego0": {"driven_any": 11.558769566165717, "survival_time": 59.99999999999873, "driven_lanedir": -2.9946664396589, "in-drivable-lane": 22.8499999999995, "deviation-heading": 28.052086176669725, "distance-from-start": 0.1593709799609358, "deviation-center-line": 3.6013448433796316, "driven_lanedir_consec": -2.9946664396589}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6190398Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 04:32:49+00:00 2021-11-01 04:54:14+00:00 0:21:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.34999999999924 driven_lanedir_consec_median -2.431951468213569 deviation-center-line_median 2.2086758690101016
other stats deviation-center-line_max 4.667602786998887 deviation-center-line_mean 2.79612880097411 deviation-center-line_min 2.099560678877349 deviation-heading_max 29.61479954577382 deviation-heading_mean 24.955989913252395 deviation-heading_median 24.88883410691427 deviation-heading_min 20.431491893407213 distance-from-start_max 0.25625509858039847 distance-from-start_mean 0.1889538722258179 distance-from-start_median 0.17028348165586454 distance-from-start_min 0.15899342701114397 driven_any_max 11.558793810525524 driven_any_mean 9.545967628319415 driven_any_median 11.21783638682026 driven_any_min 4.189403929111621 driven_lanedir_consec_max -1.3001557470223748 driven_lanedir_consec_mean -2.341193110289399 driven_lanedir_consec_min -3.200713757708084 driven_lanedir_max -1.2939777344237653 driven_lanedir_mean -2.360693108268629 driven_lanedir_median -2.4740404704713335 driven_lanedir_min -3.200713757708084 in-drivable-lane_max 37.349999999998985 in-drivable-lane_mean 24.787499999999383 in-drivable-lane_min 9.100000000000067 per-episodes details {"udem-000-ego0": {"driven_any": 4.189403929111621, "survival_time": 59.99999999999873, "driven_lanedir": -1.2939777344237653, "in-drivable-lane": 9.100000000000067, "deviation-heading": 20.431491893407213, "distance-from-start": 0.15899342701114397, "deviation-center-line": 4.667602786998887, "driven_lanedir_consec": -1.3001557470223748}, "udem-000-ego1": {"driven_any": 11.3952835242714, "survival_time": 59.99999999999873, "driven_lanedir": -3.200713757708084, "in-drivable-lane": 23.79999999999933, "deviation-heading": 29.61479954577382, "distance-from-start": 0.17632364722148833, "deviation-center-line": 2.1001293329853525, "driven_lanedir_consec": -3.200713757708084}, "udem-000-ego2": {"driven_any": 11.040389249369118, "survival_time": 59.99999999999873, "driven_lanedir": -2.306166514704378, "in-drivable-lane": 37.349999999998985, "deviation-heading": 21.01224618400311, "distance-from-start": 0.16424331609024076, "deviation-center-line": 2.099560678877349, "driven_lanedir_consec": -2.221988510188849}, "udem-000-ego3": {"driven_any": 11.558793810525524, "survival_time": 59.99999999999873, "driven_lanedir": -2.6419144262382885, "in-drivable-lane": 28.89999999999915, "deviation-heading": 28.765422029825437, "distance-from-start": 0.25625509858039847, "deviation-center-line": 2.3172224050348507, "driven_lanedir_consec": -2.6419144262382885}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6182514Bea Baselines baseline-behavior-cloning aido-LFV_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-01 04:31:18+00:00 2021-11-01 04:32:30+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6177516Bea Baselines baseline-behavior-cloning aido-LFV-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-01 04:29:27+00:00 2021-11-01 04:30:52+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6173516Bea Baselines baseline-behavior-cloning aido-LFV-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-11-01 04:27:47+00:00 2021-11-01 04:29:14+00:00 0:01:27 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6168518Bea Baselines baseline-behavior-cloning aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-01 04:25:53+00:00 2021-11-01 04:27:25+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6164519Bea Baselines baseline-behavior-cloning aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-11-01 04:24:47+00:00 2021-11-01 04:25:41+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6159520Bea Baselines baseline-behavior-cloning aido-LFVI_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-01 04:23:19+00:00 2021-11-01 04:24:33+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6155521Bea Baselines baseline-behavior-cloning aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-11-01 04:22:06+00:00 2021-11-01 04:23:06+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6151522Bea Baselines baseline-behavior-cloning aido-LFP-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-11-01 04:20:45+00:00 2021-11-01 04:21:40+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6148523Bea Baselines baseline-behavior-cloning aido-LFV-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-11-01 04:19:01+00:00 2021-11-01 04:20:26+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6145524Bea Baselines baseline-behavior-cloning aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-01 04:17:09+00:00 2021-11-01 04:18:43+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6142525Bea Baselines baseline-behavior-cloning aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-01 04:15:14+00:00 2021-11-01 04:16:45+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6131528Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 04:05:58+00:00 2021-11-01 04:14:55+00:00 0:08:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 7.649999999999758 driven_lanedir_consec_median 8.78451608714987 deviation-center-line_median 3.749733226400379
other stats deviation-center-line_max 3.8738210263296455 deviation-center-line_mean 3.749733226400379 deviation-center-line_min 3.625645426471112 deviation-heading_max 18.944132028999 deviation-heading_mean 18.553530536959784 deviation-heading_median 18.553530536959784 deviation-heading_min 18.16292904492057 distance-from-start_max 1.6257310547189583 distance-from-start_mean 1.6147644844901077 distance-from-start_median 1.6147644844901077 distance-from-start_min 1.6037979142612566 driven_any_max 11.594349392642656 driven_any_mean 11.32945567053226 driven_any_median 11.32945567053226 driven_any_min 11.064561948421863 driven_lanedir_consec_max 8.9734178889511 driven_lanedir_consec_mean 8.78451608714987 driven_lanedir_consec_min 8.595614285348638 driven_lanedir_max 8.9734178889511 driven_lanedir_mean 8.78451608714987 driven_lanedir_median 8.78451608714987 driven_lanedir_min 8.595614285348638 in-drivable-lane_max 7.749999999999736 in-drivable-lane_mean 7.649999999999758 in-drivable-lane_min 7.5499999999997796 per-episodes details {"loop2-000-ego0": {"driven_any": 11.064561948421863, "survival_time": 59.99999999999873, "driven_lanedir": 8.595614285348638, "in-drivable-lane": 7.5499999999997796, "deviation-heading": 18.16292904492057, "distance-from-start": 1.6037979142612566, "deviation-center-line": 3.625645426471112, "driven_lanedir_consec": 8.595614285348638}, "loop2-000-ego1": {"driven_any": 11.594349392642656, "survival_time": 59.99999999999873, "driven_lanedir": 8.9734178889511, "in-drivable-lane": 7.749999999999736, "deviation-heading": 18.944132028999, "distance-from-start": 1.6257310547189583, "deviation-center-line": 3.8738210263296455, "driven_lanedir_consec": 8.9734178889511}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6128529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 04:03:27+00:00 2021-11-01 04:05:53+00:00 0:02:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.950000000000037 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.2142430921606184 deviation-center-line_median 0.25384306834846737
other stats deviation-center-line_max 0.25384306834846737 deviation-center-line_mean 0.25384306834846737 deviation-center-line_min 0.25384306834846737 deviation-heading_max 2.1266680218265095 deviation-heading_mean 2.1266680218265095 deviation-heading_median 2.1266680218265095 deviation-heading_min 2.1266680218265095 distance-from-start_max 1.0881549371232544 distance-from-start_mean 1.0881549371232544 distance-from-start_median 1.0881549371232544 distance-from-start_min 1.0881549371232544 driven_any_max 1.241192192190384 driven_any_mean 1.241192192190384 driven_any_median 1.241192192190384 driven_any_min 1.241192192190384 driven_lanedir_consec_max 1.2142430921606184 driven_lanedir_consec_mean 1.2142430921606184 driven_lanedir_consec_min 1.2142430921606184 driven_lanedir_max 1.2142430921606184 driven_lanedir_mean 1.2142430921606184 driven_lanedir_median 1.2142430921606184 driven_lanedir_min 1.2142430921606184 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.241192192190384, "survival_time": 11.950000000000037, "driven_lanedir": 1.2142430921606184, "in-drivable-lane": 0.0, "deviation-heading": 2.1266680218265095, "distance-from-start": 1.0881549371232544, "deviation-center-line": 0.25384306834846737, "driven_lanedir_consec": 1.2142430921606184}}simulation-passed 1 survival_time_max 11.950000000000037 survival_time_mean 11.950000000000037 survival_time_min 11.950000000000037
No reset possible 6126529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-01 04:00:21+00:00 2021-11-01 04:03:09+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.25000000000014 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.699710128108299 deviation-center-line_median 0.5480666590345711
other stats deviation-center-line_max 0.5480666590345711 deviation-center-line_mean 0.5480666590345711 deviation-center-line_min 0.5480666590345711 deviation-heading_max 3.885714686820133 deviation-heading_mean 3.885714686820133 deviation-heading_median 3.885714686820133 deviation-heading_min 3.885714686820133 distance-from-start_max 2.416915122435156 distance-from-start_mean 2.416915122435156 distance-from-start_median 2.416915122435156 distance-from-start_min 2.416915122435156 driven_any_max 2.7623241955708746 driven_any_mean 2.7623241955708746 driven_any_median 2.7623241955708746 driven_any_min 2.7623241955708746 driven_lanedir_consec_max 2.699710128108299 driven_lanedir_consec_mean 2.699710128108299 driven_lanedir_consec_min 2.699710128108299 driven_lanedir_max 2.699710128108299 driven_lanedir_mean 2.699710128108299 driven_lanedir_median 2.699710128108299 driven_lanedir_min 2.699710128108299 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.7623241955708746, "survival_time": 19.25000000000014, "driven_lanedir": 2.699710128108299, "in-drivable-lane": 0.0, "deviation-heading": 3.885714686820133, "distance-from-start": 2.416915122435156, "deviation-center-line": 0.5480666590345711, "driven_lanedir_consec": 2.699710128108299}}simulation-passed 1 survival_time_max 19.25000000000014 survival_time_mean 19.25000000000014 survival_time_min 19.25000000000014
No reset possible 6125529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-0of4 host-error no gpu-staging-spot-0-012021-11-01 03:59:41+00:00 2021-11-01 04:00:03+00:00 0:00:22 Error while running [...] Error while running Docker Compose:
Cannot get process ids
│ output: |4be349378140659cf10478bf7edff5e482c70bbac1ae3dbb3085f9246a7371a7
│ |
│ names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6121530Bea Baselines baseline-dagger-pytorch aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-01 03:54:43+00:00 2021-11-01 03:59:10+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.200000000000166 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.2766948287017077 deviation-center-line_median 0.7713973825304761
other stats deviation-center-line_max 0.7713973825304761 deviation-center-line_mean 0.7713973825304761 deviation-center-line_min 0.7713973825304761 deviation-heading_max 4.139876748189627 deviation-heading_mean 4.139876748189627 deviation-heading_median 4.139876748189627 deviation-heading_min 4.139876748189627 distance-from-start_max 2.4910601476447507 distance-from-start_mean 2.4910601476447507 distance-from-start_median 2.4910601476447507 distance-from-start_min 2.4910601476447507 driven_any_max 3.3635231054185795 driven_any_mean 3.3635231054185795 driven_any_median 3.3635231054185795 driven_any_min 3.3635231054185795 driven_lanedir_consec_max 3.2766948287017077 driven_lanedir_consec_mean 3.2766948287017077 driven_lanedir_consec_min 3.2766948287017077 driven_lanedir_max 3.2766948287017077 driven_lanedir_mean 3.2766948287017077 driven_lanedir_median 3.2766948287017077 driven_lanedir_min 3.2766948287017077 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.3635231054185795, "survival_time": 21.200000000000166, "driven_lanedir": 3.2766948287017077, "in-drivable-lane": 0.0, "deviation-heading": 4.139876748189627, "distance-from-start": 2.4910601476447507, "deviation-center-line": 0.7713973825304761, "driven_lanedir_consec": 3.2766948287017077}}simulation-passed 1 survival_time_max 21.200000000000166 survival_time_mean 21.200000000000166 survival_time_min 21.200000000000166
No reset possible 6118531Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-01 03:53:03+00:00 2021-11-01 03:54:36+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6100535Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 03:38:50+00:00 2021-11-01 03:52:37+00:00 0:13:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.8214017455154057 deviation-center-line_median 3.3259506561474925
other stats deviation-center-line_max 3.911685839971171 deviation-center-line_mean 3.3621391766477933 deviation-center-line_min 2.8849695543250173 deviation-heading_max 23.891156114965767 deviation-heading_mean 19.76542149779048 deviation-heading_median 20.45465081813641 deviation-heading_min 14.261228239923332 distance-from-start_max 4.3455526847612385 distance-from-start_mean 2.6174719801150577 distance-from-start_median 2.1003844867620645 distance-from-start_min 1.923566262174863 driven_any_max 9.225609768030845 driven_any_mean 4.9986630054274865 driven_any_median 4.037045247382002 driven_any_min 2.694951758915101 driven_lanedir_consec_max 8.60466590740901 driven_lanedir_consec_mean 4.710630316494612 driven_lanedir_consec_min 2.5950518675386247 driven_lanedir_max 8.60466590740901 driven_lanedir_mean 4.710630316494612 driven_lanedir_median 3.8214017455154057 driven_lanedir_min 2.5950518675386247 in-drivable-lane_max 0.5499999999999687 in-drivable-lane_mean 0.13749999999999218 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5397456189229235, "survival_time": 59.99999999999873, "driven_lanedir": 3.291642167762593, "in-drivable-lane": 0.0, "deviation-heading": 23.891156114965767, "distance-from-start": 1.942602558877676, "deviation-center-line": 3.190273696791226, "driven_lanedir_consec": 3.291642167762593}, "autolab-000-ego1": {"driven_any": 9.225609768030845, "survival_time": 59.99999999999873, "driven_lanedir": 8.60466590740901, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 14.261228239923332, "distance-from-start": 4.3455526847612385, "deviation-center-line": 2.8849695543250173, "driven_lanedir_consec": 8.60466590740901}, "autolab-000-ego2": {"driven_any": 4.5343448758410805, "survival_time": 59.99999999999873, "driven_lanedir": 4.351161323268218, "in-drivable-lane": 0.0, "deviation-heading": 23.672581785957757, "distance-from-start": 1.923566262174863, "deviation-center-line": 3.911685839971171, "driven_lanedir_consec": 4.351161323268218}, "autolab-000-ego3": {"driven_any": 2.694951758915101, "survival_time": 59.99999999999873, "driven_lanedir": 2.5950518675386247, "in-drivable-lane": 0.0, "deviation-heading": 17.236719850315065, "distance-from-start": 2.258166414646453, "deviation-center-line": 3.461627615503759, "driven_lanedir_consec": 2.5950518675386247}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6088537Bea Baselines baseline-dagger-pytorch aido-LFV-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-01 03:31:31+00:00 2021-11-01 03:38:24+00:00 0:06:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.15000000000028 in-drivable-lane_median 2.9000000000000243 driven_lanedir_consec_median 3.5049670823679637 deviation-center-line_median 1.2636078128971775
other stats deviation-center-line_max 1.2636078128971775 deviation-center-line_mean 1.2636078128971775 deviation-center-line_min 1.2636078128971775 deviation-heading_max 5.884973154350186 deviation-heading_mean 5.884973154350186 deviation-heading_median 5.884973154350186 deviation-heading_min 5.884973154350186 distance-from-start_max 3.20841626038149 distance-from-start_mean 3.20841626038149 distance-from-start_median 3.20841626038149 distance-from-start_min 3.20841626038149 driven_any_max 4.248144628252916 driven_any_mean 4.248144628252916 driven_any_median 4.248144628252916 driven_any_min 4.248144628252916 driven_lanedir_consec_max 3.5049670823679637 driven_lanedir_consec_mean 3.5049670823679637 driven_lanedir_consec_min 3.5049670823679637 driven_lanedir_max 3.5049670823679637 driven_lanedir_mean 3.5049670823679637 driven_lanedir_median 3.5049670823679637 driven_lanedir_min 3.5049670823679637 in-drivable-lane_max 2.9000000000000243 in-drivable-lane_mean 2.9000000000000243 in-drivable-lane_min 2.9000000000000243 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.248144628252916, "survival_time": 29.15000000000028, "driven_lanedir": 3.5049670823679637, "in-drivable-lane": 2.9000000000000243, "deviation-heading": 5.884973154350186, "distance-from-start": 3.20841626038149, "deviation-center-line": 1.2636078128971775, "driven_lanedir_consec": 3.5049670823679637}}simulation-passed 1 survival_time_max 29.15000000000028 survival_time_mean 29.15000000000028 survival_time_min 29.15000000000028
No reset possible 6081538Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-01 03:29:26+00:00 2021-11-01 03:30:57+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6064541Bea Baselines baseline-dagger-pytorch aido-LF-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-01 03:22:43+00:00 2021-11-01 03:29:08+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.601353803957302 survival_time_median 59.99999999999873 deviation-center-line_median 3.3877470989744247 in-drivable-lane_median 0.9999999999999964
other stats deviation-center-line_max 3.3877470989744247 deviation-center-line_mean 3.3877470989744247 deviation-center-line_min 3.3877470989744247 deviation-heading_max 17.278498711899914 deviation-heading_mean 17.278498711899914 deviation-heading_median 17.278498711899914 deviation-heading_min 17.278498711899914 distance-from-start_max 3.278024887379763 distance-from-start_mean 3.278024887379763 distance-from-start_median 3.278024887379763 distance-from-start_min 3.278024887379763 driven_any_max 9.38552181198039 driven_any_mean 9.38552181198039 driven_any_median 9.38552181198039 driven_any_min 9.38552181198039 driven_lanedir_consec_max 8.601353803957302 driven_lanedir_consec_mean 8.601353803957302 driven_lanedir_consec_min 8.601353803957302 driven_lanedir_max 8.601353803957302 driven_lanedir_mean 8.601353803957302 driven_lanedir_median 8.601353803957302 driven_lanedir_min 8.601353803957302 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.9999999999999964 in-drivable-lane_min 0.9999999999999964 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.38552181198039, "survival_time": 59.99999999999873, "driven_lanedir": 8.601353803957302, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 17.278498711899914, "distance-from-start": 3.278024887379763, "deviation-center-line": 3.3877470989744247, "driven_lanedir_consec": 8.601353803957302}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6053542Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-testingsim-3of4 failed no gpu-staging-spot-0-012021-11-01 03:18:57+00:00 2021-11-01 03:22:37+00:00 0:03:40 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6044603Bea Baselines template-ros aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 03:16:04+00:00 2021-11-01 03:18:32+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.399999999999985 in-drivable-lane_median 4.999999999999985 driven_lanedir_consec_median 0.29777700591551315 deviation-center-line_median 0.12646137993688134
other stats deviation-center-line_max 0.1468190304221666 deviation-center-line_mean 0.12646137993688134 deviation-center-line_min 0.10610372945159606 deviation-heading_max 0.6360454051944944 deviation-heading_mean 0.5430640367112096 deviation-heading_median 0.5430640367112096 deviation-heading_min 0.4500826682279248 distance-from-start_max 1.6415075278758624 distance-from-start_mean 1.2144750025224995 distance-from-start_median 1.2144750025224995 distance-from-start_min 0.787442477169137 driven_any_max 1.68968289560006 driven_any_mean 1.239400986252874 driven_any_median 1.239400986252874 driven_any_min 0.7891190769056877 driven_lanedir_consec_max 0.3261041521711119 driven_lanedir_consec_mean 0.29777700591551315 driven_lanedir_consec_min 0.2694498596599144 driven_lanedir_max 0.3261041521711119 driven_lanedir_mean 0.29777700591551315 driven_lanedir_median 0.29777700591551315 driven_lanedir_min 0.2694498596599144 in-drivable-lane_max 4.999999999999985 in-drivable-lane_mean 4.999999999999985 in-drivable-lane_min 4.999999999999985 per-episodes details {"loop2-000-ego0": {"driven_any": 0.7891190769056877, "survival_time": 6.399999999999985, "driven_lanedir": 0.2694498596599144, "in-drivable-lane": 4.999999999999985, "deviation-heading": 0.6360454051944944, "distance-from-start": 0.787442477169137, "deviation-center-line": 0.10610372945159606, "driven_lanedir_consec": 0.2694498596599144}, "loop2-000-ego1": {"driven_any": 1.68968289560006, "survival_time": 6.399999999999985, "driven_lanedir": 0.3261041521711119, "in-drivable-lane": 4.999999999999985, "deviation-heading": 0.4500826682279248, "distance-from-start": 1.6415075278758624, "deviation-center-line": 0.1468190304221666, "driven_lanedir_consec": 0.3261041521711119}}simulation-passed 1 survival_time_max 6.399999999999985 survival_time_mean 6.399999999999985 survival_time_min 6.399999999999985
No reset possible 6035604Bea Baselines template-ros aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 03:13:47+00:00 2021-11-01 03:15:27+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.149999999999983 in-drivable-lane_median 3.949999999999986 driven_lanedir_consec_median 0.7378916015504124 deviation-center-line_median 0.16501429493914063
other stats deviation-center-line_max 0.16501429493914063 deviation-center-line_mean 0.16501429493914063 deviation-center-line_min 0.16501429493914063 deviation-heading_max 1.1899335528834605 deviation-heading_mean 1.1899335528834605 deviation-heading_median 1.1899335528834605 deviation-heading_min 1.1899335528834605 distance-from-start_max 1.7050253755281768 distance-from-start_mean 1.7050253755281768 distance-from-start_median 1.7050253755281768 distance-from-start_min 1.7050253755281768 driven_any_max 1.741988973953191 driven_any_mean 1.741988973953191 driven_any_median 1.741988973953191 driven_any_min 1.741988973953191 driven_lanedir_consec_max 0.7378916015504124 driven_lanedir_consec_mean 0.7378916015504124 driven_lanedir_consec_min 0.7378916015504124 driven_lanedir_max 0.7378916015504124 driven_lanedir_mean 0.7378916015504124 driven_lanedir_median 0.7378916015504124 driven_lanedir_min 0.7378916015504124 in-drivable-lane_max 3.949999999999986 in-drivable-lane_mean 3.949999999999986 in-drivable-lane_min 3.949999999999986 per-episodes details {"autolab-000-ego0": {"driven_any": 1.741988973953191, "survival_time": 7.149999999999983, "driven_lanedir": 0.7378916015504124, "in-drivable-lane": 3.949999999999986, "deviation-heading": 1.1899335528834605, "distance-from-start": 1.7050253755281768, "deviation-center-line": 0.16501429493914063, "driven_lanedir_consec": 0.7378916015504124}}simulation-passed 1 survival_time_max 7.149999999999983 survival_time_mean 7.149999999999983 survival_time_min 7.149999999999983
No reset possible 6028606Bea Baselines template-ros aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-01 03:12:02+00:00 2021-11-01 03:13:34+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6019609Bea Baselines template-ros aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 03:09:08+00:00 2021-11-01 03:11:55+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.599999999999988 in-drivable-lane_median 3.524999999999991 driven_lanedir_consec_median 0.30147232252154776 deviation-center-line_median 0.1621693163981507
other stats deviation-center-line_max 0.4058738379898732 deviation-center-line_mean 0.1993302929363056 deviation-center-line_min 0.06710870095904775 deviation-heading_max 3.914792252489027 deviation-heading_mean 1.8236115448219972 deviation-heading_median 1.4652065161747014 deviation-heading_min 0.4492408944495587 distance-from-start_max 1.3184282414991704 distance-from-start_mean 1.040264795410032 distance-from-start_median 1.169996680449275 distance-from-start_min 0.5026375792424082 driven_any_max 1.393054784299674 driven_any_mean 1.0816607468053387 driven_any_median 1.2005387228238862 driven_any_min 0.5325107572739085 driven_lanedir_consec_max 0.3899323561212959 driven_lanedir_consec_mean 0.306084696619438 driven_lanedir_consec_min 0.23146178531336048 driven_lanedir_max 0.3899323561212959 driven_lanedir_mean 0.30714333245246705 driven_lanedir_median 0.3035895941876059 driven_lanedir_min 0.23146178531336048 in-drivable-lane_max 4.399999999999988 in-drivable-lane_mean 3.424999999999992 in-drivable-lane_min 2.249999999999997 per-episodes details {"4way-000-ego0": {"driven_any": 1.393054784299674, "survival_time": 5.599999999999988, "driven_lanedir": 0.3899323561212959, "in-drivable-lane": 3.499999999999991, "deviation-heading": 1.4344136997869366, "distance-from-start": 1.3184282414991704, "deviation-center-line": 0.15840407674353346, "driven_lanedir_consec": 0.3899323561212959}, "4way-000-ego1": {"driven_any": 1.2151136770461854, "survival_time": 5.599999999999988, "driven_lanedir": 0.2581730376245541, "in-drivable-lane": 2.249999999999997, "deviation-heading": 3.914792252489027, "distance-from-start": 1.165271782748289, "deviation-center-line": 0.4058738379898732, "driven_lanedir_consec": 0.25393849429243787}, "4way-000-ego2": {"driven_any": 1.185963768601587, "survival_time": 5.599999999999988, "driven_lanedir": 0.34900615075065766, "in-drivable-lane": 3.549999999999991, "deviation-heading": 1.4959993325624663, "distance-from-start": 1.174721578150261, "deviation-center-line": 0.16593455605276788, "driven_lanedir_consec": 0.34900615075065766}, "4way-000-ego3": {"driven_any": 0.5325107572739085, "survival_time": 5.599999999999988, "driven_lanedir": 0.23146178531336048, "in-drivable-lane": 4.399999999999988, "deviation-heading": 0.4492408944495587, "distance-from-start": 0.5026375792424082, "deviation-center-line": 0.06710870095904775, "driven_lanedir_consec": 0.23146178531336048}}simulation-passed 1 survival_time_max 5.599999999999988 survival_time_mean 5.599999999999988 survival_time_min 5.599999999999988
No reset possible 6013609Bea Baselines template-ros aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-01 03:07:27+00:00 2021-11-01 03:08:49+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6008611Bea Baselines template-ros aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 03:05:49+00:00 2021-11-01 03:07:00+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.5999999999999988 in-drivable-lane_median 1.749999999999999 driven_lanedir_consec_median 0.10522871559184677 deviation-center-line_median 0.056894729221458704
other stats deviation-center-line_max 0.056894729221458704 deviation-center-line_mean 0.056894729221458704 deviation-center-line_min 0.056894729221458704 deviation-heading_max 0.6539229680608433 deviation-heading_mean 0.6539229680608433 deviation-heading_median 0.6539229680608433 deviation-heading_min 0.6539229680608433 distance-from-start_max 0.4318226571395238 distance-from-start_mean 0.4318226571395238 distance-from-start_median 0.4318226571395238 distance-from-start_min 0.4318226571395238 driven_any_max 0.4355125968610606 driven_any_mean 0.4355125968610606 driven_any_median 0.4355125968610606 driven_any_min 0.4355125968610606 driven_lanedir_consec_max 0.10522871559184677 driven_lanedir_consec_mean 0.10522871559184677 driven_lanedir_consec_min 0.10522871559184677 driven_lanedir_max 0.10522871559184677 driven_lanedir_mean 0.10522871559184677 driven_lanedir_median 0.10522871559184677 driven_lanedir_min 0.10522871559184677 in-drivable-lane_max 1.749999999999999 in-drivable-lane_mean 1.749999999999999 in-drivable-lane_min 1.749999999999999 per-episodes details {"loop2-000-ego0": {"driven_any": 0.4355125968610606, "survival_time": 2.5999999999999988, "driven_lanedir": 0.10522871559184677, "in-drivable-lane": 1.749999999999999, "deviation-heading": 0.6539229680608433, "distance-from-start": 0.4318226571395238, "deviation-center-line": 0.056894729221458704, "driven_lanedir_consec": 0.10522871559184677}}simulation-passed 1 survival_time_max 2.5999999999999988 survival_time_mean 2.5999999999999988 survival_time_min 2.5999999999999988
No reset possible 6001612Bea Baselines template-ros aido-LFV-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 03:03:09+00:00 2021-11-01 03:05:33+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.249999999999993 in-drivable-lane_median 3.1499999999999924 driven_lanedir_consec_median 0.15948889476692196 deviation-center-line_median 0.08105479801167828
other stats deviation-center-line_max 0.08105479801167828 deviation-center-line_mean 0.08105479801167828 deviation-center-line_min 0.08105479801167828 deviation-heading_max 0.6971137243638402 deviation-heading_mean 0.6971137243638402 deviation-heading_median 0.6971137243638402 deviation-heading_min 0.6971137243638402 distance-from-start_max 0.8793186984597625 distance-from-start_mean 0.8793186984597625 distance-from-start_median 0.8793186984597625 distance-from-start_min 0.8793186984597625 driven_any_max 0.890336835650087 driven_any_mean 0.890336835650087 driven_any_median 0.890336835650087 driven_any_min 0.890336835650087 driven_lanedir_consec_max 0.15948889476692196 driven_lanedir_consec_mean 0.15948889476692196 driven_lanedir_consec_min 0.15948889476692196 driven_lanedir_max 0.15948889476692196 driven_lanedir_mean 0.15948889476692196 driven_lanedir_median 0.15948889476692196 driven_lanedir_min 0.15948889476692196 in-drivable-lane_max 3.1499999999999924 in-drivable-lane_mean 3.1499999999999924 in-drivable-lane_min 3.1499999999999924 per-episodes details {"autolab-000-ego0": {"driven_any": 0.890336835650087, "survival_time": 4.249999999999993, "driven_lanedir": 0.15948889476692196, "in-drivable-lane": 3.1499999999999924, "deviation-heading": 0.6971137243638402, "distance-from-start": 0.8793186984597625, "deviation-center-line": 0.08105479801167828, "driven_lanedir_consec": 0.15948889476692196}}simulation-passed 1 survival_time_max 4.249999999999993 survival_time_mean 4.249999999999993 survival_time_min 4.249999999999993
No reset possible 5995614Bea Baselines template-ros aido-LFI-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 03:00:22+00:00 2021-11-01 03:03:01+00:00 0:02:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.799999999999991 in-drivable-lane_median 2.7499999999999956 driven_lanedir_consec_median 0.18799873855857063 deviation-center-line_median 0.181714478921107
other stats deviation-center-line_max 0.181714478921107 deviation-center-line_mean 0.181714478921107 deviation-center-line_min 0.181714478921107 deviation-heading_max 2.0522892944597255 deviation-heading_mean 2.0522892944597255 deviation-heading_median 2.0522892944597255 deviation-heading_min 2.0522892944597255 distance-from-start_max 1.0946162065959055 distance-from-start_mean 1.0946162065959055 distance-from-start_median 1.0946162065959055 distance-from-start_min 1.0946162065959055 driven_any_max 1.1198873787744617 driven_any_mean 1.1198873787744617 driven_any_median 1.1198873787744617 driven_any_min 1.1198873787744617 driven_lanedir_consec_max 0.18799873855857063 driven_lanedir_consec_mean 0.18799873855857063 driven_lanedir_consec_min 0.18799873855857063 driven_lanedir_max 0.18799873855857063 driven_lanedir_mean 0.18799873855857063 driven_lanedir_median 0.18799873855857063 driven_lanedir_min 0.18799873855857063 in-drivable-lane_max 2.7499999999999956 in-drivable-lane_mean 2.7499999999999956 in-drivable-lane_min 2.7499999999999956 per-episodes details {"4way-000-ego0": {"driven_any": 1.1198873787744617, "survival_time": 4.799999999999991, "driven_lanedir": 0.18799873855857063, "in-drivable-lane": 2.7499999999999956, "deviation-heading": 2.0522892944597255, "distance-from-start": 1.0946162065959055, "deviation-center-line": 0.181714478921107, "driven_lanedir_consec": 0.18799873855857063}}simulation-passed 1 survival_time_max 4.799999999999991 survival_time_mean 4.799999999999991 survival_time_min 4.799999999999991
No reset possible 5993614Bea Baselines template-ros aido-LFI-sim-testingsim-0of4 host-error no gpu-staging-spot-0-012021-11-01 02:59:31+00:00 2021-11-01 03:00:06+00:00 0:00:35 Error while running [...] Error while running Docker Compose:
Cannot get process ids
│ output: ''
│ names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5989616Bea Baselines template-ros aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 02:55:45+00:00 2021-11-01 02:59:14+00:00 0:03:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.049999999999994 in-drivable-lane_median 7.324999999999992 driven_lanedir_consec_median 0.25251432406995866 deviation-center-line_median 0.14147299459357832
other stats deviation-center-line_max 0.1828972119913059 deviation-center-line_mean 0.1357412976517671 deviation-center-line_min 0.0771219894286059 deviation-heading_max 2.1456095709798957 deviation-heading_mean 0.9149276585584836 deviation-heading_median 0.5649697522062941 deviation-heading_min 0.3841615588414508 distance-from-start_max 2.4289731388668163 distance-from-start_mean 1.3744079957509217 distance-from-start_median 1.3422612095343225 distance-from-start_min 0.3841364250682252 driven_any_max 2.4827833174938676 driven_any_mean 1.4240104259158568 driven_any_median 1.4103075704012749 driven_any_min 0.3926432453670092 driven_lanedir_consec_max 0.37087289735526063 driven_lanedir_consec_mean 0.2562032819845403 driven_lanedir_consec_min 0.1489115824429832 driven_lanedir_max 0.37087289735526063 driven_lanedir_mean 0.2626666029060178 driven_lanedir_median 0.25251432406995866 driven_lanedir_min 0.1747648661288932 in-drivable-lane_max 7.999999999999994 in-drivable-lane_mean 7.412499999999993 in-drivable-lane_min 6.999999999999997 per-episodes details {"udem-000-ego0": {"driven_any": 1.923320201453874, "survival_time": 9.049999999999994, "driven_lanedir": 0.18166450508924312, "in-drivable-lane": 7.999999999999994, "deviation-heading": 0.6243003670151387, "distance-from-start": 1.7897737607062376, "deviation-center-line": 0.0771219894286059, "driven_lanedir_consec": 0.18166450508924312}, "udem-000-ego1": {"driven_any": 0.8972949393486757, "survival_time": 9.049999999999994, "driven_lanedir": 0.37087289735526063, "in-drivable-lane": 7.299999999999993, "deviation-heading": 0.3841615588414508, "distance-from-start": 0.8947486583624074, "deviation-center-line": 0.1823056432531324, "driven_lanedir_consec": 0.37087289735526063}, "udem-000-ego2": {"driven_any": 0.3926432453670092, "survival_time": 9.049999999999994, "driven_lanedir": 0.3233641430506742, "in-drivable-lane": 7.349999999999992, "deviation-heading": 0.5056391373974495, "distance-from-start": 0.3841364250682252, "deviation-center-line": 0.10064034593402424, "driven_lanedir_consec": 0.3233641430506742}, "udem-000-ego3": {"driven_any": 2.4827833174938676, "survival_time": 9.049999999999994, "driven_lanedir": 0.1747648661288932, "in-drivable-lane": 6.999999999999997, "deviation-heading": 2.1456095709798957, "distance-from-start": 2.4289731388668163, "deviation-center-line": 0.1828972119913059, "driven_lanedir_consec": 0.1489115824429832}}simulation-passed 1 survival_time_max 9.049999999999994 survival_time_mean 9.049999999999994 survival_time_min 9.049999999999994
No reset possible 5984616Bea Baselines template-ros aido-LFVI_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-01 02:54:06+00:00 2021-11-01 02:55:28+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5978619Bea Baselines baseline-duckietown aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 02:49:06+00:00 2021-11-01 02:53:44+00:00 0:04:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 46.64999999999949 in-drivable-lane_median 40.699999999999726 driven_lanedir_consec_median 0.5165447331398405 deviation-center-line_median 0.3837749761987927
other stats deviation-center-line_max 0.3837749761987927 deviation-center-line_mean 0.3837749761987927 deviation-center-line_min 0.3837749761987927 deviation-heading_max 3.4988825223832705 deviation-heading_mean 3.4988825223832705 deviation-heading_median 3.4988825223832705 deviation-heading_min 3.4988825223832705 distance-from-start_max 1.085133627135274 distance-from-start_mean 1.085133627135274 distance-from-start_median 1.085133627135274 distance-from-start_min 1.085133627135274 driven_any_max 6.0414993321229105 driven_any_mean 6.0414993321229105 driven_any_median 6.0414993321229105 driven_any_min 6.0414993321229105 driven_lanedir_consec_max 0.5165447331398405 driven_lanedir_consec_mean 0.5165447331398405 driven_lanedir_consec_min 0.5165447331398405 driven_lanedir_max 0.5165447331398405 driven_lanedir_mean 0.5165447331398405 driven_lanedir_median 0.5165447331398405 driven_lanedir_min 0.5165447331398405 in-drivable-lane_max 40.699999999999726 in-drivable-lane_mean 40.699999999999726 in-drivable-lane_min 40.699999999999726 per-episodes details {"autolab-000-ego0": {"driven_any": 6.0414993321229105, "survival_time": 46.64999999999949, "driven_lanedir": 0.5165447331398405, "in-drivable-lane": 40.699999999999726, "deviation-heading": 3.4988825223832705, "distance-from-start": 1.085133627135274, "deviation-center-line": 0.3837749761987927, "driven_lanedir_consec": 0.5165447331398405}}simulation-passed 1 survival_time_max 46.64999999999949 survival_time_mean 46.64999999999949 survival_time_min 46.64999999999949
No reset possible 5958646Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 02:31:52+00:00 2021-11-01 02:48:50+00:00 0:16:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 51.87499999999867 driven_lanedir_consec_median 0.38409864093938506 deviation-center-line_median 0.868281953533847
other stats deviation-center-line_max 2.6005405528277774 deviation-center-line_mean 1.1047670015493458 deviation-center-line_min 0.08196354630191185 deviation-heading_max 15.37769179998202 deviation-heading_mean 6.866469475537316 deviation-heading_median 5.7976934838843395 deviation-heading_min 0.4927991343985651 distance-from-start_max 0.8591397592498814 distance-from-start_mean 0.5208206252922428 distance-from-start_median 0.4864911240980898 distance-from-start_min 0.2511604937229107 driven_any_max 6.349632379697989 driven_any_mean 4.449548646851251 driven_any_median 5.161325729666055 driven_any_min 1.1259107483749031 driven_lanedir_consec_max 0.8336814472800944 driven_lanedir_consec_mean 0.4390016627721885 driven_lanedir_consec_min 0.15412792192988944 driven_lanedir_max 1.1260681392283185 driven_lanedir_mean 0.6470431087261241 driven_lanedir_median 0.6539881868731442 driven_lanedir_min 0.15412792192988944 in-drivable-lane_max 59.04999999999873 in-drivable-lane_mean 51.162499999998786 in-drivable-lane_min 41.8499999999991 per-episodes details {"autolab-000-ego0": {"driven_any": 5.669866367849094, "survival_time": 59.99999999999873, "driven_lanedir": 0.791216508572598, "in-drivable-lane": 51.049999999998654, "deviation-heading": 7.104769262210392, "distance-from-start": 0.8591397592498814, "deviation-center-line": 0.8690097189332563, "driven_lanedir_consec": 0.2514374167050797}, "autolab-000-ego1": {"driven_any": 1.1259107483749031, "survival_time": 59.99999999999873, "driven_lanedir": 0.15412792192988944, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.4927991343985651, "distance-from-start": 0.5273627795892006, "deviation-center-line": 0.08196354630191185, "driven_lanedir_consec": 0.15412792192988944}, "autolab-000-ego2": {"driven_any": 6.349632379697989, "survival_time": 59.99999999999873, "driven_lanedir": 1.1260681392283185, "in-drivable-lane": 41.8499999999991, "deviation-heading": 15.37769179998202, "distance-from-start": 0.2511604937229107, "deviation-center-line": 2.6005405528277774, "driven_lanedir_consec": 0.8336814472800944}, "autolab-000-ego3": {"driven_any": 4.652785091483017, "survival_time": 59.99999999999873, "driven_lanedir": 0.5167598651736904, "in-drivable-lane": 52.69999999999869, "deviation-heading": 4.490617705558286, "distance-from-start": 0.445619468606979, "deviation-center-line": 0.8675541881344376, "driven_lanedir_consec": 0.5167598651736904}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5951647Bea Baselines template-pytorch aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 02:24:59+00:00 2021-11-01 02:31:40+00:00 0:06:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 40.44999999999904 driven_lanedir_consec_median 1.167775711437679 deviation-center-line_median 1.82602737966846
other stats deviation-center-line_max 1.82602737966846 deviation-center-line_mean 1.82602737966846 deviation-center-line_min 1.82602737966846 deviation-heading_max 15.19190767759419 deviation-heading_mean 15.19190767759419 deviation-heading_median 15.19190767759419 deviation-heading_min 15.19190767759419 distance-from-start_max 0.6514941816459446 distance-from-start_mean 0.6514941816459446 distance-from-start_median 0.6514941816459446 distance-from-start_min 0.6514941816459446 driven_any_max 6.21328381651728 driven_any_mean 6.21328381651728 driven_any_median 6.21328381651728 driven_any_min 6.21328381651728 driven_lanedir_consec_max 1.167775711437679 driven_lanedir_consec_mean 1.167775711437679 driven_lanedir_consec_min 1.167775711437679 driven_lanedir_max 1.167775711437679 driven_lanedir_mean 1.167775711437679 driven_lanedir_median 1.167775711437679 driven_lanedir_min 1.167775711437679 in-drivable-lane_max 40.44999999999904 in-drivable-lane_mean 40.44999999999904 in-drivable-lane_min 40.44999999999904 per-episodes details {"autolab-000-ego0": {"driven_any": 6.21328381651728, "survival_time": 59.99999999999873, "driven_lanedir": 1.167775711437679, "in-drivable-lane": 40.44999999999904, "deviation-heading": 15.19190767759419, "distance-from-start": 0.6514941816459446, "deviation-center-line": 1.82602737966846, "driven_lanedir_consec": 1.167775711437679}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5950647Bea Baselines template-pytorch aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-11-01 02:23:12+00:00 2021-11-01 02:24:45+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.549999999999988 in-drivable-lane_median 3.0999999999999934 driven_lanedir_consec_median 0.27736544670843744 deviation-center-line_median 0.20846869216026112
other stats deviation-center-line_max 0.20846869216026112 deviation-center-line_mean 0.20846869216026112 deviation-center-line_min 0.20846869216026112 deviation-heading_max 1.6307864363483118 deviation-heading_mean 1.6307864363483118 deviation-heading_median 1.6307864363483118 deviation-heading_min 1.6307864363483118 distance-from-start_max 0.2351354208896812 distance-from-start_mean 0.2351354208896812 distance-from-start_median 0.2351354208896812 distance-from-start_min 0.2351354208896812 driven_any_max 0.7513004242260357 driven_any_mean 0.7513004242260357 driven_any_median 0.7513004242260357 driven_any_min 0.7513004242260357 driven_lanedir_consec_max 0.27736544670843744 driven_lanedir_consec_mean 0.27736544670843744 driven_lanedir_consec_min 0.27736544670843744 driven_lanedir_max 0.27736544670843744 driven_lanedir_mean 0.27736544670843744 driven_lanedir_median 0.27736544670843744 driven_lanedir_min 0.27736544670843744 in-drivable-lane_max 3.0999999999999934 in-drivable-lane_mean 3.0999999999999934 in-drivable-lane_min 3.0999999999999934 per-episodes details {"loop-000-ego0": {"driven_any": 0.7513004242260357, "survival_time": 5.549999999999988, "driven_lanedir": 0.27736544670843744, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 1.6307864363483118, "distance-from-start": 0.2351354208896812, "deviation-center-line": 0.20846869216026112, "driven_lanedir_consec": 0.27736544670843744}}simulation-passed 1 survival_time_max 5.549999999999988 survival_time_mean 5.549999999999988 survival_time_min 5.549999999999988
No reset possible 5924652Bea Baselines template-pytorch aido-LFVI_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 02:08:36+00:00 2021-11-01 02:22:54+00:00 0:14:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 57.42499999999873 driven_lanedir_consec_median 0.1369521715022971 deviation-center-line_median 0.1289126016975456
other stats deviation-center-line_max 1.683874876142399 deviation-center-line_mean 0.49046601556398345 deviation-center-line_min 0.020163982718443385 deviation-heading_max 17.720019448119743 deviation-heading_mean 5.515792554177045 deviation-heading_median 1.8759398294192835 deviation-heading_min 0.5912711097498684 distance-from-start_max 0.4470455473343398 distance-from-start_mean 0.1784658273034653 distance-from-start_median 0.10295954146027844 distance-from-start_min 0.06089867895896451 driven_any_max 7.971546458926167 driven_any_mean 2.247298708310983 driven_any_median 0.47323852888052986 driven_any_min 0.07117131655670728 driven_lanedir_consec_max 1.2396782635726185 driven_lanedir_consec_mean 0.380581516868637 driven_lanedir_consec_min 0.008743460897335353 driven_lanedir_max 1.7486065207184085 driven_lanedir_mean 0.5078135811550846 driven_lanedir_median 0.1369521715022971 driven_lanedir_min 0.008743460897335353 in-drivable-lane_max 59.19999999999872 in-drivable-lane_mean 53.349999999998815 in-drivable-lane_min 39.349999999999085 per-episodes details {"udem-000-ego0": {"driven_any": 7.971546458926167, "survival_time": 59.99999999999873, "driven_lanedir": 1.7486065207184085, "in-drivable-lane": 39.349999999999085, "deviation-heading": 17.720019448119743, "distance-from-start": 0.4470455473343398, "deviation-center-line": 1.683874876142399, "driven_lanedir_consec": 1.2396782635726185}, "udem-000-ego1": {"driven_any": 0.07117131655670728, "survival_time": 59.99999999999873, "driven_lanedir": 0.008743460897335353, "in-drivable-lane": 59.19999999999872, "deviation-heading": 0.6946931844305501, "distance-from-start": 0.06089867895896451, "deviation-center-line": 0.03514638810720084, "driven_lanedir_consec": 0.008743460897335353}, "udem-000-ego2": {"driven_any": 0.751249301588696, "survival_time": 59.99999999999873, "driven_lanedir": 0.20941133597046857, "in-drivable-lane": 55.999999999998735, "deviation-heading": 3.0571864744080175, "distance-from-start": 0.09405782984335166, "deviation-center-line": 0.22267881528789035, "driven_lanedir_consec": 0.20941133597046857}, "udem-000-ego3": {"driven_any": 0.1952277561723637, "survival_time": 59.99999999999873, "driven_lanedir": 0.06449300703412564, "in-drivable-lane": 58.84999999999873, "deviation-heading": 0.5912711097498684, "distance-from-start": 0.11186125307720522, "deviation-center-line": 0.020163982718443385, "driven_lanedir_consec": 0.06449300703412564}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5921653Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 02:05:48+00:00 2021-11-01 02:08:17+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.649999999999988 in-drivable-lane_median 6.37499999999999 driven_lanedir_consec_median 0.3731519272582473 deviation-center-line_median 0.18874292818738425
other stats deviation-center-line_max 0.2790145649781644 deviation-center-line_mean 0.18874292818738425 deviation-center-line_min 0.09847129139660411 deviation-heading_max 1.4560849316929176 deviation-heading_mean 1.0309221790150185 deviation-heading_median 1.0309221790150185 deviation-heading_min 0.605759426337119 distance-from-start_max 0.8549949508071117 distance-from-start_mean 0.5606659795890019 distance-from-start_median 0.5606659795890019 distance-from-start_min 0.26633700837089214 driven_any_max 1.7348484942146871 driven_any_mean 1.0128717169530357 driven_any_median 1.0128717169530357 driven_any_min 0.29089493969138375 driven_lanedir_consec_max 0.6552576531123928 driven_lanedir_consec_mean 0.3731519272582473 driven_lanedir_consec_min 0.0910462014041018 driven_lanedir_max 0.6552576531123928 driven_lanedir_mean 0.3731519272582473 driven_lanedir_median 0.3731519272582473 driven_lanedir_min 0.0910462014041018 in-drivable-lane_max 7.599999999999988 in-drivable-lane_mean 6.37499999999999 in-drivable-lane_min 5.149999999999992 per-episodes details {"loop2-000-ego0": {"driven_any": 1.7348484942146871, "survival_time": 8.649999999999988, "driven_lanedir": 0.6552576531123928, "in-drivable-lane": 5.149999999999992, "deviation-heading": 1.4560849316929176, "distance-from-start": 0.8549949508071117, "deviation-center-line": 0.2790145649781644, "driven_lanedir_consec": 0.6552576531123928}, "loop2-000-ego1": {"driven_any": 0.29089493969138375, "survival_time": 8.649999999999988, "driven_lanedir": 0.0910462014041018, "in-drivable-lane": 7.599999999999988, "deviation-heading": 0.605759426337119, "distance-from-start": 0.26633700837089214, "deviation-center-line": 0.09847129139660411, "driven_lanedir_consec": 0.0910462014041018}}simulation-passed 1 survival_time_max 8.649999999999988 survival_time_mean 8.649999999999988 survival_time_min 8.649999999999988
No reset possible 5910653Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 01:58:14+00:00 2021-11-01 02:05:42+00:00 0:07:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.200000000000266 in-drivable-lane_median 24.40000000000026 driven_lanedir_consec_median 0.29366484587549846 deviation-center-line_median 0.16101590726248113
other stats deviation-center-line_max 0.6918652812391003 deviation-center-line_mean 0.2766539328078121 deviation-center-line_min 0.09271863546718576 deviation-heading_max 3.128029120688647 deviation-heading_mean 1.6335427324870366 deviation-heading_median 1.383182101080585 deviation-heading_min 0.63977760709833 distance-from-start_max 1.0327103982748154 distance-from-start_mean 0.48103465285590585 distance-from-start_median 0.3654180128508354 distance-from-start_min 0.160592187447137 driven_any_max 3.2187356119298993 driven_any_mean 1.3175221153926635 driven_any_median 0.9073932967270062 driven_any_min 0.23656625618674296 driven_lanedir_consec_max 1.0267145931278918 driven_lanedir_consec_mean 0.4287384045815107 driven_lanedir_consec_min 0.10090933344715404 driven_lanedir_max 1.0267145931278918 driven_lanedir_mean 0.4287384045815107 driven_lanedir_median 0.29366484587549846 driven_lanedir_min 0.10090933344715404 in-drivable-lane_max 27.050000000000264 in-drivable-lane_mean 24.775000000000265 in-drivable-lane_min 23.250000000000274 per-episodes details {"autolab-000-ego0": {"driven_any": 0.7632946857570463, "survival_time": 28.200000000000266, "driven_lanedir": 0.2583713621374675, "in-drivable-lane": 25.50000000000027, "deviation-heading": 1.8884787533110172, "distance-from-start": 0.160592187447137, "deviation-center-line": 0.09271863546718576, "driven_lanedir_consec": 0.2583713621374675}, "autolab-000-ego1": {"driven_any": 0.23656625618674296, "survival_time": 28.200000000000266, "driven_lanedir": 0.10090933344715404, "in-drivable-lane": 27.050000000000264, "deviation-heading": 0.63977760709833, "distance-from-start": 0.22831630630661323, "deviation-center-line": 0.11167194804010908, "driven_lanedir_consec": 0.10090933344715404}, "autolab-000-ego2": {"driven_any": 1.051491907696966, "survival_time": 28.200000000000266, "driven_lanedir": 1.0267145931278918, "in-drivable-lane": 23.250000000000274, "deviation-heading": 0.8778854488501524, "distance-from-start": 1.0327103982748154, "deviation-center-line": 0.21035986648485316, "driven_lanedir_consec": 1.0267145931278918}, "autolab-000-ego3": {"driven_any": 3.2187356119298993, "survival_time": 28.200000000000266, "driven_lanedir": 0.32895832961352944, "in-drivable-lane": 23.30000000000025, "deviation-heading": 3.128029120688647, "distance-from-start": 0.5025197193950576, "deviation-center-line": 0.6918652812391003, "driven_lanedir_consec": 0.32895832961352944}}simulation-passed 1 survival_time_max 28.200000000000266 survival_time_mean 28.200000000000266 survival_time_min 28.200000000000266
No reset possible 5878659Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 01:43:22+00:00 2021-11-01 01:57:54+00:00 0:14:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 43.574999999999065 driven_lanedir_consec_median 0.4988899718533584 deviation-center-line_median 1.1690544413593575
other stats deviation-center-line_max 8.235192225633982 deviation-center-line_mean 2.654083834921692 deviation-center-line_min 0.04303423133406841 deviation-heading_max 57.164825861134425 deviation-heading_mean 20.80836656100339 deviation-heading_median 12.638702029996365 deviation-heading_min 0.7912363228864026 distance-from-start_max 0.3939575058876673 distance-from-start_mean 0.2473741869423971 distance-from-start_median 0.2495213866015716 distance-from-start_min 0.09649646867877788 driven_any_max 5.979029096622639 driven_any_mean 2.13996869244815 driven_any_median 1.239080234281951 driven_any_min 0.10268520460605966 driven_lanedir_consec_max 2.0862054622203705 driven_lanedir_consec_mean 0.7792739067381099 driven_lanedir_consec_min 0.03311022102535244 driven_lanedir_max 2.0862054622203705 driven_lanedir_mean 0.7792739067381099 driven_lanedir_median 0.4988899718533584 driven_lanedir_min 0.03311022102535244 in-drivable-lane_max 59.14999999999873 in-drivable-lane_mean 38.28749999999923 in-drivable-lane_min 6.850000000000044 per-episodes details {"udem-000-ego0": {"driven_any": 0.3045434398343778, "survival_time": 59.99999999999873, "driven_lanedir": 0.10679708842416023, "in-drivable-lane": 58.44999999999872, "deviation-heading": 1.010799882763468, "distance-from-start": 0.15279978540105132, "deviation-center-line": 0.04303423133406841, "driven_lanedir_consec": 0.10679708842416023}, "udem-000-ego1": {"driven_any": 5.979029096622639, "survival_time": 59.99999999999873, "driven_lanedir": 2.0862054622203705, "in-drivable-lane": 28.69999999999941, "deviation-heading": 24.266604177229254, "distance-from-start": 0.3462429878020919, "deviation-center-line": 2.2714754003094284, "driven_lanedir_consec": 2.0862054622203705}, "udem-000-ego2": {"driven_any": 2.1736170287295233, "survival_time": 59.99999999999873, "driven_lanedir": 0.8909828552825565, "in-drivable-lane": 6.850000000000044, "deviation-heading": 57.164825861134425, "distance-from-start": 0.3939575058876673, "deviation-center-line": 8.235192225633982, "driven_lanedir_consec": 0.8909828552825565}, "udem-000-ego3": {"driven_any": 0.10268520460605966, "survival_time": 59.99999999999873, "driven_lanedir": 0.03311022102535244, "in-drivable-lane": 59.14999999999873, "deviation-heading": 0.7912363228864026, "distance-from-start": 0.09649646867877788, "deviation-center-line": 0.06663348240928671, "driven_lanedir_consec": 0.03311022102535244}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5873661Bea Baselines template-tensorflow aido-LFP-sim-validationsim-2of4 failed no gpu-staging-spot-0-012021-11-01 01:42:13+00:00 2021-11-01 01:43:08+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5869661Bea Baselines template-tensorflow aido-LFP-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-11-01 01:41:05+00:00 2021-11-01 01:42:01+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5866662Bea Baselines template-tensorflow aido-LFV-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-01 01:39:27+00:00 2021-11-01 01:40:51+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5861664Bea Baselines template-tensorflow aido-LFI-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-01 01:37:42+00:00 2021-11-01 01:39:07+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5853665Bea Baselines template-tensorflow aido-LF-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-01 01:36:13+00:00 2021-11-01 01:37:07+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5852666Bea Baselines template-tensorflow aido-LFVI_multi-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-11-01 01:34:54+00:00 2021-11-01 01:36:08+00:00 0:01:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5845667Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-11-01 01:33:24+00:00 2021-11-01 01:34:35+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5842668Bea Baselines template-tensorflow aido-LFP-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-11-01 01:32:13+00:00 2021-11-01 01:33:11+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5835669Bea Baselines template-tensorflow aido-LFV-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-11-01 01:30:13+00:00 2021-11-01 01:31:48+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5830670Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-11-01 01:28:27+00:00 2021-11-01 01:29:59+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5826671Bea Baselines template-tensorflow aido-LFI-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-11-01 01:26:41+00:00 2021-11-01 01:28:07+00:00 0:01:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5822673Bea Baselines template-tensorflow aido-LFVI_multi-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-11-01 01:23:46+00:00 2021-11-01 01:26:35+00:00 0:02:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5815703Bea Baselines template-random aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 01:19:14+00:00 2021-11-01 01:23:38+00:00 0:04:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.000000000000277 in-drivable-lane_median 20.025000000000247 driven_lanedir_consec_median 0.23004863869940056 deviation-center-line_median 0.7278799269429306
other stats deviation-center-line_max 0.8194317074657906 deviation-center-line_mean 0.7278799269429306 deviation-center-line_min 0.6363281464200705 deviation-heading_max 6.73261632177244 deviation-heading_mean 6.633830808409963 deviation-heading_median 6.633830808409963 deviation-heading_min 6.535045295047486 distance-from-start_max 0.8626308120701064 distance-from-start_mean 0.8293644349619179 distance-from-start_median 0.8293644349619179 distance-from-start_min 0.7960980578537294 driven_any_max 7.222519405652156 driven_any_mean 6.586737153678611 driven_any_median 6.586737153678611 driven_any_min 5.950954901705066 driven_lanedir_consec_max 0.26576074471389377 driven_lanedir_consec_mean 0.23004863869940056 driven_lanedir_consec_min 0.19433653268490736 driven_lanedir_max 0.24775126076977572 driven_lanedir_mean 0.21437974622313744 driven_lanedir_median 0.21437974622313744 driven_lanedir_min 0.18100823167649915 in-drivable-lane_max 20.30000000000025 in-drivable-lane_mean 20.025000000000247 in-drivable-lane_min 19.750000000000245 per-episodes details {"loop2-000-ego0": {"driven_any": 5.950954901705066, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977572, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537294, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.26576074471389377}, "loop2-000-ego1": {"driven_any": 7.222519405652156, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167649915, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701064, "deviation-center-line": 0.6363281464200705, "driven_lanedir_consec": 0.19433653268490736}}simulation-passed 1 survival_time_max 29.000000000000277 survival_time_mean 29.000000000000277 survival_time_min 29.000000000000277
No reset possible 5811704Bea Baselines template-random aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-11-01 01:16:19+00:00 2021-11-01 01:18:41+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.4500000000001 in-drivable-lane_median 8.850000000000088 driven_lanedir_consec_median 0.27376192919933695 deviation-center-line_median 0.6226667356941823
other stats deviation-center-line_max 0.6226667356941823 deviation-center-line_mean 0.6226667356941823 deviation-center-line_min 0.6226667356941823 deviation-heading_max 4.977695202648224 deviation-heading_mean 4.977695202648224 deviation-heading_median 4.977695202648224 deviation-heading_min 4.977695202648224 distance-from-start_max 0.6736010379605029 distance-from-start_mean 0.6736010379605029 distance-from-start_median 0.6736010379605029 distance-from-start_min 0.6736010379605029 driven_any_max 3.8273590406355353 driven_any_mean 3.8273590406355353 driven_any_median 3.8273590406355353 driven_any_min 3.8273590406355353 driven_lanedir_consec_max 0.27376192919933695 driven_lanedir_consec_mean 0.27376192919933695 driven_lanedir_consec_min 0.27376192919933695 driven_lanedir_max 0.26276154130140084 driven_lanedir_mean 0.26276154130140084 driven_lanedir_median 0.26276154130140084 driven_lanedir_min 0.26276154130140084 in-drivable-lane_max 8.850000000000088 in-drivable-lane_mean 8.850000000000088 in-drivable-lane_min 8.850000000000088 per-episodes details {"autolab-000-ego0": {"driven_any": 3.8273590406355353, "survival_time": 16.4500000000001, "driven_lanedir": 0.26276154130140084, "in-drivable-lane": 8.850000000000088, "deviation-heading": 4.977695202648224, "distance-from-start": 0.6736010379605029, "deviation-center-line": 0.6226667356941823, "driven_lanedir_consec": 0.27376192919933695}}simulation-passed 1 survival_time_max 16.4500000000001 survival_time_mean 16.4500000000001 survival_time_min 16.4500000000001
No reset possible 5804706Bea Baselines template-random aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-01 01:14:44+00:00 2021-11-01 01:16:12+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5788710Bea Baselines template-random aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 01:00:22+00:00 2021-11-01 01:14:25+00:00 0:14:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 51.799999999999194 in-drivable-lane_median 44.52499999999915 driven_lanedir_consec_median 0.17645690696034633 deviation-center-line_median 0.6288359436091835
other stats deviation-center-line_max 0.6863070684206949 deviation-center-line_mean 0.6132347216191781 deviation-center-line_min 0.5089599308376506 deviation-heading_max 5.904235246936352 deviation-heading_mean 4.779753520384025 deviation-heading_median 4.657001419426715 deviation-heading_min 3.900775995746317 distance-from-start_max 1.2120262829129491 distance-from-start_mean 1.0474942275906278 distance-from-start_median 1.090926284797921 distance-from-start_min 0.79609805785372 driven_any_max 12.87870380836423 driven_any_mean 10.630699349059253 driven_any_median 11.702531035811734 driven_any_min 6.239031516249309 driven_lanedir_consec_max 0.24485749504972 driven_lanedir_consec_mean 0.16302815368948875 driven_lanedir_consec_min 0.05434130578754237 driven_lanedir_max 0.23072215708841037 driven_lanedir_mean 0.15210419461121738 driven_lanedir_median 0.16000521526986278 driven_lanedir_min 0.057684190816733594 in-drivable-lane_max 44.99999999999916 in-drivable-lane_mean 44.44999999999917 in-drivable-lane_min 43.74999999999919 per-episodes details {"autolab-000-ego0": {"driven_any": 12.87870380836423, "survival_time": 51.799999999999194, "driven_lanedir": 0.057684190816733594, "in-drivable-lane": 44.24999999999912, "deviation-heading": 5.904235246936352, "distance-from-start": 1.2120262829129491, "deviation-center-line": 0.6346589459314982, "driven_lanedir_consec": 0.05434130578754237}, "autolab-000-ego1": {"driven_any": 6.239031516249309, "survival_time": 51.799999999999194, "driven_lanedir": 0.23072215708841037, "in-drivable-lane": 43.74999999999919, "deviation-heading": 4.4349341204672275, "distance-from-start": 0.79609805785372, "deviation-center-line": 0.6230129412868688, "driven_lanedir_consec": 0.24485749504972}, "autolab-000-ego2": {"driven_any": 11.02110496898548, "survival_time": 51.799999999999194, "driven_lanedir": 0.13091436524500333, "in-drivable-lane": 44.99999999999916, "deviation-heading": 3.900775995746317, "distance-from-start": 1.044224797669194, "deviation-center-line": 0.6863070684206949, "driven_lanedir_consec": 0.15293166981715745}, "autolab-000-ego3": {"driven_any": 12.383957102637988, "survival_time": 51.799999999999194, "driven_lanedir": 0.18909606529472223, "in-drivable-lane": 44.79999999999918, "deviation-heading": 4.879068718386203, "distance-from-start": 1.137627771926648, "deviation-center-line": 0.5089599308376506, "driven_lanedir_consec": 0.1999821441035352}}simulation-passed 1 survival_time_max 51.799999999999194 survival_time_mean 51.799999999999194 survival_time_min 51.799999999999194
No reset possible 5780712Bea Baselines template-random aido-LFV-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 00:56:15+00:00 2021-11-01 01:00:04+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.650000000000045 in-drivable-lane_median 9.200000000000031 driven_lanedir_consec_median 0.027296054749769816 deviation-center-line_median 0.3268219516832444
other stats deviation-center-line_max 0.3268219516832444 deviation-center-line_mean 0.3268219516832444 deviation-center-line_min 0.3268219516832444 deviation-heading_max 2.554024904051201 deviation-heading_mean 2.554024904051201 deviation-heading_median 2.554024904051201 deviation-heading_min 2.554024904051201 distance-from-start_max 0.6297514211538974 distance-from-start_mean 0.6297514211538974 distance-from-start_median 0.6297514211538974 distance-from-start_min 0.6297514211538974 driven_any_max 2.9055858596809983 driven_any_mean 2.9055858596809983 driven_any_median 2.9055858596809983 driven_any_min 2.9055858596809983 driven_lanedir_consec_max 0.027296054749769816 driven_lanedir_consec_mean 0.027296054749769816 driven_lanedir_consec_min 0.027296054749769816 driven_lanedir_max 0.030642992894805765 driven_lanedir_mean 0.030642992894805765 driven_lanedir_median 0.030642992894805765 driven_lanedir_min 0.030642992894805765 in-drivable-lane_max 9.200000000000031 in-drivable-lane_mean 9.200000000000031 in-drivable-lane_min 9.200000000000031 per-episodes details {"autolab-000-ego0": {"driven_any": 2.9055858596809983, "survival_time": 12.650000000000045, "driven_lanedir": 0.030642992894805765, "in-drivable-lane": 9.200000000000031, "deviation-heading": 2.554024904051201, "distance-from-start": 0.6297514211538974, "deviation-center-line": 0.3268219516832444, "driven_lanedir_consec": 0.027296054749769816}}simulation-passed 1 survival_time_max 12.650000000000045 survival_time_mean 12.650000000000045 survival_time_min 12.650000000000045
No reset possible 5772713Bea Baselines template-random aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 00:52:11+00:00 2021-11-01 00:55:48+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.02729653158692802 deviation-center-line_median 0.3268218383633572
other stats deviation-center-line_max 0.3268218383633572 deviation-center-line_mean 0.3268218383633572 deviation-center-line_min 0.3268218383633572 deviation-heading_max 2.554024904051201 deviation-heading_mean 2.554024904051201 deviation-heading_median 2.554024904051201 deviation-heading_min 2.554024904051201 distance-from-start_max 0.5461575079396507 distance-from-start_mean 0.5461575079396507 distance-from-start_median 0.5461575079396507 distance-from-start_min 0.5461575079396507 driven_any_max 2.2955250818765167 driven_any_mean 2.2955250818765167 driven_any_median 2.2955250818765167 driven_any_min 2.2955250818765167 driven_lanedir_consec_max 0.02729653158692802 driven_lanedir_consec_mean 0.02729653158692802 driven_lanedir_consec_min 0.02729653158692802 driven_lanedir_max 0.03064203922048936 driven_lanedir_mean 0.03064203922048936 driven_lanedir_median 0.03064203922048936 driven_lanedir_min 0.03064203922048936 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.2955250818765167, "survival_time": 11.350000000000026, "driven_lanedir": 0.03064203922048936, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.554024904051201, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.3268218383633572, "driven_lanedir_consec": 0.02729653158692802}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 5770714Bea Baselines template-random aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 00:49:56+00:00 2021-11-01 00:51:59+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.899999999999994 in-drivable-lane_median 2.399999999999994 driven_lanedir_consec_median 0.022350163233605613 deviation-center-line_median 0.026643428344150132
other stats deviation-center-line_max 0.026643428344150132 deviation-center-line_mean 0.026643428344150132 deviation-center-line_min 0.026643428344150132 deviation-heading_max 1.126574172093021 deviation-heading_mean 1.126574172093021 deviation-heading_median 1.126574172093021 deviation-heading_min 1.126574172093021 distance-from-start_max 0.48917230594954225 distance-from-start_mean 0.48917230594954225 distance-from-start_median 0.48917230594954225 distance-from-start_min 0.48917230594954225 driven_any_max 0.5134230938905342 driven_any_mean 0.5134230938905342 driven_any_median 0.5134230938905342 driven_any_min 0.5134230938905342 driven_lanedir_consec_max 0.022350163233605613 driven_lanedir_consec_mean 0.022350163233605613 driven_lanedir_consec_min 0.022350163233605613 driven_lanedir_max 0.022350163233605613 driven_lanedir_mean 0.022350163233605613 driven_lanedir_median 0.022350163233605613 driven_lanedir_min 0.022350163233605613 in-drivable-lane_max 2.399999999999994 in-drivable-lane_mean 2.399999999999994 in-drivable-lane_min 2.399999999999994 per-episodes details {"udem1-000-ego0": {"driven_any": 0.5134230938905342, "survival_time": 3.899999999999994, "driven_lanedir": 0.022350163233605613, "in-drivable-lane": 2.399999999999994, "deviation-heading": 1.126574172093021, "distance-from-start": 0.48917230594954225, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350163233605613}}simulation-passed 1 survival_time_max 3.899999999999994 survival_time_mean 3.899999999999994 survival_time_min 3.899999999999994
No reset possible 5766716Bea Baselines template-random aido-LFVI_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-11-01 00:48:20+00:00 2021-11-01 00:49:49+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5754734Bea Baselines baseline-duckietown-ml aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-11-01 00:36:23+00:00 2021-11-01 00:47:59+00:00 0:11:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948975282353262
other stats deviation-center-line_max 0.8948975282353262 deviation-center-line_mean 0.8948975282353262 deviation-center-line_min 0.8948975282353262 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.7755575615628914e-17 distance-from-start_mean 2.7755575615628914e-17 distance-from-start_median 2.7755575615628914e-17 distance-from-start_min 2.7755575615628914e-17 driven_any_max 3.3306690738754696e-14 driven_any_mean 3.3306690738754696e-14 driven_any_median 3.3306690738754696e-14 driven_any_min 3.3306690738754696e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5745736Bea Baselines baseline-duckietown-ml aido-LFI-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-11-01 00:31:27+00:00 2021-11-01 00:36:03+00:00 0:04:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949033835511649
other stats deviation-center-line_max 0.8949033835511649 deviation-center-line_mean 0.8949033835511649 deviation-center-line_min 0.8949033835511649 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.220446049250313e-16 distance-from-start_mean 2.220446049250313e-16 distance-from-start_median 2.220446049250313e-16 distance-from-start_min 2.220446049250313e-16 driven_any_max 2.6645352591003757e-13 driven_any_mean 2.6645352591003757e-13 driven_any_median 2.6645352591003757e-13 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5733739Bea Baselines baseline-duckietown-ml aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-11-01 00:20:10+00:00 2021-11-01 00:31:15+00:00 0:11:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5844914646140096
other stats deviation-center-line_max 3.46840075762051 deviation-center-line_mean 1.7151235775444986 deviation-center-line_min 0.22311062332946505 deviation-heading_max 40.967332753486254 deviation-heading_mean 25.437951450471505 deviation-heading_median 28.066180210798333 deviation-heading_min 4.652112626803104 distance-from-start_max 2.220446049250313e-16 distance-from-start_mean 8.326672684688674e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 0.0 driven_any_max 2.6645352591003757e-13 driven_any_mean 9.992007221626409e-14 driven_any_median 6.661338147750939e-14 driven_any_min 0.0 driven_lanedir_consec_max 0.000286102294921875 driven_lanedir_consec_mean 7.152557373046875e-05 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.000286102294921875 driven_lanedir_mean 7.152557373046875e-05 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134918, "driven_lanedir_consec": 0.000286102294921875}, "autolab-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 3.46840075762051, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332946505, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624586162145275, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5727740Bea Baselines baseline-duckietown-ml aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-11-01 00:15:04+00:00 2021-11-01 00:18:57+00:00 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065274986524565
other stats deviation-center-line_max 0.4065274986524565 deviation-center-line_mean 0.4065274986524565 deviation-center-line_min 0.4065274986524565 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 0.0 distance-from-start_mean 0.0 distance-from-start_median 0.0 distance-from-start_min 0.0 driven_any_max 0.0 driven_any_mean 0.0 driven_any_median 0.0 driven_any_min 0.0 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5705750Bea Baselines baseline-RPL-ros aido-LFP-sim-validationsim-2of4 failed no gpu-staging-spot-0-012021-11-01 00:04:02+00:00 2021-11-01 00:04:59+00:00 0:00:57 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5700751Bea Baselines baseline-RPL-ros aido-LFV-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-11-01 00:02:32+00:00 2021-11-01 00:03:43+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5692752Bea Baselines baseline-RPL-ros aido-LFVI-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-11-01 00:00:22+00:00 2021-11-01 00:02:19+00:00 0:01:57 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5686753Bea Baselines baseline-RPL-ros aido-LFI-sim-validationsim-1of4 failed no gpu-staging-spot-0-012021-10-31 23:58:59+00:00 2021-11-01 00:00:09+00:00 0:01:10 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5681755Bea Baselines baseline-RPL-ros aido-LFVI_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-012021-10-31 23:57:35+00:00 2021-10-31 23:58:34+00:00 0:00:59 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5674756Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 23:56:00+00:00 2021-10-31 23:57:01+00:00 0:01:01 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5667758Bea Baselines baseline-RPL-ros aido-LFV-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-10-31 23:54:29+00:00 2021-10-31 23:55:40+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5661759Bea Baselines baseline-RPL-ros aido-LFVI-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 23:53:11+00:00 2021-10-31 23:54:22+00:00 0:01:11 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5634632Bea Baselines minimal-agent-full aido-LFVI-full-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 23:43:14+00:00 2021-10-31 23:52:53+00:00 0:09:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.437734232870294 deviation-center-line_median 2.765649805151934
other stats deviation-center-line_max 2.765649805151934 deviation-center-line_mean 2.765649805151934 deviation-center-line_min 2.765649805151934 deviation-heading_max 4.001942616338776 deviation-heading_mean 4.001942616338776 deviation-heading_median 4.001942616338776 deviation-heading_min 4.001942616338776 distance-from-start_max 2.235923337296991 distance-from-start_mean 2.235923337296991 distance-from-start_median 2.235923337296991 distance-from-start_min 2.235923337296991 driven_any_max 3.579586929119037 driven_any_mean 3.579586929119037 driven_any_median 3.579586929119037 driven_any_min 3.579586929119037 driven_lanedir_consec_max 3.437734232870294 driven_lanedir_consec_mean 3.437734232870294 driven_lanedir_consec_min 3.437734232870294 driven_lanedir_max 3.557789693077632 driven_lanedir_mean 3.557789693077632 driven_lanedir_median 3.557789693077632 driven_lanedir_min 3.557789693077632 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.579586929119037, "survival_time": 59.99999999999873, "driven_lanedir": 3.557789693077632, "in-drivable-lane": 0.0, "deviation-heading": 4.001942616338776, "distance-from-start": 2.235923337296991, "deviation-center-line": 2.765649805151934, "driven_lanedir_consec": 3.437734232870294}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5625634Bea Baselines minimal-agent-full aido-LFV-full-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 23:37:25+00:00 2021-10-31 23:43:00+00:00 0:05:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4203998040440715 deviation-center-line_median 4.904463356399461
other stats deviation-center-line_max 4.904463356399461 deviation-center-line_mean 4.904463356399461 deviation-center-line_min 4.904463356399461 deviation-heading_max 7.745124858723169 deviation-heading_mean 7.745124858723169 deviation-heading_median 7.745124858723169 deviation-heading_min 7.745124858723169 distance-from-start_max 1.2059816832534165 distance-from-start_mean 1.2059816832534165 distance-from-start_median 1.2059816832534165 distance-from-start_min 1.2059816832534165 driven_any_max 3.485084016236962 driven_any_mean 3.485084016236962 driven_any_median 3.485084016236962 driven_any_min 3.485084016236962 driven_lanedir_consec_max 1.4203998040440715 driven_lanedir_consec_mean 1.4203998040440715 driven_lanedir_consec_min 1.4203998040440715 driven_lanedir_max 3.2905050472289954 driven_lanedir_mean 3.2905050472289954 driven_lanedir_median 3.2905050472289954 driven_lanedir_min 3.2905050472289954 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5623634Bea Baselines minimal-agent-full aido-LFV-full-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 23:33:16+00:00 2021-10-31 23:37:06+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.500000000000213 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3888839040115122 deviation-center-line_median 1.4738039593225314
other stats deviation-center-line_max 1.4738039593225314 deviation-center-line_mean 1.4738039593225314 deviation-center-line_min 1.4738039593225314 deviation-heading_max 3.246880369897966 deviation-heading_mean 3.246880369897966 deviation-heading_median 3.246880369897966 deviation-heading_min 3.246880369897966 distance-from-start_max 1.289007654085733 distance-from-start_mean 1.289007654085733 distance-from-start_median 1.289007654085733 distance-from-start_min 1.289007654085733 driven_any_max 1.4075976974295576 driven_any_mean 1.4075976974295576 driven_any_median 1.4075976974295576 driven_any_min 1.4075976974295576 driven_lanedir_consec_max 1.3888839040115122 driven_lanedir_consec_mean 1.3888839040115122 driven_lanedir_consec_min 1.3888839040115122 driven_lanedir_max 1.3888839040115122 driven_lanedir_mean 1.3888839040115122 driven_lanedir_median 1.3888839040115122 driven_lanedir_min 1.3888839040115122 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.4075976974295576, "survival_time": 24.500000000000213, "driven_lanedir": 1.3888839040115122, "in-drivable-lane": 0.0, "deviation-heading": 3.246880369897966, "distance-from-start": 1.289007654085733, "deviation-center-line": 1.4738039593225314, "driven_lanedir_consec": 1.3888839040115122}}simulation-passed 1 survival_time_max 24.500000000000213 survival_time_mean 24.500000000000213 survival_time_min 24.500000000000213
No reset possible 5621635Bea Baselines minimal-agent-full aido-LFI-full-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 23:31:12+00:00 2021-10-31 23:32:49+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5618635Bea Baselines minimal-agent-full aido-LFI-full-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 23:29:20+00:00 2021-10-31 23:30:50+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5610638Bea Baselines minimal-agent-full aido-LF-full-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-10-31 23:24:14+00:00 2021-10-31 23:29:12+00:00 0:04:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.899999999999892 driven_lanedir_consec_median 3.4064017085173024 deviation-center-line_median 5.159547195134336
other stats deviation-center-line_max 5.159547195134336 deviation-center-line_mean 5.159547195134336 deviation-center-line_min 5.159547195134336 deviation-heading_max 7.059107453483629 deviation-heading_mean 7.059107453483629 deviation-heading_median 7.059107453483629 deviation-heading_min 7.059107453483629 distance-from-start_max 2.2176127614009804 distance-from-start_mean 2.2176127614009804 distance-from-start_median 2.2176127614009804 distance-from-start_min 2.2176127614009804 driven_any_max 3.532579606984127 driven_any_mean 3.532579606984127 driven_any_median 3.532579606984127 driven_any_min 3.532579606984127 driven_lanedir_consec_max 3.4064017085173024 driven_lanedir_consec_mean 3.4064017085173024 driven_lanedir_consec_min 3.4064017085173024 driven_lanedir_max 3.4064017085173024 driven_lanedir_mean 3.4064017085173024 driven_lanedir_median 3.4064017085173024 driven_lanedir_min 3.4064017085173024 in-drivable-lane_max 1.899999999999892 in-drivable-lane_mean 1.899999999999892 in-drivable-lane_min 1.899999999999892 per-episodes details {"autolab-000-ego0": {"driven_any": 3.532579606984127, "survival_time": 59.99999999999873, "driven_lanedir": 3.4064017085173024, "in-drivable-lane": 1.899999999999892, "deviation-heading": 7.059107453483629, "distance-from-start": 2.2176127614009804, "deviation-center-line": 5.159547195134336, "driven_lanedir_consec": 3.4064017085173024}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5604639Bea Baselines minimal-agent-full aido-LFVI-full-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 23:20:10+00:00 2021-10-31 23:24:01+00:00 0:03:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.6855199039137942 deviation-center-line_median 1.1151363222094262
other stats deviation-center-line_max 1.1151363222094262 deviation-center-line_mean 1.1151363222094262 deviation-center-line_min 1.1151363222094262 deviation-heading_max 1.8997107406045024 deviation-heading_mean 1.8997107406045024 deviation-heading_median 1.8997107406045024 deviation-heading_min 1.8997107406045024 distance-from-start_max 0.6890064417552494 distance-from-start_mean 0.6890064417552494 distance-from-start_median 0.6890064417552494 distance-from-start_min 0.6890064417552494 driven_any_max 0.8255923756486474 driven_any_mean 0.8255923756486474 driven_any_median 0.8255923756486474 driven_any_min 0.8255923756486474 driven_lanedir_consec_max 0.6855199039137942 driven_lanedir_consec_mean 0.6855199039137942 driven_lanedir_consec_min 0.6855199039137942 driven_lanedir_max 0.8113565710261739 driven_lanedir_mean 0.8113565710261739 driven_lanedir_median 0.8113565710261739 driven_lanedir_min 0.8113565710261739 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.8255923756486474, "survival_time": 14.800000000000075, "driven_lanedir": 0.8113565710261739, "in-drivable-lane": 0.0, "deviation-heading": 1.8997107406045024, "distance-from-start": 0.6890064417552494, "deviation-center-line": 1.1151363222094262, "driven_lanedir_consec": 0.6855199039137942}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 5600640Bea Baselines minimal-agent-full aido-LFP-full-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 23:17:34+00:00 2021-10-31 23:19:37+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.200000000000053 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7222898911877377 deviation-center-line_median 0.6263425139703784
other stats deviation-center-line_max 0.6263425139703784 deviation-center-line_mean 0.6263425139703784 deviation-center-line_min 0.6263425139703784 deviation-heading_max 1.417085318647224 deviation-heading_mean 1.417085318647224 deviation-heading_median 1.417085318647224 deviation-heading_min 1.417085318647224 distance-from-start_max 0.7201981002422111 distance-from-start_mean 0.7201981002422111 distance-from-start_median 0.7201981002422111 distance-from-start_min 0.7201981002422111 driven_any_max 0.7295990048299438 driven_any_mean 0.7295990048299438 driven_any_median 0.7295990048299438 driven_any_min 0.7295990048299438 driven_lanedir_consec_max 0.7222898911877377 driven_lanedir_consec_mean 0.7222898911877377 driven_lanedir_consec_min 0.7222898911877377 driven_lanedir_max 0.7222898911877377 driven_lanedir_mean 0.7222898911877377 driven_lanedir_median 0.7222898911877377 driven_lanedir_min 0.7222898911877377 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.7295990048299438, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877377, "in-drivable-lane": 0.0, "deviation-heading": 1.417085318647224, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703784, "driven_lanedir_consec": 0.7222898911877377}}simulation-passed 1 survival_time_max 13.200000000000053 survival_time_mean 13.200000000000053 survival_time_min 13.200000000000053
No reset possible 5590642Bea Baselines minimal-agent-full aido-LFI-full-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 23:10:48+00:00 2021-10-31 23:17:22+00:00 0:06:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 2.186789824803002 deviation-center-line_median 5.756192467557295
other stats deviation-center-line_max 5.756192467557295 deviation-center-line_mean 5.756192467557295 deviation-center-line_min 5.756192467557295 deviation-heading_max 6.2307698813353865 deviation-heading_mean 6.2307698813353865 deviation-heading_median 6.2307698813353865 deviation-heading_min 6.2307698813353865 distance-from-start_max 1.6298009498956398 distance-from-start_mean 1.6298009498956398 distance-from-start_median 1.6298009498956398 distance-from-start_min 1.6298009498956398 driven_any_max 3.483691022699812 driven_any_mean 3.483691022699812 driven_any_median 3.483691022699812 driven_any_min 3.483691022699812 driven_lanedir_consec_max 2.186789824803002 driven_lanedir_consec_mean 2.186789824803002 driven_lanedir_consec_min 2.186789824803002 driven_lanedir_max 3.299163918160777 driven_lanedir_mean 3.299163918160777 driven_lanedir_median 3.299163918160777 driven_lanedir_min 3.299163918160777 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"4way-000-ego0": {"driven_any": 3.483691022699812, "survival_time": 59.99999999999873, "driven_lanedir": 3.299163918160777, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.2307698813353865, "distance-from-start": 1.6298009498956398, "deviation-center-line": 5.756192467557295, "driven_lanedir_consec": 2.186789824803002}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5587674Bea Baselines baseline-simple-yield aido-LF-state-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 23:06:11+00:00 2021-10-31 23:10:27+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.379280605881083 deviation-center-line_median 0.4086426394863958
other stats deviation-center-line_max 0.4086426394863958 deviation-center-line_mean 0.4086426394863958 deviation-center-line_min 0.4086426394863958 deviation-heading_max 3.257710113460004 deviation-heading_mean 3.257710113460004 deviation-heading_median 3.257710113460004 deviation-heading_min 3.257710113460004 distance-from-start_max 2.710848600829782 distance-from-start_mean 2.710848600829782 distance-from-start_median 2.710848600829782 distance-from-start_min 2.710848600829782 driven_any_max 5.395555302886635 driven_any_mean 5.395555302886635 driven_any_median 5.395555302886635 driven_any_min 5.395555302886635 driven_lanedir_consec_max 5.379280605881083 driven_lanedir_consec_mean 5.379280605881083 driven_lanedir_consec_min 5.379280605881083 driven_lanedir_max 5.379280605881083 driven_lanedir_mean 5.379280605881083 driven_lanedir_median 5.379280605881083 driven_lanedir_min 5.379280605881083 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5584675Bea Baselines baseline-simple-yield aido-LFI-state-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 23:04:24+00:00 2021-10-31 23:05:56+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5576677Bea Baselines baseline-simple-yield aido-LFVI-state-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 22:55:25+00:00 2021-10-31 23:04:03+00:00 0:08:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8949116056299468
other stats deviation-center-line_max 0.8949116056299468 deviation-center-line_mean 0.8949116056299468 deviation-center-line_min 0.8949116056299468 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5565679Bea Baselines baseline-simple-yield aido-LFP-state-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 22:51:53+00:00 2021-10-31 22:55:04+00:00 0:03:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.20000000000025 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.8824305480707815 deviation-center-line_median 0.24998323712819964
other stats deviation-center-line_max 0.24998323712819964 deviation-center-line_mean 0.24998323712819964 deviation-center-line_min 0.24998323712819964 deviation-heading_max 2.0191141438882525 deviation-heading_mean 2.0191141438882525 deviation-heading_median 2.0191141438882525 deviation-heading_min 2.0191141438882525 distance-from-start_max 2.3237448100281095 distance-from-start_mean 2.3237448100281095 distance-from-start_median 2.3237448100281095 distance-from-start_min 2.3237448100281095 driven_any_max 2.893646045198969 driven_any_mean 2.893646045198969 driven_any_median 2.893646045198969 driven_any_min 2.893646045198969 driven_lanedir_consec_max 2.8824305480707815 driven_lanedir_consec_mean 2.8824305480707815 driven_lanedir_consec_min 2.8824305480707815 driven_lanedir_max 2.8824305480707815 driven_lanedir_mean 2.8824305480707815 driven_lanedir_median 2.8824305480707815 driven_lanedir_min 2.8824305480707815 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.893646045198969, "survival_time": 33.20000000000025, "driven_lanedir": 2.8824305480707815, "in-drivable-lane": 0.0, "deviation-heading": 2.0191141438882525, "distance-from-start": 2.3237448100281095, "deviation-center-line": 0.24998323712819964, "driven_lanedir_consec": 2.8824305480707815}}simulation-passed 1 survival_time_max 33.20000000000025 survival_time_mean 33.20000000000025 survival_time_min 33.20000000000025
No reset possible 5555397Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 22:43:39+00:00 2021-10-31 22:51:32+00:00 0:07:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.7479877277835714 survival_time_median 59.99999999999873 deviation-center-line_median 3.4669041059607633 in-drivable-lane_median 25.849999999999245
other stats deviation-center-line_max 3.4669041059607633 deviation-center-line_mean 3.4669041059607633 deviation-center-line_min 3.4669041059607633 deviation-heading_max 27.85704070161557 deviation-heading_mean 27.85704070161557 deviation-heading_median 27.85704070161557 deviation-heading_min 27.85704070161557 distance-from-start_max 0.1483422989178196 distance-from-start_mean 0.1483422989178196 distance-from-start_median 0.1483422989178196 distance-from-start_min 0.1483422989178196 driven_any_max 11.510675064352576 driven_any_mean 11.510675064352576 driven_any_median 11.510675064352576 driven_any_min 11.510675064352576 driven_lanedir_consec_max -2.7479877277835714 driven_lanedir_consec_mean -2.7479877277835714 driven_lanedir_consec_min -2.7479877277835714 driven_lanedir_max -2.7479877277835714 driven_lanedir_mean -2.7479877277835714 driven_lanedir_median -2.7479877277835714 driven_lanedir_min -2.7479877277835714 in-drivable-lane_max 25.849999999999245 in-drivable-lane_mean 25.849999999999245 in-drivable-lane_min 25.849999999999245 per-episodes details {"autolab-000-ego0": {"driven_any": 11.510675064352576, "survival_time": 59.99999999999873, "driven_lanedir": -2.7479877277835714, "in-drivable-lane": 25.849999999999245, "deviation-heading": 27.85704070161557, "distance-from-start": 0.1483422989178196, "deviation-center-line": 3.4669041059607633, "driven_lanedir_consec": -2.7479877277835714}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5552526Bea Baselines baseline-behavior-cloning aido-LF-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 22:42:48+00:00 2021-10-31 22:43:33+00:00 0:00:45 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5551526Bea Baselines baseline-behavior-cloning aido-LF-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-10-31 22:41:10+00:00 2021-10-31 22:42:41+00:00 0:01:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5547658Bea Baselines template-pytorch aido-LF-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 22:38:25+00:00 2021-10-31 22:41:04+00:00 0:02:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.37110019831763585 survival_time_median 19.000000000000135 deviation-center-line_median 0.4202987329839127 in-drivable-lane_median 15.000000000000131
other stats deviation-center-line_max 0.4202987329839127 deviation-center-line_mean 0.4202987329839127 deviation-center-line_min 0.4202987329839127 deviation-heading_max 2.5183628921732333 deviation-heading_mean 2.5183628921732333 deviation-heading_median 2.5183628921732333 deviation-heading_min 2.5183628921732333 distance-from-start_max 0.4044349758196116 distance-from-start_mean 0.4044349758196116 distance-from-start_median 0.4044349758196116 distance-from-start_min 0.4044349758196116 driven_any_max 2.962092438914685 driven_any_mean 2.962092438914685 driven_any_median 2.962092438914685 driven_any_min 2.962092438914685 driven_lanedir_consec_max 0.37110019831763585 driven_lanedir_consec_mean 0.37110019831763585 driven_lanedir_consec_min 0.37110019831763585 driven_lanedir_max 0.37110019831763585 driven_lanedir_mean 0.37110019831763585 driven_lanedir_median 0.37110019831763585 driven_lanedir_min 0.37110019831763585 in-drivable-lane_max 15.000000000000131 in-drivable-lane_mean 15.000000000000131 in-drivable-lane_min 15.000000000000131 per-episodes details {"autolab-000-ego0": {"driven_any": 2.962092438914685, "survival_time": 19.000000000000135, "driven_lanedir": 0.37110019831763585, "in-drivable-lane": 15.000000000000131, "deviation-heading": 2.5183628921732333, "distance-from-start": 0.4044349758196116, "deviation-center-line": 0.4202987329839127, "driven_lanedir_consec": 0.37110019831763585}}simulation-passed 1 survival_time_max 19.000000000000135 survival_time_mean 19.000000000000135 survival_time_min 19.000000000000135
No reset possible 5541672Bea Baselines template-tensorflow aido-LF-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 22:35:23+00:00 2021-10-31 22:38:12+00:00 0:02:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5537715Bea Baselines template-random aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 22:33:29+00:00 2021-10-31 22:35:17+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.02606899309120614 survival_time_median 11.950000000000037 deviation-center-line_median 0.3267562024231576 in-drivable-lane_median 8.500000000000023
other stats deviation-center-line_max 0.3267562024231576 deviation-center-line_mean 0.3267562024231576 deviation-center-line_min 0.3267562024231576 deviation-heading_max 2.556935476404166 deviation-heading_mean 2.556935476404166 deviation-heading_median 2.556935476404166 deviation-heading_min 2.556935476404166 distance-from-start_max 0.6291689351083347 distance-from-start_mean 0.6291689351083347 distance-from-start_median 0.6291689351083347 distance-from-start_min 0.6291689351083347 driven_any_max 2.617379035765366 driven_any_mean 2.617379035765366 driven_any_median 2.617379035765366 driven_any_min 2.617379035765366 driven_lanedir_consec_max 0.02606899309120614 driven_lanedir_consec_mean 0.02606899309120614 driven_lanedir_consec_min 0.02606899309120614 driven_lanedir_max 0.029415931236242088 driven_lanedir_mean 0.029415931236242088 driven_lanedir_median 0.029415931236242088 driven_lanedir_min 0.029415931236242088 in-drivable-lane_max 8.500000000000023 in-drivable-lane_mean 8.500000000000023 in-drivable-lane_min 8.500000000000023 per-episodes details {"loop-000-ego0": {"driven_any": 2.617379035765366, "survival_time": 11.950000000000037, "driven_lanedir": 0.029415931236242088, "in-drivable-lane": 8.500000000000023, "deviation-heading": 2.556935476404166, "distance-from-start": 0.6291689351083347, "deviation-center-line": 0.3267562024231576, "driven_lanedir_consec": 0.02606899309120614}}simulation-passed 1 survival_time_max 11.950000000000037 survival_time_mean 11.950000000000037 survival_time_min 11.950000000000037
No reset possible 5530683Bea Baselines baseline-simple-yield aido-LFVI-state-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 22:24:24+00:00 2021-10-31 22:33:23+00:00 0:08:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.936558467770946 deviation-center-line_median 0.704072479117435
other stats deviation-center-line_max 0.704072479117435 deviation-center-line_mean 0.704072479117435 deviation-center-line_min 0.704072479117435 deviation-heading_max 3.2476993641319134 deviation-heading_mean 3.2476993641319134 deviation-heading_median 3.2476993641319134 deviation-heading_min 3.2476993641319134 distance-from-start_max 2.4908879599333775 distance-from-start_mean 2.4908879599333775 distance-from-start_median 2.4908879599333775 distance-from-start_min 2.4908879599333775 driven_any_max 4.95168286773776 driven_any_mean 4.95168286773776 driven_any_median 4.95168286773776 driven_any_min 4.95168286773776 driven_lanedir_consec_max 4.936558467770946 driven_lanedir_consec_mean 4.936558467770946 driven_lanedir_consec_min 4.936558467770946 driven_lanedir_max 4.936558467770946 driven_lanedir_mean 4.936558467770946 driven_lanedir_median 4.936558467770946 driven_lanedir_min 4.936558467770946 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 4.95168286773776, "survival_time": 59.99999999999873, "driven_lanedir": 4.936558467770946, "in-drivable-lane": 0.0, "deviation-heading": 3.2476993641319134, "distance-from-start": 2.4908879599333775, "deviation-center-line": 0.704072479117435, "driven_lanedir_consec": 4.936558467770946}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5518686Bea Baselines baseline-simple-yield aido-LFV-state-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-10-31 22:18:43+00:00 2021-10-31 22:23:50+00:00 0:05:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.324198327059039 deviation-center-line_median 0.5519609227418314
other stats deviation-center-line_max 0.5519609227418314 deviation-center-line_mean 0.5519609227418314 deviation-center-line_min 0.5519609227418314 deviation-heading_max 3.5883206576626248 deviation-heading_mean 3.5883206576626248 deviation-heading_median 3.5883206576626248 deviation-heading_min 3.5883206576626248 distance-from-start_max 1.0638230176113956 distance-from-start_mean 1.0638230176113956 distance-from-start_median 1.0638230176113956 distance-from-start_min 1.0638230176113956 driven_any_max 5.347239209519233 driven_any_mean 5.347239209519233 driven_any_median 5.347239209519233 driven_any_min 5.347239209519233 driven_lanedir_consec_max 5.324198327059039 driven_lanedir_consec_mean 5.324198327059039 driven_lanedir_consec_min 5.324198327059039 driven_lanedir_max 5.324198327059039 driven_lanedir_mean 5.324198327059039 driven_lanedir_median 5.324198327059039 driven_lanedir_min 5.324198327059039 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.347239209519233, "survival_time": 59.99999999999873, "driven_lanedir": 5.324198327059039, "in-drivable-lane": 0.0, "deviation-heading": 3.5883206576626248, "distance-from-start": 1.0638230176113956, "deviation-center-line": 0.5519609227418314, "driven_lanedir_consec": 5.324198327059039}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5513717Bea Baselines minimal-agent-state aido-LF-state-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 22:14:31+00:00 2021-10-31 22:18:31+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.8920792929900845 deviation-center-line_median 5.680288946152966
other stats deviation-center-line_max 5.680288946152966 deviation-center-line_mean 5.680288946152966 deviation-center-line_min 5.680288946152966 deviation-heading_max 11.490175070254152 deviation-heading_mean 11.490175070254152 deviation-heading_median 11.490175070254152 deviation-heading_min 11.490175070254152 distance-from-start_max 2.5229792435928395 distance-from-start_mean 2.5229792435928395 distance-from-start_median 2.5229792435928395 distance-from-start_min 2.5229792435928395 driven_any_max 3.4265750684858305 driven_any_mean 3.4265750684858305 driven_any_median 3.4265750684858305 driven_any_min 3.4265750684858305 driven_lanedir_consec_max 2.8920792929900845 driven_lanedir_consec_mean 2.8920792929900845 driven_lanedir_consec_min 2.8920792929900845 driven_lanedir_max 3.0978303472366893 driven_lanedir_mean 3.0978303472366893 driven_lanedir_median 3.0978303472366893 driven_lanedir_min 3.0978303472366893 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4265750684858305, "survival_time": 59.99999999999873, "driven_lanedir": 3.0978303472366893, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.490175070254152, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.680288946152966, "driven_lanedir_consec": 2.8920792929900845}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5505718Bea Baselines minimal-agent-state aido-LFI-state-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 22:10:06+00:00 2021-10-31 22:14:11+00:00 0:04:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9999999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.896613408548548 deviation-center-line_median 3.8033318362841073
other stats deviation-center-line_max 3.8033318362841073 deviation-center-line_mean 3.8033318362841073 deviation-center-line_min 3.8033318362841073 deviation-heading_max 4.074858735595133 deviation-heading_mean 4.074858735595133 deviation-heading_median 4.074858735595133 deviation-heading_min 4.074858735595133 distance-from-start_max 1.574553399562494 distance-from-start_mean 1.574553399562494 distance-from-start_median 1.574553399562494 distance-from-start_min 1.574553399562494 driven_any_max 2.9375948144939867 driven_any_mean 2.9375948144939867 driven_any_median 2.9375948144939867 driven_any_min 2.9375948144939867 driven_lanedir_consec_max 2.896613408548548 driven_lanedir_consec_mean 2.896613408548548 driven_lanedir_consec_min 2.896613408548548 driven_lanedir_max 2.916242176218421 driven_lanedir_mean 2.916242176218421 driven_lanedir_median 2.916242176218421 driven_lanedir_min 2.916242176218421 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 2.9375948144939867, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218421, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595133, "distance-from-start": 1.574553399562494, "deviation-center-line": 3.8033318362841073, "driven_lanedir_consec": 2.896613408548548}}simulation-passed 1 survival_time_max 49.9999999999993 survival_time_mean 49.9999999999993 survival_time_min 49.9999999999993
No reset possible 5494721Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-validation275 success yes gpu-staging-spot-0-012021-10-31 22:02:23+00:00 2021-10-31 22:09:59+00:00 0:07:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.024999999999956 driven_lanedir_consec_median 2.354349999154554 deviation-center-line_median 6.1904900915885825
other stats deviation-center-line_max 7.342897137212387 deviation-center-line_mean 5.815429153599174 deviation-center-line_min 3.5378392940071444 deviation-heading_max 8.643847239934157 deviation-heading_mean 5.769308033824521 deviation-heading_median 5.462417882322539 deviation-heading_min 3.5085491307188437 distance-from-start_max 2.1932800589165744 distance-from-start_mean 1.7770214145992558 distance-from-start_median 1.7822126331012849 distance-from-start_min 1.3503803332778783 driven_any_max 3.519587859801343 driven_any_mean 3.0189647101082344 driven_any_median 3.38758803636824 driven_any_min 1.7810949078951157 driven_lanedir_consec_max 3.321041838958641 driven_lanedir_consec_mean 2.428232836144684 driven_lanedir_consec_min 1.6831895073109888 driven_lanedir_max 3.387629081863654 driven_lanedir_mean 2.883329777932324 driven_lanedir_median 3.231250261277327 driven_lanedir_min 1.6831895073109888 in-drivable-lane_max 2.749999999999872 in-drivable-lane_mean 2.162499999999953 in-drivable-lane_min 1.8500000000000263 per-episodes details {"autolab-000-ego0": {"driven_any": 3.2780872163787773, "survival_time": 59.99999999999873, "driven_lanedir": 3.1414586835960128, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.270318376228316, "distance-from-start": 2.1932800589165744, "deviation-center-line": 3.5378392940071444, "driven_lanedir_consec": 2.5904401579936844}, "autolab-000-ego1": {"driven_any": 1.7810949078951157, "survival_time": 59.99999999999873, "driven_lanedir": 1.6831895073109888, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.5085491307188437, "distance-from-start": 1.3503803332778783, "deviation-center-line": 7.342897137212387, "driven_lanedir_consec": 1.6831895073109888}, "autolab-000-ego2": {"driven_any": 3.4970888563577023, "survival_time": 59.99999999999873, "driven_lanedir": 3.321041838958641, "in-drivable-lane": 2.749999999999872, "deviation-heading": 8.643847239934157, "distance-from-start": 2.062725629892184, "deviation-center-line": 5.639409153019825, "driven_lanedir_consec": 3.321041838958641}, "autolab-000-ego3": {"driven_any": 3.519587859801343, "survival_time": 59.99999999999873, "driven_lanedir": 3.387629081863654, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654517388416762, "distance-from-start": 1.5016996363103856, "deviation-center-line": 6.74157103015734, "driven_lanedir_consec": 2.1182598403154227}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5487722Bea Baselines minimal-agent-state aido-LFP-state-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 21:58:36+00:00 2021-10-31 22:02:01+00:00 0:03:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204197100811673 deviation-center-line_median 4.903600870629327
other stats deviation-center-line_max 4.903600870629327 deviation-center-line_mean 4.903600870629327 deviation-center-line_min 4.903600870629327 deviation-heading_max 7.744574576193987 deviation-heading_mean 7.744574576193987 deviation-heading_median 7.744574576193987 deviation-heading_min 7.744574576193987 distance-from-start_max 1.2060007985322774 distance-from-start_mean 1.2060007985322774 distance-from-start_median 1.2060007985322774 distance-from-start_min 1.2060007985322774 driven_any_max 3.4850840176967317 driven_any_mean 3.4850840176967317 driven_any_median 3.4850840176967317 driven_any_min 3.4850840176967317 driven_lanedir_consec_max 1.4204197100811673 driven_lanedir_consec_mean 1.4204197100811673 driven_lanedir_consec_min 1.4204197100811673 driven_lanedir_max 3.2905075260443173 driven_lanedir_mean 3.2905075260443173 driven_lanedir_median 3.2905075260443173 driven_lanedir_min 3.2905075260443173 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4850840176967317, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905075260443173, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574576193987, "distance-from-start": 1.2060007985322774, "deviation-center-line": 4.903600870629327, "driven_lanedir_consec": 1.4204197100811673}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5483723Bea Baselines minimal-agent-state aido-LF-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 21:54:22+00:00 2021-10-31 21:58:29+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.241204615389226 deviation-center-line_median 4.759684198968496
other stats deviation-center-line_max 4.759684198968496 deviation-center-line_mean 4.759684198968496 deviation-center-line_min 4.759684198968496 deviation-heading_max 9.18078892152259 deviation-heading_mean 9.18078892152259 deviation-heading_median 9.18078892152259 deviation-heading_min 9.18078892152259 distance-from-start_max 1.6296054226673595 distance-from-start_mean 1.6296054226673595 distance-from-start_median 1.6296054226673595 distance-from-start_min 1.6296054226673595 driven_any_max 3.519583547683476 driven_any_mean 3.519583547683476 driven_any_median 3.519583547683476 driven_any_min 3.519583547683476 driven_lanedir_consec_max 2.241204615389226 driven_lanedir_consec_mean 2.241204615389226 driven_lanedir_consec_min 2.241204615389226 driven_lanedir_max 3.353584317203001 driven_lanedir_mean 3.353584317203001 driven_lanedir_median 3.353584317203001 driven_lanedir_min 3.353584317203001 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5479724Bea Baselines minimal-agent-state aido-LFI-state-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 21:52:31+00:00 2021-10-31 21:54:07+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5471727Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 21:44:22+00:00 2021-10-31 21:52:11+00:00 0:07:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.549999999999912 driven_lanedir_consec_median 3.4373147503288832 deviation-center-line_median 5.543408016755537
other stats deviation-center-line_max 7.09102922648354 deviation-center-line_mean 5.54329471184905 deviation-center-line_min 3.995333587401586 deviation-heading_max 7.066664369148437 deviation-heading_mean 5.842960213142369 deviation-heading_median 6.8999459874551246 deviation-heading_min 2.505284508510791 distance-from-start_max 2.955798853097406 distance-from-start_mean 2.4988165096278374 distance-from-start_median 2.699886878673919 distance-from-start_min 1.6396934280661062 driven_any_max 3.579593246505303 driven_any_mean 3.521842404663172 driven_any_median 3.5330944521151153 driven_any_min 3.441587467917153 driven_lanedir_consec_max 3.525823359544204 driven_lanedir_consec_mean 3.4022655912637405 driven_lanedir_consec_min 3.2086095048529906 driven_lanedir_max 3.525823359544204 driven_lanedir_mean 3.4022655912637405 driven_lanedir_median 3.4373147503288832 driven_lanedir_min 3.2086095048529906 in-drivable-lane_max 4.5999999999999055 in-drivable-lane_mean 1.9249999999999323 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.51959204448395, "survival_time": 59.99999999999873, "driven_lanedir": 3.385438564236927, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066664369148437, "distance-from-start": 2.7565963439290773, "deviation-center-line": 5.430438899566171, "driven_lanedir_consec": 3.385438564236927}, "autolab-000-ego2": {"driven_any": 3.5465968597462805, "survival_time": 59.99999999999873, "driven_lanedir": 3.48919093642084, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.505284508510791, "distance-from-start": 2.643177413418761, "deviation-center-line": 3.995333587401586, "driven_lanedir_consec": 3.48919093642084}, "autolab-000-ego3": {"driven_any": 3.441587467917153, "survival_time": 59.99999999999873, "driven_lanedir": 3.2086095048529906, "in-drivable-lane": 4.5999999999999055, "deviation-heading": 6.977755733974964, "distance-from-start": 1.6396934280661062, "deviation-center-line": 7.09102922648354, "driven_lanedir_consec": 3.2086095048529906}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5466728Bea Baselines minimal-agent-state aido-LFV-state-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 21:39:10+00:00 2021-10-31 21:44:02+00:00 0:04:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.099999999999845 driven_lanedir_consec_median 3.2655265789104 deviation-center-line_median 7.114511199103643
other stats deviation-center-line_max 7.114511199103643 deviation-center-line_mean 7.114511199103643 deviation-center-line_min 7.114511199103643 deviation-heading_max 5.702635580930089 deviation-heading_mean 5.702635580930089 deviation-heading_median 5.702635580930089 deviation-heading_min 5.702635580930089 distance-from-start_max 1.6303678440695035 distance-from-start_mean 1.6303678440695035 distance-from-start_median 1.6303678440695035 distance-from-start_min 1.6303678440695035 driven_any_max 3.466336917289666 driven_any_mean 3.466336917289666 driven_any_median 3.466336917289666 driven_any_min 3.466336917289666 driven_lanedir_consec_max 3.2655265789104 driven_lanedir_consec_mean 3.2655265789104 driven_lanedir_consec_min 3.2655265789104 driven_lanedir_max 3.2655265789104 driven_lanedir_mean 3.2655265789104 driven_lanedir_median 3.2655265789104 driven_lanedir_min 3.2655265789104 in-drivable-lane_max 4.099999999999845 in-drivable-lane_mean 4.099999999999845 in-drivable-lane_min 4.099999999999845 per-episodes details {"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5452730Bea Baselines minimal-agent-state aido-LFP-state-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-10-31 21:33:49+00:00 2021-10-31 21:38:56+00:00 0:05:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.3499999999998664 driven_lanedir_consec_median 3.348849345562785 deviation-center-line_median 5.530773803151009
other stats deviation-center-line_max 5.530773803151009 deviation-center-line_mean 5.530773803151009 deviation-center-line_min 5.530773803151009 deviation-heading_max 8.935875869654826 deviation-heading_mean 8.935875869654826 deviation-heading_median 8.935875869654826 deviation-heading_min 8.935875869654826 distance-from-start_max 2.421090353696769 distance-from-start_mean 2.421090353696769 distance-from-start_median 2.421090353696769 distance-from-start_min 2.421090353696769 driven_any_max 3.509088402822391 driven_any_mean 3.509088402822391 driven_any_median 3.509088402822391 driven_any_min 3.509088402822391 driven_lanedir_consec_max 3.348849345562785 driven_lanedir_consec_mean 3.348849345562785 driven_lanedir_consec_min 3.348849345562785 driven_lanedir_max 3.348849345562785 driven_lanedir_mean 3.348849345562785 driven_lanedir_median 3.348849345562785 driven_lanedir_min 3.348849345562785 in-drivable-lane_max 2.3499999999998664 in-drivable-lane_mean 2.3499999999998664 in-drivable-lane_min 2.3499999999998664 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.509088402822391, "survival_time": 59.99999999999873, "driven_lanedir": 3.348849345562785, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 8.935875869654826, "distance-from-start": 2.421090353696769, "deviation-center-line": 5.530773803151009, "driven_lanedir_consec": 3.348849345562785}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5449690Bea Baselines minimal-agent aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 21:32:14+00:00 2021-10-31 21:33:21+00:00 0:01:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.4499999999999993 in-drivable-lane_median 0.6999999999999984 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.1256753125869936
other stats deviation-center-line_max 0.1256753125869936 deviation-center-line_mean 0.1256753125869936 deviation-center-line_min 0.1256753125869936 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.23316122665354827 distance-from-start_mean 0.23316122665354827 distance-from-start_median 0.23316122665354827 distance-from-start_min 0.23316122665354827 driven_any_max 0.23316442419546207 driven_any_mean 0.23316442419546207 driven_any_median 0.23316442419546207 driven_any_min 0.23316442419546207 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 0.6999999999999984 in-drivable-lane_mean 0.6999999999999984 in-drivable-lane_min 0.6999999999999984 per-episodes details {"loop-000-ego0": {"driven_any": 0.23316442419546207, "survival_time": 2.4499999999999993, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 0.6999999999999984, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.23316122665354827, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 2.4499999999999993 survival_time_mean 2.4499999999999993 survival_time_min 2.4499999999999993
No reset possible 5440692Bea Baselines minimal-agent aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 21:30:21+00:00 2021-10-31 21:31:53+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5435693Bea Baselines minimal-agent aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 21:28:24+00:00 2021-10-31 21:29:59+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5430694Bea Baselines minimal-agent aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-10-31 21:26:45+00:00 2021-10-31 21:28:18+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19695248970180224 survival_time_median 10.100000000000009 deviation-center-line_median 0.1253905065384011 in-drivable-lane_median 8.350000000000009
other stats deviation-center-line_max 0.1253905065384011 deviation-center-line_mean 0.1253905065384011 deviation-center-line_min 0.1253905065384011 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 1.4926447664752691 distance-from-start_mean 1.4926447664752691 distance-from-start_median 1.4926447664752691 distance-from-start_min 1.4926447664752691 driven_any_max 1.4929097725804397 driven_any_mean 1.4929097725804397 driven_any_median 1.4929097725804397 driven_any_min 1.4929097725804397 driven_lanedir_consec_max 0.19695248970180224 driven_lanedir_consec_mean 0.19695248970180224 driven_lanedir_consec_min 0.19695248970180224 driven_lanedir_max 0.19695248970180224 driven_lanedir_mean 0.19695248970180224 driven_lanedir_median 0.19695248970180224 driven_lanedir_min 0.19695248970180224 in-drivable-lane_max 8.350000000000009 in-drivable-lane_mean 8.350000000000009 in-drivable-lane_min 8.350000000000009 per-episodes details {"autolab-000-ego0": {"driven_any": 1.4929097725804397, "survival_time": 10.100000000000009, "driven_lanedir": 0.19695248970180224, "in-drivable-lane": 8.350000000000009, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.4926447664752691, "deviation-center-line": 0.1253905065384011, "driven_lanedir_consec": 0.19695248970180224}}simulation-passed 1 survival_time_max 10.100000000000009 survival_time_mean 10.100000000000009 survival_time_min 10.100000000000009
No reset possible 5423697Bea Baselines minimal-agent aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-10-31 21:25:22+00:00 2021-10-31 21:26:36+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.149999999999993 in-drivable-lane_median 2.749999999999993 driven_lanedir_consec_median 0.13666480491623578 deviation-center-line_median 0.10783842766264128
other stats deviation-center-line_max 0.10783842766264128 deviation-center-line_mean 0.10783842766264128 deviation-center-line_min 0.10783842766264128 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 0.5146479428595216 distance-from-start_mean 0.5146479428595216 distance-from-start_median 0.5146479428595216 distance-from-start_min 0.5146479428595216 driven_any_max 0.5146585239872711 driven_any_mean 0.5146585239872711 driven_any_median 0.5146585239872711 driven_any_min 0.5146585239872711 driven_lanedir_consec_max 0.13666480491623578 driven_lanedir_consec_mean 0.13666480491623578 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.13666480491623578 driven_lanedir_mean 0.13666480491623578 driven_lanedir_median 0.13666480491623578 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 2.749999999999993 in-drivable-lane_mean 2.749999999999993 in-drivable-lane_min 2.749999999999993 per-episodes details {"loop2-000-ego0": {"driven_any": 0.5146585239872711, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595216, "deviation-center-line": 0.10783842766264128, "driven_lanedir_consec": 0.13666480491623578}}simulation-passed 1 survival_time_max 4.149999999999993 survival_time_mean 4.149999999999993 survival_time_min 4.149999999999993
No reset possible 5418697Bea Baselines minimal-agent aido-LFP-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-10-31 21:23:44+00:00 2021-10-31 21:25:10+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.99999999999999 in-drivable-lane_median 3.79999999999999 driven_lanedir_consec_median 0.08715128455904608 deviation-center-line_median 0.08531010260279949
other stats deviation-center-line_max 0.08531010260279949 deviation-center-line_mean 0.08531010260279949 deviation-center-line_min 0.08531010260279949 deviation-heading_max 1.02112502633278 deviation-heading_mean 1.02112502633278 deviation-heading_median 1.02112502633278 deviation-heading_min 1.02112502633278 distance-from-start_max 0.6563203604640362 distance-from-start_mean 0.6563203604640362 distance-from-start_median 0.6563203604640362 distance-from-start_min 0.6563203604640362 driven_any_max 0.6563320833963245 driven_any_mean 0.6563320833963245 driven_any_median 0.6563320833963245 driven_any_min 0.6563320833963245 driven_lanedir_consec_max 0.08715128455904608 driven_lanedir_consec_mean 0.08715128455904608 driven_lanedir_consec_min 0.08715128455904608 driven_lanedir_max 0.08715128455904608 driven_lanedir_mean 0.08715128455904608 driven_lanedir_median 0.08715128455904608 driven_lanedir_min 0.08715128455904608 in-drivable-lane_max 3.79999999999999 in-drivable-lane_mean 3.79999999999999 in-drivable-lane_min 3.79999999999999 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6563320833963245, "survival_time": 4.99999999999999, "driven_lanedir": 0.08715128455904608, "in-drivable-lane": 3.79999999999999, "deviation-heading": 1.02112502633278, "distance-from-start": 0.6563203604640362, "deviation-center-line": 0.08531010260279949, "driven_lanedir_consec": 0.08715128455904608}}simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 4.99999999999999 survival_time_min 4.99999999999999
No reset possible 5394644Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 21:10:06+00:00 2021-10-31 21:23:30+00:00 0:13:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.320847663449453 deviation-center-line_median 5.509202824089039
other stats deviation-center-line_max 6.756952476930072 deviation-center-line_mean 5.338579474021433 deviation-center-line_min 3.57895977097758 deviation-heading_max 5.165991236119989 deviation-heading_mean 3.955233800626404 deviation-heading_median 4.636249730116838 deviation-heading_min 1.3824445061519497 distance-from-start_max 2.6950407308462383 distance-from-start_mean 1.8279509363781563 distance-from-start_median 1.656487541106691 distance-from-start_min 1.3037879324530055 driven_any_max 3.4716897005858773 driven_any_mean 2.4718702523002105 driven_any_median 2.3375972316718254 driven_any_min 1.7405968452713143 driven_lanedir_consec_max 3.292155930923049 driven_lanedir_consec_mean 2.4129950677964196 driven_lanedir_consec_min 1.7181290133637237 driven_lanedir_max 3.292155930923049 driven_lanedir_mean 2.4187239388545523 driven_lanedir_median 2.3243071631921324 driven_lanedir_min 1.734125498110895 in-drivable-lane_max 3.5999999999999623 in-drivable-lane_mean 0.8999999999999906 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.9345947247910176, "survival_time": 59.99999999999873, "driven_lanedir": 2.909967111085985, "in-drivable-lane": 0.0, "deviation-heading": 4.334701203563791, "distance-from-start": 1.5738878476280138, "deviation-center-line": 5.185168540477153, "driven_lanedir_consec": 2.9030481116006257}, "4way-000-ego1": {"driven_any": 1.7405997385526328, "survival_time": 59.99999999999873, "driven_lanedir": 1.73864721529828, "in-drivable-lane": 0.0, "deviation-heading": 4.937798256669886, "distance-from-start": 1.7390872345853683, "deviation-center-line": 5.833237107700924, "driven_lanedir_consec": 1.73864721529828}, "4way-000-ego2": {"driven_any": 1.7405968452713143, "survival_time": 59.99999999999873, "driven_lanedir": 1.734125498110895, "in-drivable-lane": 0.0, "deviation-heading": 1.3824445061519497, "distance-from-start": 1.3037879324530055, "deviation-center-line": 3.57895977097758, "driven_lanedir_consec": 1.7181290133637237}, "4way-000-ego3": {"driven_any": 3.4716897005858773, "survival_time": 59.99999999999873, "driven_lanedir": 3.292155930923049, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165991236119989, "distance-from-start": 2.6950407308462383, "deviation-center-line": 6.756952476930072, "driven_lanedir_consec": 3.292155930923049}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5389434Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 21:08:34+00:00 2021-10-31 21:09:45+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5383436Bea Baselines template-tensorflow aido-LFV-sim-testingsim-3of4 failed no gpu-staging-spot-0-012021-10-31 21:06:55+00:00 2021-10-31 21:08:19+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5375437Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-1of4 failed no gpu-staging-spot-0-012021-10-31 21:05:10+00:00 2021-10-31 21:06:48+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5371438Bea Baselines template-tensorflow aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-10-31 21:03:20+00:00 2021-10-31 21:05:03+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5361439Bea Baselines template-tensorflow aido-LF-sim-testingsim-0of4 failed no gpu-staging-spot-0-012021-10-31 21:00:21+00:00 2021-10-31 21:02:51+00:00 0:02:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5357439Bea Baselines template-tensorflow aido-LF-sim-testingsim-2of4 failed no gpu-staging-spot-0-012021-10-31 20:59:09+00:00 2021-10-31 21:00:04+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5348489Bea Baselines minimal-agent aido-LFVI-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-10-31 20:56:19+00:00 2021-10-31 20:58:37+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.3499999999999996 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.1855313235047669 deviation-center-line_median 0.23128930214039792
other stats deviation-center-line_max 0.23128930214039792 deviation-center-line_mean 0.23128930214039792 deviation-center-line_min 0.23128930214039792 deviation-heading_max 1.2772144939748085 deviation-heading_mean 1.2772144939748085 deviation-heading_median 1.2772144939748085 deviation-heading_min 1.2772144939748085 distance-from-start_max 0.2167455424653449 distance-from-start_mean 0.2167455424653449 distance-from-start_median 0.2167455424653449 distance-from-start_min 0.2167455424653449 driven_any_max 0.21674864008014844 driven_any_mean 0.21674864008014844 driven_any_median 0.21674864008014844 driven_any_min 0.21674864008014844 driven_lanedir_consec_max 0.1855313235047669 driven_lanedir_consec_mean 0.1855313235047669 driven_lanedir_consec_min 0.1855313235047669 driven_lanedir_max 0.1855313235047669 driven_lanedir_mean 0.1855313235047669 driven_lanedir_median 0.1855313235047669 driven_lanedir_min 0.1855313235047669 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.21674864008014844, "survival_time": 2.3499999999999996, "driven_lanedir": 0.1855313235047669, "in-drivable-lane": 0.0, "deviation-heading": 1.2772144939748085, "distance-from-start": 0.2167455424653449, "deviation-center-line": 0.23128930214039792, "driven_lanedir_consec": 0.1855313235047669}}simulation-passed 1 survival_time_max 2.3499999999999996 survival_time_mean 2.3499999999999996 survival_time_min 2.3499999999999996
No reset possible 5344496Bea Baselines minimal-agent aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-10-31 20:54:28+00:00 2021-10-31 20:55:59+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5333468Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-testingsim-3of4 success no gpu-staging-spot-0-012021-10-31 20:46:06+00:00 2021-10-31 20:54:01+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.024999999999899 driven_lanedir_consec_median 2.732641298569841 deviation-center-line_median 5.783205159116111
other stats deviation-center-line_max 7.544965157820116 deviation-center-line_mean 5.7497675193698345 deviation-center-line_min 3.887694601427 deviation-heading_max 10.583931080973072 deviation-heading_mean 9.151368086839163 deviation-heading_median 9.268364351217574 deviation-heading_min 7.484812563948442 distance-from-start_max 2.813869612393969 distance-from-start_mean 2.084478573533678 distance-from-start_median 1.905962653534861 distance-from-start_min 1.712119374671022 driven_any_max 3.546589753346208 driven_any_mean 3.4746585890034973 driven_any_median 3.458908334341295 driven_any_min 3.434227933985191 driven_lanedir_consec_max 3.4309687141204037 driven_lanedir_consec_mean 2.7748390965881633 driven_lanedir_consec_min 2.2031050750925667 driven_lanedir_max 3.4309687141204037 driven_lanedir_mean 3.2525878379342834 driven_lanedir_median 3.2151491306395874 driven_lanedir_min 3.1490843763375547 in-drivable-lane_max 4.849999999999876 in-drivable-lane_mean 3.499999999999903 in-drivable-lane_min 1.0999999999999377 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.434227933985191, "survival_time": 59.99999999999873, "driven_lanedir": 3.1490843763375547, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.12511562520589, "distance-from-start": 1.712119374671022, "deviation-center-line": 6.026388852659691, "driven_lanedir_consec": 2.2261398186252195}, "zigzag-000-ego1": {"driven_any": 3.455238818983606, "survival_time": 59.99999999999873, "driven_lanedir": 3.239142778514463, "in-drivable-lane": 4.149999999999885, "deviation-heading": 7.484812563948442, "distance-from-start": 1.7151458090928755, "deviation-center-line": 7.544965157820116, "driven_lanedir_consec": 3.239142778514463}, "zigzag-000-ego2": {"driven_any": 3.546589753346208, "survival_time": 59.99999999999873, "driven_lanedir": 3.4309687141204037, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 8.411613077229257, "distance-from-start": 2.813869612393969, "deviation-center-line": 3.887694601427, "driven_lanedir_consec": 3.4309687141204037}, "zigzag-000-ego3": {"driven_any": 3.462577849698985, "survival_time": 59.99999999999873, "driven_lanedir": 3.1911554827647115, "in-drivable-lane": 3.8999999999999138, "deviation-heading": 10.583931080973072, "distance-from-start": 2.0967794979768466, "deviation-center-line": 5.54002146557253, "driven_lanedir_consec": 2.2031050750925667}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5319483Bea Baselines baseline-simple-yield aido-LFV-state-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 20:37:39+00:00 2021-10-31 20:45:34+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.795272886866324 deviation-center-line_median 0.18526753481713515
other stats deviation-center-line_max 0.18526753481713515 deviation-center-line_mean 0.18526753481713515 deviation-center-line_min 0.18526753481713515 deviation-heading_max 1.7039527742064555 deviation-heading_mean 1.7039527742064555 deviation-heading_median 1.7039527742064555 deviation-heading_min 1.7039527742064555 distance-from-start_max 3.2668493430789716 distance-from-start_mean 3.2668493430789716 distance-from-start_median 3.2668493430789716 distance-from-start_min 3.2668493430789716 driven_any_max 5.803361618445096 driven_any_mean 5.803361618445096 driven_any_median 5.803361618445096 driven_any_min 5.803361618445096 driven_lanedir_consec_max 5.795272886866324 driven_lanedir_consec_mean 5.795272886866324 driven_lanedir_consec_min 5.795272886866324 driven_lanedir_max 5.795272886866324 driven_lanedir_mean 5.795272886866324 driven_lanedir_median 5.795272886866324 driven_lanedir_min 5.795272886866324 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.803361618445096, "survival_time": 59.99999999999873, "driven_lanedir": 5.795272886866324, "in-drivable-lane": 0.0, "deviation-heading": 1.7039527742064555, "distance-from-start": 3.2668493430789716, "deviation-center-line": 0.18526753481713515, "driven_lanedir_consec": 5.795272886866324}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5312485Bea Baselines baseline-simple-yield aido-LFP-state-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 20:35:41+00:00 2021-10-31 20:37:19+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.450000000000056 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.239051419614633 deviation-center-line_median 0.0997629919452237
other stats deviation-center-line_max 0.0997629919452237 deviation-center-line_mean 0.0997629919452237 deviation-center-line_min 0.0997629919452237 deviation-heading_max 0.96870438500335 deviation-heading_mean 0.96870438500335 deviation-heading_median 0.96870438500335 deviation-heading_min 0.96870438500335 distance-from-start_max 1.2390725918040948 distance-from-start_mean 1.2390725918040948 distance-from-start_median 1.2390725918040948 distance-from-start_min 1.2390725918040948 driven_any_max 1.2494632844349631 driven_any_mean 1.2494632844349631 driven_any_median 1.2494632844349631 driven_any_min 1.2494632844349631 driven_lanedir_consec_max 1.239051419614633 driven_lanedir_consec_mean 1.239051419614633 driven_lanedir_consec_min 1.239051419614633 driven_lanedir_max 1.239051419614633 driven_lanedir_mean 1.239051419614633 driven_lanedir_median 1.239051419614633 driven_lanedir_min 1.239051419614633 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 1.2494632844349631, "survival_time": 13.450000000000056, "driven_lanedir": 1.239051419614633, "in-drivable-lane": 0.0, "deviation-heading": 0.96870438500335, "distance-from-start": 1.2390725918040948, "deviation-center-line": 0.0997629919452237, "driven_lanedir_consec": 1.239051419614633}}simulation-passed 1 survival_time_max 13.450000000000056 survival_time_mean 13.450000000000056 survival_time_min 13.450000000000056
No reset possible 5307486Bea Baselines minimal-agent aido-LFV_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 20:32:25+00:00 2021-10-31 20:35:27+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.699999999999989 in-drivable-lane_median 5.124999999999994 driven_lanedir_consec_median 0.3534980472911704 deviation-center-line_median 0.31473998602704023
other stats deviation-center-line_max 1.1167880744707592 deviation-center-line_mean 0.4679858397779584 deviation-center-line_min 0.1256753125869936 deviation-heading_max 2.483401077481458 deviation-heading_mean 1.59686418028581 deviation-heading_median 1.5781230863572229 deviation-heading_min 0.7478094709473372 distance-from-start_max 1.2661028531770575 distance-from-start_mean 0.9500582944506836 distance-from-start_median 1.0055183306038733 distance-from-start_min 0.5230936634179303 driven_any_max 1.2661876874339428 driven_any_mean 0.9501035001353118 driven_any_median 1.0055609346511667 driven_any_min 0.5231044438049705 driven_lanedir_consec_max 0.7375228777305465 driven_lanedir_consec_mean 0.4010538260367736 driven_lanedir_consec_min 0.15969633183420706 driven_lanedir_max 0.7375228777305465 driven_lanedir_mean 0.4010538260367736 driven_lanedir_median 0.3534980472911704 driven_lanedir_min 0.15969633183420706 in-drivable-lane_max 7.2499999999999885 in-drivable-lane_mean 4.374999999999994 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.9347451682894408, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566112, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955005044754337}, "loop-000-ego1": {"driven_any": 1.2661876874339428, "survival_time": 8.699999999999989, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473372, "distance-from-start": 1.2661028531770575, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969633183420706}, "loop-000-ego2": {"driven_any": 0.5231044438049705, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441347974, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077481458, "distance-from-start": 0.5230936634179303, "deviation-center-line": 1.1167880744707592, "driven_lanedir_consec": 0.5074460441347974}, "loop-000-ego3": {"driven_any": 1.0763767010128928, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777305465, "in-drivable-lane": 3.3, "deviation-heading": 2.207424217156399, "distance-from-start": 1.0763222871511355, "deviation-center-line": 0.4938550612758114, "driven_lanedir_consec": 0.7375228777305465}}simulation-passed 1 survival_time_max 8.699999999999989 survival_time_mean 8.699999999999989 survival_time_min 8.699999999999989
No reset possible 5300487Bea Baselines minimal-agent aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-012021-10-31 20:30:28+00:00 2021-10-31 20:32:04+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.700000000000044 in-drivable-lane_median 9.40000000000005 driven_lanedir_consec_median 0.33122977762117056 deviation-center-line_median 0.2697354450181819
other stats deviation-center-line_max 0.2697354450181819 deviation-center-line_mean 0.2697354450181819 deviation-center-line_min 0.2697354450181819 deviation-heading_max 2.5383505748046193 deviation-heading_mean 2.5383505748046193 deviation-heading_median 2.5383505748046193 deviation-heading_min 2.5383505748046193 distance-from-start_max 1.9240493840830373 distance-from-start_mean 1.9240493840830373 distance-from-start_median 1.9240493840830373 distance-from-start_min 1.9240493840830373 driven_any_max 1.9241954407136783 driven_any_mean 1.9241954407136783 driven_any_median 1.9241954407136783 driven_any_min 1.9241954407136783 driven_lanedir_consec_max 0.33122977762117056 driven_lanedir_consec_mean 0.33122977762117056 driven_lanedir_consec_min 0.33122977762117056 driven_lanedir_max 0.33122977762117056 driven_lanedir_mean 0.33122977762117056 driven_lanedir_median 0.33122977762117056 driven_lanedir_min 0.33122977762117056 in-drivable-lane_max 9.40000000000005 in-drivable-lane_mean 9.40000000000005 in-drivable-lane_min 9.40000000000005 per-episodes details {"loop2-000-ego0": {"driven_any": 1.9241954407136783, "survival_time": 12.700000000000044, "driven_lanedir": 0.33122977762117056, "in-drivable-lane": 9.40000000000005, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9240493840830373, "deviation-center-line": 0.2697354450181819, "driven_lanedir_consec": 0.33122977762117056}}simulation-passed 1 survival_time_max 12.700000000000044 survival_time_mean 12.700000000000044 survival_time_min 12.700000000000044
No reset possible 5281481Bea Baselines baseline-simple-yield aido-LFVI-state-sim-testingsim-1of4 success no gpu-staging-spot-0-012021-10-31 20:20:53+00:00 2021-10-31 20:30:14+00:00 0:09:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.619340458553207 deviation-center-line_median 0.29362362810082904
other stats deviation-center-line_max 0.29362362810082904 deviation-center-line_mean 0.29362362810082904 deviation-center-line_min 0.29362362810082904 deviation-heading_max 2.404267084079743 deviation-heading_mean 2.404267084079743 deviation-heading_median 2.404267084079743 deviation-heading_min 2.404267084079743 distance-from-start_max 2.3421142281734313 distance-from-start_mean 2.3421142281734313 distance-from-start_median 2.3421142281734313 distance-from-start_min 2.3421142281734313 driven_any_max 4.634748572927819 driven_any_mean 4.634748572927819 driven_any_median 4.634748572927819 driven_any_min 4.634748572927819 driven_lanedir_consec_max 4.619340458553207 driven_lanedir_consec_mean 4.619340458553207 driven_lanedir_consec_min 4.619340458553207 driven_lanedir_max 4.6193404722652875 driven_lanedir_mean 4.6193404722652875 driven_lanedir_median 4.6193404722652875 driven_lanedir_min 4.6193404722652875 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 4.634748572927819, "survival_time": 59.99999999999873, "driven_lanedir": 4.6193404722652875, "in-drivable-lane": 0.0, "deviation-heading": 2.404267084079743, "distance-from-start": 2.3421142281734313, "deviation-center-line": 0.29362362810082904, "driven_lanedir_consec": 4.619340458553207}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5277493Bea Baselines minimal-agent aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-012021-10-31 20:18:29+00:00 2021-10-31 20:20:19+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.949999999999994 in-drivable-lane_median 2.324999999999993 driven_lanedir_consec_median 0.1871224013646781 deviation-center-line_median 0.15552364466166196
other stats deviation-center-line_max 0.20320919013322583 deviation-center-line_mean 0.15552364466166196 deviation-center-line_min 0.10783809919009804 deviation-heading_max 0.9508048428349386 deviation-heading_mean 0.7622210804954066 deviation-heading_median 0.7622210804954066 deviation-heading_min 0.5736373181558745 distance-from-start_max 0.4813616860528347 distance-from-start_mean 0.481361686052834 distance-from-start_median 0.481361686052834 distance-from-start_min 0.4813616860528333 driven_any_max 0.4813712171148974 driven_any_mean 0.48137121711489705 driven_any_median 0.48137121711489705 driven_any_min 0.4813712171148967 driven_lanedir_consec_max 0.2375799978131203 driven_lanedir_consec_mean 0.1871224013646781 driven_lanedir_consec_min 0.13666480491623578 driven_lanedir_max 0.2375799978131203 driven_lanedir_mean 0.1871224013646781 driven_lanedir_median 0.1871224013646781 driven_lanedir_min 0.13666480491623578 in-drivable-lane_max 2.5499999999999936 in-drivable-lane_mean 2.324999999999993 in-drivable-lane_min 2.099999999999993 per-episodes details {"loop2-000-ego0": {"driven_any": 0.4813712171148974, "survival_time": 3.949999999999994, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4813616860528333, "deviation-center-line": 0.10783809919009804, "driven_lanedir_consec": 0.13666480491623578}, "loop2-000-ego1": {"driven_any": 0.4813712171148967, "survival_time": 3.949999999999994, "driven_lanedir": 0.2375799978131203, "in-drivable-lane": 2.099999999999993, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.4813616860528347, "deviation-center-line": 0.20320919013322583, "driven_lanedir_consec": 0.2375799978131203}}simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 3.949999999999994 survival_time_min 3.949999999999994
No reset possible 5268475Bea Baselines baseline-simple-yield aido-LFVI-state-sim-validationsim-1of4 success no gpu-staging-spot-0-012021-10-31 20:08:43+00:00 2021-10-31 20:18:01+00:00 0:09:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.3684768253684605 deviation-center-line_median 0.26341057846251453
other stats deviation-center-line_max 0.26341057846251453 deviation-center-line_mean 0.26341057846251453 deviation-center-line_min 0.26341057846251453 deviation-heading_max 2.2732184433064777 deviation-heading_mean 2.2732184433064777 deviation-heading_median 2.2732184433064777 deviation-heading_min 2.2732184433064777 distance-from-start_max 0.3686479402497791 distance-from-start_mean 0.3686479402497791 distance-from-start_median 0.3686479402497791 distance-from-start_min 0.3686479402497791 driven_any_max 0.3741734844735202 driven_any_mean 0.3741734844735202 driven_any_median 0.3741734844735202 driven_any_min 0.3741734844735202 driven_lanedir_consec_max 0.3684768253684605 driven_lanedir_consec_mean 0.3684768253684605 driven_lanedir_consec_min 0.3684768253684605 driven_lanedir_max 0.3684768253684605 driven_lanedir_mean 0.3684768253684605 driven_lanedir_median 0.3684768253684605 driven_lanedir_min 0.3684768253684605 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.3741734844735202, "survival_time": 59.99999999999873, "driven_lanedir": 0.3684768253684605, "in-drivable-lane": 0.0, "deviation-heading": 2.2732184433064777, "distance-from-start": 0.3686479402497791, "deviation-center-line": 0.26341057846251453, "driven_lanedir_consec": 0.3684768253684605}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5254480Bea Baselines baseline-simple-yield aido-LFVI_multi-state-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 19:58:37+00:00 2021-10-31 20:08:22+00:00 0:09:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3396682743607817 deviation-center-line_median 0.47467850444644666
other stats deviation-center-line_max 2.7624735124851627 deviation-center-line_mean 0.9837388055255328 deviation-center-line_min 0.22312470072407511 deviation-heading_max 37.82293240559152 deviation-heading_mean 12.027592251390926 deviation-heading_median 4.152980159928612 deviation-heading_min 1.9814762801149592 distance-from-start_max 2.493583137044009 distance-from-start_mean 1.23889774392311 distance-from-start_median 1.2310039193242155 distance-from-start_min 2.220446049250313e-16 driven_any_max 5.800963325947782 driven_any_mean 2.6242223629299586 driven_any_median 2.3479630628858925 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 5.788647556544016 driven_lanedir_consec_mean 2.6169960263163947 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.788647556544016 driven_lanedir_mean 2.6169960263163947 driven_lanedir_median 2.3396682743607817 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 4.695926125771519, "survival_time": 59.99999999999873, "driven_lanedir": 4.6793365487215635, "in-drivable-lane": 0.0, "deviation-heading": 3.6538476930540615, "distance-from-start": 2.493583137044009, "deviation-center-line": 0.6128395606196001, "driven_lanedir_consec": 4.6793365487215635}, "4way-000-ego1": {"driven_any": 5.800963325947782, "survival_time": 59.99999999999873, "driven_lanedir": 5.788647556544016, "in-drivable-lane": 0.0, "deviation-heading": 1.9814762801149592, "distance-from-start": 2.462007838648431, "deviation-center-line": 0.3365174482732932, "driven_lanedir_consec": 5.788647556544016}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803163, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.22312470072407511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624735124851627, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5251491Bea Baselines minimal-agent aido-LF-sim-validationsim-2of4 success no gpu-staging-spot-0-012021-10-31 19:56:51+00:00 2021-10-31 19:58:17+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19694617160956465 survival_time_median 6.199999999999986 deviation-center-line_median 0.12539055697768176 in-drivable-lane_median 4.449999999999985
other stats deviation-center-line_max 0.12539055697768176 deviation-center-line_mean 0.12539055697768176 deviation-center-line_min 0.12539055697768176 deviation-heading_max 0.9520924629376072 deviation-heading_mean 0.9520924629376072 deviation-heading_median 0.9520924629376072 deviation-heading_min 0.9520924629376072 distance-from-start_max 0.8501561575907637 distance-from-start_mean 0.8501561575907637 distance-from-start_median 0.8501561575907637 distance-from-start_min 0.8501561575907637 driven_any_max 0.8502902342720478 driven_any_mean 0.8502902342720478 driven_any_median 0.8502902342720478 driven_any_min 0.8502902342720478 driven_lanedir_consec_max 0.19694617160956465 driven_lanedir_consec_mean 0.19694617160956465 driven_lanedir_consec_min 0.19694617160956465 driven_lanedir_max 0.19694617160956465 driven_lanedir_mean 0.19694617160956465 driven_lanedir_median 0.19694617160956465 driven_lanedir_min 0.19694617160956465 in-drivable-lane_max 4.449999999999985 in-drivable-lane_mean 4.449999999999985 in-drivable-lane_min 4.449999999999985 per-episodes details {"loop-000-ego0": {"driven_any": 0.8502902342720478, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376072, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}simulation-passed 1 survival_time_max 6.199999999999986 survival_time_mean 6.199999999999986 survival_time_min 6.199999999999986
No reset possible 5247492Bea Baselines minimal-agent aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 19:55:21+00:00 2021-10-31 19:56:39+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5230484Bea Baselines baseline-simple-yield aido-LFV-state-sim-testingsim-2of4 success no gpu-staging-spot-0-012021-10-31 19:47:31+00:00 2021-10-31 19:55:14+00:00 0:07:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.823620228930529 deviation-center-line_median 0.3618127573828305
other stats deviation-center-line_max 0.3618127573828305 deviation-center-line_mean 0.3618127573828305 deviation-center-line_min 0.3618127573828305 deviation-heading_max 2.729795565656188 deviation-heading_mean 2.729795565656188 deviation-heading_median 2.729795565656188 deviation-heading_min 2.729795565656188 distance-from-start_max 1.9492246701212408 distance-from-start_mean 1.9492246701212408 distance-from-start_median 1.9492246701212408 distance-from-start_min 1.9492246701212408 driven_any_max 4.8406264605922145 driven_any_mean 4.8406264605922145 driven_any_median 4.8406264605922145 driven_any_min 4.8406264605922145 driven_lanedir_consec_max 4.823620228930529 driven_lanedir_consec_mean 4.823620228930529 driven_lanedir_consec_min 4.823620228930529 driven_lanedir_max 4.823620228930529 driven_lanedir_mean 4.823620228930529 driven_lanedir_median 4.823620228930529 driven_lanedir_min 4.823620228930529 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 4.8406264605922145, "survival_time": 59.99999999999873, "driven_lanedir": 4.823620228930529, "in-drivable-lane": 0.0, "deviation-heading": 2.729795565656188, "distance-from-start": 1.9492246701212408, "deviation-center-line": 0.3618127573828305, "driven_lanedir_consec": 4.823620228930529}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5225477Bea Baselines baseline-simple-yield aido-LFP-state-sim-validationsim-3of4 success no gpu-staging-spot-0-012021-10-31 19:44:20+00:00 2021-10-31 19:47:24+00:00 0:03:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.20000000000025 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.8824305480707815 deviation-center-line_median 0.24998323712819964
other stats deviation-center-line_max 0.24998323712819964 deviation-center-line_mean 0.24998323712819964 deviation-center-line_min 0.24998323712819964 deviation-heading_max 2.0191141438882525 deviation-heading_mean 2.0191141438882525 deviation-heading_median 2.0191141438882525 deviation-heading_min 2.0191141438882525 distance-from-start_max 2.3237448100281095 distance-from-start_mean 2.3237448100281095 distance-from-start_median 2.3237448100281095 distance-from-start_min 2.3237448100281095 driven_any_max 2.893646045198969 driven_any_mean 2.893646045198969 driven_any_median 2.893646045198969 driven_any_min 2.893646045198969 driven_lanedir_consec_max 2.8824305480707815 driven_lanedir_consec_mean 2.8824305480707815 driven_lanedir_consec_min 2.8824305480707815 driven_lanedir_max 2.8824305480707815 driven_lanedir_mean 2.8824305480707815 driven_lanedir_median 2.8824305480707815 driven_lanedir_min 2.8824305480707815 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.893646045198969, "survival_time": 33.20000000000025, "driven_lanedir": 2.8824305480707815, "in-drivable-lane": 0.0, "deviation-heading": 2.0191141438882525, "distance-from-start": 2.3237448100281095, "deviation-center-line": 0.24998323712819964, "driven_lanedir_consec": 2.8824305480707815}}simulation-passed 1 survival_time_max 33.20000000000025 survival_time_mean 33.20000000000025 survival_time_min 33.20000000000025
No reset possible 5213544Bea Baselines baseline-dagger-pytorch aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-012021-10-31 19:37:47+00:00 2021-10-31 19:44:06+00:00 0:06:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.012352882155700629 deviation-center-line_median 0.006326182422549555
other stats deviation-center-line_max 0.006326182422549555 deviation-center-line_mean 0.006326182422549555 deviation-center-line_min 0.006326182422549555 deviation-heading_max 0.2381344933511698 deviation-heading_mean 0.2381344933511698 deviation-heading_median 0.2381344933511698 deviation-heading_min 0.2381344933511698 distance-from-start_max 0.013397842089698898 distance-from-start_mean 0.013397842089698898 distance-from-start_median 0.013397842089698898 distance-from-start_min 0.013397842089698898 driven_any_max 0.013443182547218805 driven_any_mean 0.013443182547218805 driven_any_median 0.013443182547218805 driven_any_min 0.013443182547218805 driven_lanedir_consec_max 0.012352882155700629 driven_lanedir_consec_mean 0.012352882155700629 driven_lanedir_consec_min 0.012352882155700629 driven_lanedir_max 0.012352882155700629 driven_lanedir_mean 0.012352882155700629 driven_lanedir_median 0.012352882155700629 driven_lanedir_min 0.012352882155700629 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.013443182547218805, "survival_time": 0.49999999999999994, "driven_lanedir": 0.012352882155700629, "in-drivable-lane": 0.0, "deviation-heading": 0.2381344933511698, "distance-from-start": 0.013397842089698898, "deviation-center-line": 0.006326182422549555, "driven_lanedir_consec": 0.012352882155700629}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 5197590Bea Baselines challenge-aido_LF-template-tensorflow:daffy-staging:c1e9f7599eed6f6348c02260cf5c2b3cecd13e36 aido-hello-sim-validationsanity-check failed no gpu-staging-spot-0-012021-10-31 13:39:26+00:00 2021-10-31 13:40:22+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5193600Liam Paull template-tensorflow aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-012021-10-31 13:33:09+00:00 2021-10-31 13:38:59+00:00 0:05:50 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Bea Baselines 🐤
Andrea Daniele
Liam Paull