Evaluator 135

sim-4of5

success

yes

aido-LFV-sim-validation

2022-11-30 12:58:59+00:00

2022-11-30 13:08:00+00:00

0:09:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.668917750556934e-17

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.668917750556934e-17
distance-from-start_median	5.668917750556934e-17
distance-from-start_min	5.668917750556934e-17
driven_any_max	6.802701300668135e-14
driven_any_mean	6.802701300668135e-14
driven_any_median	6.802701300668135e-14
driven_any_min	6.802701300668135e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17240

387

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

yes

2022-11-29 14:31:17+00:00

2022-11-29 14:53:13+00:00

0:21:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	27.349999999998943
driven_lanedir_consec_median	-2.208278780698058
deviation-center-line_median	3.1274717244018553

other stats

deviation-center-line_max	3.1274717244018553
deviation-center-line_mean	3.1274717244018553
deviation-center-line_min	3.1274717244018553
deviation-heading_max	23.145833022185233
deviation-heading_mean	23.145833022185233
deviation-heading_median	23.145833022185233
deviation-heading_min	23.145833022185233
distance-from-start_max	0.3346939981099261
distance-from-start_mean	0.3346939981099261
distance-from-start_median	0.3346939981099261
distance-from-start_min	0.3346939981099261
driven_any_max	12.963742779376927
driven_any_mean	12.963742779376927
driven_any_median	12.963742779376927
driven_any_min	12.963742779376927
driven_lanedir_consec_max	-2.208278780698058
driven_lanedir_consec_mean	-2.208278780698058
driven_lanedir_consec_min	-2.208278780698058
driven_lanedir_max	-4.708754854438169
driven_lanedir_mean	-4.708754854438169
driven_lanedir_median	-4.708754854438169
driven_lanedir_min	-4.708754854438169
in-drivable-lane_max	27.349999999998943
in-drivable-lane_mean	27.349999999998943
in-drivable-lane_min	27.349999999998943
per-episodes	details {"zigzag-000-ego0": {"driven_any": 12.963742779376927, "survival_time": 59.99999999999873, "driven_lanedir": -4.708754854438169, "in-drivable-lane": 27.349999999998943, "deviation-heading": 23.145833022185233, "distance-from-start": 0.3346939981099261, "deviation-center-line": 3.1274717244018553, "driven_lanedir_consec": -2.208278780698058}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17235

388

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-1of4

host-error

yes

2022-11-29 14:29:16+00:00

2022-11-29 14:30:56+00:00

0:01:40

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17231

388

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

host-error

yes

2022-11-29 14:26:58+00:00

2022-11-29 14:28:45+00:00

0:01:47

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17226

388

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

yes

2022-11-29 14:25:05+00:00

2022-11-29 14:26:44+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17221

389

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

success

yes

2022-11-29 14:23:05+00:00

2022-11-29 14:24:46+00:00

0:01:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17217

390

Bea Baselines 🐤

baseline-RL-sim-pytorch

aido-LF-sim-validation

sim-0of4

host-error

yes

aido-LFVI_multi-sim-validation

2022-11-29 14:21:42+00:00

2022-11-29 14:22:39+00:00

0:00:57

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17212

391

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

host-error

yes

2022-11-29 14:19:46+00:00

2022-11-29 14:21:14+00:00

0:01:28

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17207

389

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-2of4

success

yes

2022-11-29 14:17:57+00:00

2022-11-29 14:19:27+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17202

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-3of4

host-error

yes

2022-11-29 14:16:15+00:00

2022-11-29 14:17:31+00:00

0:01:16

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17198

392

Bea Baselines 🐤

baseline-RL-sim-pytorch

sim-0of4

host-error

yes

2022-11-29 14:14:43+00:00

2022-11-29 14:15:55+00:00

0:01:12

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17188

393

Bea Baselines 🐤

baseline-RL-sim-pytorch

aido-LFP-sim-testing

sim-3of4

success

yes

2022-11-29 14:08:05+00:00

2022-11-29 14:14:29+00:00

0:06:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	34.550000000000175
in-drivable-lane_median	15.900000000000068
driven_lanedir_consec_median	-1.7810267003512088
deviation-center-line_median	1.2961630850994792

other stats

deviation-center-line_max	1.2961630850994792
deviation-center-line_mean	1.2961630850994792
deviation-center-line_min	1.2961630850994792
deviation-heading_max	15.881921777618745
deviation-heading_mean	15.881921777618745
deviation-heading_median	15.881921777618745
deviation-heading_min	15.881921777618745
distance-from-start_max	0.1616646415742646
distance-from-start_mean	0.1616646415742646
distance-from-start_median	0.1616646415742646
distance-from-start_min	0.1616646415742646
driven_any_max	6.108845643973642
driven_any_mean	6.108845643973642
driven_any_median	6.108845643973642
driven_any_min	6.108845643973642
driven_lanedir_consec_max	-1.7810267003512088
driven_lanedir_consec_mean	-1.7810267003512088
driven_lanedir_consec_min	-1.7810267003512088
driven_lanedir_max	-1.7810267003512088
driven_lanedir_mean	-1.7810267003512088
driven_lanedir_median	-1.7810267003512088
driven_lanedir_min	-1.7810267003512088
in-drivable-lane_max	15.900000000000068
in-drivable-lane_mean	15.900000000000068
in-drivable-lane_min	15.900000000000068
per-episodes	details {"zigzag-000-ego0": {"driven_any": 6.108845643973642, "survival_time": 34.550000000000175, "driven_lanedir": -1.7810267003512088, "in-drivable-lane": 15.900000000000068, "deviation-heading": 15.881921777618745, "distance-from-start": 0.1616646415742646, "deviation-center-line": 1.2961630850994792, "driven_lanedir_consec": -1.7810267003512088}}
simulation-passed	1
survival_time_max	34.550000000000175
survival_time_mean	34.550000000000175
survival_time_min	34.550000000000175

No reset possible

17170

396

Bea Baselines 🐤

baseline-RL-sim-pytorch

aido-LFI-sim-testing

sim-1of4

success

yes

2022-11-29 13:56:43+00:00

2022-11-29 14:07:39+00:00

0:10:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	30.699999999999292
driven_lanedir_consec_median	-3.1355637001281074
deviation-center-line_median	2.934952938872135

other stats

deviation-center-line_max	2.934952938872135
deviation-center-line_mean	2.934952938872135
deviation-center-line_min	2.934952938872135
deviation-heading_max	25.552279669740106
deviation-heading_mean	25.552279669740106
deviation-heading_median	25.552279669740106
deviation-heading_min	25.552279669740106
distance-from-start_max	0.1627029550076341
distance-from-start_mean	0.1627029550076341
distance-from-start_median	0.1627029550076341
distance-from-start_min	0.1627029550076341
driven_any_max	11.605809475307318
driven_any_mean	11.605809475307318
driven_any_median	11.605809475307318
driven_any_min	11.605809475307318
driven_lanedir_consec_max	-3.1355637001281074
driven_lanedir_consec_mean	-3.1355637001281074
driven_lanedir_consec_min	-3.1355637001281074
driven_lanedir_max	-3.1355637001281074
driven_lanedir_mean	-3.1355637001281074
driven_lanedir_median	-3.1355637001281074
driven_lanedir_min	-3.1355637001281074
in-drivable-lane_max	30.699999999999292
in-drivable-lane_mean	30.699999999999292
in-drivable-lane_min	30.699999999999292
per-episodes	details {"udem1-000-ego0": {"driven_any": 11.605809475307318, "survival_time": 59.99999999999873, "driven_lanedir": -3.1355637001281074, "in-drivable-lane": 30.699999999999292, "deviation-heading": 25.552279669740106, "distance-from-start": 0.1627029550076341, "deviation-center-line": 2.934952938872135, "driven_lanedir_consec": -3.1355637001281074}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17161

514

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

yes

2022-11-29 13:55:00+00:00

2022-11-29 13:56:12+00:00

0:01:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17153

517

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

yes

2022-11-29 13:52:50+00:00

2022-11-29 13:54:25+00:00

0:01:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17144

518

Bea Baselines 🐤

baseline-behavior-cloning

sim-2of4

success

yes

aido-LFVI_multi-sim-validation

2022-11-29 13:50:57+00:00

2022-11-29 13:52:30+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17136

520

Bea Baselines 🐤

baseline-behavior-cloning

sim-1of4

failed

yes

2022-11-29 13:49:36+00:00

2022-11-29 13:50:50+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17130

522

Bea Baselines 🐤

baseline-behavior-cloning

aido-LFP-sim-testing

sim-1of4

failed

yes

2022-11-29 13:48:28+00:00

2022-11-29 13:49:22+00:00

0:00:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17122

524

Bea Baselines 🐤

baseline-behavior-cloning

aido-LFVI-sim-testing

sim-1of4

failed

yes

aido-LFVI_multi-sim-testing

2022-11-29 13:46:33+00:00

2022-11-29 13:48:09+00:00

0:01:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17116

527

Bea Baselines 🐤

baseline-behavior-cloning

sim-0of4

failed

yes

2022-11-29 13:44:54+00:00

2022-11-29 13:46:26+00:00

0:01:32

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17110

528

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

failed

yes

aido-LFP-sim-validation

2022-11-29 13:43:11+00:00

2022-11-29 13:44:31+00:00

0:01:20

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17106

529

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

failed

yes

2022-11-29 13:41:52+00:00

2022-11-29 13:42:51+00:00

0:00:59

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17100

531

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

failed

yes

2022-11-29 13:39:59+00:00

2022-11-29 13:41:31+00:00

0:01:32

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17096

532

Bea Baselines 🐤

baseline-dagger-pytorch

sim-0of4

failed

yes

2022-11-29 13:38:18+00:00

2022-11-29 13:39:47+00:00

0:01:29

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17094

533

Bea Baselines 🐤

baseline-dagger-pytorch

aido-LF-sim-validation

sim-3of4

failed

yes

aido-LFVI_multi-sim-validation

2022-11-29 13:37:09+00:00

2022-11-29 13:38:05+00:00

0:00:56

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17088

534

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

success

yes

2022-11-29 13:35:36+00:00

2022-11-29 13:36:51+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17083

535

Bea Baselines 🐤

baseline-dagger-pytorch

sim-3of4

failed

yes

2022-11-29 13:33:56+00:00

2022-11-29 13:35:02+00:00

0:01:06

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17081

535

Bea Baselines 🐤

baseline-dagger-pytorch

sim-2of4

failed

yes

2022-11-29 13:32:31+00:00

2022-11-29 13:33:36+00:00

0:01:05

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

17059

541

Bea Baselines 🐤

baseline-dagger-pytorch

aido-LF-sim-testing

sim-0of4

success

yes

aido-hello-sim-validation

2022-11-29 13:20:42+00:00

2022-11-29 13:32:18+00:00

0:11:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.224086897557136
survival_time_median	59.99999999999873
deviation-center-line_median	2.816030773064013
in-drivable-lane_median	1.249999999999929

other stats

deviation-center-line_max	2.816030773064013
deviation-center-line_mean	2.816030773064013
deviation-center-line_min	2.816030773064013
deviation-heading_max	12.623518823609292
deviation-heading_mean	12.623518823609292
deviation-heading_median	12.623518823609292
deviation-heading_min	12.623518823609292
distance-from-start_max	2.8983115115864795
distance-from-start_mean	2.8983115115864795
distance-from-start_median	2.8983115115864795
distance-from-start_min	2.8983115115864795
driven_any_max	9.794819266071189
driven_any_mean	9.794819266071189
driven_any_median	9.794819266071189
driven_any_min	9.794819266071189
driven_lanedir_consec_max	9.224086897557136
driven_lanedir_consec_mean	9.224086897557136
driven_lanedir_consec_min	9.224086897557136
driven_lanedir_max	9.224086897557136
driven_lanedir_mean	9.224086897557136
driven_lanedir_median	9.224086897557136
driven_lanedir_min	9.224086897557136
in-drivable-lane_max	1.249999999999929
in-drivable-lane_mean	1.249999999999929
in-drivable-lane_min	1.249999999999929
per-episodes	details {"autolab-000-ego0": {"driven_any": 9.794819266071189, "survival_time": 59.99999999999873, "driven_lanedir": 9.224086897557136, "in-drivable-lane": 1.249999999999929, "deviation-heading": 12.623518823609292, "distance-from-start": 2.8983115115864795, "deviation-center-line": 2.816030773064013, "driven_lanedir_consec": 9.224086897557136}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17053

765

Bea Baselines 🐤

challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802

sanity-check

success

yes

aido-hello-sim-validation

2022-11-29 13:18:25+00:00

2022-11-29 13:20:24+00:00

0:01:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.022468268502921163
deviation-center-line_median	0.005240505528479328

other stats

deviation-center-line_max	0.005240505528479328
deviation-center-line_mean	0.005240505528479328
deviation-center-line_min	0.005240505528479328
deviation-heading_max	0.29478439373500653
deviation-heading_mean	0.29478439373500653
deviation-heading_median	0.29478439373500653
deviation-heading_min	0.29478439373500653
distance-from-start_max	0.028162894336858504
distance-from-start_mean	0.028162894336858504
distance-from-start_median	0.028162894336858504
distance-from-start_min	0.028162894336858504
driven_any_max	0.028243404956832228
driven_any_mean	0.028243404956832228
driven_any_median	0.028243404956832228
driven_any_min	0.028243404956832228
driven_lanedir_consec_max	0.022468268502921163
driven_lanedir_consec_mean	0.022468268502921163
driven_lanedir_consec_min	0.022468268502921163
driven_lanedir_max	0.022468268502921163
driven_lanedir_mean	0.022468268502921163
driven_lanedir_median	0.022468268502921163
driven_lanedir_min	0.022468268502921163
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.028243404956832228, "survival_time": 0.49999999999999994, "driven_lanedir": 0.022468268502921163, "in-drivable-lane": 0.0, "deviation-heading": 0.29478439373500653, "distance-from-start": 0.028162894336858504, "deviation-center-line": 0.005240505528479328, "driven_lanedir_consec": 0.022468268502921163}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

17046

797

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3d

sanity-check

success

yes

aido-hello-sim-validation

2022-11-29 13:16:14+00:00

2022-11-29 13:18:05+00:00

0:01:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.04976153604225919
deviation-center-line_median	0.006527887863951426

other stats

deviation-center-line_max	0.006527887863951426
deviation-center-line_mean	0.006527887863951426
deviation-center-line_min	0.006527887863951426
deviation-heading_max	0.2703592668848383
deviation-heading_mean	0.2703592668848383
deviation-heading_median	0.2703592668848383
deviation-heading_min	0.2703592668848383
distance-from-start_max	0.05808520229604176
distance-from-start_mean	0.05808520229604176
distance-from-start_median	0.05808520229604176
distance-from-start_min	0.05808520229604176
driven_any_max	0.05808658971291994
driven_any_mean	0.05808658971291994
driven_any_median	0.05808658971291994
driven_any_min	0.05808658971291994
driven_lanedir_consec_max	0.04976153604225919
driven_lanedir_consec_mean	0.04976153604225919
driven_lanedir_consec_min	0.04976153604225919
driven_lanedir_max	0.04976153604225919
driven_lanedir_mean	0.04976153604225919
driven_lanedir_median	0.04976153604225919
driven_lanedir_min	0.04976153604225919
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.05808658971291994, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04976153604225919, "in-drivable-lane": 0.0, "deviation-heading": 0.2703592668848383, "distance-from-start": 0.05808520229604176, "deviation-center-line": 0.006527887863951426, "driven_lanedir_consec": 0.04976153604225919}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

17043

804

Bea Baselines 🐤

challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2

sanity-check

success

yes

2022-11-29 13:14:51+00:00

2022-11-29 13:16:00+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0477594364901206
deviation-center-line_median	0.005682441352304184

other stats

deviation-center-line_max	0.005682441352304184
deviation-center-line_mean	0.005682441352304184
deviation-center-line_min	0.005682441352304184
deviation-heading_max	0.24576707779399895
deviation-heading_mean	0.24576707779399895
deviation-heading_median	0.24576707779399895
deviation-heading_min	0.24576707779399895
distance-from-start_max	0.052519840670766274
distance-from-start_mean	0.052519840670766274
distance-from-start_median	0.052519840670766274
distance-from-start_min	0.052519840670766274
driven_any_max	0.052625239600837016
driven_any_mean	0.052625239600837016
driven_any_median	0.052625239600837016
driven_any_min	0.052625239600837016
driven_lanedir_consec_max	0.0477594364901206
driven_lanedir_consec_mean	0.0477594364901206
driven_lanedir_consec_min	0.0477594364901206
driven_lanedir_max	0.0477594364901206
driven_lanedir_mean	0.0477594364901206
driven_lanedir_median	0.0477594364901206
driven_lanedir_min	0.0477594364901206
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.052625239600837016, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0477594364901206, "in-drivable-lane": 0.0, "deviation-heading": 0.24576707779399895, "distance-from-start": 0.052519840670766274, "deviation-center-line": 0.005682441352304184, "driven_lanedir_consec": 0.0477594364901206}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

17033

1555

Andrea Daniele

exercises_braitenberg

sim-0of5

success

yes

2022-11-29 13:07:37+00:00

2022-11-29 13:14:36+00:00

0:06:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.668917750556934e-17

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.668917750556934e-17
distance-from-start_median	5.668917750556934e-17
distance-from-start_min	5.668917750556934e-17
driven_any_max	6.802701300668135e-14
driven_any_mean	6.802701300668135e-14
driven_any_median	6.802701300668135e-14
driven_any_min	6.802701300668135e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17018

1584

Andrea Censi

exercises_braitenberg

sim-4of5

success

yes

2022-11-29 12:55:22+00:00

2022-11-29 13:07:05+00:00

0:11:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.668917750556934e-17

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.668917750556934e-17
distance-from-start_median	5.668917750556934e-17
distance-from-start_min	5.668917750556934e-17
driven_any_max	6.802701300668135e-14
driven_any_mean	6.802701300668135e-14
driven_any_median	6.802701300668135e-14
driven_any_min	6.802701300668135e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

17010

1602

Andrea Daniele

exercises_braitenberg

sim-1of5

success

yes

2022-11-29 12:53:06+00:00

2022-11-29 12:55:15+00:00

0:02:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

0.6177600080595083

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	0.6177600080595083
distance-from-start_median	0.6177600080595083
distance-from-start_min	0.6177600080595083
driven_any_max	0.6177600080595129
driven_any_mean	0.6177600080595129
driven_any_median	0.6177600080595129
driven_any_min	0.6177600080595129
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	3.899999999999994
in-drivable-lane_mean	3.899999999999994
in-drivable-lane_median	3.899999999999994
in-drivable-lane_min	3.899999999999994
per-episodes	details {"d45-ego0": {"driven_any": 0.6177600080595129, "survival_time": 3.899999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 3.899999999999994, "deviation-heading": 0.0, "distance-from-start": 0.6177600080595083, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	3.899999999999994
survival_time_mean	3.899999999999994
survival_time_median	3.899999999999994
survival_time_min	3.899999999999994

No reset possible

16996

1605

Bea Baselines 🐤

baseline-RPL-ros

sim-2of4

failed

yes

2022-11-29 12:51:17+00:00

2022-11-29 12:52:33+00:00

0:01:16

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16987

1608

Bea Baselines 🐤

baseline-RPL-ros

sim-0of4

failed

yes

aido-LFP-sim-validation

2022-11-29 12:49:32+00:00

2022-11-29 12:50:49+00:00

0:01:17

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16977

1609

Bea Baselines 🐤

baseline-RPL-ros

sim-1of4

failed

yes

2022-11-29 12:47:52+00:00

2022-11-29 12:49:05+00:00

0:01:13

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16970

1622

Bea Baselines 🐤

baseline-RPL-ros

aido-LFVI-sim-testing

sim-1of4

failed

yes

2022-11-29 12:46:09+00:00

2022-11-29 12:47:26+00:00

0:01:17

The container "solut [...]

The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16935

1629

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

yes

2022-11-29 12:34:09+00:00

2022-11-29 12:45:34+00:00

0:11:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8949033835511649

other stats

deviation-center-line_max	0.8949033835511649
deviation-center-line_mean	0.8949033835511649
deviation-center-line_min	0.8949033835511649
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	4.965068306494546e-16
distance-from-start_mean	4.965068306494546e-16
distance-from-start_median	4.965068306494546e-16
distance-from-start_min	4.965068306494546e-16
driven_any_max	5.95808196779335e-13
driven_any_mean	5.95808196779335e-13
driven_any_median	5.95808196779335e-13
driven_any_min	5.95808196779335e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16927

1631

Bea Baselines 🐤

baseline-duckietown-ml

aido-LF-sim-validation

sim-2of4

success

yes

2022-11-29 12:29:27+00:00

2022-11-29 12:33:50+00:00

0:04:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	0.8948975282353535
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.8948975282353535
deviation-center-line_mean	0.8948975282353535
deviation-center-line_min	0.8948975282353535
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	2.482534153247273e-16
distance-from-start_mean	2.482534153247273e-16
distance-from-start_median	2.482534153247273e-16
distance-from-start_min	2.482534153247273e-16
driven_any_max	2.9790409838966753e-13
driven_any_mean	2.9790409838966753e-13
driven_any_median	2.9790409838966753e-13
driven_any_min	2.9790409838966753e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16909

1638

Bea Baselines 🐤

baseline-duckietown-ml

lx22-state-estimation

sim

success

yes

aido-LFVI_multi-sim-testing

2022-11-29 12:13:15+00:00

2022-11-29 12:29:20+00:00

0:16:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.218352815298077
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	2.510227052706017
deviation-center-line_mean	1.2556911097991184
deviation-center-line_min	0.03849346139326115
deviation-heading_max	13.13020219115658
deviation-heading_mean	10.183598661533924
deviation-heading_median	11.981267076309448
deviation-heading_min	5.439326717135747
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	9.5367431640625e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	9.5367431640625e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-zig-zag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 5.439326717135747, "distance-from-start": 0.0, "deviation-center-line": 0.03849346139326115, "driven_lanedir_consec": 0.0}, "LF-zig-zag-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.13020219115658, "distance-from-start": 0.0, "deviation-center-line": 1.218352815298077, "driven_lanedir_consec": 0.0}, "LF-zig-zag-002-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 11.981267076309448, "distance-from-start": 0.0, "deviation-center-line": 2.510227052706017, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16891

1650

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

yes

2022-11-29 11:57:22+00:00

2022-11-29 12:13:08+00:00

0:15:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.5845005055688632

other stats

deviation-center-line_max	3.4684039432595792
deviation-center-line_mean	1.7151303582606574
deviation-center-line_min	0.22311647864532352
deviation-heading_max	40.967332753486254
deviation-heading_mean	25.437951450471505
deviation-heading_median	28.066180210798333
deviation-heading_min	4.652112626803104
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	4.754249828401435e-16
distance-from-start_median	4.702980202497586e-16
distance-from-start_min	3.3306690738754696e-16
driven_any_max	7.536443801682175e-13
driven_any_mean	5.70509979408171e-13
driven_any_median	5.643576242997049e-13
driven_any_min	3.9968028886505635e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.40652749865251137, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 3.4684039432595792, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.22311647864532352, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 2.762473512485215, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16888

1639

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of5

timeout

yes

2022-11-28 21:41:11+00:00

No reset possible

16872

1646

Bea Baselines 🐤

baseline-duckietown-ml

aido-LFV-sim-testing

sim-1of4

host-error

yes

2022-11-28 19:38:32+00:00

2022-11-28 19:46:49+00:00

0:08:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/9ed15dc5ff6fe636500bb761f191bc65197974fdf7910fc8be86881d4498fc65"

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16866

1647

Bea Baselines 🐤

baseline-duckietown-ml

aido-LFVI-sim-testing

sim-2of4

success

yes

2022-11-28 19:36:27+00:00

2022-11-28 19:38:13+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

16857

1649

Bea Baselines 🐤

baseline-duckietown-ml

aido-LF-sim-testing

sim-2of4

success

yes

2022-11-28 19:30:36+00:00

2022-11-28 19:36:13+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	0.4065274986524565
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.4065274986524565
deviation-center-line_mean	0.4065274986524565
deviation-center-line_min	0.4065274986524565
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16823

1658

Bea Baselines 🐤

baseline-duckietown

sim-3of4

success

yes

2022-11-28 19:04:51+00:00

2022-11-28 19:30:15+00:00

0:25:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	8.94999999999985
driven_lanedir_consec_median	1.8790072779544136
deviation-center-line_median	4.284993412825015

other stats

deviation-center-line_max	5.171183861236073
deviation-center-line_mean	3.4650746727173085
deviation-center-line_min	0.11912800398312937
deviation-heading_max	30.645447081964655
deviation-heading_mean	18.13814240725168
deviation-heading_median	20.16937083151577
deviation-heading_min	1.5683808840105196
distance-from-start_max	2.169490921604256
distance-from-start_mean	1.3551872245635592
distance-from-start_median	1.2230174694286058
distance-from-start_min	0.8052230377927692
driven_any_max	7.91332693935604
driven_any_mean	4.209587957297308
driven_any_median	3.5591903124743496
driven_any_min	1.8066442648844936
driven_lanedir_consec_max	3.1203921984879095
driven_lanedir_consec_mean	1.7696600398151816
driven_lanedir_consec_min	0.20023340486398933
driven_lanedir_max	4.9995345313495
driven_lanedir_mean	2.744525736787367
driven_lanedir_median	2.8891675054679897
driven_lanedir_min	0.20023340486398933
in-drivable-lane_max	57.54999999999873
in-drivable-lane_mean	19.28749999999961
in-drivable-lane_min	1.7000000000000028
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.8066442648844936, "survival_time": 59.99999999999873, "driven_lanedir": 0.20023340486398933, "in-drivable-lane": 57.54999999999873, "deviation-heading": 1.5683808840105196, "distance-from-start": 0.8052230377927692, "deviation-center-line": 0.11912800398312937, "driven_lanedir_consec": 0.20023340486398933}, "zigzag-000-ego1": {"driven_any": 3.5591976208327045, "survival_time": 59.99999999999873, "driven_lanedir": 2.802379565420292, "in-drivable-lane": 2.80000000000004, "deviation-heading": 30.645447081964655, "distance-from-start": 1.326875367110345, "deviation-center-line": 5.171183861236073, "driven_lanedir_consec": 1.5609262641955215}, "zigzag-000-ego2": {"driven_any": 3.559183004115994, "survival_time": 59.99999999999873, "driven_lanedir": 2.975955445515688, "in-drivable-lane": 1.7000000000000028, "deviation-heading": 20.971893574948854, "distance-from-start": 2.169490921604256, "deviation-center-line": 5.031301412547918, "driven_lanedir_consec": 2.197088291713306}, "zigzag-000-ego3": {"driven_any": 7.91332693935604, "survival_time": 59.99999999999873, "driven_lanedir": 4.9995345313495, "in-drivable-lane": 15.09999999999966, "deviation-heading": 19.366848088082687, "distance-from-start": 1.1191595717468663, "deviation-center-line": 3.538685413102113, "driven_lanedir_consec": 3.1203921984879095}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16803

1671

Bea Baselines 🐤

baseline-duckietown

aido-LFV-sim-testing

sim-0of4

success

yes

2022-11-28 18:49:05+00:00

2022-11-28 19:04:33+00:00

0:15:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	50.549999999999265
in-drivable-lane_median	11.749999999999844
driven_lanedir_consec_median	2.715671891898503
deviation-center-line_median	2.1096573215441627

other stats

deviation-center-line_max	2.1096573215441627
deviation-center-line_mean	2.1096573215441627
deviation-center-line_min	2.1096573215441627
deviation-heading_max	12.654416271572138
deviation-heading_mean	12.654416271572138
deviation-heading_median	12.654416271572138
deviation-heading_min	12.654416271572138
distance-from-start_max	2.5152438689991756
distance-from-start_mean	2.5152438689991756
distance-from-start_median	2.5152438689991756
distance-from-start_min	2.5152438689991756
driven_any_max	6.566369031471294
driven_any_mean	6.566369031471294
driven_any_median	6.566369031471294
driven_any_min	6.566369031471294
driven_lanedir_consec_max	2.715671891898503
driven_lanedir_consec_mean	2.715671891898503
driven_lanedir_consec_min	2.715671891898503
driven_lanedir_max	4.546162519766088
driven_lanedir_mean	4.546162519766088
driven_lanedir_median	4.546162519766088
driven_lanedir_min	4.546162519766088
in-drivable-lane_max	11.749999999999844
in-drivable-lane_mean	11.749999999999844
in-drivable-lane_min	11.749999999999844
per-episodes	details {"autolab-000-ego0": {"driven_any": 6.566369031471294, "survival_time": 50.549999999999265, "driven_lanedir": 4.546162519766088, "in-drivable-lane": 11.749999999999844, "deviation-heading": 12.654416271572138, "distance-from-start": 2.5152438689991756, "deviation-center-line": 2.1096573215441627, "driven_lanedir_consec": 2.715671891898503}}
simulation-passed	1
survival_time_max	50.549999999999265
survival_time_mean	50.549999999999265
survival_time_min	50.549999999999265

No reset possible

16796

1673

Bea Baselines 🐤

baseline-duckietown

aido-LFI-sim-testing

sim-2of4

success

yes

2022-11-28 18:46:16+00:00

2022-11-28 18:48:43+00:00

0:02:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

16795

1673

Bea Baselines 🐤

baseline-duckietown

aido-LFI-sim-testing

sim-3of4

success

yes

aido-LFVI_multi-sim-testing

2022-11-28 18:44:21+00:00

2022-11-28 18:45:55+00:00

0:01:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

16792

1675

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

yes

2022-11-28 18:40:58+00:00

2022-11-28 18:42:31+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

16772

1852

Andrea Censi

exercises_braitenberg

sim-3of5

success

yes

aido-LFVI-state-sim-validation

2022-11-28 18:29:24+00:00

2022-11-28 18:40:45+00:00

0:11:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

distance-from-start_mean

5.668917750556934e-17

other stats

deviation-center-line_max	0.0
deviation-center-line_mean	0.0
deviation-center-line_median	0.0
deviation-center-line_min	0.0
deviation-heading_max	0.0
deviation-heading_mean	0.0
deviation-heading_median	0.0
deviation-heading_min	0.0
distance-from-start_max	5.668917750556934e-17
distance-from-start_median	5.668917750556934e-17
distance-from-start_min	5.668917750556934e-17
driven_any_max	6.802701300668135e-14
driven_any_mean	6.802701300668135e-14
driven_any_median	6.802701300668135e-14
driven_any_min	6.802701300668135e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_median	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	59.99999999999873
in-drivable-lane_median	59.99999999999873
in-drivable-lane_min	59.99999999999873
per-episodes	details {"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_median	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16759

1681

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

yes

aido-LF-state-sim-testing

2022-11-28 18:18:16+00:00

2022-11-28 18:29:11+00:00

0:10:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.3318472576969511
deviation-center-line_median	0.6648693526614008

other stats

deviation-center-line_max	0.6648693526614008
deviation-center-line_mean	0.6648693526614008
deviation-center-line_min	0.6648693526614008
deviation-heading_max	4.49371507747449
deviation-heading_mean	4.49371507747449
deviation-heading_median	4.49371507747449
deviation-heading_min	4.49371507747449
distance-from-start_max	1.4319552848600958
distance-from-start_mean	1.4319552848600958
distance-from-start_median	1.4319552848600958
distance-from-start_min	1.4319552848600958
driven_any_max	1.8616750012145875
driven_any_mean	1.8616750012145875
driven_any_median	1.8616750012145875
driven_any_min	1.8616750012145875
driven_lanedir_consec_max	1.3318472576969511
driven_lanedir_consec_mean	1.3318472576969511
driven_lanedir_consec_min	1.3318472576969511
driven_lanedir_max	1.8544941763277367
driven_lanedir_mean	1.8544941763277367
driven_lanedir_median	1.8544941763277367
driven_lanedir_min	1.8544941763277367
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.8616750012145875, "survival_time": 59.99999999999873, "driven_lanedir": 1.8544941763277367, "in-drivable-lane": 0.0, "deviation-heading": 4.49371507747449, "distance-from-start": 1.4319552848600958, "deviation-center-line": 0.6648693526614008, "driven_lanedir_consec": 1.3318472576969511}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16750

1684

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

success

yes

aido-LFI-state-sim-testing

2022-11-28 18:12:59+00:00

2022-11-28 18:17:54+00:00

0:04:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.791208880785928
deviation-center-line_median	0.422779318982871

other stats

deviation-center-line_max	0.422779318982871
deviation-center-line_mean	0.422779318982871
deviation-center-line_min	0.422779318982871
deviation-heading_max	3.5609142078788527
deviation-heading_mean	3.5609142078788527
deviation-heading_median	3.5609142078788527
deviation-heading_min	3.5609142078788527
distance-from-start_max	3.7147561232030184
distance-from-start_mean	3.7147561232030184
distance-from-start_median	3.7147561232030184
distance-from-start_min	3.7147561232030184
driven_any_max	5.812151887501377
driven_any_mean	5.812151887501377
driven_any_median	5.812151887501377
driven_any_min	5.812151887501377
driven_lanedir_consec_max	5.791208880785928
driven_lanedir_consec_mean	5.791208880785928
driven_lanedir_consec_min	5.791208880785928
driven_lanedir_max	5.791208880785928
driven_lanedir_mean	5.791208880785928
driven_lanedir_median	5.791208880785928
driven_lanedir_min	5.791208880785928
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.812151887501377, "survival_time": 59.99999999999873, "driven_lanedir": 5.791208880785928, "in-drivable-lane": 0.0, "deviation-heading": 3.5609142078788527, "distance-from-start": 3.7147561232030184, "deviation-center-line": 0.422779318982871, "driven_lanedir_consec": 5.791208880785928}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16746

1685

Bea Baselines 🐤

baseline-simple-yield

sim-2of4

success

yes

aido-LFVI-state-sim-testing

2022-11-28 18:11:15+00:00

2022-11-28 18:12:53+00:00

0:01:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

16735

1687

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

yes

aido-LFV_multi-full-sim-validation

2022-11-28 18:00:12+00:00

2022-11-28 18:10:55+00:00

0:10:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.40653839040804857

other stats

deviation-center-line_max	0.40653839040804857
deviation-center-line_mean	0.40653839040804857
deviation-center-line_min	0.40653839040804857
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	1.1102230246251563e-16
distance-from-start_mean	1.1102230246251563e-16
distance-from-start_median	1.1102230246251563e-16
distance-from-start_min	1.1102230246251563e-16
driven_any_max	1.3322676295501878e-13
driven_any_mean	1.3322676295501878e-13
driven_any_median	1.3322676295501878e-13
driven_any_min	1.3322676295501878e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16712

1697

Bea Baselines 🐤

minimal-agent-full

sim-1of4

success

yes

aido-LFI-full-sim-validation

2022-11-28 17:43:13+00:00

2022-11-28 17:59:51+00:00

0:16:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.9999999999999822
driven_lanedir_consec_median	3.396874188758651
deviation-center-line_median	6.848336335212338

other stats

deviation-center-line_max	7.516036575940118
deviation-center-line_mean	6.209131018472381
deviation-center-line_min	3.6238148275247304
deviation-heading_max	7.032818929812941
deviation-heading_mean	4.55196967857351
deviation-heading_median	4.199788237499533
deviation-heading_min	2.7754833094820346
distance-from-start_max	2.9834410770695685
distance-from-start_mean	2.4797248726783128
distance-from-start_median	2.446473764157263
distance-from-start_min	2.0425108853291554
driven_any_max	3.579596486578675
driven_any_mean	3.314094256325256
driven_any_median	3.5210921058800326
driven_any_min	2.6345963269622827
driven_lanedir_consec_max	3.551753017565808
driven_lanedir_consec_mean	3.229798941754201
driven_lanedir_consec_min	2.573694371933692
driven_lanedir_max	3.551753017565808
driven_lanedir_mean	3.229798941754201
driven_lanedir_median	3.396874188758651
driven_lanedir_min	2.573694371933692
in-drivable-lane_max	2.9999999999998295
in-drivable-lane_mean	1.2499999999999485
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 2.6345963269622827, "survival_time": 59.99999999999873, "driven_lanedir": 2.573694371933692, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920074235215898, "distance-from-start": 2.0425108853291554, "deviation-center-line": 7.516036575940118, "driven_lanedir_consec": 2.573694371933692}, "loop-000-ego1": {"driven_any": 3.579596486578675, "survival_time": 59.99999999999873, "driven_lanedir": 3.551753017565808, "in-drivable-lane": 0.0, "deviation-heading": 2.7754833094820346, "distance-from-start": 2.724162342686075, "deviation-center-line": 6.299841022357562, "driven_lanedir_consec": 3.551753017565808}, "loop-000-ego2": {"driven_any": 3.5525920285820543, "survival_time": 59.99999999999873, "driven_lanedir": 3.458623985525704, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 7.032818929812941, "distance-from-start": 2.9834410770695685, "deviation-center-line": 3.6238148275247304, "driven_lanedir_consec": 3.458623985525704}, "loop-000-ego3": {"driven_any": 3.489592183178011, "survival_time": 59.99999999999873, "driven_lanedir": 3.335124391991598, "in-drivable-lane": 2.9999999999998295, "deviation-heading": 5.479502239783168, "distance-from-start": 2.168785185628451, "deviation-center-line": 7.396831648067114, "driven_lanedir_consec": 3.335124391991598}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16703

1696

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

yes

aido-LFVI_multi-full-sim-validation

2022-11-28 17:35:09+00:00

2022-11-28 17:42:46+00:00

0:07:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.499999999999858
driven_lanedir_consec_median	2.0645358809359813
deviation-center-line_median	5.566213132905718

other stats

deviation-center-line_max	5.566213132905718
deviation-center-line_mean	5.566213132905718
deviation-center-line_min	5.566213132905718
deviation-heading_max	4.9431426026826735
deviation-heading_mean	4.9431426026826735
deviation-heading_median	4.9431426026826735
deviation-heading_min	4.9431426026826735
distance-from-start_max	1.7331587954302872
distance-from-start_mean	1.7331587954302872
distance-from-start_median	1.7331587954302872
distance-from-start_min	1.7331587954302872
driven_any_max	3.504736975249796
driven_any_mean	3.504736975249796
driven_any_median	3.504736975249796
driven_any_min	3.504736975249796
driven_lanedir_consec_max	2.0645358809359813
driven_lanedir_consec_mean	2.0645358809359813
driven_lanedir_consec_min	2.0645358809359813
driven_lanedir_max	3.3607755978458167
driven_lanedir_mean	3.3607755978458167
driven_lanedir_median	3.3607755978458167
driven_lanedir_min	3.3607755978458167
in-drivable-lane_max	2.499999999999858
in-drivable-lane_mean	2.499999999999858
in-drivable-lane_min	2.499999999999858
per-episodes	details {"4way-000-ego0": {"driven_any": 3.504736975249796, "survival_time": 59.99999999999873, "driven_lanedir": 3.3607755978458167, "in-drivable-lane": 2.499999999999858, "deviation-heading": 4.9431426026826735, "distance-from-start": 1.7331587954302872, "deviation-center-line": 5.566213132905718, "driven_lanedir_consec": 2.0645358809359813}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16689

1698

Bea Baselines 🐤

minimal-agent-full

sim-0of4

timeout

yes

aido-LF-full-sim-validation

2022-11-28 17:23:52+00:00

2022-11-28 17:34:56+00:00

0:11:04

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

16683

1699

Bea Baselines 🐤

minimal-agent-full

sim-1of4

success

yes