Duckietown Challenges Home Challenges Submissions

Evaluator 132

ID132
evaluatordavinci-stage-04-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-04-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success36 16681
# timeout2 16693
# failed9 16945
# error
# aborted
# host-error6 16855
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors97%
RAM total (MB)251.6 GB
RAM free (MB)242.8 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172761859Kathryn Hiteexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-04-6.2.530:08:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
172721858Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-04-6.2.530:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
17245388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:18:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median20.349999999999444
driven_lanedir_consec_median-2.799320110480811
deviation-center-line_median4.106919907625483


other stats
deviation-center-line_max4.106919907625483
deviation-center-line_mean4.106919907625483
deviation-center-line_min4.106919907625483
deviation-heading_max28.94356697267495
deviation-heading_mean28.94356697267495
deviation-heading_median28.94356697267495
deviation-heading_min28.94356697267495
distance-from-start_max0.22053425666131965
distance-from-start_mean0.22053425666131965
distance-from-start_median0.22053425666131965
distance-from-start_min0.22053425666131965
driven_any_max11.052241015164745
driven_any_mean11.052241015164745
driven_any_median11.052241015164745
driven_any_min11.052241015164745
driven_lanedir_consec_max-2.799320110480811
driven_lanedir_consec_mean-2.799320110480811
driven_lanedir_consec_min-2.799320110480811
driven_lanedir_max-2.9924345503586465
driven_lanedir_mean-2.9924345503586465
driven_lanedir_median-2.9924345503586465
driven_lanedir_min-2.9924345503586465
in-drivable-lane_max20.349999999999444
in-drivable-lane_mean20.349999999999444
in-drivable-lane_min20.349999999999444
per-episodes
details{"udem-000-ego0": {"driven_any": 11.052241015164745, "survival_time": 59.99999999999873, "driven_lanedir": -2.9924345503586465, "in-drivable-lane": 20.349999999999444, "deviation-heading": 28.94356697267495, "distance-from-start": 0.22053425666131965, "deviation-center-line": 4.106919907625483, "driven_lanedir_consec": -2.799320110480811}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17219389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.299999999998995
in-drivable-lane_median23.44999999999956
driven_lanedir_consec_median-3.400332046754454
deviation-center-line_median1.999362585995937


other stats
deviation-center-line_max1.999362585995937
deviation-center-line_mean1.999362585995937
deviation-center-line_min1.999362585995937
deviation-heading_max24.0776055155273
deviation-heading_mean24.0776055155273
deviation-heading_median24.0776055155273
deviation-heading_min24.0776055155273
distance-from-start_max0.19816985400807985
distance-from-start_mean0.19816985400807985
distance-from-start_median0.19816985400807985
distance-from-start_min0.19816985400807985
driven_any_max11.31960802972671
driven_any_mean11.31960802972671
driven_any_median11.31960802972671
driven_any_min11.31960802972671
driven_lanedir_consec_max-3.400332046754454
driven_lanedir_consec_mean-3.400332046754454
driven_lanedir_consec_min-3.400332046754454
driven_lanedir_max-4.066140236815472
driven_lanedir_mean-4.066140236815472
driven_lanedir_median-4.066140236815472
driven_lanedir_min-4.066140236815472
in-drivable-lane_max23.44999999999956
in-drivable-lane_mean23.44999999999956
in-drivable-lane_min23.44999999999956
per-episodes
details{"4way-000-ego0": {"driven_any": 11.31960802972671, "survival_time": 55.299999999998995, "driven_lanedir": -4.066140236815472, "in-drivable-lane": 23.44999999999956, "deviation-heading": 24.0776055155273, "distance-from-start": 0.19816985400807985, "deviation-center-line": 1.999362585995937, "driven_lanedir_consec": -3.400332046754454}}
simulation-passed1
survival_time_max55.299999999998995
survival_time_mean55.299999999998995
survival_time_min55.299999999998995
No reset possible
17216392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4host-erroryesdavinci-stage-04-6.2.530:01:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17213390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-0of4host-erroryesdavinci-stage-04-6.2.530:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17209392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4host-erroryesdavinci-stage-04-6.2.530:01:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17205390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4host-erroryesdavinci-stage-04-6.2.530:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17201391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4host-erroryesdavinci-stage-04-6.2.530:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17197391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-04-6.2.530:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17193391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17187395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-04-6.2.530:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.750000000000103
in-drivable-lane_median7.600000000000048
driven_lanedir_consec_median-1.137979933194094
deviation-center-line_median0.35582658130770806


other stats
deviation-center-line_max0.35582658130770806
deviation-center-line_mean0.35582658130770806
deviation-center-line_min0.35582658130770806
deviation-heading_max7.382791271613367
deviation-heading_mean7.382791271613367
deviation-heading_median7.382791271613367
deviation-heading_min7.382791271613367
distance-from-start_max0.16375554270961637
distance-from-start_mean0.16375554270961637
distance-from-start_median0.16375554270961637
distance-from-start_min0.16375554270961637
driven_any_max3.6033348409621095
driven_any_mean3.6033348409621095
driven_any_median3.6033348409621095
driven_any_min3.6033348409621095
driven_lanedir_consec_max-1.137979933194094
driven_lanedir_consec_mean-1.137979933194094
driven_lanedir_consec_min-1.137979933194094
driven_lanedir_max-1.1245351556262426
driven_lanedir_mean-1.1245351556262426
driven_lanedir_median-1.1245351556262426
driven_lanedir_min-1.1245351556262426
in-drivable-lane_max7.600000000000048
in-drivable-lane_mean7.600000000000048
in-drivable-lane_min7.600000000000048
per-episodes
details{"4way-000-ego0": {"driven_any": 3.6033348409621095, "survival_time": 16.750000000000103, "driven_lanedir": -1.1245351556262426, "in-drivable-lane": 7.600000000000048, "deviation-heading": 7.382791271613367, "distance-from-start": 0.16375554270961637, "deviation-center-line": 0.35582658130770806, "driven_lanedir_consec": -1.137979933194094}}
simulation-passed1
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_min16.750000000000103
No reset possible
17180394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-1of4successyesdavinci-stage-04-6.2.530:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median2.8999999999999906
driven_lanedir_consec_median-0.43937585828224446
deviation-center-line_median0.17413298320792647


other stats
deviation-center-line_max0.17413298320792647
deviation-center-line_mean0.17413298320792647
deviation-center-line_min0.17413298320792647
deviation-heading_max4.8204626876476135
deviation-heading_mean4.8204626876476135
deviation-heading_median4.8204626876476135
deviation-heading_min4.8204626876476135
distance-from-start_max0.15665584372659958
distance-from-start_mean0.15665584372659958
distance-from-start_median0.15665584372659958
distance-from-start_min0.15665584372659958
driven_any_max1.360736121976895
driven_any_mean1.360736121976895
driven_any_median1.360736121976895
driven_any_min1.360736121976895
driven_lanedir_consec_max-0.43937585828224446
driven_lanedir_consec_mean-0.43937585828224446
driven_lanedir_consec_min-0.43937585828224446
driven_lanedir_max-0.43937585828224446
driven_lanedir_mean-0.43937585828224446
driven_lanedir_median-0.43937585828224446
driven_lanedir_min-0.43937585828224446
in-drivable-lane_max2.8999999999999906
in-drivable-lane_mean2.8999999999999906
in-drivable-lane_min2.8999999999999906
per-episodes
details{"loop-000-ego0": {"driven_any": 1.360736121976895, "survival_time": 8.09999999999998, "driven_lanedir": -0.43937585828224446, "in-drivable-lane": 2.8999999999999906, "deviation-heading": 4.8204626876476135, "distance-from-start": 0.15665584372659958, "deviation-center-line": 0.17413298320792647, "driven_lanedir_consec": -0.43937585828224446}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
17174514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4failedyesdavinci-stage-04-6.2.530:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17084534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-1of4successyesdavinci-stage-04-6.2.530:23:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.18823274785413
deviation-center-line_median3.1488817939042586


other stats
deviation-center-line_max6.079676766658749
deviation-center-line_mean3.8674087610871006
deviation-center-line_min3.0921946898811363
deviation-heading_max25.403170069714108
deviation-heading_mean16.52787481725155
deviation-heading_median13.665208143412666
deviation-heading_min13.377912912466773
distance-from-start_max3.0410116254742454
distance-from-start_mean2.4899977075264483
distance-from-start_median3.002846735991067
distance-from-start_min0.9132857326494136
driven_any_max10.76702311656624
driven_any_mean8.266905385835223
driven_any_median10.531482394635397
driven_any_min1.23763363750386
driven_lanedir_consec_max9.687196442646384
driven_lanedir_consec_mean7.313077011107574
driven_lanedir_consec_min1.1886461060756517
driven_lanedir_max10.276430674901702
driven_lanedir_mean7.883017354062498
driven_lanedir_median10.03349631763632
driven_lanedir_min1.1886461060756517
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.23763363750386, "survival_time": 59.99999999999873, "driven_lanedir": 1.1886461060756517, "in-drivable-lane": 0.0, "deviation-heading": 25.403170069714108, "distance-from-start": 0.9132857326494136, "deviation-center-line": 6.079676766658749, "driven_lanedir_consec": 1.1886461060756517}, "4way-000-ego1": {"driven_any": 10.76702311656624, "survival_time": 59.99999999999873, "driven_lanedir": 10.276430674901702, "in-drivable-lane": 0.0, "deviation-heading": 13.377912912466773, "distance-from-start": 3.0410116254742454, "deviation-center-line": 3.1846929376182023, "driven_lanedir_consec": 9.687196442646384}, "4way-000-ego2": {"driven_any": 10.71596573818268, "survival_time": 59.99999999999873, "driven_lanedir": 10.229901974322807, "in-drivable-lane": 0.0, "deviation-heading": 13.509534099628958, "distance-from-start": 2.984057375526807, "deviation-center-line": 3.113070650190315, "driven_lanedir_consec": 9.38033844835493}, "4way-000-ego3": {"driven_any": 10.346999051088115, "survival_time": 59.99999999999873, "driven_lanedir": 9.83709066094983, "in-drivable-lane": 0.0, "deviation-heading": 13.820882187196377, "distance-from-start": 3.021636096455327, "deviation-center-line": 3.0921946898811363, "driven_lanedir_consec": 8.99612704735333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17065541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-3of4successyesdavinci-stage-04-6.2.530:12:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.615883420707828
survival_time_median59.99999999999873
deviation-center-line_median3.3817505795370923
in-drivable-lane_median0.9999999999999432


other stats
deviation-center-line_max3.3817505795370923
deviation-center-line_mean3.3817505795370923
deviation-center-line_min3.3817505795370923
deviation-heading_max14.112191151388236
deviation-heading_mean14.112191151388236
deviation-heading_median14.112191151388236
deviation-heading_min14.112191151388236
distance-from-start_max2.8951004509544163
distance-from-start_mean2.8951004509544163
distance-from-start_median2.8951004509544163
distance-from-start_min2.8951004509544163
driven_any_max9.22016015355508
driven_any_mean9.22016015355508
driven_any_median9.22016015355508
driven_any_min9.22016015355508
driven_lanedir_consec_max8.615883420707828
driven_lanedir_consec_mean8.615883420707828
driven_lanedir_consec_min8.615883420707828
driven_lanedir_max8.615883420707828
driven_lanedir_mean8.615883420707828
driven_lanedir_median8.615883420707828
driven_lanedir_min8.615883420707828
in-drivable-lane_max0.9999999999999432
in-drivable-lane_mean0.9999999999999432
in-drivable-lane_min0.9999999999999432
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.22016015355508, "survival_time": 59.99999999999873, "driven_lanedir": 8.615883420707828, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 14.112191151388236, "distance-from-start": 2.8951004509544163, "deviation-center-line": 3.3817505795370923, "driven_lanedir_consec": 8.615883420707828}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17057544Bea Baselines 🐤baseline-dagger-pytorchaido-hello-sim-validationsanity-checksuccessyesdavinci-stage-04-6.2.530:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.03647239073901587
deviation-center-line_median0.005217366239242812


other stats
deviation-center-line_max0.005217366239242812
deviation-center-line_mean0.005217366239242812
deviation-center-line_min0.005217366239242812
deviation-heading_max0.2466864022639927
deviation-heading_mean0.2466864022639927
deviation-heading_median0.2466864022639927
deviation-heading_min0.2466864022639927
distance-from-start_max0.04024251853591468
distance-from-start_mean0.04024251853591468
distance-from-start_median0.04024251853591468
distance-from-start_min0.04024251853591468
driven_any_max0.040314619423422085
driven_any_mean0.040314619423422085
driven_any_median0.040314619423422085
driven_any_min0.040314619423422085
driven_lanedir_consec_max0.03647239073901587
driven_lanedir_consec_mean0.03647239073901587
driven_lanedir_consec_min0.03647239073901587
driven_lanedir_max0.03647239073901587
driven_lanedir_mean0.03647239073901587
driven_lanedir_median0.03647239073901587
driven_lanedir_min0.03647239073901587
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.040314619423422085, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03647239073901587, "in-drivable-lane": 0.0, "deviation-heading": 0.2466864022639927, "distance-from-start": 0.04024251853591468, "deviation-center-line": 0.005217366239242812, "driven_lanedir_consec": 0.03647239073901587}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
17047791Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71daido-hello-sim-validationsanity-checksuccessyesdavinci-stage-04-6.2.530:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.012895149727536248
deviation-center-line_median0.006513116990777803


other stats
deviation-center-line_max0.006513116990777803
deviation-center-line_mean0.006513116990777803
deviation-center-line_min0.006513116990777803
deviation-heading_max0.27051420208130383
deviation-heading_mean0.27051420208130383
deviation-heading_median0.27051420208130383
deviation-heading_min0.27051420208130383
distance-from-start_max0.015084836004456405
distance-from-start_mean0.015084836004456405
distance-from-start_median0.015084836004456405
distance-from-start_min0.015084836004456405
driven_any_max0.015084868013400707
driven_any_mean0.015084868013400707
driven_any_median0.015084868013400707
driven_any_min0.015084868013400707
driven_lanedir_consec_max0.012895149727536248
driven_lanedir_consec_mean0.012895149727536248
driven_lanedir_consec_min0.012895149727536248
driven_lanedir_max0.012895149727536248
driven_lanedir_mean0.012895149727536248
driven_lanedir_median0.012895149727536248
driven_lanedir_min0.012895149727536248
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084868013400707, "survival_time": 0.49999999999999994, "driven_lanedir": 0.012895149727536248, "in-drivable-lane": 0.0, "deviation-heading": 0.27051420208130383, "distance-from-start": 0.015084836004456405, "deviation-center-line": 0.006513116990777803, "driven_lanedir_consec": 0.012895149727536248}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
170351555Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-04-6.2.530:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170251557Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-04-6.2.530:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170071597Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-04-6.2.530:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
169971605Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-1of4failedyesdavinci-stage-04-6.2.530:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169851608Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-1of4failedyesdavinci-stage-04-6.2.530:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169761613Bea Baselines 🐤baseline-RPL-roslx22-state-estimationsimfailedyesdavinci-stage-04-6.2.530:01:19
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169671621Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-1of4failedyesdavinci-stage-04-6.2.530:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169601623Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4failedyesdavinci-stage-04-6.2.530:01:30
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169551625Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-3of4failedyesdavinci-stage-04-6.2.530:01:23
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169501626Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-0of4failedyesdavinci-stage-04-6.2.530:01:19
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169451626Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4failedyesdavinci-stage-04-6.2.530:01:34
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169381629Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
169291631Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-1of4successyesdavinci-stage-04-6.2.530:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0001430511474609375
survival_time_median59.99999999999873
deviation-center-line_median0.8949070851524836
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949070851524836
deviation-center-line_mean0.8949070851524836
deviation-center-line_min0.8949070851524836
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8949070851524836, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169121635Bea Baselines 🐤baseline-duckietown-mllx22-modconsimsuccessyesdavinci-stage-04-6.2.530:14:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median59.99999999999873
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.220446049250313e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min0.0
driven_any_max2.6645352591003757e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "LF-full-loop-001-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169051639Bea Baselines 🐤baseline-duckietown-mllx22-BV1sim-0of5successyesdavinci-stage-04-6.2.530:07:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168921853Frank (Chude) Qianexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-04-6.2.530:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168841647Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4timeoutyesdavinci-stage-04-6.2.53----No reset possible
168551650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4host-erroryesdavinci-stage-04-6.2.530:17:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/d72290073f314a01c046dec2dca05b959da63c97d7aed36df1360cca583e025a"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168381654Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:15:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.349999999998765
in-drivable-lane_median5.7499999999999005
driven_lanedir_consec_median4.180661894096556
deviation-center-line_median3.917240551333078


other stats
deviation-center-line_max3.917240551333078
deviation-center-line_mean3.917240551333078
deviation-center-line_min3.917240551333078
deviation-heading_max12.903468042574657
deviation-heading_mean12.903468042574657
deviation-heading_median12.903468042574657
deviation-heading_min12.903468042574657
distance-from-start_max3.1379661997080577
distance-from-start_mean3.1379661997080577
distance-from-start_median3.1379661997080577
distance-from-start_min3.1379661997080577
driven_any_max7.734990496200622
driven_any_mean7.734990496200622
driven_any_median7.734990496200622
driven_any_min7.734990496200622
driven_lanedir_consec_max4.180661894096556
driven_lanedir_consec_mean4.180661894096556
driven_lanedir_consec_min4.180661894096556
driven_lanedir_max6.5551973951963785
driven_lanedir_mean6.5551973951963785
driven_lanedir_median6.5551973951963785
driven_lanedir_min6.5551973951963785
in-drivable-lane_max5.7499999999999005
in-drivable-lane_mean5.7499999999999005
in-drivable-lane_min5.7499999999999005
per-episodes
details{"udem-000-ego0": {"driven_any": 7.734990496200622, "survival_time": 59.349999999998765, "driven_lanedir": 6.5551973951963785, "in-drivable-lane": 5.7499999999999005, "deviation-heading": 12.903468042574657, "distance-from-start": 3.1379661997080577, "deviation-center-line": 3.917240551333078, "driven_lanedir_consec": 4.180661894096556}}
simulation-passed1
survival_time_max59.349999999998765
survival_time_mean59.349999999998765
survival_time_min59.349999999998765
No reset possible
168351655Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.749999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7134642982603528
deviation-center-line_median0.1744862204912268


other stats
deviation-center-line_max0.1744862204912268
deviation-center-line_mean0.1744862204912268
deviation-center-line_min0.1744862204912268
deviation-heading_max1.4853320484573516
deviation-heading_mean1.4853320484573516
deviation-heading_median1.4853320484573516
deviation-heading_min1.4853320484573516
distance-from-start_max0.6219368347692609
distance-from-start_mean0.6219368347692609
distance-from-start_median0.6219368347692609
distance-from-start_min0.6219368347692609
driven_any_max0.7448101018880773
driven_any_mean0.7448101018880773
driven_any_median0.7448101018880773
driven_any_min0.7448101018880773
driven_lanedir_consec_max0.7134642982603528
driven_lanedir_consec_mean0.7134642982603528
driven_lanedir_consec_min0.7134642982603528
driven_lanedir_max0.7279404692857799
driven_lanedir_mean0.7279404692857799
driven_lanedir_median0.7279404692857799
driven_lanedir_min0.7279404692857799
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7448101018880773, "survival_time": 6.749999999999984, "driven_lanedir": 0.7279404692857799, "in-drivable-lane": 0.0, "deviation-heading": 1.4853320484573516, "distance-from-start": 0.6219368347692609, "deviation-center-line": 0.1744862204912268, "driven_lanedir_consec": 0.7134642982603528}}
simulation-passed1
survival_time_max6.749999999999984
survival_time_mean6.749999999999984
survival_time_min6.749999999999984
No reset possible
168331655Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168051671Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-3of4successyesdavinci-stage-04-6.2.530:18:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median12.299999999999969
driven_lanedir_consec_median5.6057444274972
deviation-center-line_median3.8728297231717344


other stats
deviation-center-line_max3.8728297231717344
deviation-center-line_mean3.8728297231717344
deviation-center-line_min3.8728297231717344
deviation-heading_max17.311207119181468
deviation-heading_mean17.311207119181468
deviation-heading_median17.311207119181468
deviation-heading_min17.311207119181468
distance-from-start_max2.3113140117470956
distance-from-start_mean2.3113140117470956
distance-from-start_median2.3113140117470956
distance-from-start_min2.3113140117470956
driven_any_max7.91389453263797
driven_any_mean7.91389453263797
driven_any_median7.91389453263797
driven_any_min7.91389453263797
driven_lanedir_consec_max5.6057444274972
driven_lanedir_consec_mean5.6057444274972
driven_lanedir_consec_min5.6057444274972
driven_lanedir_max5.6057444274972
driven_lanedir_mean5.6057444274972
driven_lanedir_median5.6057444274972
driven_lanedir_min5.6057444274972
in-drivable-lane_max12.299999999999969
in-drivable-lane_mean12.299999999999969
in-drivable-lane_min12.299999999999969
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.91389453263797, "survival_time": 59.99999999999873, "driven_lanedir": 5.6057444274972, "in-drivable-lane": 12.299999999999969, "deviation-heading": 17.311207119181468, "distance-from-start": 2.3113140117470956, "deviation-center-line": 3.8728297231717344, "driven_lanedir_consec": 5.6057444274972}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168021672Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-3of4successyesdavinci-stage-04-6.2.530:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
167871675Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4successyesdavinci-stage-04-6.2.530:09:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.750000000000117
in-drivable-lane_median12.675000000000129
driven_lanedir_consec_median0.49017350145143174
deviation-center-line_median0.1660262590449265


other stats
deviation-center-line_max2.3598496045444364
deviation-center-line_mean0.7055486542396483
deviation-center-line_min0.13029249432430398
deviation-heading_max6.7569324575837095
deviation-heading_mean2.990430744130301
deviation-heading_median1.8391426275569915
deviation-heading_min1.5265052638235106
distance-from-start_max0.8786367795942154
distance-from-start_mean0.5875430837156371
distance-from-start_median0.5481887137179099
distance-from-start_min0.3751581278325135
driven_any_max2.2118373954342343
driven_any_mean1.003688495098143
driven_any_median0.6850664716176627
driven_any_min0.43278364172301226
driven_lanedir_consec_max0.5998873479985334
driven_lanedir_consec_mean0.4875392125720842
driven_lanedir_consec_min0.36992249938694033
driven_lanedir_max0.5998873479985334
driven_lanedir_mean0.4875392125720842
driven_lanedir_median0.49017350145143174
driven_lanedir_min0.36992249938694033
in-drivable-lane_max13.200000000000124
in-drivable-lane_mean9.637500000000095
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.2118373954342343, "survival_time": 17.750000000000117, "driven_lanedir": 0.5998873479985334, "in-drivable-lane": 12.35000000000013, "deviation-heading": 2.0256338344910687, "distance-from-start": 0.8786367795942154, "deviation-center-line": 0.13029249432430398, "driven_lanedir_consec": 0.5998873479985334}, "udem-000-ego1": {"driven_any": 0.5854662163416063, "survival_time": 17.750000000000117, "driven_lanedir": 0.5173467423094779, "in-drivable-lane": 13.000000000000126, "deviation-heading": 1.5265052638235106, "distance-from-start": 0.5041428984758606, "deviation-center-line": 0.1707066055886902, "driven_lanedir_consec": 0.5173467423094779}, "udem-000-ego2": {"driven_any": 0.784666726893719, "survival_time": 17.750000000000117, "driven_lanedir": 0.4630002605933856, "in-drivable-lane": 13.200000000000124, "deviation-heading": 1.6526514206229146, "distance-from-start": 0.5922345289599592, "deviation-center-line": 0.1613459125011628, "driven_lanedir_consec": 0.4630002605933856}, "udem-000-ego3": {"driven_any": 0.43278364172301226, "survival_time": 17.750000000000117, "driven_lanedir": 0.36992249938694033, "in-drivable-lane": 0.0, "deviation-heading": 6.7569324575837095, "distance-from-start": 0.3751581278325135, "deviation-center-line": 2.3598496045444364, "driven_lanedir_consec": 0.36992249938694033}}
simulation-passed1
survival_time_max17.750000000000117
survival_time_mean17.750000000000117
survival_time_min17.750000000000117
No reset possible
167791678Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.675696836821229
deviation-center-line_median0.19635223125533263


other stats
deviation-center-line_max0.19635223125533263
deviation-center-line_mean0.19635223125533263
deviation-center-line_min0.19635223125533263
deviation-heading_max1.81505389113436
deviation-heading_mean1.81505389113436
deviation-heading_median1.81505389113436
deviation-heading_min1.81505389113436
distance-from-start_max3.5639702148835872
distance-from-start_mean3.5639702148835872
distance-from-start_median3.5639702148835872
distance-from-start_min3.5639702148835872
driven_any_max5.684198905858687
driven_any_mean5.684198905858687
driven_any_median5.684198905858687
driven_any_min5.684198905858687
driven_lanedir_consec_max5.675696836821229
driven_lanedir_consec_mean5.675696836821229
driven_lanedir_consec_min5.675696836821229
driven_lanedir_max5.675696836821229
driven_lanedir_mean5.675696836821229
driven_lanedir_median5.675696836821229
driven_lanedir_min5.675696836821229
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.684198905858687, "survival_time": 59.99999999999873, "driven_lanedir": 5.675696836821229, "in-drivable-lane": 0.0, "deviation-heading": 1.81505389113436, "distance-from-start": 3.5639702148835872, "deviation-center-line": 0.19635223125533263, "driven_lanedir_consec": 5.675696836821229}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167621680Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successyesdavinci-stage-04-6.2.530:11:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.304249926437537
deviation-center-line_median0.1825026183725989


other stats
deviation-center-line_max0.34104251013325637
deviation-center-line_mean0.20912268674780385
deviation-center-line_min0.13044300011276103
deviation-heading_max2.994295582077131
deviation-heading_mean2.5147400523068573
deviation-heading_median2.5090088664494945
deviation-heading_min2.0466468942513076
distance-from-start_max3.0928237060834363
distance-from-start_mean2.645965341319192
distance-from-start_median2.580815039187992
distance-from-start_min2.329407580817348
driven_any_max5.8241864351349815
driven_any_mean4.627603360938423
driven_any_median4.714304114852396
driven_any_min3.25761877891392
driven_lanedir_consec_max5.808142217564284
driven_lanedir_consec_mean4.417823696659784
driven_lanedir_consec_min3.254652716199778
driven_lanedir_max5.808142217564284
driven_lanedir_mean4.6194454357816355
driven_lanedir_median4.70749340468124
driven_lanedir_min3.254652716199778
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.25761877891392, "survival_time": 59.99999999999873, "driven_lanedir": 3.254652716199778, "in-drivable-lane": 0.0, "deviation-heading": 2.4432266696129785, "distance-from-start": 2.7016200695021144, "deviation-center-line": 0.1633304587519851, "driven_lanedir_consec": 3.254652716199778}, "udem-001-ego1": {"driven_any": 4.275772003750879, "survival_time": 59.99999999999873, "driven_lanedir": 4.270214821719897, "in-drivable-lane": 0.0, "deviation-heading": 2.994295582077131, "distance-from-start": 3.0928237060834363, "deviation-center-line": 0.13044300011276103, "driven_lanedir_consec": 3.867286559394435}, "udem-001-ego2": {"driven_any": 5.152836225953913, "survival_time": 59.99999999999873, "driven_lanedir": 5.144771987642583, "in-drivable-lane": 0.0, "deviation-heading": 2.0466468942513076, "distance-from-start": 2.329407580817348, "deviation-center-line": 0.20167477799321273, "driven_lanedir_consec": 4.741213293480639}, "udem-001-ego3": {"driven_any": 5.8241864351349815, "survival_time": 59.99999999999873, "driven_lanedir": 5.808142217564284, "in-drivable-lane": 0.0, "deviation-heading": 2.5747910632860105, "distance-from-start": 2.460010008873869, "deviation-center-line": 0.34104251013325637, "driven_lanedir_consec": 5.808142217564284}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167511683Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successyesdavinci-stage-04-6.2.530:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167381687Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4successyesdavinci-stage-04-6.2.530:10:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2100199545198067
deviation-center-line_median1.272693831894064


other stats
deviation-center-line_max1.272693831894064
deviation-center-line_mean1.272693831894064
deviation-center-line_min1.272693831894064
deviation-heading_max5.855606525916092
deviation-heading_mean5.855606525916092
deviation-heading_median5.855606525916092
deviation-heading_min5.855606525916092
distance-from-start_max1.194075152462886
distance-from-start_mean1.194075152462886
distance-from-start_median1.194075152462886
distance-from-start_min1.194075152462886
driven_any_max1.2141472555607715
driven_any_mean1.2141472555607715
driven_any_median1.2141472555607715
driven_any_min1.2141472555607715
driven_lanedir_consec_max1.2100199545198067
driven_lanedir_consec_mean1.2100199545198067
driven_lanedir_consec_min1.2100199545198067
driven_lanedir_max1.2100199545198067
driven_lanedir_mean1.2100199545198067
driven_lanedir_median1.2100199545198067
driven_lanedir_min1.2100199545198067
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 1.2141472555607715, "survival_time": 59.99999999999873, "driven_lanedir": 1.2100199545198067, "in-drivable-lane": 0.0, "deviation-heading": 5.855606525916092, "distance-from-start": 1.194075152462886, "deviation-center-line": 1.272693831894064, "driven_lanedir_consec": 1.2100199545198067}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167271689Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166991697Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4successyesdavinci-stage-04-6.2.530:21:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999863
driven_lanedir_consec_median2.2674023788849116
deviation-center-line_median5.536893088323296


other stats
deviation-center-line_max5.653870952725518
deviation-center-line_mean5.457974501938994
deviation-center-line_min5.104240878383868
deviation-heading_max10.449364417109743
deviation-heading_mean10.11792868792557
deviation-heading_median10.098710996708824
deviation-heading_min9.824928341174887
distance-from-start_max2.5614095423342453
distance-from-start_mean2.0332734037963895
distance-from-start_median2.023972936634097
distance-from-start_min1.523738199583119
driven_any_max3.4820813210684833
driven_any_mean3.4569958269192997
driven_any_median3.4490866130099316
driven_any_min3.447728760588852
driven_lanedir_consec_max3.143458087423762
driven_lanedir_consec_mean2.322116699583174
driven_lanedir_consec_min1.610203953139111
driven_lanedir_max3.2610750728685343
driven_lanedir_mean3.200371790495466
driven_lanedir_median3.1833277569609386
driven_lanedir_min3.173756575191452
in-drivable-lane_max4.399999999999963
in-drivable-lane_mean4.0874999999999115
in-drivable-lane_min3.249999999999958
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4490933302185676, "survival_time": 59.99999999999873, "driven_lanedir": 3.182424665546428, "in-drivable-lane": 4.3499999999998415, "deviation-heading": 10.087643041980582, "distance-from-start": 2.5614095423342453, "deviation-center-line": 5.533862530350289, "driven_lanedir_consec": 3.143458087423762}, "zigzag-000-ego1": {"driven_any": 3.447728760588852, "survival_time": 59.99999999999873, "driven_lanedir": 3.173756575191452, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.449364417109743, "distance-from-start": 1.5342133784714156, "deviation-center-line": 5.653870952725518, "driven_lanedir_consec": 1.6329981415649488}, "zigzag-000-ego2": {"driven_any": 3.4820813210684833, "survival_time": 59.99999999999873, "driven_lanedir": 3.2610750728685343, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778951437065, "distance-from-start": 1.523738199583119, "deviation-center-line": 5.104240878383868, "driven_lanedir_consec": 1.610203953139111}, "zigzag-000-ego3": {"driven_any": 3.4490798958012956, "survival_time": 59.99999999999873, "driven_lanedir": 3.184230848375449, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.824928341174887, "distance-from-start": 2.5137324947967783, "deviation-center-line": 5.5399236462963035, "driven_lanedir_consec": 2.901806616204875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166931697Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-0of4timeoutyesdavinci-stage-04-6.2.530:04:10
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166921698Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166911698Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-3of4successyesdavinci-stage-04-6.2.530:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166871700Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4successyesdavinci-stage-04-6.2.530:04:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.05000000000008
in-drivable-lane_median0.0
driven_lanedir_consec_median0.6855434087750805
deviation-center-line_median1.12957986069885


other stats
deviation-center-line_max1.12957986069885
deviation-center-line_mean1.12957986069885
deviation-center-line_min1.12957986069885
deviation-heading_max1.951860613365137
deviation-heading_mean1.951860613365137
deviation-heading_median1.951860613365137
deviation-heading_min1.951860613365137
distance-from-start_max0.6890064762174344
distance-from-start_mean0.6890064762174344
distance-from-start_median0.6890064762174344
distance-from-start_min0.6890064762174344
driven_any_max0.8405923695951633
driven_any_mean0.8405923695951633
driven_any_median0.8405923695951633
driven_any_min0.8405923695951633
driven_lanedir_consec_max0.6855434087750805
driven_lanedir_consec_mean0.6855434087750805
driven_lanedir_consec_min0.6855434087750805
driven_lanedir_max0.8262266008885575
driven_lanedir_mean0.8262266008885575
driven_lanedir_median0.8262266008885575
driven_lanedir_min0.8262266008885575
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.8405923695951633, "survival_time": 15.05000000000008, "driven_lanedir": 0.8262266008885575, "in-drivable-lane": 0.0, "deviation-heading": 1.951860613365137, "distance-from-start": 0.6890064762174344, "deviation-center-line": 1.12957986069885, "driven_lanedir_consec": 0.6855434087750805}}
simulation-passed1
survival_time_max15.05000000000008
survival_time_mean15.05000000000008
survival_time_min15.05000000000008
No reset possible
166811699Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successyesdavinci-stage-04-6.2.530:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203839696348646
deviation-center-line_median4.904461575108174


other stats
deviation-center-line_max4.904461575108174
deviation-center-line_mean4.904461575108174
deviation-center-line_min4.904461575108174
deviation-heading_max7.745124892472468
deviation-heading_mean7.745124892472468
deviation-heading_median7.745124892472468
deviation-heading_min7.745124892472468
distance-from-start_max1.2059816740532263
distance-from-start_mean1.2059816740532263
distance-from-start_median1.2059816740532263
distance-from-start_min1.2059816740532263
driven_any_max3.485084016237799
driven_any_mean3.485084016237799
driven_any_median3.485084016237799
driven_any_min3.485084016237799
driven_lanedir_consec_max1.4203839696348646
driven_lanedir_consec_mean1.4203839696348646
driven_lanedir_consec_min1.4203839696348646
driven_lanedir_max3.2905245152042193
driven_lanedir_mean3.2905245152042193
driven_lanedir_median3.2905245152042193
driven_lanedir_min3.2905245152042193
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016237799, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905245152042193, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124892472468, "distance-from-start": 1.2059816740532263, "deviation-center-line": 4.904461575108174, "driven_lanedir_consec": 1.4203839696348646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible