Duckietown Challenges Home Challenges Submissions

Evaluator 134

ID134
evaluatordavinci-stage-03-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-03-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success34 16684
# timeout2 16694
# failed18 16943
# error
# aborted
# host-error10 16887
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors90%
RAM total (MB)251.6 GB
RAM free (MB)242.9 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172671856Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-03-6.2.530:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
17256385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:32:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.92499999999935
driven_lanedir_consec_median-3.298094482444622
deviation-center-line_median2.7912619943184147


other stats
deviation-center-line_max3.823201113640619
deviation-center-line_mean2.9622853444611916
deviation-center-line_min2.4434162755673188
deviation-heading_max28.298074421329396
deviation-heading_mean27.46276446465614
deviation-heading_median27.276120827193587
deviation-heading_min27.00074178290798
distance-from-start_max0.2090723460249335
distance-from-start_mean0.18144222837136464
distance-from-start_median0.17506839134744184
distance-from-start_min0.1665597847656414
driven_any_max12.720994578764708
driven_any_mean11.631238230910906
driven_any_median11.614589058249722
driven_any_min10.574780228379463
driven_lanedir_consec_max-2.26406537282643
driven_lanedir_consec_mean-3.1720459909712355
driven_lanedir_consec_min-3.827929626169269
driven_lanedir_max-2.6753052128097488
driven_lanedir_mean-3.322239967957433
driven_lanedir_median-3.3928625164253576
driven_lanedir_min-3.827929626169269
in-drivable-lane_max28.79999999999938
in-drivable-lane_mean25.424999999999343
in-drivable-lane_min23.049999999999287
per-episodes
details{"loop-000-ego0": {"driven_any": 11.505804176448471, "survival_time": 59.99999999999873, "driven_lanedir": -3.1687616965369703, "in-drivable-lane": 23.84999999999939, "deviation-heading": 27.198194583486337, "distance-from-start": 0.1834517764238565, "deviation-center-line": 2.672829503619949, "driven_lanedir_consec": -3.1687616965369703}, "loop-000-ego1": {"driven_any": 12.720994578764708, "survival_time": 59.99999999999873, "driven_lanedir": -3.827929626169269, "in-drivable-lane": 28.79999999999938, "deviation-heading": 27.00074178290798, "distance-from-start": 0.2090723460249335, "deviation-center-line": 2.4434162755673188, "driven_lanedir_consec": -3.827929626169269}, "loop-000-ego2": {"driven_any": 10.574780228379463, "survival_time": 59.99999999999873, "driven_lanedir": -2.6753052128097488, "in-drivable-lane": 23.049999999999287, "deviation-heading": 28.298074421329396, "distance-from-start": 0.1665597847656414, "deviation-center-line": 3.823201113640619, "driven_lanedir_consec": -2.26406537282643}, "loop-000-ego3": {"driven_any": 11.723373940050973, "survival_time": 59.99999999999873, "driven_lanedir": -3.616963336313745, "in-drivable-lane": 25.99999999999931, "deviation-heading": 27.354047070900837, "distance-from-start": 0.16668500627102725, "deviation-center-line": 2.909694485016881, "driven_lanedir_consec": -3.4274272683522735}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17253385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4host-erroryesdavinci-stage-03-6.2.530:01:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17251385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4host-erroryesdavinci-stage-03-6.2.530:01:23
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17250386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4host-erroryesdavinci-stage-03-6.2.530:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17249386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4host-erroryesdavinci-stage-03-6.2.530:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17248386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4host-erroryesdavinci-stage-03-6.2.530:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17227389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.099999999999397
driven_lanedir_consec_median-3.3646725705377123
deviation-center-line_median2.1540021563112215


other stats
deviation-center-line_max2.1540021563112215
deviation-center-line_mean2.1540021563112215
deviation-center-line_min2.1540021563112215
deviation-heading_max30.15163124748327
deviation-heading_mean30.15163124748327
deviation-heading_median30.15163124748327
deviation-heading_min30.15163124748327
distance-from-start_max0.215125044786342
distance-from-start_mean0.215125044786342
distance-from-start_median0.215125044786342
distance-from-start_min0.215125044786342
driven_any_max11.827858593103288
driven_any_mean11.827858593103288
driven_any_median11.827858593103288
driven_any_min11.827858593103288
driven_lanedir_consec_max-3.3646725705377123
driven_lanedir_consec_mean-3.3646725705377123
driven_lanedir_consec_min-3.3646725705377123
driven_lanedir_max-3.434592148991556
driven_lanedir_mean-3.434592148991556
driven_lanedir_median-3.434592148991556
driven_lanedir_min-3.434592148991556
in-drivable-lane_max24.099999999999397
in-drivable-lane_mean24.099999999999397
in-drivable-lane_min24.099999999999397
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.827858593103288, "survival_time": 59.99999999999873, "driven_lanedir": -3.434592148991556, "in-drivable-lane": 24.099999999999397, "deviation-heading": 30.15163124748327, "distance-from-start": 0.215125044786342, "deviation-center-line": 2.1540021563112215, "driven_lanedir_consec": -3.3646725705377123}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17223392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4host-erroryesdavinci-stage-03-6.2.530:01:23
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17218391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4host-erroryesdavinci-stage-03-6.2.530:01:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17214390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4host-erroryesdavinci-stage-03-6.2.530:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17181394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-0of4successyesdavinci-stage-03-6.2.530:19:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.84999999999903
driven_lanedir_consec_median-2.596168725794497
deviation-center-line_median1.8625509644343072


other stats
deviation-center-line_max1.8625509644343072
deviation-center-line_mean1.8625509644343072
deviation-center-line_min1.8625509644343072
deviation-heading_max22.502560604009208
deviation-heading_mean22.502560604009208
deviation-heading_median22.502560604009208
deviation-heading_min22.502560604009208
distance-from-start_max0.172915698927857
distance-from-start_mean0.172915698927857
distance-from-start_median0.172915698927857
distance-from-start_min0.172915698927857
driven_any_max10.99858085341895
driven_any_mean10.99858085341895
driven_any_median10.99858085341895
driven_any_min10.99858085341895
driven_lanedir_consec_max-2.596168725794497
driven_lanedir_consec_mean-2.596168725794497
driven_lanedir_consec_min-2.596168725794497
driven_lanedir_max-2.596168725794497
driven_lanedir_mean-2.596168725794497
driven_lanedir_median-2.596168725794497
driven_lanedir_min-2.596168725794497
in-drivable-lane_max36.84999999999903
in-drivable-lane_mean36.84999999999903
in-drivable-lane_min36.84999999999903
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.99858085341895, "survival_time": 59.99999999999873, "driven_lanedir": -2.596168725794497, "in-drivable-lane": 36.84999999999903, "deviation-heading": 22.502560604009208, "distance-from-start": 0.172915698927857, "deviation-center-line": 1.8625509644343072, "driven_lanedir_consec": -2.596168725794497}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17165398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4host-erroryesdavinci-stage-03-6.2.530:05:27
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-03-6.2.53-job17165-933576, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.53-job17165-933576', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17160515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-3of4failedyesdavinci-stage-03-6.2.530:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17152517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17145519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failedyesdavinci-stage-03-6.2.530:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17137521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.530:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17131522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.530:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17123524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successyesdavinci-stage-03-6.2.530:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17115527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failedyesdavinci-stage-03-6.2.530:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17090533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-0of4successyesdavinci-stage-03-6.2.530:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.585360000111613
survival_time_median59.99999999999873
deviation-center-line_median3.1114891567015768
in-drivable-lane_median0.0


other stats
deviation-center-line_max3.1114891567015768
deviation-center-line_mean3.1114891567015768
deviation-center-line_min3.1114891567015768
deviation-heading_max14.309183839924325
deviation-heading_mean14.309183839924325
deviation-heading_median14.309183839924325
deviation-heading_min14.309183839924325
distance-from-start_max4.0428461897156875
distance-from-start_mean4.0428461897156875
distance-from-start_median4.0428461897156875
distance-from-start_min4.0428461897156875
driven_any_max9.040295289747556
driven_any_mean9.040295289747556
driven_any_median9.040295289747556
driven_any_min9.040295289747556
driven_lanedir_consec_max8.585360000111613
driven_lanedir_consec_mean8.585360000111613
driven_lanedir_consec_min8.585360000111613
driven_lanedir_max8.585360000111613
driven_lanedir_mean8.585360000111613
driven_lanedir_median8.585360000111613
driven_lanedir_min8.585360000111613
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.040295289747556, "survival_time": 59.99999999999873, "driven_lanedir": 8.585360000111613, "in-drivable-lane": 0.0, "deviation-heading": 14.309183839924325, "distance-from-start": 4.0428461897156875, "deviation-center-line": 3.1114891567015768, "driven_lanedir_consec": 8.585360000111613}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17087534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-2of4failedyesdavinci-stage-03-6.2.530:01:05
The container "solut [...]
The container "solution-ego2" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17082535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-0of4failedyesdavinci-stage-03-6.2.530:01:09
The container "solut [...]
The container "solution-ego1" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17063541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-1of4successyesdavinci-stage-03-6.2.530:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.141200429181076
survival_time_median59.99999999999873
deviation-center-line_median3.257594718676204
in-drivable-lane_median2.6999999999998465


other stats
deviation-center-line_max3.257594718676204
deviation-center-line_mean3.257594718676204
deviation-center-line_min3.257594718676204
deviation-heading_max17.87731460516444
deviation-heading_mean17.87731460516444
deviation-heading_median17.87731460516444
deviation-heading_min17.87731460516444
distance-from-start_max3.2695546403215916
distance-from-start_mean3.2695546403215916
distance-from-start_median3.2695546403215916
distance-from-start_min3.2695546403215916
driven_any_max10.49053225758392
driven_any_mean10.49053225758392
driven_any_median10.49053225758392
driven_any_min10.49053225758392
driven_lanedir_consec_max9.141200429181076
driven_lanedir_consec_mean9.141200429181076
driven_lanedir_consec_min9.141200429181076
driven_lanedir_max9.141200429181076
driven_lanedir_mean9.141200429181076
driven_lanedir_median9.141200429181076
driven_lanedir_min9.141200429181076
in-drivable-lane_max2.6999999999998465
in-drivable-lane_mean2.6999999999998465
in-drivable-lane_min2.6999999999998465
per-episodes
details{"loop-000-ego0": {"driven_any": 10.49053225758392, "survival_time": 59.99999999999873, "driven_lanedir": 9.141200429181076, "in-drivable-lane": 2.6999999999998465, "deviation-heading": 17.87731460516444, "distance-from-start": 3.2695546403215916, "deviation-center-line": 3.257594718676204, "driven_lanedir_consec": 9.141200429181076}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17054617Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessyesdavinci-stage-03-6.2.530:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.051884500157577174
deviation-center-line_median0.006279414341880645


other stats
deviation-center-line_max0.006279414341880645
deviation-center-line_mean0.006279414341880645
deviation-center-line_min0.006279414341880645
deviation-heading_max0.2500898268816803
deviation-heading_mean0.2500898268816803
deviation-heading_median0.2500898268816803
deviation-heading_min0.2500898268816803
distance-from-start_max0.05779346228902923
distance-from-start_mean0.05779346228902923
distance-from-start_median0.05779346228902923
distance-from-start_min0.05779346228902923
driven_any_max0.05785309993811989
driven_any_mean0.05785309993811989
driven_any_median0.05785309993811989
driven_any_min0.05785309993811989
driven_lanedir_consec_max0.051884500157577174
driven_lanedir_consec_mean0.051884500157577174
driven_lanedir_consec_min0.051884500157577174
driven_lanedir_max0.051884500157577174
driven_lanedir_mean0.051884500157577174
driven_lanedir_median0.051884500157577174
driven_lanedir_min0.051884500157577174
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05785309993811989, "survival_time": 0.49999999999999994, "driven_lanedir": 0.051884500157577174, "in-drivable-lane": 0.0, "deviation-heading": 0.2500898268816803, "distance-from-start": 0.05779346228902923, "deviation-center-line": 0.006279414341880645, "driven_lanedir_consec": 0.051884500157577174}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
17048796Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1aido-hello-sim-validationsanity-checkfailedyesdavinci-stage-03-6.2.530:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170341555Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-03-6.2.530:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170231557Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-03-6.2.530:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170211584Andrea Censiexercises_braitenberglx22-BV1sim-3of5failedyesdavinci-stage-03-6.2.530:03:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170081599Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-03-6.2.530:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4113567897974235


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4113567897974235
distance-from-start_median1.4113567897974235
distance-from-start_min1.4113567897974235
driven_any_max1.6235360469470643
driven_any_mean1.6235360469470643
driven_any_median1.6235360469470643
driven_any_min1.6235360469470643
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.549999999999988
in-drivable-lane_mean5.549999999999988
in-drivable-lane_median5.549999999999988
in-drivable-lane_min5.549999999999988
per-episodes
details{"d60-ego0": {"driven_any": 1.6235360469470643, "survival_time": 5.549999999999988, "driven_lanedir": 0.0, "in-drivable-lane": 5.549999999999988, "deviation-heading": 0.0, "distance-from-start": 1.4113567897974235, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean5.549999999999988
survival_time_median5.549999999999988
survival_time_min5.549999999999988
No reset possible
170011604Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-0of4failedyesdavinci-stage-03-6.2.530:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169901607Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-2of4failedyesdavinci-stage-03-6.2.530:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169811609Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-0of4failedyesdavinci-stage-03-6.2.530:01:03
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169721614Bea Baselines 🐤baseline-RPL-roslx22-BV1sim-2of5failedyesdavinci-stage-03-6.2.530:01:03
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169641617Bea Baselines 🐤baseline-RPL-rosaido-hello-sim-validationsanity-checkfailedyesdavinci-stage-03-6.2.530:00:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169581623Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-2of4failedyesdavinci-stage-03-6.2.530:01:31
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169531624Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-3of4failedyesdavinci-stage-03-6.2.530:01:19
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169481626Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-1of4failedyesdavinci-stage-03-6.2.530:01:18
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169431627Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4failedyesdavinci-stage-03-6.2.530:01:58
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169321630Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.8949224973854444


other stats
deviation-center-line_max0.8949224973854444
deviation-center-line_mean0.8949224973854444
deviation-center-line_min0.8949224973854444
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949224973854444, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169261631Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8949084199908675
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949084199908675
deviation-center-line_mean0.8949084199908675
deviation-center-line_min0.8949084199908675
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.002966042486721e-16
distance-from-start_mean4.002966042486721e-16
distance-from-start_median4.002966042486721e-16
distance-from-start_min4.002966042486721e-16
driven_any_max4.803559250983913e-13
driven_any_mean4.803559250983913e-13
driven_any_median4.803559250983913e-13
driven_any_min4.803559250983913e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.803559250983913e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.002966042486721e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169161634Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successyesdavinci-stage-03-6.2.530:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949224973854443


other stats
deviation-center-line_max0.8949224973854443
deviation-center-line_mean0.8949224973854443
deviation-center-line_min0.8949224973854443
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8949224973854443, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169061639Bea Baselines 🐤baseline-duckietown-mllx22-BV1sim-4of5successyesdavinci-stage-03-6.2.530:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168961854Frank (Chude) Qianlx22-modconlx22-modconsimsuccessyesdavinci-stage-03-6.2.530:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.275
deviation-center-line_median1.871650104442895
driven_lanedir_consec_median5.761654854437985
survival_time_median44.2249999999995


other stats
deviation-center-line_max2.1035208605336924
deviation-center-line_mean1.871650104442895
deviation-center-line_min1.639779348352098
deviation-heading_max2.0505662091004826
deviation-heading_mean1.8954402000999475
deviation-heading_median1.8954402000999475
deviation-heading_min1.7403141910994124
distance-from-start_max8.259746973325429
distance-from-start_mean5.9884052686326985
distance-from-start_median5.9884052686326985
distance-from-start_min3.717063563939969
driven_any_max8.338212651182213
driven_any_mean6.081042066280771
driven_any_median6.081042066280771
driven_any_min3.8238714813793298
driven_lanedir_consec_max8.063779519019562
driven_lanedir_consec_mean5.761654854437985
driven_lanedir_consec_min3.4595301898564097
driven_lanedir_max8.063779519019562
driven_lanedir_mean5.761654854437985
driven_lanedir_median5.761654854437985
driven_lanedir_min3.4595301898564097
in-drivable-lane_max2.5999999999999988
in-drivable-lane_mean2.275
in-drivable-lane_min1.950000000000001
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338212651182213, "survival_time": 59.99999999999873, "driven_lanedir": 8.063779519019562, "in-drivable-lane": 1.950000000000001, "deviation-heading": 1.7403141910994124, "distance-from-start": 8.259746973325429, "deviation-center-line": 1.639779348352098, "driven_lanedir_consec": 8.063779519019562}, "LF-full-loop-001-ego0": {"driven_any": 3.8238714813793298, "survival_time": 28.45000000000027, "driven_lanedir": 3.4595301898564097, "in-drivable-lane": 2.5999999999999988, "deviation-heading": 2.0505662091004826, "distance-from-start": 3.717063563939969, "deviation-center-line": 2.1035208605336924, "driven_lanedir_consec": 3.4595301898564097}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean44.2249999999995
survival_time_min28.45000000000027
No reset possible
168871650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4host-erroryesdavinci-stage-03-6.2.530:02:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 139, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner_cache.py", line 64, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1032, in run_single
    prepare_dir(wd, aws_config, steps2artefacts=steps2artefacts, steps2scores=steps2scores, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1465, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 155, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 204, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 359, in object_download_file
    return self.meta.client.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 190, in download_file
    return transfer.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 320, in download_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 269, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/download.py", line 354, in _submit
    response = client.head_object(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1595, in redirect_from_error
    new_region = self.get_bucket_region(bucket, response)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1665, in get_bucket_region
    response = self._client.head_bucket(Bucket=bucket)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/"

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168651648Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-1of4timeoutyesdavinci-stage-03-6.2.53----No reset possible
168481651Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4successyesdavinci-stage-03-6.2.530:15:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.7343157482938594e-06
deviation-center-line_median1.5844853993259105


other stats
deviation-center-line_max3.468395817902628
deviation-center-line_mean1.7151188170525231
deviation-center-line_min0.22310865165564356
deviation-heading_max40.96732188588877
deviation-heading_mean25.437947521585144
deviation-heading_median28.06617110903251
deviation-heading_min4.652125982386785
distance-from-start_max5.551115123125784e-16
distance-from-start_mean3.248269708766571e-16
distance-from-start_median3.165870343657673e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max6.661338147750939e-13
driven_any_mean3.897923650519886e-13
driven_any_median3.7990444123892075e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.00014045138598817175
driven_lanedir_consec_mean1.7402070830174754e-05
driven_lanedir_consec_min-7.831173416406045e-05
driven_lanedir_max0.00014045138598817175
driven_lanedir_mean1.7402070830174754e-05
driven_lanedir_median3.7343157482938594e-06
driven_lanedir_min-7.831173416406045e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.661338147750939e-13, "survival_time": 59.99999999999873, "driven_lanedir": -7.831173416406045e-05, "in-drivable-lane": 0.0, "deviation-heading": 40.96732188588877, "distance-from-start": 5.551115123125784e-16, "deviation-center-line": 0.40651203156888976, "driven_lanedir_consec": -7.831173416406045e-05}, "zigzag-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.00014045138598817175, "in-drivable-lane": 0.0, "deviation-heading": 18.309423483353505, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 3.468395817902628, "driven_lanedir_consec": 0.00014045138598817175}, "zigzag-000-ego2": {"driven_any": 2.2690183065776637e-13, "survival_time": 59.99999999999873, "driven_lanedir": -5.626369536937403e-07, "in-drivable-lane": 0.0, "deviation-heading": 4.652125982386785, "distance-from-start": 1.8908485888147195e-16, "deviation-center-line": 0.22310865165564356, "driven_lanedir_consec": -5.626369536937403e-07}, "zigzag-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 8.031268450281459e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822918734711514, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.762458767082931, "driven_lanedir_consec": 8.031268450281459e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168431653Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.000000000000107
in-drivable-lane_median7.050000000000091
driven_lanedir_consec_median1.1398441672080757
deviation-center-line_median0.6792845839614687


other stats
deviation-center-line_max0.6792845839614687
deviation-center-line_mean0.6792845839614687
deviation-center-line_min0.6792845839614687
deviation-heading_max3.3124109756391378
deviation-heading_mean3.3124109756391378
deviation-heading_median3.3124109756391378
deviation-heading_min3.3124109756391378
distance-from-start_max1.4381616290453312
distance-from-start_mean1.4381616290453312
distance-from-start_median1.4381616290453312
distance-from-start_min1.4381616290453312
driven_any_max2.1123198935748775
driven_any_mean2.1123198935748775
driven_any_median2.1123198935748775
driven_any_min2.1123198935748775
driven_lanedir_consec_max1.1398441672080757
driven_lanedir_consec_mean1.1398441672080757
driven_lanedir_consec_min1.1398441672080757
driven_lanedir_max1.1398441672080757
driven_lanedir_mean1.1398441672080757
driven_lanedir_median1.1398441672080757
driven_lanedir_min1.1398441672080757
in-drivable-lane_max7.050000000000091
in-drivable-lane_mean7.050000000000091
in-drivable-lane_min7.050000000000091
per-episodes
details{"loop-000-ego0": {"driven_any": 2.1123198935748775, "survival_time": 17.000000000000107, "driven_lanedir": 1.1398441672080757, "in-drivable-lane": 7.050000000000091, "deviation-heading": 3.3124109756391378, "distance-from-start": 1.4381616290453312, "deviation-center-line": 0.6792845839614687, "driven_lanedir_consec": 1.1398441672080757}}
simulation-passed1
survival_time_max17.000000000000107
survival_time_mean17.000000000000107
survival_time_min17.000000000000107
No reset possible
168371654Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168361655Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168291656Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4successyesdavinci-stage-03-6.2.530:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8427935319488293
survival_time_median22.20000000000018
deviation-center-line_median0.1933622188883573
in-drivable-lane_median15.050000000000198


other stats
deviation-center-line_max0.1933622188883573
deviation-center-line_mean0.1933622188883573
deviation-center-line_min0.1933622188883573
deviation-heading_max1.634477299750728
deviation-heading_mean1.634477299750728
deviation-heading_median1.634477299750728
deviation-heading_min1.634477299750728
distance-from-start_max1.033243876430916
distance-from-start_mean1.033243876430916
distance-from-start_median1.033243876430916
distance-from-start_min1.033243876430916
driven_any_max2.79585443640827
driven_any_mean2.79585443640827
driven_any_median2.79585443640827
driven_any_min2.79585443640827
driven_lanedir_consec_max0.8427935319488293
driven_lanedir_consec_mean0.8427935319488293
driven_lanedir_consec_min0.8427935319488293
driven_lanedir_max0.8427935319488293
driven_lanedir_mean0.8427935319488293
driven_lanedir_median0.8427935319488293
driven_lanedir_min0.8427935319488293
in-drivable-lane_max15.050000000000198
in-drivable-lane_mean15.050000000000198
in-drivable-lane_min15.050000000000198
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.79585443640827, "survival_time": 22.20000000000018, "driven_lanedir": 0.8427935319488293, "in-drivable-lane": 15.050000000000198, "deviation-heading": 1.634477299750728, "distance-from-start": 1.033243876430916, "deviation-center-line": 0.1933622188883573, "driven_lanedir_consec": 0.8427935319488293}}
simulation-passed1
survival_time_max22.20000000000018
survival_time_mean22.20000000000018
survival_time_min22.20000000000018
No reset possible
168201659Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median38.19999999999997
in-drivable-lane_median3.450000000000035
driven_lanedir_consec_median2.954166851959711
deviation-center-line_median2.6594588441515024


other stats
deviation-center-line_max2.6594588441515024
deviation-center-line_mean2.6594588441515024
deviation-center-line_min2.6594588441515024
deviation-heading_max10.13976566165057
deviation-heading_mean10.13976566165057
deviation-heading_median10.13976566165057
deviation-heading_min10.13976566165057
distance-from-start_max2.2180839512434787
distance-from-start_mean2.2180839512434787
distance-from-start_median2.2180839512434787
distance-from-start_min2.2180839512434787
driven_any_max4.926796333194103
driven_any_mean4.926796333194103
driven_any_median4.926796333194103
driven_any_min4.926796333194103
driven_lanedir_consec_max2.954166851959711
driven_lanedir_consec_mean2.954166851959711
driven_lanedir_consec_min2.954166851959711
driven_lanedir_max4.086709715800125
driven_lanedir_mean4.086709715800125
driven_lanedir_median4.086709715800125
driven_lanedir_min4.086709715800125
in-drivable-lane_max3.450000000000035
in-drivable-lane_mean3.450000000000035
in-drivable-lane_min3.450000000000035
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.926796333194103, "survival_time": 38.19999999999997, "driven_lanedir": 4.086709715800125, "in-drivable-lane": 3.450000000000035, "deviation-heading": 10.13976566165057, "distance-from-start": 2.2180839512434787, "deviation-center-line": 2.6594588441515024, "driven_lanedir_consec": 2.954166851959711}}
simulation-passed1
survival_time_max38.19999999999997
survival_time_mean38.19999999999997
survival_time_min38.19999999999997
No reset possible
167861676Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-3of4successyesdavinci-stage-03-6.2.530:22:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.24999999999968
in-drivable-lane_median8.300000000000072
driven_lanedir_consec_median1.8136596559134692
deviation-center-line_median2.967954385462908


other stats
deviation-center-line_max5.323210724654739
deviation-center-line_mean3.290404889848863
deviation-center-line_min1.902500063814897
deviation-heading_max26.22229062384312
deviation-heading_mean19.49098660635087
deviation-heading_median19.14763907989851
deviation-heading_min13.44637764176334
distance-from-start_max2.485924488240446
distance-from-start_mean1.4547758599800376
distance-from-start_median1.3764711752056524
distance-from-start_min0.5802366012683995
driven_any_max5.596521620229235
driven_any_mean4.1978170269113
driven_any_median4.368941247460485
driven_any_min2.456863992494994
driven_lanedir_consec_max2.331315383651501
driven_lanedir_consec_mean1.7025744290807965
driven_lanedir_consec_min0.851663020844746
driven_lanedir_max3.666039613135923
driven_lanedir_mean2.3314788395675277
driven_lanedir_median2.3212974758343363
driven_lanedir_min1.017280793465515
in-drivable-lane_max19.899999999999633
in-drivable-lane_mean9.587499999999949
in-drivable-lane_min1.8500000000000163
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.368992771175671, "survival_time": 43.24999999999968, "driven_lanedir": 3.666039613135923, "in-drivable-lane": 1.8500000000000163, "deviation-heading": 13.44637764176334, "distance-from-start": 0.9041035724646036, "deviation-center-line": 2.6716168254779915, "driven_lanedir_consec": 2.014460449834514}, "zigzag-000-ego1": {"driven_any": 2.456863992494994, "survival_time": 43.24999999999968, "driven_lanedir": 1.017280793465515, "in-drivable-lane": 7.500000000000074, "deviation-heading": 26.22229062384312, "distance-from-start": 0.5802366012683995, "deviation-center-line": 5.323210724654739, "driven_lanedir_consec": 0.851663020844746}, "zigzag-000-ego2": {"driven_any": 5.596521620229235, "survival_time": 43.24999999999968, "driven_lanedir": 2.1070188867976656, "in-drivable-lane": 19.899999999999633, "deviation-heading": 15.96647751631313, "distance-from-start": 1.8488387779467013, "deviation-center-line": 1.902500063814897, "driven_lanedir_consec": 1.6128588619924242}, "zigzag-000-ego3": {"driven_any": 4.3688897237452995, "survival_time": 43.24999999999968, "driven_lanedir": 2.535576064871007, "in-drivable-lane": 9.100000000000067, "deviation-heading": 22.32880064348389, "distance-from-start": 2.485924488240446, "deviation-center-line": 3.2642919454478245, "driven_lanedir_consec": 2.331315383651501}}
simulation-passed1
survival_time_max43.24999999999968
survival_time_mean43.24999999999968
survival_time_min43.24999999999968
No reset possible
167781678Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successyesdavinci-stage-03-6.2.530:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.692768953399423
deviation-center-line_median0.22838243511519724


other stats
deviation-center-line_max0.22838243511519724
deviation-center-line_mean0.22838243511519724
deviation-center-line_min0.22838243511519724
deviation-heading_max2.327018578184933
deviation-heading_mean2.327018578184933
deviation-heading_median2.327018578184933
deviation-heading_min2.327018578184933
distance-from-start_max1.517284045125221
distance-from-start_mean1.517284045125221
distance-from-start_median1.517284045125221
distance-from-start_min1.517284045125221
driven_any_max5.702917901484924
driven_any_mean5.702917901484924
driven_any_median5.702917901484924
driven_any_min5.702917901484924
driven_lanedir_consec_max5.692768953399423
driven_lanedir_consec_mean5.692768953399423
driven_lanedir_consec_min5.692768953399423
driven_lanedir_max5.692768953399423
driven_lanedir_mean5.692768953399423
driven_lanedir_median5.692768953399423
driven_lanedir_min5.692768953399423
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.702917901484924, "survival_time": 59.99999999999873, "driven_lanedir": 5.692768953399423, "in-drivable-lane": 0.0, "deviation-heading": 2.327018578184933, "distance-from-start": 1.517284045125221, "deviation-center-line": 0.22838243511519724, "driven_lanedir_consec": 5.692768953399423}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167671680Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-2of4successyesdavinci-stage-03-6.2.530:12:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.496299828477744
deviation-center-line_median0.17183898904941014


other stats
deviation-center-line_max0.21132079357626976
deviation-center-line_mean0.1743653873253979
deviation-center-line_min0.1424627776265016
deviation-heading_max1.5868854715733702
deviation-heading_mean1.4512616339961206
deviation-heading_median1.4728924991747463
deviation-heading_min1.2723760660616197
distance-from-start_max3.152836469048969
distance-from-start_mean2.690530320315596
distance-from-start_median2.641239810973879
distance-from-start_min2.3268051902656572
driven_any_max5.831435519999375
driven_any_mean5.567123575605065
driven_any_median5.707730195058858
driven_any_min5.021598392303173
driven_lanedir_consec_max5.704845460644086
driven_lanedir_consec_mean5.327153206008904
driven_lanedir_consec_min4.611167706436042
driven_lanedir_max5.8223962690688085
driven_lanedir_mean5.560890784650249
driven_lanedir_median5.703499571898595
driven_lanedir_min5.014167725734996
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.021598392303173, "survival_time": 59.99999999999873, "driven_lanedir": 5.014167725734996, "in-drivable-lane": 0.0, "deviation-heading": 1.5868854715733702, "distance-from-start": 2.339170523946391, "deviation-center-line": 0.1827495883978732, "driven_lanedir_consec": 4.611167706436042}, "4way-000-ego1": {"driven_any": 5.831435519999375, "survival_time": 59.99999999999873, "driven_lanedir": 5.8223962690688085, "in-drivable-lane": 0.0, "deviation-heading": 1.537638141336496, "distance-from-start": 3.152836469048969, "deviation-center-line": 0.21132079357626976, "driven_lanedir_consec": 5.584035348945523}, "4way-000-ego2": {"driven_any": 5.707095572773834, "survival_time": 59.99999999999873, "driven_lanedir": 5.702153535639253, "in-drivable-lane": 0.0, "deviation-heading": 1.408146857012997, "distance-from-start": 2.3268051902656572, "deviation-center-line": 0.16092838970094706, "driven_lanedir_consec": 5.408564308009964}, "4way-000-ego3": {"driven_any": 5.708364817343881, "survival_time": 59.99999999999873, "driven_lanedir": 5.704845608157938, "in-drivable-lane": 0.0, "deviation-heading": 1.2723760660616197, "distance-from-start": 2.943309098001367, "deviation-center-line": 0.1424627776265016, "driven_lanedir_consec": 5.704845460644086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167531683Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-3of4successyesdavinci-stage-03-6.2.530:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.250000000000306
in-drivable-lane_median0.0
driven_lanedir_consec_median3.064552505017095
deviation-center-line_median0.2147705908085717


other stats
deviation-center-line_max0.2147705908085717
deviation-center-line_mean0.2147705908085717
deviation-center-line_min0.2147705908085717
deviation-heading_max2.0427908857831625
deviation-heading_mean2.0427908857831625
deviation-heading_median2.0427908857831625
deviation-heading_min2.0427908857831625
distance-from-start_max2.4774569280358056
distance-from-start_mean2.4774569280358056
distance-from-start_median2.4774569280358056
distance-from-start_min2.4774569280358056
driven_any_max3.0766443175721947
driven_any_mean3.0766443175721947
driven_any_median3.0766443175721947
driven_any_min3.0766443175721947
driven_lanedir_consec_max3.064552505017095
driven_lanedir_consec_mean3.064552505017095
driven_lanedir_consec_min3.064552505017095
driven_lanedir_max3.064552505017095
driven_lanedir_mean3.064552505017095
driven_lanedir_median3.064552505017095
driven_lanedir_min3.064552505017095
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.0766443175721947, "survival_time": 32.250000000000306, "driven_lanedir": 3.064552505017095, "in-drivable-lane": 0.0, "deviation-heading": 2.0427908857831625, "distance-from-start": 2.4774569280358056, "deviation-center-line": 0.2147705908085717, "driven_lanedir_consec": 3.064552505017095}}
simulation-passed1
survival_time_max32.250000000000306
survival_time_mean32.250000000000306
survival_time_min32.250000000000306
No reset possible
167441685Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4successyesdavinci-stage-03-6.2.530:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065102356187873


other stats
deviation-center-line_max0.4065102356187873
deviation-center-line_mean0.4065102356187873
deviation-center-line_min0.4065102356187873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356187873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167341688Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-1of4successyesdavinci-stage-03-6.2.530:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.432891091920204
deviation-center-line_median0.289208824985897


other stats
deviation-center-line_max0.3421554544578389
deviation-center-line_mean0.28103246849939895
deviation-center-line_min0.20355676956796287
deviation-heading_max2.532090128626256
deviation-heading_mean2.1233379748915846
deviation-heading_median2.091598288393426
deviation-heading_min1.77806519415323
distance-from-start_max3.1537593976013736
distance-from-start_mean2.7244723642293835
distance-from-start_median2.704318718385367
distance-from-start_min2.3354926225454276
driven_any_max5.681727317187617
driven_any_mean5.356790518866223
driven_any_median5.444463301686621
driven_any_min4.856508154904032
driven_lanedir_consec_max5.66768880982045
driven_lanedir_consec_mean5.346200743455493
driven_lanedir_consec_min4.851331980161115
driven_lanedir_max5.66768880982045
driven_lanedir_mean5.346200743455493
driven_lanedir_median5.432891091920204
driven_lanedir_min4.851331980161115
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.292009447895602, "survival_time": 59.99999999999873, "driven_lanedir": 5.278658727024759, "in-drivable-lane": 0.0, "deviation-heading": 2.532090128626256, "distance-from-start": 2.693777297091483, "deviation-center-line": 0.295448770789397, "driven_lanedir_consec": 5.278658727024759}, "loop-000-ego1": {"driven_any": 5.596917155477642, "survival_time": 59.99999999999873, "driven_lanedir": 5.5871234568156485, "in-drivable-lane": 0.0, "deviation-heading": 2.16404711059614, "distance-from-start": 2.3354926225454276, "deviation-center-line": 0.3421554544578389, "driven_lanedir_consec": 5.5871234568156485}, "loop-000-ego2": {"driven_any": 4.856508154904032, "survival_time": 59.99999999999873, "driven_lanedir": 4.851331980161115, "in-drivable-lane": 0.0, "deviation-heading": 1.77806519415323, "distance-from-start": 3.1537593976013736, "deviation-center-line": 0.20355676956796287, "driven_lanedir_consec": 4.851331980161115}, "loop-000-ego3": {"driven_any": 5.681727317187617, "survival_time": 59.99999999999873, "driven_lanedir": 5.66768880982045, "in-drivable-lane": 0.0, "deviation-heading": 2.0191494661907115, "distance-from-start": 2.7148601396792507, "deviation-center-line": 0.282968879182397, "driven_lanedir_consec": 5.66768880982045}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167151693Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:12:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4352426430008087
deviation-center-line_median3.497394545816877


other stats
deviation-center-line_max3.497394545816877
deviation-center-line_mean3.497394545816877
deviation-center-line_min3.497394545816877
deviation-heading_max4.5431846817285875
deviation-heading_mean4.5431846817285875
deviation-heading_median4.5431846817285875
deviation-heading_min4.5431846817285875
distance-from-start_max2.2779004007617862
distance-from-start_mean2.2779004007617862
distance-from-start_median2.2779004007617862
distance-from-start_min2.2779004007617862
driven_any_max3.579588780115603
driven_any_mean3.579588780115603
driven_any_median3.579588780115603
driven_any_min3.579588780115603
driven_lanedir_consec_max3.4352426430008087
driven_lanedir_consec_mean3.4352426430008087
driven_lanedir_consec_min3.4352426430008087
driven_lanedir_max3.556065828743906
driven_lanedir_mean3.556065828743906
driven_lanedir_median3.556065828743906
driven_lanedir_min3.556065828743906
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579588780115603, "survival_time": 59.99999999999873, "driven_lanedir": 3.556065828743906, "in-drivable-lane": 0.0, "deviation-heading": 4.5431846817285875, "distance-from-start": 2.2779004007617862, "deviation-center-line": 3.497394545816877, "driven_lanedir_consec": 3.4352426430008087}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167101694Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-1of4successyesdavinci-stage-03-6.2.530:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median0.41885674395418215
deviation-center-line_median0.2592734099538108


other stats
deviation-center-line_max0.2592734099538108
deviation-center-line_mean0.2592734099538108
deviation-center-line_min0.2592734099538108
deviation-heading_max0.7151194489559713
deviation-heading_mean0.7151194489559713
deviation-heading_median0.7151194489559713
deviation-heading_min0.7151194489559713
distance-from-start_max0.4199960454985642
distance-from-start_mean0.4199960454985642
distance-from-start_median0.4199960454985642
distance-from-start_min0.4199960454985642
driven_any_max0.42359927688869903
driven_any_mean0.42359927688869903
driven_any_median0.42359927688869903
driven_any_min0.42359927688869903
driven_lanedir_consec_max0.41885674395418215
driven_lanedir_consec_mean0.41885674395418215
driven_lanedir_consec_min0.41885674395418215
driven_lanedir_max0.41885674395418215
driven_lanedir_mean0.41885674395418215
driven_lanedir_median0.41885674395418215
driven_lanedir_min0.41885674395418215
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
167061697Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4successyesdavinci-stage-03-6.2.530:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.949999999999754
in-drivable-lane_median2.0999999999999854
driven_lanedir_consec_median1.6184374408409197
deviation-center-line_median5.314566823663881


other stats
deviation-center-line_max5.605898707577726
deviation-center-line_mean5.314566823663881
deviation-center-line_min5.0232349397500355
deviation-heading_max12.492151788067773
deviation-heading_mean8.7311003580401
deviation-heading_median8.7311003580401
deviation-heading_min4.970048928012427
distance-from-start_max1.619836734308344
distance-from-start_mean1.309141287354286
distance-from-start_median1.309141287354286
distance-from-start_min0.998445840400228
driven_any_max2.3617420337632864
driven_any_mean1.724083393442756
driven_any_median1.724083393442756
driven_any_min1.0864247531222258
driven_lanedir_consec_max2.2050573724797125
driven_lanedir_consec_mean1.6184374408409197
driven_lanedir_consec_min1.031817509202127
driven_lanedir_max2.2050573724797125
driven_lanedir_mean1.6184374408409197
driven_lanedir_median1.6184374408409197
driven_lanedir_min1.031817509202127
in-drivable-lane_max3.0999999999999552
in-drivable-lane_mean2.0999999999999854
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0864247531222258, "survival_time": 41.949999999999754, "driven_lanedir": 1.031817509202127, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 12.492151788067773, "distance-from-start": 0.998445840400228, "deviation-center-line": 5.605898707577726, "driven_lanedir_consec": 1.031817509202127}, "loop2-000-ego1": {"driven_any": 2.3617420337632864, "survival_time": 41.949999999999754, "driven_lanedir": 2.2050573724797125, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 4.970048928012427, "distance-from-start": 1.619836734308344, "deviation-center-line": 5.0232349397500355, "driven_lanedir_consec": 2.2050573724797125}}
simulation-passed1
survival_time_max41.949999999999754
survival_time_mean41.949999999999754
survival_time_min41.949999999999754
No reset possible
166941697Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-1of4timeoutyesdavinci-stage-03-6.2.530:01:05
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166861702Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-0of4successyesdavinci-stage-03-6.2.530:12:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0918531760676333
deviation-center-line_median5.910477685795049


other stats
deviation-center-line_max5.910477685795049
deviation-center-line_mean5.910477685795049
deviation-center-line_min5.910477685795049
deviation-heading_max8.289002671411088
deviation-heading_mean8.289002671411088
deviation-heading_median8.289002671411088
deviation-heading_min8.289002671411088
distance-from-start_max1.0313532441319608
distance-from-start_mean1.0313532441319608
distance-from-start_median1.0313532441319608
distance-from-start_min1.0313532441319608
driven_any_max3.4490819978293596
driven_any_mean3.4490819978293596
driven_any_median3.4490819978293596
driven_any_min3.4490819978293596
driven_lanedir_consec_max2.0918531760676333
driven_lanedir_consec_mean2.0918531760676333
driven_lanedir_consec_min2.0918531760676333
driven_lanedir_max3.2042238074943747
driven_lanedir_mean3.2042238074943747
driven_lanedir_median3.2042238074943747
driven_lanedir_min3.2042238074943747
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.4490819978293596, "survival_time": 59.99999999999873, "driven_lanedir": 3.2042238074943747, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.289002671411088, "distance-from-start": 1.0313532441319608, "deviation-center-line": 5.910477685795049, "driven_lanedir_consec": 2.0918531760676333}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166841700Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-3of4successyesdavinci-stage-03-6.2.530:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible