Duckietown Challenges Home Challenges Submissions

Evaluator 137

ID137
evaluatordavinci-stage-09-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-09-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success32 16697
# timeout
# failed6 17003
# error
# aborted
# host-error4 16875
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors99%
RAM total (MB)251.6 GB
RAM free (MB)242.5 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172771859Kathryn Hiteexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-09-6.2.530:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
172651856Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-09-6.2.530:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
17261385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4host-erroryesdavinci-stage-09-6.2.530:01:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17258385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4host-erroryesdavinci-stage-09-6.2.530:01:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17189392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4successyesdavinci-stage-09-6.2.530:35:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.999999999999336
driven_lanedir_consec_median-3.4156499099354853
deviation-center-line_median2.87239643914994


other stats
deviation-center-line_max3.4537472946026178
deviation-center-line_mean2.871714197345292
deviation-center-line_min2.2883166164786695
deviation-heading_max28.568943948043977
deviation-heading_mean26.693110976341337
deviation-heading_median27.22104797973163
deviation-heading_min23.761403997858103
distance-from-start_max0.16749848487583546
distance-from-start_mean0.1603659015992278
distance-from-start_median0.16013753826758417
distance-from-start_min0.15369004498590744
driven_any_max12.431360586878789
driven_any_mean12.113961971925365
driven_any_median12.16173473685745
driven_any_min11.70101782710776
driven_lanedir_consec_max-3.006322274904445
driven_lanedir_consec_mean-3.422851739275908
driven_lanedir_consec_min-3.853784862328217
driven_lanedir_max-3.006322274904445
driven_lanedir_mean-3.49583325130566
driven_lanedir_median-3.561612933994989
driven_lanedir_min-3.853784862328217
in-drivable-lane_max31.49999999999931
in-drivable-lane_mean28.787499999999344
in-drivable-lane_min23.649999999999388
per-episodes
details{"loop-000-ego0": {"driven_any": 11.70101782710776, "survival_time": 59.99999999999873, "driven_lanedir": -3.2842551489671727, "in-drivable-lane": 23.649999999999388, "deviation-heading": 28.568943948043977, "distance-from-start": 0.15369004498590744, "deviation-center-line": 3.4537472946026178, "driven_lanedir_consec": -3.2842551489671727}, "loop-000-ego1": {"driven_any": 12.385460393712902, "survival_time": 59.99999999999873, "driven_lanedir": -3.006322274904445, "in-drivable-lane": 30.649999999999288, "deviation-heading": 27.91215760925922, "distance-from-start": 0.16520364472957816, "deviation-center-line": 3.0152621533695534, "driven_lanedir_consec": -3.006322274904445}, "loop-000-ego2": {"driven_any": 11.938009080002, "survival_time": 59.99999999999873, "driven_lanedir": -3.838970719022806, "in-drivable-lane": 31.49999999999931, "deviation-heading": 23.761403997858103, "distance-from-start": 0.16749848487583546, "deviation-center-line": 2.2883166164786695, "driven_lanedir_consec": -3.5470446709037975}, "loop-000-ego3": {"driven_any": 12.431360586878789, "survival_time": 59.99999999999873, "driven_lanedir": -3.853784862328217, "in-drivable-lane": 29.349999999999383, "deviation-heading": 26.52993835020403, "distance-from-start": 0.15507143180559016, "deviation-center-line": 2.729530724930327, "driven_lanedir_consec": -3.853784862328217}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17179394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-2of4successyesdavinci-stage-09-6.2.530:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.399999999999142
driven_lanedir_consec_median-1.8115207049710225
deviation-center-line_median3.619278325570927


other stats
deviation-center-line_max3.619278325570927
deviation-center-line_mean3.619278325570927
deviation-center-line_min3.619278325570927
deviation-heading_max25.651175977169135
deviation-heading_mean25.651175977169135
deviation-heading_median25.651175977169135
deviation-heading_min25.651175977169135
distance-from-start_max0.152755833793969
distance-from-start_mean0.152755833793969
distance-from-start_median0.152755833793969
distance-from-start_min0.152755833793969
driven_any_max10.210169126488724
driven_any_mean10.210169126488724
driven_any_median10.210169126488724
driven_any_min10.210169126488724
driven_lanedir_consec_max-1.8115207049710225
driven_lanedir_consec_mean-1.8115207049710225
driven_lanedir_consec_min-1.8115207049710225
driven_lanedir_max-1.8115207049710225
driven_lanedir_mean-1.8115207049710225
driven_lanedir_median-1.8115207049710225
driven_lanedir_min-1.8115207049710225
in-drivable-lane_max26.399999999999142
in-drivable-lane_mean26.399999999999142
in-drivable-lane_min26.399999999999142
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.210169126488724, "survival_time": 59.99999999999873, "driven_lanedir": -1.8115207049710225, "in-drivable-lane": 26.399999999999142, "deviation-heading": 25.651175977169135, "distance-from-start": 0.152755833793969, "deviation-center-line": 3.619278325570927, "driven_lanedir_consec": -1.8115207049710225}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17172396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-3of4successyesdavinci-stage-09-6.2.530:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17166514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failedyesdavinci-stage-09-6.2.530:01:45
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17159515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failedyesdavinci-stage-09-6.2.530:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17149517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-0of4failedyesdavinci-stage-09-6.2.530:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17141519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-0of4failedyesdavinci-stage-09-6.2.530:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17132521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failedyesdavinci-stage-09-6.2.530:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17124524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-3of4successyesdavinci-stage-09-6.2.530:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17062542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-1of4successyesdavinci-stage-09-6.2.530:25:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median6.469323635565996
deviation-center-line_median4.3143707239626


other stats
deviation-center-line_max7.310521768919497
deviation-center-line_mean4.814337196931958
deviation-center-line_min3.3180855708831354
deviation-heading_max28.327641092414815
deviation-heading_mean19.158021927773344
deviation-heading_median17.18986465543658
deviation-heading_min13.924717307805402
distance-from-start_max3.259907041099038
distance-from-start_mean1.9328320676150583
distance-from-start_median2.003233765591634
distance-from-start_min0.464953698177928
driven_any_max10.683513621314466
driven_any_mean6.390438341258884
driven_any_median7.196585458744389
driven_any_min0.4850688262322927
driven_lanedir_consec_max9.728056709458372
driven_lanedir_consec_mean5.781293297136001
driven_lanedir_consec_min0.4584692079536401
driven_lanedir_max10.089690948759772
driven_lanedir_mean6.049094264497043
driven_lanedir_median6.8241084506373815
driven_lanedir_min0.4584692079536401
in-drivable-lane_max0.29999999999998295
in-drivable-lane_mean0.07499999999999574
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4850688262322927, "survival_time": 59.99999999999873, "driven_lanedir": 0.4584692079536401, "in-drivable-lane": 0.0, "deviation-heading": 19.74992981274655, "distance-from-start": 0.464953698177928, "deviation-center-line": 7.310521768919497, "driven_lanedir_consec": 0.4584692079536401}, "4way-000-ego1": {"driven_any": 3.793757079890853, "survival_time": 59.99999999999873, "driven_lanedir": 3.62270018335154, "in-drivable-lane": 0.0, "deviation-heading": 28.327641092414815, "distance-from-start": 0.973574810162383, "deviation-center-line": 5.139649988648461, "driven_lanedir_consec": 3.62270018335154}, "4way-000-ego2": {"driven_any": 10.683513621314466, "survival_time": 59.99999999999873, "driven_lanedir": 10.089690948759772, "in-drivable-lane": 0.29999999999998295, "deviation-heading": 13.924717307805402, "distance-from-start": 3.0328927210208847, "deviation-center-line": 3.3180855708831354, "driven_lanedir_consec": 9.315947087780453}, "4way-000-ego3": {"driven_any": 10.599413837597924, "survival_time": 59.99999999999873, "driven_lanedir": 10.025516717923225, "in-drivable-lane": 0.0, "deviation-heading": 14.629799498126603, "distance-from-start": 3.259907041099038, "deviation-center-line": 3.4890914592767404, "driven_lanedir_consec": 9.728056709458372}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
170391554Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-09-6.2.530:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170281556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-09-6.2.530:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170141597Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-09-6.2.530:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170031603Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4failedyesdavinci-stage-09-6.2.530:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169411628Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successyesdavinci-stage-09-6.2.530:14:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.6017417553703126e-06
deviation-center-line_median0.8949077950231444


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169301630Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-0of4successyesdavinci-stage-09-6.2.530:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299162


other stats
deviation-center-line_max0.8949116056299162
deviation-center-line_mean0.8949116056299162
deviation-center-line_min0.8949116056299162
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949116056299162, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169111636Bea Baselines 🐤baseline-duckietown-mllx22-objdetsimsuccessyesdavinci-stage-09-6.2.530:15:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median0.0001430511474609375


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 0.0001430511474609375}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 0.0, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168891650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4successyesdavinci-stage-09-6.2.530:16:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844889463941298


other stats
deviation-center-line_max3.468403943259572
deviation-center-line_mean1.715123114844324
deviation-center-line_min0.22311062332946505
deviation-heading_max40.967332753486254
deviation-heading_mean25.437951450471505
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max8.95090418262362e-16
distance-from-start_mean2.515281801812194e-16
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max1.0741085019148277e-12
driven_any_mean3.018338162174616e-13
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.0741085019148277e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 8.95090418262362e-16, "deviation-center-line": 0.40651845769758127, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.468403943259572, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332946505, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168791646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4host-erroryesdavinci-stage-09-6.2.530:04:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: TLS handshake timeout")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/f431188fb8ebd31a0eb9cfd0805e7fee5e369b5650be580cbe27e52bc2c0200c"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168751639Bea Baselines 🐤baseline-duckietown-mllx22-BV1sim-2of5host-erroryesdavinci-stage-09-6.2.530:06:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/3ad67e16040c245fc6a54f04f80e81ce1a461e9b49a6f06561125128b613ce8d"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168741642Bea Baselines 🐤baseline-duckietown-mlaido-hello-sim-validationsanity-checksuccessyesdavinci-stage-09-6.2.530:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1920928955078125e-06
deviation-center-line_median0.007457559042937448


other stats
deviation-center-line_max0.007457559042937448
deviation-center-line_mean0.007457559042937448
deviation-center-line_min0.007457559042937448
deviation-heading_max0.26874261028062396
deviation-heading_mean0.26874261028062396
deviation-heading_median0.26874261028062396
deviation-heading_min0.26874261028062396
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max6.280369834735102e-15
driven_any_mean6.280369834735102e-15
driven_any_median6.280369834735102e-15
driven_any_min6.280369834735102e-15
driven_lanedir_consec_max1.1920928955078125e-06
driven_lanedir_consec_mean1.1920928955078125e-06
driven_lanedir_consec_min1.1920928955078125e-06
driven_lanedir_max1.1920928955078125e-06
driven_lanedir_mean1.1920928955078125e-06
driven_lanedir_median1.1920928955078125e-06
driven_lanedir_min1.1920928955078125e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 6.280369834735102e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.26874261028062396, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
168631649Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-1of4successyesdavinci-stage-09-6.2.530:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065134212579011
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065134212579011
deviation-center-line_mean0.4065134212579011
deviation-center-line_min0.4065134212579011
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.4065134212579011, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168621648Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4successyesdavinci-stage-09-6.2.530:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168561650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-09-6.2.530:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168221658Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4successyesdavinci-stage-09-6.2.530:24:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median11.49999999999963
driven_lanedir_consec_median3.233627285336651
deviation-center-line_median3.9237969891156697


other stats
deviation-center-line_max5.6094957897238045
deviation-center-line_mean3.839322711153715
deviation-center-line_min1.900201076659718
deviation-heading_max26.121483543374964
deviation-heading_mean16.63568380685753
deviation-heading_median15.784492112170373
deviation-heading_min8.852267459714401
distance-from-start_max2.6951292178840305
distance-from-start_mean2.0999962823570444
distance-from-start_median2.1326449689550433
distance-from-start_min1.4395659736340596
driven_any_max7.913918913662998
driven_any_mean6.363797629361558
driven_any_median6.363701182616291
driven_any_min4.813869238550651
driven_lanedir_consec_max4.985281125603234
driven_lanedir_consec_mean3.550480764029561
driven_lanedir_consec_min2.7493873598417067
driven_lanedir_max6.320684412338849
driven_lanedir_mean4.806290125996183
driven_lanedir_median4.551285366444843
driven_lanedir_min3.801905358756195
in-drivable-lane_max27.849999999998687
in-drivable-lane_mean13.72499999999948
in-drivable-lane_min4.049999999999972
per-episodes
details{"loop-000-ego0": {"driven_any": 4.813869238550651, "survival_time": 59.99999999999873, "driven_lanedir": 3.801905358756195, "in-drivable-lane": 4.049999999999972, "deviation-heading": 26.121483543374964, "distance-from-start": 2.1368139803570374, "deviation-center-line": 5.6094957897238045, "driven_lanedir_consec": 2.7493873598417067}, "loop-000-ego1": {"driven_any": 7.913918913662998, "survival_time": 59.99999999999873, "driven_lanedir": 6.320684412338849, "in-drivable-lane": 7.749999999999723, "deviation-heading": 15.439053532475691, "distance-from-start": 2.6951292178840305, "deviation-center-line": 4.294983215459429, "driven_lanedir_consec": 4.985281125603234}, "loop-000-ego2": {"driven_any": 7.913512390970832, "survival_time": 59.99999999999873, "driven_lanedir": 5.231051093868647, "in-drivable-lane": 15.249999999999536, "deviation-heading": 16.129930691865052, "distance-from-start": 1.4395659736340596, "deviation-center-line": 3.55261076277191, "driven_lanedir_consec": 3.5502318773359605}, "loop-000-ego3": {"driven_any": 4.81388997426175, "survival_time": 59.99999999999873, "driven_lanedir": 3.87151963902104, "in-drivable-lane": 27.849999999998687, "deviation-heading": 8.852267459714401, "distance-from-start": 2.1284759575530496, "deviation-center-line": 1.900201076659718, "driven_lanedir_consec": 2.9170226933373415}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168191659Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-2of4successyesdavinci-stage-09-6.2.530:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.299999999999995
in-drivable-lane_median2.1000000000000147
driven_lanedir_consec_median0.862787926971639
deviation-center-line_median0.26187930037806706


other stats
deviation-center-line_max0.26187930037806706
deviation-center-line_mean0.26187930037806706
deviation-center-line_min0.26187930037806706
deviation-heading_max1.4589397629719076
deviation-heading_mean1.4589397629719076
deviation-heading_median1.4589397629719076
deviation-heading_min1.4589397629719076
distance-from-start_max0.7840818000130989
distance-from-start_mean0.7840818000130989
distance-from-start_median0.7840818000130989
distance-from-start_min0.7840818000130989
driven_any_max1.0834018058914796
driven_any_mean1.0834018058914796
driven_any_median1.0834018058914796
driven_any_min1.0834018058914796
driven_lanedir_consec_max0.862787926971639
driven_lanedir_consec_mean0.862787926971639
driven_lanedir_consec_min0.862787926971639
driven_lanedir_max0.862787926971639
driven_lanedir_mean0.862787926971639
driven_lanedir_median0.862787926971639
driven_lanedir_min0.862787926971639
in-drivable-lane_max2.1000000000000147
in-drivable-lane_mean2.1000000000000147
in-drivable-lane_min2.1000000000000147
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0834018058914796, "survival_time": 9.299999999999995, "driven_lanedir": 0.862787926971639, "in-drivable-lane": 2.1000000000000147, "deviation-heading": 1.4589397629719076, "distance-from-start": 0.7840818000130989, "deviation-center-line": 0.26187930037806706, "driven_lanedir_consec": 0.862787926971639}}
simulation-passed1
survival_time_max9.299999999999995
survival_time_mean9.299999999999995
survival_time_min9.299999999999995
No reset possible
168121664Bea Baselines 🐤baseline-duckietownlx22-BV1sim-3of5successyesdavinci-stage-09-6.2.530:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.683638047423256


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.683638047423256
distance-from-start_median5.683638047423256
distance-from-start_min5.683638047423256
driven_any_max6.108913024706582
driven_any_mean6.108913024706582
driven_any_median6.108913024706582
driven_any_min6.108913024706582
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max47.09999999999946
in-drivable-lane_mean47.09999999999946
in-drivable-lane_median47.09999999999946
in-drivable-lane_min47.09999999999946
per-episodes
details{"d50-ego0": {"driven_any": 6.108913024706582, "survival_time": 47.09999999999946, "driven_lanedir": 0.0, "in-drivable-lane": 47.09999999999946, "deviation-heading": 0.0, "distance-from-start": 5.683638047423256, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max47.09999999999946
survival_time_mean47.09999999999946
survival_time_median47.09999999999946
survival_time_min47.09999999999946
No reset possible
168041671Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4successyesdavinci-stage-09-6.2.530:04:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.400000000000055
in-drivable-lane_median11.350000000000056
driven_lanedir_consec_median0.161696333392781
deviation-center-line_median0.17694525285524573


other stats
deviation-center-line_max0.17694525285524573
deviation-center-line_mean0.17694525285524573
deviation-center-line_min0.17694525285524573
deviation-heading_max1.3842827237215003
deviation-heading_mean1.3842827237215003
deviation-heading_median1.3842827237215003
deviation-heading_min1.3842827237215003
distance-from-start_max1.1295403666741084
distance-from-start_mean1.1295403666741084
distance-from-start_median1.1295403666741084
distance-from-start_min1.1295403666741084
driven_any_max1.6341976444136197
driven_any_mean1.6341976444136197
driven_any_median1.6341976444136197
driven_any_min1.6341976444136197
driven_lanedir_consec_max0.161696333392781
driven_lanedir_consec_mean0.161696333392781
driven_lanedir_consec_min0.161696333392781
driven_lanedir_max0.1683481764621606
driven_lanedir_mean0.1683481764621606
driven_lanedir_median0.1683481764621606
driven_lanedir_min0.1683481764621606
in-drivable-lane_max11.350000000000056
in-drivable-lane_mean11.350000000000056
in-drivable-lane_min11.350000000000056
per-episodes
details{"loop-000-ego0": {"driven_any": 1.6341976444136197, "survival_time": 13.400000000000055, "driven_lanedir": 0.1683481764621606, "in-drivable-lane": 11.350000000000056, "deviation-heading": 1.3842827237215003, "distance-from-start": 1.1295403666741084, "deviation-center-line": 0.17694525285524573, "driven_lanedir_consec": 0.161696333392781}}
simulation-passed1
survival_time_max13.400000000000055
survival_time_mean13.400000000000055
survival_time_min13.400000000000055
No reset possible
167981672Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-2of4successyesdavinci-stage-09-6.2.530:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
167901674Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-3of4successyesdavinci-stage-09-6.2.530:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.423006437522288
survival_time_median54.69999999999903
deviation-center-line_median4.377648933894154
in-drivable-lane_median2.249999999999905


other stats
deviation-center-line_max4.377648933894154
deviation-center-line_mean4.377648933894154
deviation-center-line_min4.377648933894154
deviation-heading_max11.252525680196014
deviation-heading_mean11.252525680196014
deviation-heading_median11.252525680196014
deviation-heading_min11.252525680196014
distance-from-start_max2.83590505399894
distance-from-start_mean2.83590505399894
distance-from-start_median2.83590505399894
distance-from-start_min2.83590505399894
driven_any_max7.111141849771182
driven_any_mean7.111141849771182
driven_any_median7.111141849771182
driven_any_min7.111141849771182
driven_lanedir_consec_max5.423006437522288
driven_lanedir_consec_mean5.423006437522288
driven_lanedir_consec_min5.423006437522288
driven_lanedir_max6.4937073242003835
driven_lanedir_mean6.4937073242003835
driven_lanedir_median6.4937073242003835
driven_lanedir_min6.4937073242003835
in-drivable-lane_max2.249999999999905
in-drivable-lane_mean2.249999999999905
in-drivable-lane_min2.249999999999905
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.111141849771182, "survival_time": 54.69999999999903, "driven_lanedir": 6.4937073242003835, "in-drivable-lane": 2.249999999999905, "deviation-heading": 11.252525680196014, "distance-from-start": 2.83590505399894, "deviation-center-line": 4.377648933894154, "driven_lanedir_consec": 5.423006437522288}}
simulation-passed1
survival_time_max54.69999999999903
survival_time_mean54.69999999999903
survival_time_min54.69999999999903
No reset possible
167731852Andrea Censiexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-09-6.2.530:10:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
167581681Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successyesdavinci-stage-09-6.2.530:10:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4477076357371352
deviation-center-line_median0.0719572483263306


other stats
deviation-center-line_max0.0719572483263306
deviation-center-line_mean0.0719572483263306
deviation-center-line_min0.0719572483263306
deviation-heading_max1.9197947517405864
deviation-heading_mean1.9197947517405864
deviation-heading_median1.9197947517405864
deviation-heading_min1.9197947517405864
distance-from-start_max0.4476854412517205
distance-from-start_mean0.4476854412517205
distance-from-start_median0.4476854412517205
distance-from-start_min0.4476854412517205
driven_any_max0.4483014753438006
driven_any_mean0.4483014753438006
driven_any_median0.4483014753438006
driven_any_min0.4483014753438006
driven_lanedir_consec_max0.4477076357371352
driven_lanedir_consec_mean0.4477076357371352
driven_lanedir_consec_min0.4477076357371352
driven_lanedir_max0.4477076357371352
driven_lanedir_mean0.4477076357371352
driven_lanedir_median0.4477076357371352
driven_lanedir_min0.4477076357371352
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 0.4483014753438006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4477076357371352, "in-drivable-lane": 0.0, "deviation-heading": 1.9197947517405864, "distance-from-start": 0.4476854412517205, "deviation-center-line": 0.0719572483263306, "driven_lanedir_consec": 0.4477076357371352}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167401686Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-3of4successyesdavinci-stage-09-6.2.530:12:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.38577379311006
deviation-center-line_median0.2253916973044201


other stats
deviation-center-line_max0.25150945762104626
deviation-center-line_mean0.2258728989276509
deviation-center-line_min0.20119874348071703
deviation-heading_max1.870868162450936
deviation-heading_mean1.6814661218930986
deviation-heading_median1.6978808943178063
deviation-heading_min1.4592345364858448
distance-from-start_max2.4901635835539864
distance-from-start_mean2.340615857594544
distance-from-start_median2.4217755218392245
distance-from-start_min2.0287488031457404
driven_any_max5.888840872450049
driven_any_mean5.666255234642627
driven_any_median5.696354385105463
driven_any_min5.383471295909528
driven_lanedir_consec_max5.88286659371623
driven_lanedir_consec_mean5.383274938407007
driven_lanedir_consec_min4.878685573691682
driven_lanedir_max5.88286659371623
driven_lanedir_mean5.6600988125150735
driven_lanedir_median5.689408214739162
driven_lanedir_min5.378712226865741
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.589326286428048, "survival_time": 59.99999999999873, "driven_lanedir": 5.583554682769149, "in-drivable-lane": 0.0, "deviation-heading": 1.828622792773347, "distance-from-start": 2.3544469360186357, "deviation-center-line": 0.2485102614270095, "driven_lanedir_consec": 4.878685573691682}, "4way-001-ego1": {"driven_any": 5.888840872450049, "survival_time": 59.99999999999873, "driven_lanedir": 5.88286659371623, "in-drivable-lane": 0.0, "deviation-heading": 1.4592345364858448, "distance-from-start": 2.4891041076598133, "deviation-center-line": 0.20119874348071703, "driven_lanedir_consec": 5.88286659371623}, "4way-001-ego2": {"driven_any": 5.803382483782878, "survival_time": 59.99999999999873, "driven_lanedir": 5.795261746709174, "in-drivable-lane": 0.0, "deviation-heading": 1.870868162450936, "distance-from-start": 2.4901635835539864, "deviation-center-line": 0.25150945762104626, "driven_lanedir_consec": 5.392835359354378}, "4way-001-ego3": {"driven_any": 5.383471295909528, "survival_time": 59.99999999999873, "driven_lanedir": 5.378712226865741, "in-drivable-lane": 0.0, "deviation-heading": 1.567138995862266, "distance-from-start": 2.0287488031457404, "deviation-center-line": 0.2022731331818307, "driven_lanedir_consec": 5.378712226865741}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167241690Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-0of4successyesdavinci-stage-09-6.2.530:13:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.1417360050531755
deviation-center-line_median0.53453245126959


other stats
deviation-center-line_max0.53453245126959
deviation-center-line_mean0.53453245126959
deviation-center-line_min0.53453245126959
deviation-heading_max4.002468114919836
deviation-heading_mean4.002468114919836
deviation-heading_median4.002468114919836
deviation-heading_min4.002468114919836
distance-from-start_max3.4062886142559416
distance-from-start_mean3.4062886142559416
distance-from-start_median3.4062886142559416
distance-from-start_min3.4062886142559416
driven_any_max5.164260198360464
driven_any_mean5.164260198360464
driven_any_median5.164260198360464
driven_any_min5.164260198360464
driven_lanedir_consec_max5.1417360050531755
driven_lanedir_consec_mean5.1417360050531755
driven_lanedir_consec_min5.1417360050531755
driven_lanedir_max5.1417360050531755
driven_lanedir_mean5.1417360050531755
driven_lanedir_median5.1417360050531755
driven_lanedir_min5.1417360050531755
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.164260198360464, "survival_time": 59.99999999999873, "driven_lanedir": 5.1417360050531755, "in-drivable-lane": 0.0, "deviation-heading": 4.002468114919836, "distance-from-start": 3.4062886142559416, "deviation-center-line": 0.53453245126959, "driven_lanedir_consec": 5.1417360050531755}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167201691Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successyesdavinci-stage-09-6.2.530:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.250000000000153
in-drivable-lane_median0.0
driven_lanedir_consec_median1.822088964337002
deviation-center-line_median0.20357564547105955


other stats
deviation-center-line_max0.20357564547105955
deviation-center-line_mean0.20357564547105955
deviation-center-line_min0.20357564547105955
deviation-heading_max1.6073324247192475
deviation-heading_mean1.6073324247192475
deviation-heading_median1.6073324247192475
deviation-heading_min1.6073324247192475
distance-from-start_max1.059982869303493
distance-from-start_mean1.059982869303493
distance-from-start_median1.059982869303493
distance-from-start_min1.059982869303493
driven_any_max1.8350627704817688
driven_any_mean1.8350627704817688
driven_any_median1.8350627704817688
driven_any_min1.8350627704817688
driven_lanedir_consec_max1.822088964337002
driven_lanedir_consec_mean1.822088964337002
driven_lanedir_consec_min1.822088964337002
driven_lanedir_max1.822088964337002
driven_lanedir_mean1.822088964337002
driven_lanedir_median1.822088964337002
driven_lanedir_min1.822088964337002
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8350627704817688, "survival_time": 20.250000000000153, "driven_lanedir": 1.822088964337002, "in-drivable-lane": 0.0, "deviation-heading": 1.6073324247192475, "distance-from-start": 1.059982869303493, "deviation-center-line": 0.20357564547105955, "driven_lanedir_consec": 1.822088964337002}}
simulation-passed1
survival_time_max20.250000000000153
survival_time_mean20.250000000000153
survival_time_min20.250000000000153
No reset possible
167181692Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checksuccessyesdavinci-stage-09-6.2.530:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02249654394867484
deviation-center-line_median0.0052536287874529785


other stats
deviation-center-line_max0.0052536287874529785
deviation-center-line_mean0.0052536287874529785
deviation-center-line_min0.0052536287874529785
deviation-heading_max0.2537079422480557
deviation-heading_mean0.2537079422480557
deviation-heading_median0.2537079422480557
deviation-heading_min0.2537079422480557
distance-from-start_max0.025223546623389756
distance-from-start_mean0.025223546623389756
distance-from-start_median0.025223546623389756
distance-from-start_min0.025223546623389756
driven_any_max0.025243366614066683
driven_any_mean0.025243366614066683
driven_any_median0.025243366614066683
driven_any_min0.025243366614066683
driven_lanedir_consec_max0.02249654394867484
driven_lanedir_consec_mean0.02249654394867484
driven_lanedir_consec_min0.02249654394867484
driven_lanedir_max0.02249654394867484
driven_lanedir_mean0.02249654394867484
driven_lanedir_median0.02249654394867484
driven_lanedir_min0.02249654394867484
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.025243366614066683, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02249654394867484, "in-drivable-lane": 0.0, "deviation-heading": 0.2537079422480557, "distance-from-start": 0.025223546623389756, "deviation-center-line": 0.0052536287874529785, "driven_lanedir_consec": 0.02249654394867484}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
167131694Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-0of4successyesdavinci-stage-09-6.2.530:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.200000000000223
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.3557424143249113
deviation-center-line_median2.2764052687353016


other stats
deviation-center-line_max2.2764052687353016
deviation-center-line_mean2.2764052687353016
deviation-center-line_min2.2764052687353016
deviation-heading_max2.9201829757406066
deviation-heading_mean2.9201829757406066
deviation-heading_median2.9201829757406066
deviation-heading_min2.9201829757406066
distance-from-start_max1.1340032910142968
distance-from-start_mean1.1340032910142968
distance-from-start_median1.1340032910142968
distance-from-start_min1.1340032910142968
driven_any_max1.4165963270662665
driven_any_mean1.4165963270662665
driven_any_median1.4165963270662665
driven_any_min1.4165963270662665
driven_lanedir_consec_max1.3557424143249113
driven_lanedir_consec_mean1.3557424143249113
driven_lanedir_consec_min1.3557424143249113
driven_lanedir_max1.3557424143249113
driven_lanedir_mean1.3557424143249113
driven_lanedir_median1.3557424143249113
driven_lanedir_min1.3557424143249113
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean25.200000000000223
survival_time_min25.200000000000223
No reset possible
166971696Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-1of4successyesdavinci-stage-09-6.2.530:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5265618997780304
deviation-center-line_median3.553964307961913


other stats
deviation-center-line_max3.553964307961913
deviation-center-line_mean3.553964307961913
deviation-center-line_min3.553964307961913
deviation-heading_max4.887734095372573
deviation-heading_mean4.887734095372573
deviation-heading_median4.887734095372573
deviation-heading_min4.887734095372573
distance-from-start_max1.5359325577938203
distance-from-start_mean1.5359325577938203
distance-from-start_median1.5359325577938203
distance-from-start_min1.5359325577938203
driven_any_max3.579592227332615
driven_any_mean3.579592227332615
driven_any_median3.579592227332615
driven_any_min3.579592227332615
driven_lanedir_consec_max3.5265618997780304
driven_lanedir_consec_mean3.5265618997780304
driven_lanedir_consec_min3.5265618997780304
driven_lanedir_max3.553623248038845
driven_lanedir_mean3.553623248038845
driven_lanedir_median3.553623248038845
driven_lanedir_min3.553623248038845
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579592227332615, "survival_time": 59.99999999999873, "driven_lanedir": 3.553623248038845, "in-drivable-lane": 0.0, "deviation-heading": 4.887734095372573, "distance-from-start": 1.5359325577938203, "deviation-center-line": 3.553964307961913, "driven_lanedir_consec": 3.5265618997780304}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible