Duckietown Challenges Home Challenges Submissions

Evaluator 141

ID141
evaluatordavinci-stage-07-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-07-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success42 16702
# timeout2 16877
# failed10 16961
# error
# aborted
# host-error5 16873
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors98%
RAM total (MB)251.6 GB
RAM free (MB)242.5 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
17255386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median10.349999999999728
driven_lanedir_consec_median-5.310963471592967
deviation-center-line_median5.40415494664396


other stats
deviation-center-line_max5.40415494664396
deviation-center-line_mean5.40415494664396
deviation-center-line_min5.40415494664396
deviation-heading_max32.42008208358762
deviation-heading_mean32.42008208358762
deviation-heading_median32.42008208358762
deviation-heading_min32.42008208358762
distance-from-start_max0.28370181540005096
distance-from-start_mean0.28370181540005096
distance-from-start_median0.28370181540005096
distance-from-start_min0.28370181540005096
driven_any_max15.443572014214675
driven_any_mean15.443572014214675
driven_any_median15.443572014214675
driven_any_min15.443572014214675
driven_lanedir_consec_max-5.310963471592967
driven_lanedir_consec_mean-5.310963471592967
driven_lanedir_consec_min-5.310963471592967
driven_lanedir_max-9.0129608618032
driven_lanedir_mean-9.0129608618032
driven_lanedir_median-9.0129608618032
driven_lanedir_min-9.0129608618032
in-drivable-lane_max10.349999999999728
in-drivable-lane_mean10.349999999999728
in-drivable-lane_min10.349999999999728
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.443572014214675, "survival_time": 59.99999999999873, "driven_lanedir": -9.0129608618032, "in-drivable-lane": 10.349999999999728, "deviation-heading": 32.42008208358762, "distance-from-start": 0.28370181540005096, "deviation-center-line": 5.40415494664396, "driven_lanedir_consec": -5.310963471592967}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17246386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-1of4successyesdavinci-stage-07-6.2.530:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.89999999999976
in-drivable-lane_median14.299999999999784
driven_lanedir_consec_median-1.5677272292382185
deviation-center-line_median2.4843542717765112


other stats
deviation-center-line_max2.4843542717765112
deviation-center-line_mean2.4843542717765112
deviation-center-line_min2.4843542717765112
deviation-heading_max21.03781937302345
deviation-heading_mean21.03781937302345
deviation-heading_median21.03781937302345
deviation-heading_min21.03781937302345
distance-from-start_max0.18487475652547797
distance-from-start_mean0.18487475652547797
distance-from-start_median0.18487475652547797
distance-from-start_min0.18487475652547797
driven_any_max7.419813798607
driven_any_mean7.419813798607
driven_any_median7.419813798607
driven_any_min7.419813798607
driven_lanedir_consec_max-1.5677272292382185
driven_lanedir_consec_mean-1.5677272292382185
driven_lanedir_consec_min-1.5677272292382185
driven_lanedir_max-1.9018530098721296
driven_lanedir_mean-1.9018530098721296
driven_lanedir_median-1.9018530098721296
driven_lanedir_min-1.9018530098721296
in-drivable-lane_max14.299999999999784
in-drivable-lane_mean14.299999999999784
in-drivable-lane_min14.299999999999784
per-episodes
details{"loop-000-ego0": {"driven_any": 7.419813798607, "survival_time": 41.89999999999976, "driven_lanedir": -1.9018530098721296, "in-drivable-lane": 14.299999999999784, "deviation-heading": 21.03781937302345, "distance-from-start": 0.18487475652547797, "deviation-center-line": 2.4843542717765112, "driven_lanedir_consec": -1.5677272292382185}}
simulation-passed1
survival_time_max41.89999999999976
survival_time_mean41.89999999999976
survival_time_min41.89999999999976
No reset possible
17244391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4failedyesdavinci-stage-07-6.2.530:01:29
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17220390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.9777863204020623
survival_time_median59.99999999999873
deviation-center-line_median1.8263338017583353
in-drivable-lane_median26.699999999999484


other stats
deviation-center-line_max1.8263338017583353
deviation-center-line_mean1.8263338017583353
deviation-center-line_min1.8263338017583353
deviation-heading_max28.179730202436456
deviation-heading_mean28.179730202436456
deviation-heading_median28.179730202436456
deviation-heading_min28.179730202436456
distance-from-start_max0.21823279645169788
distance-from-start_mean0.21823279645169788
distance-from-start_median0.21823279645169788
distance-from-start_min0.21823279645169788
driven_any_max13.14036317960576
driven_any_mean13.14036317960576
driven_any_median13.14036317960576
driven_any_min13.14036317960576
driven_lanedir_consec_max-3.9777863204020623
driven_lanedir_consec_mean-3.9777863204020623
driven_lanedir_consec_min-3.9777863204020623
driven_lanedir_max-4.421816528752701
driven_lanedir_mean-4.421816528752701
driven_lanedir_median-4.421816528752701
driven_lanedir_min-4.421816528752701
in-drivable-lane_max26.699999999999484
in-drivable-lane_mean26.699999999999484
in-drivable-lane_min26.699999999999484
per-episodes
details{"zigzag-000-ego0": {"driven_any": 13.14036317960576, "survival_time": 59.99999999999873, "driven_lanedir": -4.421816528752701, "in-drivable-lane": 26.699999999999484, "deviation-heading": 28.179730202436456, "distance-from-start": 0.21823279645169788, "deviation-center-line": 1.8263338017583353, "driven_lanedir_consec": -3.9777863204020623}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17215392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4host-erroryesdavinci-stage-07-6.2.530:01:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17210392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4host-erroryesdavinci-stage-07-6.2.530:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17208390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-2of4host-erroryesdavinci-stage-07-6.2.530:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17204390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-0of4host-erroryesdavinci-stage-07-6.2.530:00:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17177395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-07-6.2.530:17:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.849999999999195
driven_lanedir_consec_median-2.757255501829291
deviation-center-line_median2.9451204666257524


other stats
deviation-center-line_max2.9451204666257524
deviation-center-line_mean2.9451204666257524
deviation-center-line_min2.9451204666257524
deviation-heading_max27.46675692774402
deviation-heading_mean27.46675692774402
deviation-heading_median27.46675692774402
deviation-heading_min27.46675692774402
distance-from-start_max0.14150413430657544
distance-from-start_mean0.14150413430657544
distance-from-start_median0.14150413430657544
distance-from-start_min0.14150413430657544
driven_any_max12.177141344233844
driven_any_mean12.177141344233844
driven_any_median12.177141344233844
driven_any_min12.177141344233844
driven_lanedir_consec_max-2.757255501829291
driven_lanedir_consec_mean-2.757255501829291
driven_lanedir_consec_min-2.757255501829291
driven_lanedir_max-2.757255501829291
driven_lanedir_mean-2.757255501829291
driven_lanedir_median-2.757255501829291
driven_lanedir_min-2.757255501829291
in-drivable-lane_max28.849999999999195
in-drivable-lane_mean28.849999999999195
in-drivable-lane_min28.849999999999195
per-episodes
details{"udem-000-ego0": {"driven_any": 12.177141344233844, "survival_time": 59.99999999999873, "driven_lanedir": -2.757255501829291, "in-drivable-lane": 28.849999999999195, "deviation-heading": 27.46675692774402, "distance-from-start": 0.14150413430657544, "deviation-center-line": 2.9451204666257524, "driven_lanedir_consec": -2.757255501829291}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17164398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-07-6.2.530:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17156516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failedyesdavinci-stage-07-6.2.530:01:40
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17147518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-1of4failedyesdavinci-stage-07-6.2.530:01:49
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17139520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17129523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-0of4failedyesdavinci-stage-07-6.2.530:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17121525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failedyesdavinci-stage-07-6.2.530:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17109529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-0of4successyesdavinci-stage-07-6.2.530:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.20000000000001
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2676241529784202
deviation-center-line_median0.26056920404532075


other stats
deviation-center-line_max0.26056920404532075
deviation-center-line_mean0.26056920404532075
deviation-center-line_min0.26056920404532075
deviation-heading_max1.6277645049990976
deviation-heading_mean1.6277645049990976
deviation-heading_median1.6277645049990976
deviation-heading_min1.6277645049990976
distance-from-start_max1.1101029947933654
distance-from-start_mean1.1101029947933654
distance-from-start_median1.1101029947933654
distance-from-start_min1.1101029947933654
driven_any_max1.2924366020392155
driven_any_mean1.2924366020392155
driven_any_median1.2924366020392155
driven_any_min1.2924366020392155
driven_lanedir_consec_max1.2676241529784202
driven_lanedir_consec_mean1.2676241529784202
driven_lanedir_consec_min1.2676241529784202
driven_lanedir_max1.2676241529784202
driven_lanedir_mean1.2676241529784202
driven_lanedir_median1.2676241529784202
driven_lanedir_min1.2676241529784202
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.2924366020392155, "survival_time": 10.20000000000001, "driven_lanedir": 1.2676241529784202, "in-drivable-lane": 0.0, "deviation-heading": 1.6277645049990976, "distance-from-start": 1.1101029947933654, "deviation-center-line": 0.26056920404532075, "driven_lanedir_consec": 1.2676241529784202}}
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean10.20000000000001
survival_time_min10.20000000000001
No reset possible
17058542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4successyesdavinci-stage-07-6.2.530:23:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.56589238522859
deviation-center-line_median3.802804521997847


other stats
deviation-center-line_max5.866814890013379
deviation-center-line_mean3.469955024185722
deviation-center-line_min0.40739616273381496
deviation-heading_max30.359343508168372
deviation-heading_mean18.20296961498894
deviation-heading_median20.078524639617353
deviation-heading_min2.295485672552684
distance-from-start_max3.2425757479733353
distance-from-start_mean1.7343315259887837
distance-from-start_median1.398540741269016
distance-from-start_min0.8976688734437688
driven_any_max10.521229500607122
driven_any_mean3.7779677848550577
driven_any_median1.665398985053879
driven_any_min1.2598436687053487
driven_lanedir_consec_max9.420735207041629
driven_lanedir_consec_mean3.439789095590744
driven_lanedir_consec_min1.206636404864171
driven_lanedir_max10.014922925203486
driven_lanedir_mean3.589984149205945
driven_lanedir_median1.5691886333780625
driven_lanedir_min1.206636404864171
in-drivable-lane_max49.99999999999872
in-drivable-lane_mean12.49999999999968
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 10.521229500607122, "survival_time": 59.99999999999873, "driven_lanedir": 10.014922925203486, "in-drivable-lane": 0.0, "deviation-heading": 13.950459094911098, "distance-from-start": 3.2425757479733353, "deviation-center-line": 3.089851631926232, "driven_lanedir_consec": 9.420735207041629}, "udem-000-ego1": {"driven_any": 1.2598436687053487, "survival_time": 59.99999999999873, "driven_lanedir": 1.206636404864171, "in-drivable-lane": 0.0, "deviation-heading": 30.359343508168372, "distance-from-start": 0.8976688734437688, "deviation-center-line": 5.866814890013379, "driven_lanedir_consec": 1.206636404864171}, "udem-000-ego2": {"driven_any": 1.6298682034883272, "survival_time": 59.99999999999873, "driven_lanedir": 1.507997066958198, "in-drivable-lane": 49.99999999999872, "deviation-heading": 2.295485672552684, "distance-from-start": 1.1672129852216788, "deviation-center-line": 0.40739616273381496, "driven_lanedir_consec": 1.5019980779466138}, "udem-000-ego3": {"driven_any": 1.700929766619431, "survival_time": 59.99999999999873, "driven_lanedir": 1.6303801997979266, "in-drivable-lane": 0.0, "deviation-heading": 26.20659018432361, "distance-from-start": 1.629868497316353, "deviation-center-line": 4.515757412069462, "driven_lanedir_consec": 1.6297866925105662}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17051768Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484aido-hello-sim-validationsanity-checksuccessyesdavinci-stage-07-6.2.530:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.009064991924794484
deviation-center-line_median0.006983132039636023


other stats
deviation-center-line_max0.006983132039636023
deviation-center-line_mean0.006983132039636023
deviation-center-line_min0.006983132039636023
deviation-heading_max0.26868975096151776
deviation-heading_mean0.26868975096151776
deviation-heading_median0.26868975096151776
deviation-heading_min0.26868975096151776
distance-from-start_max0.010495918904044922
distance-from-start_mean0.010495918904044922
distance-from-start_median0.010495918904044922
distance-from-start_min0.010495918904044922
driven_any_max0.01049690255215259
driven_any_mean0.01049690255215259
driven_any_median0.01049690255215259
driven_any_min0.01049690255215259
driven_lanedir_consec_max0.009064991924794484
driven_lanedir_consec_mean0.009064991924794484
driven_lanedir_consec_min0.009064991924794484
driven_lanedir_max0.009064991924794484
driven_lanedir_mean0.009064991924794484
driven_lanedir_median0.009064991924794484
driven_lanedir_min0.009064991924794484
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.01049690255215259, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009064991924794484, "in-drivable-lane": 0.0, "deviation-heading": 0.26868975096151776, "distance-from-start": 0.010495918904044922, "deviation-center-line": 0.006983132039636023, "driven_lanedir_consec": 0.009064991924794484}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
17044802Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551aido-hello-sim-validationsanity-checksuccessyesdavinci-stage-07-6.2.530:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.007027605186679109
deviation-center-line_median0.006458747302613722


other stats
deviation-center-line_max0.006458747302613722
deviation-center-line_mean0.006458747302613722
deviation-center-line_min0.006458747302613722
deviation-heading_max0.31396173900239127
deviation-heading_mean0.31396173900239127
deviation-heading_median0.31396173900239127
deviation-heading_min0.31396173900239127
distance-from-start_max0.009663679333371047
distance-from-start_mean0.009663679333371047
distance-from-start_median0.009663679333371047
distance-from-start_min0.009663679333371047
driven_any_max0.00978509036370642
driven_any_mean0.00978509036370642
driven_any_median0.00978509036370642
driven_any_min0.00978509036370642
driven_lanedir_consec_max0.007027605186679109
driven_lanedir_consec_mean0.007027605186679109
driven_lanedir_consec_min0.007027605186679109
driven_lanedir_max0.007027605186679109
driven_lanedir_mean0.007027605186679109
driven_lanedir_median0.007027605186679109
driven_lanedir_min0.007027605186679109
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.00978509036370642, "survival_time": 0.49999999999999994, "driven_lanedir": 0.007027605186679109, "in-drivable-lane": 0.0, "deviation-heading": 0.31396173900239127, "distance-from-start": 0.009663679333371047, "deviation-center-line": 0.006458747302613722, "driven_lanedir_consec": 0.007027605186679109}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
17042805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checksuccessyesdavinci-stage-07-6.2.530:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013228475740935774
deviation-center-line_median0.006545593960936848


other stats
deviation-center-line_max0.006545593960936848
deviation-center-line_mean0.006545593960936848
deviation-center-line_min0.006545593960936848
deviation-heading_max0.26446454042588047
deviation-heading_mean0.26446454042588047
deviation-heading_median0.26446454042588047
deviation-heading_min0.26446454042588047
distance-from-start_max0.015078142643126045
distance-from-start_mean0.015078142643126045
distance-from-start_median0.015078142643126045
distance-from-start_min0.015078142643126045
driven_any_max0.015084395507555193
driven_any_mean0.015084395507555193
driven_any_median0.015084395507555193
driven_any_min0.015084395507555193
driven_lanedir_consec_max0.013228475740935774
driven_lanedir_consec_mean0.013228475740935774
driven_lanedir_consec_min0.013228475740935774
driven_lanedir_max0.013228475740935774
driven_lanedir_mean0.013228475740935774
driven_lanedir_median0.013228475740935774
driven_lanedir_min0.013228475740935774
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084395507555193, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013228475740935774, "in-drivable-lane": 0.0, "deviation-heading": 0.26446454042588047, "distance-from-start": 0.015078142643126045, "deviation-center-line": 0.006545593960936848, "driven_lanedir_consec": 0.013228475740935774}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
170301556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-07-6.2.530:08:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170191584Andrea Censiexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-07-6.2.530:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170131602Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-07-6.2.530:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.32616750001817346


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.32616750001817346
distance-from-start_median0.32616750001817346
distance-from-start_min0.32616750001817346
driven_any_max0.3261675000181755
driven_any_mean0.3261675000181755
driven_any_median0.3261675000181755
driven_any_min0.3261675000181755
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.549999999999999
in-drivable-lane_mean2.549999999999999
in-drivable-lane_median2.549999999999999
in-drivable-lane_min2.549999999999999
per-episodes
details{"d40-ego0": {"driven_any": 0.3261675000181755, "survival_time": 2.549999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 2.549999999999999, "deviation-heading": 0.0, "distance-from-start": 0.32616750001817346, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.549999999999999
survival_time_mean2.549999999999999
survival_time_median2.549999999999999
survival_time_min2.549999999999999
No reset possible
170001604Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-3of4failedyesdavinci-stage-07-6.2.530:01:14
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169881608Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4failedyesdavinci-stage-07-6.2.530:01:17
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169781611Bea Baselines 🐤baseline-RPL-roslx22-objdetsimfailedyesdavinci-stage-07-6.2.530:01:17
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169661621Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-0of4failedyesdavinci-stage-07-6.2.530:01:17
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169611623Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-0of4failedyesdavinci-stage-07-6.2.530:01:29
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169341629Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-0of4successyesdavinci-stage-07-6.2.530:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949224973854444


other stats
deviation-center-line_max0.8949224973854444
deviation-center-line_mean0.8949224973854444
deviation-center-line_min0.8949224973854444
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8949224973854444, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169281630Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
169241631Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-0of4successyesdavinci-stage-07-6.2.530:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8948975282352575
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8948975282352575
deviation-center-line_mean0.8948975282352575
deviation-center-line_min0.8948975282352575
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8948975282352575, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169211632Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
169151634Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-2of4successyesdavinci-stage-07-6.2.530:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299162


other stats
deviation-center-line_max0.8949116056299162
deviation-center-line_mean0.8949116056299162
deviation-center-line_min0.8949116056299162
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949116056299162, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169011646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4successyesdavinci-stage-07-6.2.530:11:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134252


other stats
deviation-center-line_max0.4065243130134252
deviation-center-line_mean0.4065243130134252
deviation-center-line_min0.4065243130134252
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168991853Frank (Chude) Qianexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-07-6.2.530:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168821646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4timeoutyesdavinci-stage-07-6.2.53----No reset possible
168771650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4timeoutyesdavinci-stage-07-6.2.53----No reset possible
168731646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4host-erroryesdavinci-stage-07-6.2.530:08:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
    return self.version(api_version=False)["ApiVersion"]
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 181, in version
    return self._result(self._get(url), json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 60, in check_docker_environment
    client = docker.from_env()
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 96, in from_env
    return cls(
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 45, in __init__
    self.api = APIClient(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 197, in __init__
    self._version = self._retrieve_server_version()
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1118, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 125, in write_logs
    client = check_docker_environment()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/env_checks.py", line 69, in check_docker_environment
    raise InvalidEnvironment(msg)
duckietown_challenges.exceptions.InvalidEnvironment: I cannot communicate with Docker:
Error while fetching server API version: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/70aa46d039411dcdceebd15f6e9a345bec96b5e18d6d909251bdc97f94ea46ed"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168641648Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4successyesdavinci-stage-07-6.2.530:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168581649Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-0of4successyesdavinci-stage-07-6.2.530:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065197925359665
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065197925359665
deviation-center-line_mean0.4065197925359665
deviation-center-line_min0.4065197925359665
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.095246377785861e-16
distance-from-start_mean5.095246377785861e-16
distance-from-start_median5.095246377785861e-16
distance-from-start_min5.095246377785861e-16
driven_any_max6.114295653343089e-13
driven_any_mean6.114295653343089e-13
driven_any_median6.114295653343089e-13
driven_any_min6.114295653343089e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.114295653343089e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.095246377785861e-16, "deviation-center-line": 0.4065197925359665, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168531650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-07-6.2.530:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168461652Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4successyesdavinci-stage-07-6.2.530:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.000286102294921875
deviation-center-line_median0.4065583231185028


other stats
deviation-center-line_max0.4065583231185028
deviation-center-line_mean0.4065583231185028
deviation-center-line_min0.4065583231185028
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max1.3877787807814457e-17
distance-from-start_mean1.3877787807814457e-17
distance-from-start_median1.3877787807814457e-17
distance-from-start_min1.3877787807814457e-17
driven_any_max1.6653345369377348e-14
driven_any_mean1.6653345369377348e-14
driven_any_median1.6653345369377348e-14
driven_any_min1.6653345369377348e-14
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.6653345369377348e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 1.3877787807814457e-17, "deviation-center-line": 0.4065583231185028, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168391654Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-1of4successyesdavinci-stage-07-6.2.530:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.750000000000018
in-drivable-lane_median2.3999999999999932
driven_lanedir_consec_median0.8318612383455897
deviation-center-line_median0.838900487628053


other stats
deviation-center-line_max0.838900487628053
deviation-center-line_mean0.838900487628053
deviation-center-line_min0.838900487628053
deviation-heading_max4.169134220919311
deviation-heading_mean4.169134220919311
deviation-heading_median4.169134220919311
deviation-heading_min4.169134220919311
distance-from-start_max0.919230203664486
distance-from-start_mean0.919230203664486
distance-from-start_median0.919230203664486
distance-from-start_min0.919230203664486
driven_any_max1.2823650009012884
driven_any_mean1.2823650009012884
driven_any_median1.2823650009012884
driven_any_min1.2823650009012884
driven_lanedir_consec_max0.8318612383455897
driven_lanedir_consec_mean0.8318612383455897
driven_lanedir_consec_min0.8318612383455897
driven_lanedir_max0.8318612383455897
driven_lanedir_mean0.8318612383455897
driven_lanedir_median0.8318612383455897
driven_lanedir_min0.8318612383455897
in-drivable-lane_max2.3999999999999932
in-drivable-lane_mean2.3999999999999932
in-drivable-lane_min2.3999999999999932
per-episodes
details{"4way-000-ego0": {"driven_any": 1.2823650009012884, "survival_time": 10.750000000000018, "driven_lanedir": 0.8318612383455897, "in-drivable-lane": 2.3999999999999932, "deviation-heading": 4.169134220919311, "distance-from-start": 0.919230203664486, "deviation-center-line": 0.838900487628053, "driven_lanedir_consec": 0.8318612383455897}}
simulation-passed1
survival_time_max10.750000000000018
survival_time_mean10.750000000000018
survival_time_min10.750000000000018
No reset possible
168311656Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successyesdavinci-stage-07-6.2.530:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.698826714803808
survival_time_median59.99999999999873
deviation-center-line_median3.4581940578145227
in-drivable-lane_median10.99999999999974


other stats
deviation-center-line_max3.4581940578145227
deviation-center-line_mean3.4581940578145227
deviation-center-line_min3.4581940578145227
deviation-heading_max8.542692224799127
deviation-heading_mean8.542692224799127
deviation-heading_median8.542692224799127
deviation-heading_min8.542692224799127
distance-from-start_max3.8731109110285793
distance-from-start_mean3.8731109110285793
distance-from-start_median3.8731109110285793
distance-from-start_min3.8731109110285793
driven_any_max7.907842791269262
driven_any_mean7.907842791269262
driven_any_median7.907842791269262
driven_any_min7.907842791269262
driven_lanedir_consec_max4.698826714803808
driven_lanedir_consec_mean4.698826714803808
driven_lanedir_consec_min4.698826714803808
driven_lanedir_max6.200098809868518
driven_lanedir_mean6.200098809868518
driven_lanedir_median6.200098809868518
driven_lanedir_min6.200098809868518
in-drivable-lane_max10.99999999999974
in-drivable-lane_mean10.99999999999974
in-drivable-lane_min10.99999999999974
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907842791269262, "survival_time": 59.99999999999873, "driven_lanedir": 6.200098809868518, "in-drivable-lane": 10.99999999999974, "deviation-heading": 8.542692224799127, "distance-from-start": 3.8731109110285793, "deviation-center-line": 3.4581940578145227, "driven_lanedir_consec": 4.698826714803808}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168261657Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-07-6.2.530:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168151662Bea Baselines 🐤baseline-duckietownlx22-visservoingsimsuccessyesdavinci-stage-07-6.2.530:09:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median25.024999999999345
deviation-center-line_median4.645845629969119
driven_lanedir_consec_median4.486633064970856
survival_time_median59.99999999999873


other stats
deviation-center-line_max4.673889140066246
deviation-center-line_mean4.645845629969119
deviation-center-line_min4.6178021198719925
deviation-heading_max5.304435522500531
deviation-heading_mean4.704545337275782
deviation-heading_median4.704545337275782
deviation-heading_min4.104655152051032
distance-from-start_max1.4923387376874968
distance-from-start_mean1.2498119023912386
distance-from-start_median1.2498119023912386
distance-from-start_min1.0072850670949804
driven_any_max7.920859674564185
driven_any_mean7.914347074532579
driven_any_median7.914347074532579
driven_any_min7.907834474500971
driven_lanedir_consec_max4.71944565334179
driven_lanedir_consec_mean4.486633064970856
driven_lanedir_consec_min4.2538204765999215
driven_lanedir_max4.71944565334179
driven_lanedir_mean4.486633064970856
driven_lanedir_median4.486633064970856
driven_lanedir_min4.2538204765999215
in-drivable-lane_max26.999999999999293
in-drivable-lane_mean25.024999999999345
in-drivable-lane_min23.049999999999393
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 7.920859674564185, "survival_time": 59.99999999999873, "driven_lanedir": 4.2538204765999215, "in-drivable-lane": 26.999999999999293, "deviation-heading": 4.104655152051032, "distance-from-start": 1.0072850670949804, "deviation-center-line": 4.6178021198719925, "driven_lanedir_consec": 4.2538204765999215}, "LF-small-loop-001-ego0": {"driven_any": 7.907834474500971, "survival_time": 59.99999999999873, "driven_lanedir": 4.71944565334179, "in-drivable-lane": 23.049999999999393, "deviation-heading": 5.304435522500531, "distance-from-start": 1.4923387376874968, "deviation-center-line": 4.673889140066246, "driven_lanedir_consec": 4.71944565334179}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168091664Bea Baselines 🐤baseline-duckietownlx22-BV1sim-1of5successyesdavinci-stage-07-6.2.530:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.47691499553365135


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.47691499553365135
distance-from-start_median0.47691499553365135
distance-from-start_min0.47691499553365135
driven_any_max0.631972930458127
driven_any_mean0.631972930458127
driven_any_median0.631972930458127
driven_any_min0.631972930458127
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.849999999999987
in-drivable-lane_mean5.849999999999987
in-drivable-lane_median5.849999999999987
in-drivable-lane_min5.849999999999987
per-episodes
details{"d45-ego0": {"driven_any": 0.631972930458127, "survival_time": 5.849999999999987, "driven_lanedir": 0.0, "in-drivable-lane": 5.849999999999987, "deviation-heading": 0.0, "distance-from-start": 0.47691499553365135, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.849999999999987
survival_time_mean5.849999999999987
survival_time_median5.849999999999987
survival_time_min5.849999999999987
No reset possible
168011672Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-07-6.2.530:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.300000000000026
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2383226789864266
deviation-center-line_median0.7315010533504023


other stats
deviation-center-line_max0.7315010533504023
deviation-center-line_mean0.7315010533504023
deviation-center-line_min0.7315010533504023
deviation-heading_max4.269533377589092
deviation-heading_mean4.269533377589092
deviation-heading_median4.269533377589092
deviation-heading_min4.269533377589092
distance-from-start_max0.9250600971247273
distance-from-start_mean0.9250600971247273
distance-from-start_median0.9250600971247273
distance-from-start_min0.9250600971247273
driven_any_max1.3554775795133542
driven_any_mean1.3554775795133542
driven_any_median1.3554775795133542
driven_any_min1.3554775795133542
driven_lanedir_consec_max1.2383226789864266
driven_lanedir_consec_mean1.2383226789864266
driven_lanedir_consec_min1.2383226789864266
driven_lanedir_max1.2383226789864266
driven_lanedir_mean1.2383226789864266
driven_lanedir_median1.2383226789864266
driven_lanedir_min1.2383226789864266
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.3554775795133542, "survival_time": 11.300000000000026, "driven_lanedir": 1.2383226789864266, "in-drivable-lane": 0.0, "deviation-heading": 4.269533377589092, "distance-from-start": 0.9250600971247273, "deviation-center-line": 0.7315010533504023, "driven_lanedir_consec": 1.2383226789864266}}
simulation-passed1
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_min11.300000000000026
No reset possible
167941674Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4successyesdavinci-stage-07-6.2.530:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.55055337074191
survival_time_median59.99999999999873
deviation-center-line_median2.7904956303280097
in-drivable-lane_median6.799999999999706


other stats
deviation-center-line_max2.7904956303280097
deviation-center-line_mean2.7904956303280097
deviation-center-line_min2.7904956303280097
deviation-heading_max9.944602922434305
deviation-heading_mean9.944602922434305
deviation-heading_median9.944602922434305
deviation-heading_min9.944602922434305
distance-from-start_max2.8611346348537245
distance-from-start_mean2.8611346348537245
distance-from-start_median2.8611346348537245
distance-from-start_min2.8611346348537245
driven_any_max7.907698191385903
driven_any_mean7.907698191385903
driven_any_median7.907698191385903
driven_any_min7.907698191385903
driven_lanedir_consec_max5.55055337074191
driven_lanedir_consec_mean5.55055337074191
driven_lanedir_consec_min5.55055337074191
driven_lanedir_max6.6607437454972285
driven_lanedir_mean6.6607437454972285
driven_lanedir_median6.6607437454972285
driven_lanedir_min6.6607437454972285
in-drivable-lane_max6.799999999999706
in-drivable-lane_mean6.799999999999706
in-drivable-lane_min6.799999999999706
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907698191385903, "survival_time": 59.99999999999873, "driven_lanedir": 6.6607437454972285, "in-drivable-lane": 6.799999999999706, "deviation-heading": 9.944602922434305, "distance-from-start": 2.8611346348537245, "deviation-center-line": 2.7904956303280097, "driven_lanedir_consec": 5.55055337074191}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167881675Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-07-6.2.530:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
167811677Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-2of4successyesdavinci-stage-07-6.2.530:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.45000000000007
in-drivable-lane_median0.4499999999999984
driven_lanedir_consec_median0.8486105021659078
deviation-center-line_median0.38554660144709546


other stats
deviation-center-line_max0.38554660144709546
deviation-center-line_mean0.38554660144709546
deviation-center-line_min0.38554660144709546
deviation-heading_max3.411883424835106
deviation-heading_mean3.411883424835106
deviation-heading_median3.411883424835106
deviation-heading_min3.411883424835106
distance-from-start_max0.7452751015363087
distance-from-start_mean0.7452751015363087
distance-from-start_median0.7452751015363087
distance-from-start_min0.7452751015363087
driven_any_max1.767144624689829
driven_any_mean1.767144624689829
driven_any_median1.767144624689829
driven_any_min1.767144624689829
driven_lanedir_consec_max0.8486105021659078
driven_lanedir_consec_mean0.8486105021659078
driven_lanedir_consec_min0.8486105021659078
driven_lanedir_max1.601282099808859
driven_lanedir_mean1.601282099808859
driven_lanedir_median1.601282099808859
driven_lanedir_min1.601282099808859
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.4499999999999984
in-drivable-lane_min0.4499999999999984
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.767144624689829, "survival_time": 14.45000000000007, "driven_lanedir": 1.601282099808859, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 3.411883424835106, "distance-from-start": 0.7452751015363087, "deviation-center-line": 0.38554660144709546, "driven_lanedir_consec": 0.8486105021659078}}
simulation-passed1
survival_time_max14.45000000000007
survival_time_mean14.45000000000007
survival_time_min14.45000000000007
No reset possible
167691852Andrea Censiexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-07-6.2.530:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
167681679Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-2of4successyesdavinci-stage-07-6.2.530:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
167421686Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successyesdavinci-stage-07-6.2.530:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.527134503811414


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.6864438380333175
deviation-center-line_min0.22311062332950052
deviation-heading_max37.82293240559152
deviation-heading_mean15.742347894422767
deviation-heading_median11.480770321404124
deviation-heading_min2.184918529291301
distance-from-start_max3.177442392514494
distance-from-start_mean0.7943605981286238
distance-from-start_median7.447602459741819e-16
distance-from-start_min0.0
driven_any_max6.082579575597374
driven_any_mean1.5206448938997903
driven_any_median8.937122951690024e-13
driven_any_min0.0
driven_lanedir_consec_max6.065368636558107
driven_lanedir_consec_mean1.5163421591395267
driven_lanedir_consec_min0.0
driven_lanedir_max6.065368636558107
driven_lanedir_mean1.5163421591395267
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 6.082579575597374, "survival_time": 59.99999999999873, "driven_lanedir": 6.065368636558107, "in-drivable-lane": 0.0, "deviation-heading": 2.184918529291301, "distance-from-start": 3.177442392514494, "deviation-center-line": 0.2918095725321498, "driven_lanedir_consec": 6.065368636558107}, "udem-000-ego1": {"driven_any": 1.19161639355867e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 9.930136612989092e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.22311062332950052, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 0.0, "deviation-center-line": 2.7624594350906784, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167301688Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-3of4successyesdavinci-stage-07-6.2.530:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.354121751024167
deviation-center-line_median1.5907898424502358


other stats
deviation-center-line_max3.468394386342305
deviation-center-line_mean1.7204870668180092
deviation-center-line_min0.23197419602925975
deviation-heading_max37.822937304744066
deviation-heading_mean15.410893192415545
deviation-heading_median10.924693244125017
deviation-heading_min1.9712489766680776
distance-from-start_max4.757326687346635
distance-from-start_mean1.9702948065027592
distance-from-start_median1.5619262693322007
distance-from-start_min2.220446049250313e-16
driven_any_max5.8896577604958456
driven_any_mean2.651059104566359
driven_any_median2.357289328884662
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.867756494746063
driven_lanedir_consec_mean2.6439994058236502
driven_lanedir_consec_min-2.3734997967039817e-06
driven_lanedir_max5.867756494746063
driven_lanedir_mean2.6439994058236502
driven_lanedir_median2.354121751024167
driven_lanedir_min-2.3734997967039817e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.8896577604958456, "survival_time": 59.99999999999873, "driven_lanedir": 5.867756494746063, "in-drivable-lane": 0.0, "deviation-heading": 3.5399584722448916, "distance-from-start": 4.757326687346635, "deviation-center-line": 0.4191165927509713, "driven_lanedir_consec": 5.867756494746063}, "zigzag-000-ego1": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.468394386342305, "driven_lanedir_consec": 0.0}, "zigzag-000-ego2": {"driven_any": 4.714578657768775, "survival_time": 59.99999999999873, "driven_lanedir": 4.708243502048335, "in-drivable-lane": 0.0, "deviation-heading": 1.9712489766680776, "distance-from-start": 3.123852538664401, "deviation-center-line": 0.23197419602925975, "driven_lanedir_consec": 4.708243502048335}, "zigzag-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.3734997967039817e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822937304744066, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624630921495004, "driven_lanedir_consec": -2.3734997967039817e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167251690Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4successyesdavinci-stage-07-6.2.530:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.650000000000087
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3397922837799834
deviation-center-line_median0.17577830426095897


other stats
deviation-center-line_max0.17577830426095897
deviation-center-line_mean0.17577830426095897
deviation-center-line_min0.17577830426095897
deviation-heading_max1.414000512850352
deviation-heading_mean1.414000512850352
deviation-heading_median1.414000512850352
deviation-heading_min1.414000512850352
distance-from-start_max0.9953946201002636
distance-from-start_mean0.9953946201002636
distance-from-start_median0.9953946201002636
distance-from-start_min0.9953946201002636
driven_any_max1.3507304582476738
driven_any_mean1.3507304582476738
driven_any_median1.3507304582476738
driven_any_min1.3507304582476738
driven_lanedir_consec_max1.3397922837799834
driven_lanedir_consec_mean1.3397922837799834
driven_lanedir_consec_min1.3397922837799834
driven_lanedir_max1.3397922837799834
driven_lanedir_mean1.3397922837799834
driven_lanedir_median1.3397922837799834
driven_lanedir_min1.3397922837799834
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3507304582476738, "survival_time": 15.650000000000087, "driven_lanedir": 1.3397922837799834, "in-drivable-lane": 0.0, "deviation-heading": 1.414000512850352, "distance-from-start": 0.9953946201002636, "deviation-center-line": 0.17577830426095897, "driven_lanedir_consec": 1.3397922837799834}}
simulation-passed1
survival_time_max15.650000000000087
survival_time_mean15.650000000000087
survival_time_min15.650000000000087
No reset possible
167221691Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-0of4successyesdavinci-stage-07-6.2.530:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.800000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median0.838943310921324
deviation-center-line_median0.1433047164551813


other stats
deviation-center-line_max0.1433047164551813
deviation-center-line_mean0.1433047164551813
deviation-center-line_min0.1433047164551813
deviation-heading_max1.2694840494293371
deviation-heading_mean1.2694840494293371
deviation-heading_median1.2694840494293371
deviation-heading_min1.2694840494293371
distance-from-start_max0.6851393057632532
distance-from-start_mean0.6851393057632532
distance-from-start_median0.6851393057632532
distance-from-start_min0.6851393057632532
driven_any_max0.8503814872464346
driven_any_mean0.8503814872464346
driven_any_median0.8503814872464346
driven_any_min0.8503814872464346
driven_lanedir_consec_max0.838943310921324
driven_lanedir_consec_mean0.838943310921324
driven_lanedir_consec_min0.838943310921324
driven_lanedir_max0.838943310921324
driven_lanedir_mean0.838943310921324
driven_lanedir_median0.838943310921324
driven_lanedir_min0.838943310921324
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8503814872464346, "survival_time": 9.800000000000004, "driven_lanedir": 0.838943310921324, "in-drivable-lane": 0.0, "deviation-heading": 1.2694840494293371, "distance-from-start": 0.6851393057632532, "deviation-center-line": 0.1433047164551813, "driven_lanedir_consec": 0.838943310921324}}
simulation-passed1
survival_time_max9.800000000000004
survival_time_mean9.800000000000004
survival_time_min9.800000000000004
No reset possible
167111694Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-3of4successyesdavinci-stage-07-6.2.530:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.599999999999376
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.1822085786120473
deviation-center-line_median4.281969506383752


other stats
deviation-center-line_max4.281969506383752
deviation-center-line_mean4.281969506383752
deviation-center-line_min4.281969506383752
deviation-heading_max8.956926170181262
deviation-heading_mean8.956926170181262
deviation-heading_median8.956926170181262
deviation-heading_min8.956926170181262
distance-from-start_max1.84932503046977
distance-from-start_mean1.84932503046977
distance-from-start_median1.84932503046977
distance-from-start_min1.84932503046977
driven_any_max2.760582128240964
driven_any_mean2.760582128240964
driven_any_median2.760582128240964
driven_any_min2.760582128240964
driven_lanedir_consec_max2.1822085786120473
driven_lanedir_consec_mean2.1822085786120473
driven_lanedir_consec_min2.1822085786120473
driven_lanedir_max2.5502818256429407
driven_lanedir_mean2.5502818256429407
driven_lanedir_median2.5502818256429407
driven_lanedir_min2.5502818256429407
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed1
survival_time_max48.599999999999376
survival_time_mean48.599999999999376
survival_time_min48.599999999999376
No reset possible
167021695Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-2of4successyesdavinci-stage-07-6.2.530:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2653509128575537
deviation-center-line_median7.121053917268459


other stats
deviation-center-line_max7.121053917268459
deviation-center-line_mean7.121053917268459
deviation-center-line_min7.121053917268459
deviation-heading_max5.705613996279617
deviation-heading_mean5.705613996279617
deviation-heading_median5.705613996279617
deviation-heading_min5.705613996279617
distance-from-start_max1.6305272704555316
distance-from-start_mean1.6305272704555316
distance-from-start_median1.6305272704555316
distance-from-start_min1.6305272704555316
driven_any_max3.4663369114033205
driven_any_mean3.4663369114033205
driven_any_median3.4663369114033205
driven_any_min3.4663369114033205
driven_lanedir_consec_max3.2653509128575537
driven_lanedir_consec_mean3.2653509128575537
driven_lanedir_consec_min3.2653509128575537
driven_lanedir_max3.2653509128575537
driven_lanedir_mean3.2653509128575537
driven_lanedir_median3.2653509128575537
driven_lanedir_min3.2653509128575537
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369114033205, "survival_time": 59.99999999999873, "driven_lanedir": 3.2653509128575537, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.705613996279617, "distance-from-start": 1.6305272704555316, "deviation-center-line": 7.121053917268459, "driven_lanedir_consec": 3.2653509128575537}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible