Duckietown Challenges Home Challenges Submissions

Evaluator 139

ID139
evaluatordavinci-stage-06-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-06-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success39 16705
# timeout1 16869
# failed16 16991
# error
# aborted
# host-error9 16886
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors99%
RAM total (MB)251.6 GB
RAM free (MB)242.3 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172701858Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-06-6.2.530:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
172691857Liam Paullstate estimation exerciselx22-state-estimationsimsuccessyesdavinci-stage-06-6.2.530:13:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.172122801848059
survival_time_median59.99999999999873
deviation-center-line_median3.2705492983591995
in-drivable-lane_median19.849999999999373


other stats
deviation-center-line_max4.529093194663255
deviation-center-line_mean2.7356968725299886
deviation-center-line_min0.40744812456751256
deviation-heading_max11.948139417767647
deviation-heading_mean6.197194978417958
deviation-heading_median5.31032533001539
deviation-heading_min1.333120187470837
distance-from-start_max2.900295704089926
distance-from-start_mean2.771851655362466
distance-from-start_median2.7796843679222465
distance-from-start_min2.635574894075225
driven_any_max7.921124280511373
driven_any_mean7.916582703906175
driven_any_median7.921029952611576
driven_any_min7.907593878595573
driven_lanedir_consec_max6.731538882392487
driven_lanedir_consec_mean4.249101965031304
driven_lanedir_consec_min0.8436442108533676
driven_lanedir_max6.731538882392487
driven_lanedir_mean4.249101965031304
driven_lanedir_median5.172122801848059
driven_lanedir_min0.8436442108533676
in-drivable-lane_max52.89999999999874
in-drivable-lane_mean26.299999999999283
in-drivable-lane_min6.149999999999729
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 7.907593878595573, "survival_time": 59.99999999999873, "driven_lanedir": 0.8436442108533676, "in-drivable-lane": 52.89999999999874, "deviation-heading": 1.333120187470837, "distance-from-start": 2.635574894075225, "deviation-center-line": 0.40744812456751256, "driven_lanedir_consec": 0.8436442108533676}, "LF-zig-zag-001-ego0": {"driven_any": 7.921029952611576, "survival_time": 59.99999999999873, "driven_lanedir": 6.731538882392487, "in-drivable-lane": 6.149999999999729, "deviation-heading": 11.948139417767647, "distance-from-start": 2.900295704089926, "deviation-center-line": 4.529093194663255, "driven_lanedir_consec": 6.731538882392487}, "LF-zig-zag-002-ego0": {"driven_any": 7.921124280511373, "survival_time": 59.99999999999873, "driven_lanedir": 5.172122801848059, "in-drivable-lane": 19.849999999999373, "deviation-heading": 5.31032533001539, "distance-from-start": 2.7796843679222465, "deviation-center-line": 3.2705492983591995, "driven_lanedir_consec": 5.172122801848059}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
172641856Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-06-6.2.530:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
17260385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:12:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.57499999999915
driven_lanedir_consec_median-2.84891178816083
deviation-center-line_median2.549828697487662


other stats
deviation-center-line_max2.621005791917744
deviation-center-line_mean2.549828697487662
deviation-center-line_min2.4786516030575796
deviation-heading_max26.030180440662253
deviation-heading_mean25.60222181841532
deviation-heading_median25.60222181841532
deviation-heading_min25.174263196168383
distance-from-start_max0.16304304911899392
distance-from-start_mean0.1609398389939206
distance-from-start_median0.1609398389939206
distance-from-start_min0.15883662886884725
driven_any_max11.333816833275366
driven_any_mean11.206687885601074
driven_any_median11.206687885601074
driven_any_min11.079558937926784
driven_lanedir_consec_max-2.7014777118262785
driven_lanedir_consec_mean-2.84891178816083
driven_lanedir_consec_min-2.996345864495382
driven_lanedir_max-2.7014777118262785
driven_lanedir_mean-2.9421073057481406
driven_lanedir_median-2.9421073057481406
driven_lanedir_min-3.182736899670003
in-drivable-lane_max32.299999999999116
in-drivable-lane_mean30.57499999999915
in-drivable-lane_min28.849999999999184
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.079558937926784, "survival_time": 59.99999999999873, "driven_lanedir": -3.182736899670003, "in-drivable-lane": 28.849999999999184, "deviation-heading": 26.030180440662253, "distance-from-start": 0.16304304911899392, "deviation-center-line": 2.621005791917744, "driven_lanedir_consec": -2.996345864495382}, "loop2-000-ego1": {"driven_any": 11.333816833275366, "survival_time": 59.99999999999873, "driven_lanedir": -2.7014777118262785, "in-drivable-lane": 32.299999999999116, "deviation-heading": 25.174263196168383, "distance-from-start": 0.15883662886884725, "deviation-center-line": 2.4786516030575796, "driven_lanedir_consec": -2.7014777118262785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17259385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-0of4host-erroryesdavinci-stage-06-6.2.530:01:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17252386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.94999999999947
driven_lanedir_consec_median-2.8795281126782086
deviation-center-line_median3.15984622929658


other stats
deviation-center-line_max3.15984622929658
deviation-center-line_mean3.15984622929658
deviation-center-line_min3.15984622929658
deviation-heading_max28.027655775745007
deviation-heading_mean28.027655775745007
deviation-heading_median28.027655775745007
deviation-heading_min28.027655775745007
distance-from-start_max0.2098482385630756
distance-from-start_mean0.2098482385630756
distance-from-start_median0.2098482385630756
distance-from-start_min0.2098482385630756
driven_any_max11.058557083059746
driven_any_mean11.058557083059746
driven_any_median11.058557083059746
driven_any_min11.058557083059746
driven_lanedir_consec_max-2.8795281126782086
driven_lanedir_consec_mean-2.8795281126782086
driven_lanedir_consec_min-2.8795281126782086
driven_lanedir_max-2.976242361580625
driven_lanedir_mean-2.976242361580625
driven_lanedir_median-2.976242361580625
driven_lanedir_min-2.976242361580625
in-drivable-lane_max23.94999999999947
in-drivable-lane_mean23.94999999999947
in-drivable-lane_min23.94999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.058557083059746, "survival_time": 59.99999999999873, "driven_lanedir": -2.976242361580625, "in-drivable-lane": 23.94999999999947, "deviation-heading": 28.027655775745007, "distance-from-start": 0.2098482385630756, "deviation-center-line": 3.15984622929658, "driven_lanedir_consec": -2.8795281126782086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17241387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successyesdavinci-stage-06-6.2.530:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.95000000000012
in-drivable-lane_median6.150000000000045
driven_lanedir_consec_median-1.1302759793993178
deviation-center-line_median0.987760401927135


other stats
deviation-center-line_max0.987760401927135
deviation-center-line_mean0.987760401927135
deviation-center-line_min0.987760401927135
deviation-heading_max8.186748710268294
deviation-heading_mean8.186748710268294
deviation-heading_median8.186748710268294
deviation-heading_min8.186748710268294
distance-from-start_max0.1877209254407249
distance-from-start_mean0.1877209254407249
distance-from-start_median0.1877209254407249
distance-from-start_min0.1877209254407249
driven_any_max3.746361869050701
driven_any_mean3.746361869050701
driven_any_median3.746361869050701
driven_any_min3.746361869050701
driven_lanedir_consec_max-1.1302759793993178
driven_lanedir_consec_mean-1.1302759793993178
driven_lanedir_consec_min-1.1302759793993178
driven_lanedir_max-1.7375542687953058
driven_lanedir_mean-1.7375542687953058
driven_lanedir_median-1.7375542687953058
driven_lanedir_min-1.7375542687953058
in-drivable-lane_max6.150000000000045
in-drivable-lane_mean6.150000000000045
in-drivable-lane_min6.150000000000045
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.746361869050701, "survival_time": 17.95000000000012, "driven_lanedir": -1.7375542687953058, "in-drivable-lane": 6.150000000000045, "deviation-heading": 8.186748710268294, "distance-from-start": 0.1877209254407249, "deviation-center-line": 0.987760401927135, "driven_lanedir_consec": -1.1302759793993178}}
simulation-passed1
survival_time_max17.95000000000012
survival_time_mean17.95000000000012
survival_time_min17.95000000000012
No reset possible
17238388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-0of4host-erroryesdavinci-stage-06-6.2.530:01:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17233388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17229388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4host-erroryesdavinci-stage-06-6.2.530:01:54
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17225391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4host-erroryesdavinci-stage-06-6.2.530:01:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17222390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-0of4host-erroryesdavinci-stage-06-6.2.530:01:02
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17200390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-1of4successyesdavinci-stage-06-6.2.530:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.2828465765292183
survival_time_median59.99999999999873
deviation-center-line_median2.840521537080275
in-drivable-lane_median20.49999999999958


other stats
deviation-center-line_max2.840521537080275
deviation-center-line_mean2.840521537080275
deviation-center-line_min2.840521537080275
deviation-heading_max27.919722193461432
deviation-heading_mean27.919722193461432
deviation-heading_median27.919722193461432
deviation-heading_min27.919722193461432
distance-from-start_max0.1967328712959616
distance-from-start_mean0.1967328712959616
distance-from-start_median0.1967328712959616
distance-from-start_min0.1967328712959616
driven_any_max11.925209344658676
driven_any_mean11.925209344658676
driven_any_median11.925209344658676
driven_any_min11.925209344658676
driven_lanedir_consec_max-3.2828465765292183
driven_lanedir_consec_mean-3.2828465765292183
driven_lanedir_consec_min-3.2828465765292183
driven_lanedir_max-4.79482152076195
driven_lanedir_mean-4.79482152076195
driven_lanedir_median-4.79482152076195
driven_lanedir_min-4.79482152076195
in-drivable-lane_max20.49999999999958
in-drivable-lane_mean20.49999999999958
in-drivable-lane_min20.49999999999958
per-episodes
details{"loop-000-ego0": {"driven_any": 11.925209344658676, "survival_time": 59.99999999999873, "driven_lanedir": -4.79482152076195, "in-drivable-lane": 20.49999999999958, "deviation-heading": 27.919722193461432, "distance-from-start": 0.1967328712959616, "deviation-center-line": 2.840521537080275, "driven_lanedir_consec": -3.2828465765292183}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17196392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4host-erroryesdavinci-stage-06-6.2.530:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17192392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4host-erroryesdavinci-stage-06-6.2.530:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17183393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-0of4successyesdavinci-stage-06-6.2.530:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.94999999999913
driven_lanedir_consec_median-2.564840676976607
deviation-center-line_median2.0690490159727264


other stats
deviation-center-line_max2.0690490159727264
deviation-center-line_mean2.0690490159727264
deviation-center-line_min2.0690490159727264
deviation-heading_max22.573987346640596
deviation-heading_mean22.573987346640596
deviation-heading_median22.573987346640596
deviation-heading_min22.573987346640596
distance-from-start_max0.15794168914516157
distance-from-start_mean0.15794168914516157
distance-from-start_median0.15794168914516157
distance-from-start_min0.15794168914516157
driven_any_max11.182797725398071
driven_any_mean11.182797725398071
driven_any_median11.182797725398071
driven_any_min11.182797725398071
driven_lanedir_consec_max-2.564840676976607
driven_lanedir_consec_mean-2.564840676976607
driven_lanedir_consec_min-2.564840676976607
driven_lanedir_max-2.564840676976607
driven_lanedir_mean-2.564840676976607
driven_lanedir_median-2.564840676976607
driven_lanedir_min-2.564840676976607
in-drivable-lane_max34.94999999999913
in-drivable-lane_mean34.94999999999913
in-drivable-lane_min34.94999999999913
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.182797725398071, "survival_time": 59.99999999999873, "driven_lanedir": -2.564840676976607, "in-drivable-lane": 34.94999999999913, "deviation-heading": 22.573987346640596, "distance-from-start": 0.15794168914516157, "deviation-center-line": 2.0690490159727264, "driven_lanedir_consec": -2.564840676976607}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17173396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4successyesdavinci-stage-06-6.2.530:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.100000000000009
in-drivable-lane_median1.999999999999993
driven_lanedir_consec_median-0.3142632718276417
deviation-center-line_median0.3049079323989983


other stats
deviation-center-line_max0.3049079323989983
deviation-center-line_mean0.3049079323989983
deviation-center-line_min0.3049079323989983
deviation-heading_max6.451039479191902
deviation-heading_mean6.451039479191902
deviation-heading_median6.451039479191902
deviation-heading_min6.451039479191902
distance-from-start_max0.15674361669443038
distance-from-start_mean0.15674361669443038
distance-from-start_median0.15674361669443038
distance-from-start_min0.15674361669443038
driven_any_max1.648769475082401
driven_any_mean1.648769475082401
driven_any_median1.648769475082401
driven_any_min1.648769475082401
driven_lanedir_consec_max-0.3142632718276417
driven_lanedir_consec_mean-0.3142632718276417
driven_lanedir_consec_min-0.3142632718276417
driven_lanedir_max-0.3088662370340476
driven_lanedir_mean-0.3088662370340476
driven_lanedir_median-0.3088662370340476
driven_lanedir_min-0.3088662370340476
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.999999999999993
in-drivable-lane_min1.999999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 1.648769475082401, "survival_time": 10.100000000000009, "driven_lanedir": -0.3088662370340476, "in-drivable-lane": 1.999999999999993, "deviation-heading": 6.451039479191902, "distance-from-start": 0.15674361669443038, "deviation-center-line": 0.3049079323989983, "driven_lanedir_consec": -0.3142632718276417}}
simulation-passed1
survival_time_max10.100000000000009
survival_time_mean10.100000000000009
survival_time_min10.100000000000009
No reset possible
17167514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4host-erroryesdavinci-stage-06-6.2.530:01:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17155516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-1of4failedyesdavinci-stage-06-6.2.530:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17150519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17143519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17134521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-2of4failedyesdavinci-stage-06-6.2.530:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17127522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-2of4failedyesdavinci-stage-06-6.2.530:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17120525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17114527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17108528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:01:22
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17105529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-1of4failedyesdavinci-stage-06-6.2.530:01:10
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17101530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:01:33
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17097531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4failedyesdavinci-stage-06-6.2.530:01:12
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17092532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-3of4failedyesdavinci-stage-06-6.2.530:01:27
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17080536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.650000000000173
in-drivable-lane_median4.850000000000051
driven_lanedir_consec_median2.511192838979184
deviation-center-line_median1.0654749087928057


other stats
deviation-center-line_max1.0654749087928057
deviation-center-line_mean1.0654749087928057
deviation-center-line_min1.0654749087928057
deviation-heading_max5.857592443384156
deviation-heading_mean5.857592443384156
deviation-heading_median5.857592443384156
deviation-heading_min5.857592443384156
distance-from-start_max1.5731666237013733
distance-from-start_mean1.5731666237013733
distance-from-start_median1.5731666237013733
distance-from-start_min1.5731666237013733
driven_any_max3.713030606884853
driven_any_mean3.713030606884853
driven_any_median3.713030606884853
driven_any_min3.713030606884853
driven_lanedir_consec_max2.511192838979184
driven_lanedir_consec_mean2.511192838979184
driven_lanedir_consec_min2.511192838979184
driven_lanedir_max2.511192838979184
driven_lanedir_mean2.511192838979184
driven_lanedir_median2.511192838979184
driven_lanedir_min2.511192838979184
in-drivable-lane_max4.850000000000051
in-drivable-lane_mean4.850000000000051
in-drivable-lane_min4.850000000000051
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.713030606884853, "survival_time": 21.650000000000173, "driven_lanedir": 2.511192838979184, "in-drivable-lane": 4.850000000000051, "deviation-heading": 5.857592443384156, "distance-from-start": 1.5731666237013733, "deviation-center-line": 1.0654749087928057, "driven_lanedir_consec": 2.511192838979184}}
simulation-passed1
survival_time_max21.650000000000173
survival_time_mean21.650000000000173
survival_time_min21.650000000000173
No reset possible
17079536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-3of4failedyesdavinci-stage-06-6.2.530:01:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17078536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4failedyesdavinci-stage-06-6.2.530:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17067539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-1of4successyesdavinci-stage-06-6.2.530:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.20000000000031
in-drivable-lane_median0.7499999999999973
driven_lanedir_consec_median4.829726783576551
deviation-center-line_median1.8680732120759147


other stats
deviation-center-line_max1.8680732120759147
deviation-center-line_mean1.8680732120759147
deviation-center-line_min1.8680732120759147
deviation-heading_max9.213467062751567
deviation-heading_mean9.213467062751567
deviation-heading_median9.213467062751567
deviation-heading_min9.213467062751567
distance-from-start_max2.9107788765001237
distance-from-start_mean2.9107788765001237
distance-from-start_median2.9107788765001237
distance-from-start_min2.9107788765001237
driven_any_max5.264732605160545
driven_any_mean5.264732605160545
driven_any_median5.264732605160545
driven_any_min5.264732605160545
driven_lanedir_consec_max4.829726783576551
driven_lanedir_consec_mean4.829726783576551
driven_lanedir_consec_min4.829726783576551
driven_lanedir_max4.841538225151944
driven_lanedir_mean4.841538225151944
driven_lanedir_median4.841538225151944
driven_lanedir_min4.841538225151944
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.7499999999999973
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.264732605160545, "survival_time": 31.20000000000031, "driven_lanedir": 4.841538225151944, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 9.213467062751567, "distance-from-start": 2.9107788765001237, "deviation-center-line": 1.8680732120759147, "driven_lanedir_consec": 4.829726783576551}}
simulation-passed1
survival_time_max31.20000000000031
survival_time_mean31.20000000000031
survival_time_min31.20000000000031
No reset possible
17056542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-3of4successyesdavinci-stage-06-6.2.530:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17050766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailedyesdavinci-stage-06-6.2.530:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170371554Andrea Danieleexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-06-6.2.530:07:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170271556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-06-6.2.530:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170171597Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-06-6.2.530:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170061603Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:01:13
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169941604Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-2of4failedyesdavinci-stage-06-6.2.530:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169911606Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failedyesdavinci-stage-06-6.2.530:00:59
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169371628Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4successyesdavinci-stage-06-6.2.530:13:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.000286102294921875
deviation-center-line_median0.8949084199909635


other stats
deviation-center-line_max0.8949084199909635
deviation-center-line_mean0.8949084199909635
deviation-center-line_min0.8949084199909635
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949084199909635, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169331629Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successyesdavinci-stage-06-6.2.530:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
169311630Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
169181633Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5116931584219764


other stats
deviation-center-line_max2.128491974247649
deviation-center-line_mean1.5116931584219764
deviation-center-line_min0.8948943425963037
deviation-heading_max32.249113233675025
deviation-heading_mean31.48103999887634
deviation-heading_median31.48103999887634
deviation-heading_min30.712966764077652
distance-from-start_max3.1401849173675503e-16
distance-from-start_mean2.2639818490744983e-16
distance-from-start_median2.2639818490744983e-16
distance-from-start_min1.3877787807814454e-16
driven_any_max3.7682219008410875e-13
driven_any_mean2.716778218889411e-13
driven_any_median2.716778218889411e-13
driven_any_min1.665334536937735e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.128491974247649, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169031646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4successyesdavinci-stage-06-6.2.530:14:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-7.759561260201053e-05
deviation-center-line_median0.40651500228682685


other stats
deviation-center-line_max0.40651500228682685
deviation-center-line_mean0.40651500228682685
deviation-center-line_min0.40651500228682685
deviation-heading_max40.96731396890531
deviation-heading_mean40.96731396890531
deviation-heading_median40.96731396890531
deviation-heading_min40.96731396890531
distance-from-start_max4.577566798522237e-16
distance-from-start_mean4.577566798522237e-16
distance-from-start_median4.577566798522237e-16
distance-from-start_min4.577566798522237e-16
driven_any_max5.49308015822675e-13
driven_any_mean5.49308015822675e-13
driven_any_median5.49308015822675e-13
driven_any_min5.49308015822675e-13
driven_lanedir_consec_max-7.759561260201053e-05
driven_lanedir_consec_mean-7.759561260201053e-05
driven_lanedir_consec_min-7.759561260201053e-05
driven_lanedir_max-7.759561260201053e-05
driven_lanedir_mean-7.759561260201053e-05
driven_lanedir_median-7.759561260201053e-05
driven_lanedir_min-7.759561260201053e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": -7.759561260201053e-05, "in-drivable-lane": 0.0, "deviation-heading": 40.96731396890531, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.40651500228682685, "driven_lanedir_consec": -7.759561260201053e-05}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168971853Frank (Chude) Qianexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-06-6.2.530:08:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168861650Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4host-erroryesdavinci-stage-06-6.2.530:04:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 139, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner_cache.py", line 64, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1032, in run_single
    prepare_dir(wd, aws_config, steps2artefacts=steps2artefacts, steps2scores=steps2scores, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1465, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 155, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 204, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 359, in object_download_file
    return self.meta.client.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 190, in download_file
    return transfer.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 320, in download_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 269, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/download.py", line 354, in _submit
    response = client.head_object(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1595, in redirect_from_error
    new_region = self.get_bucket_region(bucket, response)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1665, in get_bucket_region
    response = self._client.head_bucket(Bucket=bucket)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/"

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168691646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4timeoutyesdavinci-stage-06-6.2.53----No reset possible
168601648Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-0of4successyesdavinci-stage-06-6.2.530:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065102356187873


other stats
deviation-center-line_max0.4065102356187873
deviation-center-line_mean0.4065102356187873
deviation-center-line_min0.4065102356187873
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356187873, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168511651Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.9374500507418704


other stats
deviation-center-line_max3.4683898658648995
deviation-center-line_mean1.9374500507418704
deviation-center-line_min0.4065102356188418
deviation-heading_max40.967332753486225
deviation-heading_mean29.638380384745684
deviation-heading_median29.638380384745684
deviation-heading_min18.309428016005143
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max1.3322676295501878e-13
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065102356188418, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.4683898658648995, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168471652Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524565


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168421653Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-0of4successyesdavinci-stage-06-6.2.530:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.499999999999985
in-drivable-lane_median0.9999999999999964
driven_lanedir_consec_median0.6082743143628369
deviation-center-line_median0.2011870348777605


other stats
deviation-center-line_max0.2011870348777605
deviation-center-line_mean0.2011870348777605
deviation-center-line_min0.2011870348777605
deviation-heading_max1.914163313873877
deviation-heading_mean1.914163313873877
deviation-heading_median1.914163313873877
deviation-heading_min1.914163313873877
distance-from-start_max0.5542814996577634
distance-from-start_mean0.5542814996577634
distance-from-start_median0.5542814996577634
distance-from-start_min0.5542814996577634
driven_any_max0.7182495960695305
driven_any_mean0.7182495960695305
driven_any_median0.7182495960695305
driven_any_min0.7182495960695305
driven_lanedir_consec_max0.6082743143628369
driven_lanedir_consec_mean0.6082743143628369
driven_lanedir_consec_min0.6082743143628369
driven_lanedir_max0.6082743143628369
driven_lanedir_mean0.6082743143628369
driven_lanedir_median0.6082743143628369
driven_lanedir_min0.6082743143628369
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0.9999999999999964
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7182495960695305, "survival_time": 6.499999999999985, "driven_lanedir": 0.6082743143628369, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.914163313873877, "distance-from-start": 0.5542814996577634, "deviation-center-line": 0.2011870348777605, "driven_lanedir_consec": 0.6082743143628369}}
simulation-passed1
survival_time_max6.499999999999985
survival_time_mean6.499999999999985
survival_time_min6.499999999999985
No reset possible
168321656Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-3of4successyesdavinci-stage-06-6.2.530:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.964963405875217
survival_time_median59.99999999999873
deviation-center-line_median4.987311436683526
in-drivable-lane_median5.049999999999858


other stats
deviation-center-line_max4.987311436683526
deviation-center-line_mean4.987311436683526
deviation-center-line_min4.987311436683526
deviation-heading_max10.371487264792489
deviation-heading_mean10.371487264792489
deviation-heading_median10.371487264792489
deviation-heading_min10.371487264792489
distance-from-start_max4.087111834055999
distance-from-start_mean4.087111834055999
distance-from-start_median4.087111834055999
distance-from-start_min4.087111834055999
driven_any_max7.907770023862072
driven_any_mean7.907770023862072
driven_any_median7.907770023862072
driven_any_min7.907770023862072
driven_lanedir_consec_max6.964963405875217
driven_lanedir_consec_mean6.964963405875217
driven_lanedir_consec_min6.964963405875217
driven_lanedir_max6.964963405875217
driven_lanedir_mean6.964963405875217
driven_lanedir_median6.964963405875217
driven_lanedir_min6.964963405875217
in-drivable-lane_max5.049999999999858
in-drivable-lane_mean5.049999999999858
in-drivable-lane_min5.049999999999858
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907770023862072, "survival_time": 59.99999999999873, "driven_lanedir": 6.964963405875217, "in-drivable-lane": 5.049999999999858, "deviation-heading": 10.371487264792489, "distance-from-start": 4.087111834055999, "deviation-center-line": 4.987311436683526, "driven_lanedir_consec": 6.964963405875217}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168211658Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4successyesdavinci-stage-06-6.2.530:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.900000000000093
in-drivable-lane_median8.525000000000073
driven_lanedir_consec_median0.827407133876223
deviation-center-line_median0.8998390246134534


other stats
deviation-center-line_max1.056998706411281
deviation-center-line_mean0.8998390246134534
deviation-center-line_min0.742679342815626
deviation-heading_max2.2733985283520215
deviation-heading_mean2.047034329754214
deviation-heading_median2.047034329754214
deviation-heading_min1.8206701311564064
distance-from-start_max0.9336482254909064
distance-from-start_mean0.764509281847219
distance-from-start_median0.764509281847219
distance-from-start_min0.5953703382035317
driven_any_max1.9662332513467695
driven_any_mean1.3754360200789428
driven_any_median1.3754360200789428
driven_any_min0.7846387888111163
driven_lanedir_consec_max0.9106188569519952
driven_lanedir_consec_mean0.827407133876223
driven_lanedir_consec_min0.7441954108004509
driven_lanedir_max0.9106188569519952
driven_lanedir_mean0.827407133876223
driven_lanedir_median0.827407133876223
driven_lanedir_min0.7441954108004509
in-drivable-lane_max9.550000000000106
in-drivable-lane_mean8.525000000000073
in-drivable-lane_min7.500000000000042
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.9662332513467695, "survival_time": 15.900000000000093, "driven_lanedir": 0.9106188569519952, "in-drivable-lane": 7.500000000000042, "deviation-heading": 2.2733985283520215, "distance-from-start": 0.9336482254909064, "deviation-center-line": 1.056998706411281, "driven_lanedir_consec": 0.9106188569519952}, "loop2-000-ego1": {"driven_any": 0.7846387888111163, "survival_time": 15.900000000000093, "driven_lanedir": 0.7441954108004509, "in-drivable-lane": 9.550000000000106, "deviation-heading": 1.8206701311564064, "distance-from-start": 0.5953703382035317, "deviation-center-line": 0.742679342815626, "driven_lanedir_consec": 0.7441954108004509}}
simulation-passed1
survival_time_max15.900000000000093
survival_time_mean15.900000000000093
survival_time_min15.900000000000093
No reset possible
167841676Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4successyesdavinci-stage-06-6.2.530:24:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median9.024999999999846
driven_lanedir_consec_median2.4063094907768257
deviation-center-line_median3.469102042929584


other stats
deviation-center-line_max3.980962807252799
deviation-center-line_mean3.255113781594514
deviation-center-line_min2.1012882332660885
deviation-heading_max22.934358761818576
deviation-heading_mean17.329368596010017
deviation-heading_median17.04484112490935
deviation-heading_min12.2934333724028
distance-from-start_max2.7886390652481987
distance-from-start_mean1.783148725080557
distance-from-start_median1.72120318763768
distance-from-start_min0.9015494597986708
driven_any_max7.913402453878135
driven_any_mean5.162088878271401
driven_any_median5.351188983833989
driven_any_min2.0325750915394907
driven_lanedir_consec_max3.9173919984634
driven_lanedir_consec_mean2.576143215922314
driven_lanedir_consec_min1.574561883672204
driven_lanedir_max4.954126816850611
driven_lanedir_mean3.4678463227237883
driven_lanedir_median3.52235980274227
driven_lanedir_min1.8725388685600015
in-drivable-lane_max16.24999999999978
in-drivable-lane_mean8.574999999999868
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.0325750915394907, "survival_time": 59.99999999999873, "driven_lanedir": 1.8725388685600015, "in-drivable-lane": 0.0, "deviation-heading": 15.75898668503616, "distance-from-start": 1.872983125896224, "deviation-center-line": 3.0874027366771326, "driven_lanedir_consec": 1.8725388685600015}, "autolab-000-ego1": {"driven_any": 7.913402453878135, "survival_time": 59.99999999999873, "driven_lanedir": 4.910791563906003, "in-drivable-lane": 16.24999999999978, "deviation-heading": 18.33069556478254, "distance-from-start": 2.7886390652481987, "deviation-center-line": 3.980962807252799, "driven_lanedir_consec": 3.9173919984634}, "autolab-000-ego2": {"driven_any": 2.7893022297925003, "survival_time": 59.99999999999873, "driven_lanedir": 2.1339280415785367, "in-drivable-lane": 4.050000000000047, "deviation-heading": 12.2934333724028, "distance-from-start": 0.9015494597986708, "deviation-center-line": 2.1012882332660885, "driven_lanedir_consec": 1.574561883672204}, "autolab-000-ego3": {"driven_any": 7.913075737875477, "survival_time": 59.99999999999873, "driven_lanedir": 4.954126816850611, "in-drivable-lane": 13.999999999999645, "deviation-heading": 22.934358761818576, "distance-from-start": 1.5694232493791365, "deviation-center-line": 3.850801349182035, "driven_lanedir_consec": 2.94008011299365}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167761678Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-1of4successyesdavinci-stage-06-6.2.530:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.804192854394257
deviation-center-line_median0.16028545636710145


other stats
deviation-center-line_max0.16028545636710145
deviation-center-line_mean0.16028545636710145
deviation-center-line_min0.16028545636710145
deviation-heading_max1.6564513443463602
deviation-heading_mean1.6564513443463602
deviation-heading_median1.6564513443463602
deviation-heading_min1.6564513443463602
distance-from-start_max2.5357490341649536
distance-from-start_mean2.5357490341649536
distance-from-start_median2.5357490341649536
distance-from-start_min2.5357490341649536
driven_any_max5.81208847227964
driven_any_mean5.81208847227964
driven_any_median5.81208847227964
driven_any_min5.81208847227964
driven_lanedir_consec_max5.804192854394257
driven_lanedir_consec_mean5.804192854394257
driven_lanedir_consec_min5.804192854394257
driven_lanedir_max5.804192854394257
driven_lanedir_mean5.804192854394257
driven_lanedir_median5.804192854394257
driven_lanedir_min5.804192854394257
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.81208847227964, "survival_time": 59.99999999999873, "driven_lanedir": 5.804192854394257, "in-drivable-lane": 0.0, "deviation-heading": 1.6564513443463602, "distance-from-start": 2.5357490341649536, "deviation-center-line": 0.16028545636710145, "driven_lanedir_consec": 5.804192854394257}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167651680Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-1of4successyesdavinci-stage-06-6.2.530:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.35641596777958673
deviation-center-line_median0.5955312146522322


other stats
deviation-center-line_max2.128491974247639
deviation-center-line_mean0.9139675952717752
deviation-center-line_min0.33631597753499803
deviation-heading_max30.712966764077652
deviation-heading_mean12.7034688538512
deviation-heading_median8.860215367203583
deviation-heading_min2.3804779169199795
distance-from-start_max2.866773837264375
distance-from-start_mean0.8802267381267181
distance-from-start_median0.3270665576212487
distance-from-start_min2.2887833992611187e-16
driven_any_max4.95910239753371
driven_any_mean1.4197330129653098
driven_any_median0.3599148271636274
driven_any_min2.746540079113375e-13
driven_lanedir_consec_max4.9492867887322785
driven_lanedir_consec_mean1.415529681072863
driven_lanedir_consec_min0.0
driven_lanedir_max4.9492867887322785
driven_lanedir_mean1.415529681072863
driven_lanedir_median0.35641596777958673
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.7198296543267219, "survival_time": 59.99999999999873, "driven_lanedir": 0.7128319355591735, "in-drivable-lane": 0.0, "deviation-heading": 3.8060895796891416, "distance-from-start": 0.654133115242497, "deviation-center-line": 0.8533318010395783, "driven_lanedir_consec": 0.7128319355591735}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 4.95910239753371, "survival_time": 59.99999999999873, "driven_lanedir": 4.9492867887322785, "in-drivable-lane": 0.0, "deviation-heading": 2.3804779169199795, "distance-from-start": 2.866773837264375, "deviation-center-line": 0.33631597753499803, "driven_lanedir_consec": 4.9492867887322785}, "udem-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.33773062826488615, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167541683Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successyesdavinci-stage-06-6.2.530:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.050000000000264
in-drivable-lane_median0.0
driven_lanedir_consec_median2.292618548158817
deviation-center-line_median0.19323515838271432


other stats
deviation-center-line_max0.19323515838271432
deviation-center-line_mean0.19323515838271432
deviation-center-line_min0.19323515838271432
deviation-heading_max1.8288145404727405
deviation-heading_mean1.8288145404727405
deviation-heading_median1.8288145404727405
deviation-heading_min1.8288145404727405
distance-from-start_max1.9904020045641833
distance-from-start_mean1.9904020045641833
distance-from-start_median1.9904020045641833
distance-from-start_min1.9904020045641833
driven_any_max2.3014771077635525
driven_any_mean2.3014771077635525
driven_any_median2.3014771077635525
driven_any_min2.3014771077635525
driven_lanedir_consec_max2.292618548158817
driven_lanedir_consec_mean2.292618548158817
driven_lanedir_consec_min2.292618548158817
driven_lanedir_max2.292618548158817
driven_lanedir_mean2.292618548158817
driven_lanedir_median2.292618548158817
driven_lanedir_min2.292618548158817
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3014771077635525, "survival_time": 28.050000000000264, "driven_lanedir": 2.292618548158817, "in-drivable-lane": 0.0, "deviation-heading": 1.8288145404727405, "distance-from-start": 1.9904020045641833, "deviation-center-line": 0.19323515838271432, "driven_lanedir_consec": 2.292618548158817}}
simulation-passed1
survival_time_max28.050000000000264
survival_time_mean28.050000000000264
survival_time_min28.050000000000264
No reset possible
167471684Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4successyesdavinci-stage-06-6.2.530:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.667494145070765
deviation-center-line_median0.2625618403675503


other stats
deviation-center-line_max0.2625618403675503
deviation-center-line_mean0.2625618403675503
deviation-center-line_min0.2625618403675503
deviation-heading_max2.4450188093470064
deviation-heading_mean2.4450188093470064
deviation-heading_median2.4450188093470064
deviation-heading_min2.4450188093470064
distance-from-start_max1.5213034236679508
distance-from-start_mean1.5213034236679508
distance-from-start_median1.5213034236679508
distance-from-start_min1.5213034236679508
driven_any_max5.681963014330128
driven_any_mean5.681963014330128
driven_any_median5.681963014330128
driven_any_min5.681963014330128
driven_lanedir_consec_max5.667494145070765
driven_lanedir_consec_mean5.667494145070765
driven_lanedir_consec_min5.667494145070765
driven_lanedir_max5.667494145070765
driven_lanedir_mean5.667494145070765
driven_lanedir_median5.667494145070765
driven_lanedir_min5.667494145070765
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.681963014330128, "survival_time": 59.99999999999873, "driven_lanedir": 5.667494145070765, "in-drivable-lane": 0.0, "deviation-heading": 2.4450188093470064, "distance-from-start": 1.5213034236679508, "deviation-center-line": 0.2625618403675503, "driven_lanedir_consec": 5.667494145070765}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167361687Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-3of4successyesdavinci-stage-06-6.2.530:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.9255344112495525
deviation-center-line_median0.16823253637776917


other stats
deviation-center-line_max0.16823253637776917
deviation-center-line_mean0.16823253637776917
deviation-center-line_min0.16823253637776917
deviation-heading_max1.2427067181497071
deviation-heading_mean1.2427067181497071
deviation-heading_median1.2427067181497071
deviation-heading_min1.2427067181497071
distance-from-start_max3.1528512934161523
distance-from-start_mean3.1528512934161523
distance-from-start_median3.1528512934161523
distance-from-start_min3.1528512934161523
driven_any_max5.930776876357659
driven_any_mean5.930776876357659
driven_any_median5.930776876357659
driven_any_min5.930776876357659
driven_lanedir_consec_max5.9255344112495525
driven_lanedir_consec_mean5.9255344112495525
driven_lanedir_consec_min5.9255344112495525
driven_lanedir_max5.9255344226858995
driven_lanedir_mean5.9255344226858995
driven_lanedir_median5.9255344226858995
driven_lanedir_min5.9255344226858995
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.930776876357659, "survival_time": 59.99999999999873, "driven_lanedir": 5.9255344226858995, "in-drivable-lane": 0.0, "deviation-heading": 1.2427067181497071, "distance-from-start": 3.1528512934161523, "deviation-center-line": 0.16823253637776917, "driven_lanedir_consec": 5.9255344112495525}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167311689Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successyesdavinci-stage-06-6.2.530:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3608923653025524
deviation-center-line_median0.051213017209835086


other stats
deviation-center-line_max0.051213017209835086
deviation-center-line_mean0.051213017209835086
deviation-center-line_min0.051213017209835086
deviation-heading_max0.6136512740909245
deviation-heading_mean0.6136512740909245
deviation-heading_median0.6136512740909245
deviation-heading_min0.6136512740909245
distance-from-start_max0.3609304026851721
distance-from-start_mean0.3609304026851721
distance-from-start_median0.3609304026851721
distance-from-start_min0.3609304026851721
driven_any_max0.3664829367467816
driven_any_mean0.3664829367467816
driven_any_median0.3664829367467816
driven_any_min0.3664829367467816
driven_lanedir_consec_max0.3608923653025524
driven_lanedir_consec_mean0.3608923653025524
driven_lanedir_consec_min0.3608923653025524
driven_lanedir_max0.3608923653025524
driven_lanedir_mean0.3608923653025524
driven_lanedir_median0.3608923653025524
driven_lanedir_min0.3608923653025524
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.3664829367467816, "survival_time": 4.899999999999991, "driven_lanedir": 0.3608923653025524, "in-drivable-lane": 0.0, "deviation-heading": 0.6136512740909245, "distance-from-start": 0.3609304026851721, "deviation-center-line": 0.051213017209835086, "driven_lanedir_consec": 0.3608923653025524}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
167171693Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-0of4successyesdavinci-stage-06-6.2.530:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.699999999999314
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.825725124357286
deviation-center-line_median4.868938294800302


other stats
deviation-center-line_max4.868938294800302
deviation-center-line_mean4.868938294800302
deviation-center-line_min4.868938294800302
deviation-heading_max2.920667575049727
deviation-heading_mean2.920667575049727
deviation-heading_median2.920667575049727
deviation-heading_min2.920667575049727
distance-from-start_max2.1386574023523237
distance-from-start_mean2.1386574023523237
distance-from-start_median2.1386574023523237
distance-from-start_min2.1386574023523237
driven_any_max2.8865963267498715
driven_any_mean2.8865963267498715
driven_any_median2.8865963267498715
driven_any_min2.8865963267498715
driven_lanedir_consec_max2.825725124357286
driven_lanedir_consec_mean2.825725124357286
driven_lanedir_consec_min2.825725124357286
driven_lanedir_max2.825725124357286
driven_lanedir_mean2.825725124357286
driven_lanedir_median2.825725124357286
driven_lanedir_min2.825725124357286
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8865963267498715, "survival_time": 49.699999999999314, "driven_lanedir": 2.825725124357286, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920667575049727, "distance-from-start": 2.1386574023523237, "deviation-center-line": 4.868938294800302, "driven_lanedir_consec": 2.825725124357286}}
simulation-passed1
survival_time_max49.699999999999314
survival_time_mean49.699999999999314
survival_time_min49.699999999999314
No reset possible
167051695Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-1of4successyesdavinci-stage-06-6.2.530:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.305858702972225
deviation-center-line_median7.198939676780748


other stats
deviation-center-line_max7.198939676780748
deviation-center-line_mean7.198939676780748
deviation-center-line_min7.198939676780748
deviation-heading_max5.347648671657762
deviation-heading_mean5.347648671657762
deviation-heading_median5.347648671657762
deviation-heading_min5.347648671657762
distance-from-start_max2.180674072281247
distance-from-start_mean2.180674072281247
distance-from-start_median2.180674072281247
distance-from-start_min2.180674072281247
driven_any_max3.476091095751902
driven_any_mean3.476091095751902
driven_any_median3.476091095751902
driven_any_min3.476091095751902
driven_lanedir_consec_max3.305858702972225
driven_lanedir_consec_mean3.305858702972225
driven_lanedir_consec_min3.305858702972225
driven_lanedir_max3.305858702972225
driven_lanedir_mean3.305858702972225
driven_lanedir_median3.305858702972225
driven_lanedir_min3.305858702972225
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop-000-ego0": {"driven_any": 3.476091095751902, "survival_time": 59.99999999999873, "driven_lanedir": 3.305858702972225, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.347648671657762, "distance-from-start": 2.180674072281247, "deviation-center-line": 7.198939676780748, "driven_lanedir_consec": 3.305858702972225}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible