Duckietown Challenges Home Challenges Submissions

Evaluator 136

ID136
evaluatordavinci-stage-02-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-02-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success30 16685
# timeout2 16690
# failed10 16974
# error1 16756
# aborted
# host-error2 16883
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors97%
RAM total (MB)251.6 GB
RAM free (MB)243.1 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172731858Andrea Danieleexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-02-6.2.530:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
17228392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successyesdavinci-stage-02-6.2.530:36:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median33.79999999999906
driven_lanedir_consec_median-2.150717091183137
deviation-center-line_median2.4150217158474696


other stats
deviation-center-line_max2.8234577371192127
deviation-center-line_mean2.352184613275294
deviation-center-line_min1.7552372842870247
deviation-heading_max26.720609784922093
deviation-heading_mean23.260599301967368
deviation-heading_median23.77075965265783
deviation-heading_min18.780268117631717
distance-from-start_max0.18887729736516645
distance-from-start_mean0.16642327197171905
distance-from-start_median0.16537766653018043
distance-from-start_min0.14606045746134882
driven_any_max12.35498001930534
driven_any_mean11.160633519276765
driven_any_median11.263131678164488
driven_any_min9.761290701472742
driven_lanedir_consec_max-1.6551335762023278
driven_lanedir_consec_mean-2.3903156634218785
driven_lanedir_consec_min-3.604694895118912
driven_lanedir_max-1.6551335762023278
driven_lanedir_mean-2.4987563767108836
driven_lanedir_median-2.150717091183137
driven_lanedir_min-4.038457748274933
in-drivable-lane_max41.29999999999893
in-drivable-lane_mean33.962499999999096
in-drivable-lane_min26.949999999999317
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.479973844366054, "survival_time": 59.99999999999873, "driven_lanedir": -2.360743813066779, "in-drivable-lane": 30.89999999999919, "deviation-heading": 25.505040136568955, "distance-from-start": 0.16595448305310348, "deviation-center-line": 2.8234577371192127, "driven_lanedir_consec": -2.360743813066779}, "autolab-000-ego1": {"driven_any": 9.761290701472742, "survival_time": 59.99999999999873, "driven_lanedir": -1.6551335762023278, "in-drivable-lane": 41.29999999999893, "deviation-heading": 18.780268117631717, "distance-from-start": 0.14606045746134882, "deviation-center-line": 1.7552372842870247, "driven_lanedir_consec": -1.6551335762023278}, "autolab-000-ego2": {"driven_any": 12.35498001930534, "survival_time": 59.99999999999873, "driven_lanedir": -4.038457748274933, "in-drivable-lane": 26.949999999999317, "deviation-heading": 26.720609784922093, "distance-from-start": 0.1648008500072574, "deviation-center-line": 2.4261165567199163, "driven_lanedir_consec": -3.604694895118912}, "autolab-000-ego3": {"driven_any": 11.046289511962922, "survival_time": 59.99999999999873, "driven_lanedir": -1.940690369299494, "in-drivable-lane": 36.69999999999894, "deviation-heading": 22.036479168746705, "distance-from-start": 0.18887729736516645, "deviation-center-line": 2.403926874975023, "driven_lanedir_consec": -1.940690369299494}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17224392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4host-erroryesdavinci-stage-02-6.2.530:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17182394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4successyesdavinci-stage-02-6.2.530:22:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.39999999999902
driven_lanedir_consec_median-1.550144461122788
deviation-center-line_median2.463367203716699


other stats
deviation-center-line_max2.463367203716699
deviation-center-line_mean2.463367203716699
deviation-center-line_min2.463367203716699
deviation-heading_max20.05757283402047
deviation-heading_mean20.05757283402047
deviation-heading_median20.05757283402047
deviation-heading_min20.05757283402047
distance-from-start_max0.2202657828431243
distance-from-start_mean0.2202657828431243
distance-from-start_median0.2202657828431243
distance-from-start_min0.2202657828431243
driven_any_max10.7594709865027
driven_any_mean10.7594709865027
driven_any_median10.7594709865027
driven_any_min10.7594709865027
driven_lanedir_consec_max-1.550144461122788
driven_lanedir_consec_mean-1.550144461122788
driven_lanedir_consec_min-1.550144461122788
driven_lanedir_max-1.550144461122788
driven_lanedir_mean-1.550144461122788
driven_lanedir_median-1.550144461122788
driven_lanedir_min-1.550144461122788
in-drivable-lane_max37.39999999999902
in-drivable-lane_mean37.39999999999902
in-drivable-lane_min37.39999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.7594709865027, "survival_time": 59.99999999999873, "driven_lanedir": -1.550144461122788, "in-drivable-lane": 37.39999999999902, "deviation-heading": 20.05757283402047, "distance-from-start": 0.2202657828431243, "deviation-center-line": 2.463367203716699, "driven_lanedir_consec": -1.550144461122788}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17175395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successyesdavinci-stage-02-6.2.530:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17171396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successyesdavinci-stage-02-6.2.530:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17163514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failedyesdavinci-stage-02-6.2.530:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17154516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failedyesdavinci-stage-02-6.2.530:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17146518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-0of4failedyesdavinci-stage-02-6.2.530:01:50
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17138520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-2of4successyesdavinci-stage-02-6.2.530:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17128523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failedyesdavinci-stage-02-6.2.530:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17119524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failedyesdavinci-stage-02-6.2.530:01:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17107529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-2of4successyesdavinci-stage-02-6.2.530:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.950000000000163
in-drivable-lane_median4.800000000000068
driven_lanedir_consec_median2.395624337667042
deviation-center-line_median0.8233870972797572


other stats
deviation-center-line_max0.8233870972797572
deviation-center-line_mean0.8233870972797572
deviation-center-line_min0.8233870972797572
deviation-heading_max5.106721749635897
deviation-heading_mean5.106721749635897
deviation-heading_median5.106721749635897
deviation-heading_min5.106721749635897
distance-from-start_max1.7485321265015945
distance-from-start_mean1.7485321265015945
distance-from-start_median1.7485321265015945
distance-from-start_min1.7485321265015945
driven_any_max3.553662462230939
driven_any_mean3.553662462230939
driven_any_median3.553662462230939
driven_any_min3.553662462230939
driven_lanedir_consec_max2.395624337667042
driven_lanedir_consec_mean2.395624337667042
driven_lanedir_consec_min2.395624337667042
driven_lanedir_max2.395624337667042
driven_lanedir_mean2.395624337667042
driven_lanedir_median2.395624337667042
driven_lanedir_min2.395624337667042
in-drivable-lane_max4.800000000000068
in-drivable-lane_mean4.800000000000068
in-drivable-lane_min4.800000000000068
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.553662462230939, "survival_time": 20.950000000000163, "driven_lanedir": 2.395624337667042, "in-drivable-lane": 4.800000000000068, "deviation-heading": 5.106721749635897, "distance-from-start": 1.7485321265015945, "deviation-center-line": 0.8233870972797572, "driven_lanedir_consec": 2.395624337667042}}
simulation-passed1
survival_time_max20.950000000000163
survival_time_mean20.950000000000163
survival_time_min20.950000000000163
No reset possible
17103530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4failedyesdavinci-stage-02-6.2.530:01:19
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17070538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-1of4successyesdavinci-stage-02-6.2.530:17:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.477070048950315
deviation-center-line_median3.0618248563608166


other stats
deviation-center-line_max3.0618248563608166
deviation-center-line_mean3.0618248563608166
deviation-center-line_min3.0618248563608166
deviation-heading_max15.167164964214908
deviation-heading_mean15.167164964214908
deviation-heading_median15.167164964214908
deviation-heading_min15.167164964214908
distance-from-start_max1.0891997423545003
distance-from-start_mean1.0891997423545003
distance-from-start_median1.0891997423545003
distance-from-start_min1.0891997423545003
driven_any_max9.863846439013514
driven_any_mean9.863846439013514
driven_any_median9.863846439013514
driven_any_min9.863846439013514
driven_lanedir_consec_max9.477070048950315
driven_lanedir_consec_mean9.477070048950315
driven_lanedir_consec_min9.477070048950315
driven_lanedir_max9.477070048950315
driven_lanedir_mean9.477070048950315
driven_lanedir_median9.477070048950315
driven_lanedir_min9.477070048950315
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 9.863846439013514, "survival_time": 59.99999999999873, "driven_lanedir": 9.477070048950315, "in-drivable-lane": 0.0, "deviation-heading": 15.167164964214908, "distance-from-start": 1.0891997423545003, "deviation-center-line": 3.0618248563608166, "driven_lanedir_consec": 9.477070048950315}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17064539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-0of4failedyesdavinci-stage-02-6.2.530:01:29
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170411554Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-02-6.2.530:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170311556Frank (Chude) Qianexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-02-6.2.530:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170201584Andrea Censiexercises_braitenberglx22-BV1sim-1of5successyesdavinci-stage-02-6.2.530:10:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170111602Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-02-6.2.530:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.48816016817238


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.48816016817238
distance-from-start_median0.48816016817238
distance-from-start_min0.48816016817238
driven_any_max0.4881601681723813
driven_any_mean0.4881601681723813
driven_any_median0.4881601681723813
driven_any_min0.4881601681723813
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.2999999999999963
in-drivable-lane_mean3.2999999999999963
in-drivable-lane_median3.2999999999999963
in-drivable-lane_min3.2999999999999963
per-episodes
details{"d60-ego0": {"driven_any": 0.4881601681723813, "survival_time": 3.2999999999999963, "driven_lanedir": 0.0, "in-drivable-lane": 3.2999999999999963, "deviation-heading": 0.0, "distance-from-start": 0.48816016817238, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_median3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
169951605Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-0of4failedyesdavinci-stage-02-6.2.530:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169831607Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4failedyesdavinci-stage-02-6.2.530:01:17
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169741610Bea Baselines 🐤baseline-RPL-roslx22-modconsimfailedyesdavinci-stage-02-6.2.530:01:18
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169401628Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4successyesdavinci-stage-02-6.2.530:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299469


other stats
deviation-center-line_max0.8949116056299469
deviation-center-line_mean0.8949116056299469
deviation-center-line_min0.8949116056299469
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.577566798522237e-16
distance-from-start_mean4.577566798522237e-16
distance-from-start_median4.577566798522237e-16
distance-from-start_min4.577566798522237e-16
driven_any_max5.49308015822675e-13
driven_any_mean5.49308015822675e-13
driven_any_median5.49308015822675e-13
driven_any_min5.49308015822675e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169221633Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4successyesdavinci-stage-02-6.2.530:14:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5117001971192878


other stats
deviation-center-line_max2.946786737000149
deviation-center-line_mean1.5769829592245754
deviation-center-line_min0.3377447056595774
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max6.280369834735102e-16
distance-from-start_mean3.5129827517777994e-16
distance-from-start_median3.3306690738754696e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max7.536443801682175e-13
driven_any_mean4.215579302133373e-13
driven_any_median3.9968028886505635e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.1285028660032124, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.946786737000149, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169081639Bea Baselines 🐤baseline-duckietown-mllx22-BV1sim-3of5successyesdavinci-stage-02-6.2.530:09:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168941646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4successyesdavinci-stage-02-6.2.530:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.406517941735332


other stats
deviation-center-line_max0.406517941735332
deviation-center-line_mean0.406517941735332
deviation-center-line_min0.406517941735332
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max1.6653345369377348e-16
distance-from-start_mean1.6653345369377348e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min1.6653345369377348e-16
driven_any_max1.9984014443252818e-13
driven_any_mean1.9984014443252818e-13
driven_any_median1.9984014443252818e-13
driven_any_min1.9984014443252818e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.9984014443252818e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.6653345369377348e-16, "deviation-center-line": 0.406517941735332, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168831647Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4host-erroryesdavinci-stage-02-6.2.530:04:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 139, in download_artefacts
    get_file_from_cache(fn, sha256hex)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner_cache.py", line 64, in get_file_from_cache
    raise KeyError(msg)
KeyError: 'Hash not in cache'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1032, in run_single
    prepare_dir(wd, aws_config, steps2artefacts=steps2artefacts, steps2scores=steps2scores, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1465, in prepare_dir
    download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 155, in download_artefacts
    get_object(aws_config, bucket_name, object_key, fn)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 204, in get_object
    aws_object.download_file(fn)
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 359, in object_download_file
    return self.meta.client.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 190, in download_file
    return transfer.download_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 320, in download_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 269, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/download.py", line 354, in _submit
    response = client.head_object(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1595, in redirect_from_error
    new_region = self.get_bucket_region(bucket, response)
  File "/usr/local/lib/python3.8/dist-packages/botocore/utils.py", line 1665, in get_bucket_region
    response = self._client.head_bucket(Bucket=bucket)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/"

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168711646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4timeoutyesdavinci-stage-02-6.2.53----No reset possible
168681647Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4successyesdavinci-stage-02-6.2.530:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
168501651Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-0of4successyesdavinci-stage-02-6.2.530:15:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.0001430511474609375
deviation-center-line_median1.5844950596910814


other stats
deviation-center-line_max3.4683962371431485
deviation-center-line_mean1.7151242449636883
deviation-center-line_min0.22311062332944268
deviation-heading_max40.967332753486225
deviation-heading_mean25.4379514504715
deviation-heading_median28.066180210798333
deviation-heading_min4.652112626803104
distance-from-start_max6.280369834735102e-16
distance-from-start_mean2.6803154833089315e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max7.536443801682175e-13
driven_any_mean3.216378579970732e-13
driven_any_median1.9984014443252818e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean-0.0001430511474609375
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max0.0
driven_lanedir_mean-0.0001430511474609375
driven_lanedir_median-0.0001430511474609375
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.40651342125780654, "driven_lanedir_consec": -0.000286102294921875}, "autolab-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.22311062332944268, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624766981243565, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168281657Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successyesdavinci-stage-02-6.2.530:14:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.90000000000021
in-drivable-lane_median2.3249999999999886
driven_lanedir_consec_median1.2177662527694952
deviation-center-line_median2.3002135284940906


other stats
deviation-center-line_max3.908754079420156
deviation-center-line_mean2.222950995126784
deviation-center-line_min0.3826228440987987
deviation-heading_max26.23072170803864
deviation-heading_mean12.26554969252966
deviation-heading_median9.842297840921647
deviation-heading_min3.1468813802367017
distance-from-start_max2.535816959402835
distance-from-start_mean1.444767113029012
distance-from-start_median1.405026282937512
distance-from-start_min0.433198926838189
driven_any_max4.3559970304540006
driven_any_mean2.560271306210762
driven_any_median2.3146154315627676
driven_any_min1.2558573312635115
driven_lanedir_consec_max2.900055131313948
driven_lanedir_consec_mean1.455478279103659
driven_lanedir_consec_min0.48632547956169625
driven_lanedir_max3.964501525614375
driven_lanedir_mean2.0593399679896724
driven_lanedir_median1.769210832316452
driven_lanedir_min0.7344366817114111
in-drivable-lane_max26.9000000000002
in-drivable-lane_mean8.075000000000044
in-drivable-lane_min0.7499999999999973
per-episodes
details{"4way-000-ego0": {"driven_any": 1.2558573312635115, "survival_time": 33.90000000000021, "driven_lanedir": 0.7344366817114111, "in-drivable-lane": 26.9000000000002, "deviation-heading": 3.1468813802367017, "distance-from-start": 0.433198926838189, "deviation-center-line": 0.3826228440987987, "driven_lanedir_consec": 0.48632547956169625}, "4way-000-ego1": {"driven_any": 2.775984409768532, "survival_time": 33.90000000000021, "driven_lanedir": 2.015042438186937, "in-drivable-lane": 3.3500000000000334, "deviation-heading": 11.358502892971394, "distance-from-start": 2.082941727107, "deviation-center-line": 3.908754079420156, "driven_lanedir_consec": 1.6355380226983576}, "4way-000-ego2": {"driven_any": 4.3559970304540006, "survival_time": 33.90000000000021, "driven_lanedir": 3.964501525614375, "in-drivable-lane": 1.299999999999944, "deviation-heading": 8.3260927888719, "distance-from-start": 2.535816959402835, "deviation-center-line": 1.8513851261016312, "driven_lanedir_consec": 2.900055131313948}, "4way-000-ego3": {"driven_any": 1.853246453357003, "survival_time": 33.90000000000021, "driven_lanedir": 1.5233792264459665, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 26.23072170803864, "distance-from-start": 0.7271108387680243, "deviation-center-line": 2.7490419308865497, "driven_lanedir_consec": 0.7999944828406331}}
simulation-passed1
survival_time_max33.90000000000021
survival_time_mean33.90000000000021
survival_time_min33.90000000000021
No reset possible
167851676Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-1of4successyesdavinci-stage-02-6.2.530:28:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median14.499999999999488
driven_lanedir_consec_median3.9202979304335113
deviation-center-line_median3.5149870605505376


other stats
deviation-center-line_max4.695558985377423
deviation-center-line_mean3.4765485844250965
deviation-center-line_min2.180661231221887
deviation-heading_max19.14374858760568
deviation-heading_mean16.24016571026464
deviation-heading_median18.047510489788685
deviation-heading_min9.721893273875503
distance-from-start_max2.706994366679789
distance-from-start_mean2.256237241373646
distance-from-start_median2.2305932172900524
distance-from-start_min1.8567681642346896
driven_any_max7.913892185956756
driven_any_mean7.496918690222469
driven_any_median7.9134643233449
driven_any_min6.246853928243321
driven_lanedir_consec_max5.524655957283073
driven_lanedir_consec_mean4.006064547966161
driven_lanedir_consec_min2.6590063737145475
driven_lanedir_max6.596526548845707
driven_lanedir_mean5.053314528088829
driven_lanedir_median5.188919234399073
driven_lanedir_min3.238893094711462
in-drivable-lane_max32.79999999999846
in-drivable-lane_mean16.62499999999933
in-drivable-lane_min4.699999999999878
per-episodes
details{"loop-000-ego0": {"driven_any": 6.246853928243321, "survival_time": 59.99999999999873, "driven_lanedir": 3.238893094711462, "in-drivable-lane": 32.79999999999846, "deviation-heading": 9.721893273875503, "distance-from-start": 2.706994366679789, "deviation-center-line": 2.180661231221887, "driven_lanedir_consec": 2.6590063737145475}, "loop-000-ego1": {"driven_any": 7.913892185956756, "survival_time": 59.99999999999873, "driven_lanedir": 6.596526548845707, "in-drivable-lane": 4.699999999999878, "deviation-heading": 18.500085378617147, "distance-from-start": 2.354335790113187, "deviation-center-line": 4.695558985377423, "driven_lanedir_consec": 5.524655957283073}, "loop-000-ego2": {"driven_any": 7.913283946515249, "survival_time": 59.99999999999873, "driven_lanedir": 5.098022622925344, "in-drivable-lane": 14.399999999999595, "deviation-heading": 19.14374858760568, "distance-from-start": 2.1068506444669177, "deviation-center-line": 3.456929734343108, "driven_lanedir_consec": 4.123861273520447}, "loop-000-ego3": {"driven_any": 7.91364470017455, "survival_time": 59.99999999999873, "driven_lanedir": 5.279815845872803, "in-drivable-lane": 14.59999999999938, "deviation-heading": 17.594935600960223, "distance-from-start": 1.8567681642346896, "deviation-center-line": 3.573044386757967, "driven_lanedir_consec": 3.716734587346576}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167821677Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-1of4successyesdavinci-stage-02-6.2.530:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.749999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5979160012362161
deviation-center-line_median0.16961813163860587


other stats
deviation-center-line_max0.16961813163860587
deviation-center-line_mean0.16961813163860587
deviation-center-line_min0.16961813163860587
deviation-heading_max1.099663381925174
deviation-heading_mean1.099663381925174
deviation-heading_median1.099663381925174
deviation-heading_min1.099663381925174
distance-from-start_max0.5799092162514967
distance-from-start_mean0.5799092162514967
distance-from-start_median0.5799092162514967
distance-from-start_min0.5799092162514967
driven_any_max0.6120709051882427
driven_any_mean0.6120709051882427
driven_any_median0.6120709051882427
driven_any_min0.6120709051882427
driven_lanedir_consec_max0.5979160012362161
driven_lanedir_consec_mean0.5979160012362161
driven_lanedir_consec_min0.5979160012362161
driven_lanedir_max0.5979160012362161
driven_lanedir_mean0.5979160012362161
driven_lanedir_median0.5979160012362161
driven_lanedir_min0.5979160012362161
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6120709051882427, "survival_time": 5.749999999999988, "driven_lanedir": 0.5979160012362161, "in-drivable-lane": 0.0, "deviation-heading": 1.099663381925174, "distance-from-start": 0.5799092162514967, "deviation-center-line": 0.16961813163860587, "driven_lanedir_consec": 0.5979160012362161}}
simulation-passed1
survival_time_max5.749999999999988
survival_time_mean5.749999999999988
survival_time_min5.749999999999988
No reset possible
167751678Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-3of4successyesdavinci-stage-02-6.2.530:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median9.938760268113356e-05
deviation-center-line_median0.8948971250979786


other stats
deviation-center-line_max0.8948971250979786
deviation-center-line_mean0.8948971250979786
deviation-center-line_min0.8948971250979786
deviation-heading_max32.2491476465892
deviation-heading_mean32.2491476465892
deviation-heading_median32.2491476465892
deviation-heading_min32.2491476465892
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max9.938760268113356e-05
driven_lanedir_consec_mean9.938760268113356e-05
driven_lanedir_consec_min9.938760268113356e-05
driven_lanedir_max9.938760268113356e-05
driven_lanedir_mean9.938760268113356e-05
driven_lanedir_median9.938760268113356e-05
driven_lanedir_min9.938760268113356e-05
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 9.938760268113356e-05, "in-drivable-lane": 0.0, "deviation-heading": 32.2491476465892, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8948971250979786, "driven_lanedir_consec": 9.938760268113356e-05}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167601681Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-2of4successyesdavinci-stage-02-6.2.530:12:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median6.0817422473064955
deviation-center-line_median0.25576965235048754


other stats
deviation-center-line_max0.25576965235048754
deviation-center-line_mean0.25576965235048754
deviation-center-line_min0.25576965235048754
deviation-heading_max1.94582432309865
deviation-heading_mean1.94582432309865
deviation-heading_median1.94582432309865
deviation-heading_min1.94582432309865
distance-from-start_max2.49941447398169
distance-from-start_mean2.49941447398169
distance-from-start_median2.49941447398169
distance-from-start_min2.49941447398169
driven_any_max6.0939946438635975
driven_any_mean6.0939946438635975
driven_any_median6.0939946438635975
driven_any_min6.0939946438635975
driven_lanedir_consec_max6.0817422473064955
driven_lanedir_consec_mean6.0817422473064955
driven_lanedir_consec_min6.0817422473064955
driven_lanedir_max6.081742517685205
driven_lanedir_mean6.081742517685205
driven_lanedir_median6.081742517685205
driven_lanedir_min6.081742517685205
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 6.0939946438635975, "survival_time": 59.99999999999873, "driven_lanedir": 6.081742517685205, "in-drivable-lane": 0.0, "deviation-heading": 1.94582432309865, "distance-from-start": 2.49941447398169, "deviation-center-line": 0.25576965235048754, "driven_lanedir_consec": 6.0817422473064955}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167561682Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validationsim-2of3erroryesdavinci-stage-02-6.2.530:01:29
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'dynamics' in data for class ScenarioRobotSpec and no default available
│  anns: dict[7]
│        │ configuration: RobotConfiguration
│        │ color: str
│        │ description: str
│        │ controllable: bool
│        │ protocol: Optional[ProtocolDesc ]
│        │ dynamics: str
│        │ dynamics_params: Dict[str,Any ]
│     T: str
│ known: [color, configuration, controllable, description, protocol]
│     f: Field(name='dynamics',type=<class 'str'>,default=<dataclasses._MISSING_TYPE object at 0x7f312966be20>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f312966be20>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 167, in main
    episodes0 = get_episodes_from_dirs(config.scenarios)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 833, in get_episodes_from_dirs
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/dist-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: Scenario
│          mj: dict[6]
│              │ payload_yaml: ''
│              │ player_robots: [ego0, ego1, ego2, ego3]
│              │ scenario_name: LFV_multi-state-4way-000
│              │ robots:
│              │ dict[4]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 3.19, y: 1.276, theta_deg: 180.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego1:
│              │ │ dict[5]
│              │ │ │ color: green
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego1
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 2.175, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego2:
│              │ │ dict[5]
│              │ │ │ color: blue
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego2
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 2.75, y: 3.074, theta_deg: 90.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ │ ego3:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_STATE
│              │ │ │ description: Playable robot ego3
│              │ │ │ controllable: True
│              │ │ │ configuration: {pose: {x: 1.914, y: 2.7492, theta_deg: 0.0} , velocity: {x: 0.0, y: 0.0, theta_deg: 0.0} }
│              │ duckies: {}
│              │ environment:
│              │ |# 5x5 counter-clockwise loop with a 4-way intersection in the middle
│              │ |# Designed to test the 4-way intersection tile and traffic light
│              │ |tiles:
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |- [floor, curve_left/W , straight/W, 3way_left/W   , straight/W, curve_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/N    , asphalt   , straight/N, floor]
│              │ |- [floor, 3way_left/S  , straight/W, 4way          , straight/E, 3way_left/N, floor]
│              │ |- [floor, straight/S   , asphalt   , straight/S    , asphalt   , straight/N, floor]
│              │ |- [floor, curve_left/S , straight/E, 3way_left/E   , straight/E, curve_left/E, floor]
│              │ |- [floor, floor, floor, floor, floor, floor, floor]
│              │ |
│              │ |objects:
│              │ |  trafficlight:
│              │ |    kind: trafficlight
│              │ |    place:
│              │ |      tile: [3,3]
│              │ |      relative:
│              │ |        ~SE2Transform:
│              │ |          p: [-0.18,-0.18]
│              │ |          theta_deg: 135
│              │ |    height: 0.4
│              │ |    optional: true
│              │ |
│              │ |tile_size: 0.585
│              │ |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
167481684Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-1of4successyesdavinci-stage-02-6.2.530:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.762199167368613
deviation-center-line_median0.2695568246827997


other stats
deviation-center-line_max0.2695568246827997
deviation-center-line_mean0.2695568246827997
deviation-center-line_min0.2695568246827997
deviation-heading_max2.286728929136476
deviation-heading_mean2.286728929136476
deviation-heading_median2.286728929136476
deviation-heading_min2.286728929136476
distance-from-start_max2.8947685325489236
distance-from-start_mean2.8947685325489236
distance-from-start_median2.8947685325489236
distance-from-start_min2.8947685325489236
driven_any_max5.7779481252581375
driven_any_mean5.7779481252581375
driven_any_median5.7779481252581375
driven_any_min5.7779481252581375
driven_lanedir_consec_max5.762199167368613
driven_lanedir_consec_mean5.762199167368613
driven_lanedir_consec_min5.762199167368613
driven_lanedir_max5.762199167368613
driven_lanedir_mean5.762199167368613
driven_lanedir_median5.762199167368613
driven_lanedir_min5.762199167368613
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.7779481252581375, "survival_time": 59.99999999999873, "driven_lanedir": 5.762199167368613, "in-drivable-lane": 0.0, "deviation-heading": 2.286728929136476, "distance-from-start": 2.8947685325489236, "deviation-center-line": 0.2695568246827997, "driven_lanedir_consec": 5.762199167368613}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167451685Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-3of4successyesdavinci-stage-02-6.2.530:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
167321688Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-0of4successyesdavinci-stage-02-6.2.530:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.806165216596741
deviation-center-line_median0.346929751854674


other stats
deviation-center-line_max3.4683962371431485
deviation-center-line_mean1.0771419870569272
deviation-center-line_min0.14631220737521272
deviation-heading_max18.309428016005143
deviation-heading_mean6.183544615708726
deviation-heading_median2.5217690015662964
deviation-heading_min1.3812124436971696
distance-from-start_max3.2999669320195104
distance-from-start_mean1.5546858371442225
distance-from-start_median1.459388208278689
distance-from-start_min3.1401849173675503e-16
driven_any_max5.037078959860759
driven_any_mean2.168309320245248
driven_any_median1.818079160559928
driven_any_min3.7682219008410875e-13
driven_lanedir_consec_max5.026911335982149
driven_lanedir_consec_mean2.159846205080773
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max5.026911335982149
driven_lanedir_mean2.159846205080773
driven_lanedir_median1.806165216596741
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.631893286204257, "survival_time": 59.99999999999873, "driven_lanedir": 1.6201843097857167, "in-drivable-lane": 0.0, "deviation-heading": 1.3812124436971696, "distance-from-start": 1.2742263432539964, "deviation-center-line": 0.14631220737521272, "driven_lanedir_consec": 1.6201843097857167}, "autolab-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0001430511474609375}, "autolab-000-ego2": {"driven_any": 5.037078959860759, "survival_time": 59.99999999999873, "driven_lanedir": 5.026911335982149, "in-drivable-lane": 0.0, "deviation-heading": 2.8050873323880503, "distance-from-start": 3.2999669320195104, "deviation-center-line": 0.3909808473609087, "driven_lanedir_consec": 5.026911335982149}, "autolab-000-ego3": {"driven_any": 2.0042650349155986, "survival_time": 59.99999999999873, "driven_lanedir": 1.992146123407765, "in-drivable-lane": 0.0, "deviation-heading": 2.2384506707445424, "distance-from-start": 1.644550073303382, "deviation-center-line": 0.3028786563484393, "driven_lanedir_consec": 1.992146123407765}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167261690Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4successyesdavinci-stage-02-6.2.530:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.649999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4132337880721526
deviation-center-line_median0.17972902691412632


other stats
deviation-center-line_max0.17972902691412632
deviation-center-line_mean0.17972902691412632
deviation-center-line_min0.17972902691412632
deviation-heading_max1.5025479858278594
deviation-heading_mean1.5025479858278594
deviation-heading_median1.5025479858278594
deviation-heading_min1.5025479858278594
distance-from-start_max0.37886290004634626
distance-from-start_mean0.37886290004634626
distance-from-start_median0.37886290004634626
distance-from-start_min0.37886290004634626
driven_any_max0.4316381850886603
driven_any_mean0.4316381850886603
driven_any_median0.4316381850886603
driven_any_min0.4316381850886603
driven_lanedir_consec_max0.4132337880721526
driven_lanedir_consec_mean0.4132337880721526
driven_lanedir_consec_min0.4132337880721526
driven_lanedir_max0.4132337880721526
driven_lanedir_mean0.4132337880721526
driven_lanedir_median0.4132337880721526
driven_lanedir_min0.4132337880721526
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.4316381850886603, "survival_time": 5.649999999999988, "driven_lanedir": 0.4132337880721526, "in-drivable-lane": 0.0, "deviation-heading": 1.5025479858278594, "distance-from-start": 0.37886290004634626, "deviation-center-line": 0.17972902691412632, "driven_lanedir_consec": 0.4132337880721526}}
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean5.649999999999988
survival_time_min5.649999999999988
No reset possible
167081698Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-1of4successyesdavinci-stage-02-6.2.530:17:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.20000000000000284
driven_lanedir_consec_median2.1565184275403313
deviation-center-line_median6.8847539526335915


other stats
deviation-center-line_max8.505262062597504
deviation-center-line_mean6.394382047888438
deviation-center-line_min3.302758223689067
deviation-heading_max3.5798145230604925
deviation-heading_mean3.012446130364057
deviation-heading_median3.033769498208445
deviation-heading_min2.402431001978846
distance-from-start_max2.264476618156332
distance-from-start_mean1.734085808306428
distance-from-start_median1.6868768650116457
distance-from-start_min1.29811288504609
driven_any_max3.579581555069671
driven_any_mean2.4167183064098396
driven_any_median2.2138464935031155
driven_any_min1.6595986835634573
driven_lanedir_consec_max3.3044744777527537
driven_lanedir_consec_mean2.3124661245028157
driven_lanedir_consec_min1.6323531651778471
driven_lanedir_max3.561566929531012
driven_lanedir_mean2.376739286489579
driven_lanedir_median2.156518525624728
driven_lanedir_min1.6323531651778471
in-drivable-lane_max1.8499999999998948
in-drivable-lane_mean0.5624999999999751
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579581555069671, "survival_time": 59.99999999999873, "driven_lanedir": 3.561566929531012, "in-drivable-lane": 0.0, "deviation-heading": 3.2546450343389006, "distance-from-start": 2.0440638678450447, "deviation-center-line": 3.302758223689067, "driven_lanedir_consec": 3.3044744777527537}, "4way-000-ego1": {"driven_any": 2.762094908064345, "survival_time": 59.99999999999873, "driven_lanedir": 2.6640283319084603, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.5798145230604925, "distance-from-start": 2.264476618156332, "deviation-center-line": 6.515047986085757, "driven_lanedir_consec": 2.664028135739667}, "4way-000-ego2": {"driven_any": 1.665598078941886, "survival_time": 59.99999999999873, "driven_lanedir": 1.6323531651778471, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 2.8128939620779896, "distance-from-start": 1.29811288504609, "deviation-center-line": 7.254459919181427, "driven_lanedir_consec": 1.6323531651778471}, "4way-000-ego3": {"driven_any": 1.6595986835634573, "survival_time": 59.99999999999873, "driven_lanedir": 1.6490087193409952, "in-drivable-lane": 0.0, "deviation-heading": 2.402431001978846, "distance-from-start": 1.3296898621782465, "deviation-center-line": 8.505262062597504, "driven_lanedir_consec": 1.6490087193409952}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166961696Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-2of4successyesdavinci-stage-02-6.2.530:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166901698Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-1of4timeoutyesdavinci-stage-02-6.2.530:10:08
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166851699Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-0of4successyesdavinci-stage-02-6.2.530:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.4553761243508863
deviation-center-line_median4.120476289903731


other stats
deviation-center-line_max4.120476289903731
deviation-center-line_mean4.120476289903731
deviation-center-line_min4.120476289903731
deviation-heading_max6.775158807062685
deviation-heading_mean6.775158807062685
deviation-heading_median6.775158807062685
deviation-heading_min6.775158807062685
distance-from-start_max2.7414345611822344
distance-from-start_mean2.7414345611822344
distance-from-start_median2.7414345611822344
distance-from-start_min2.7414345611822344
driven_any_max3.5465926378379353
driven_any_mean3.5465926378379353
driven_any_median3.5465926378379353
driven_any_min3.5465926378379353
driven_lanedir_consec_max3.4553761243508863
driven_lanedir_consec_mean3.4553761243508863
driven_lanedir_consec_min3.4553761243508863
driven_lanedir_max3.4553761243508863
driven_lanedir_mean3.4553761243508863
driven_lanedir_median3.4553761243508863
driven_lanedir_min3.4553761243508863
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465926378379353, "survival_time": 59.99999999999873, "driven_lanedir": 3.4553761243508863, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 6.775158807062685, "distance-from-start": 2.7414345611822344, "deviation-center-line": 4.120476289903731, "driven_lanedir_consec": 3.4553761243508863}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible