Duckietown Challenges Home Challenges Submissions

Evaluator 133

ID133
evaluatordavinci-stage-05-6.2.53
owneruser1000001
machinedavinci-stage
processdavinci-stage-05-6.2.53
version6.2.53
first heard
last heard
statusinactive
# evaluating
# success31 16680
# timeout2 16695
# failed12 16944
# error
# aborted
# host-error4 16859
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors99%
RAM total (MB)251.6 GB
RAM free (MB)243.2 GB
Disk (MB)3666.4 GB
Disk available (MB)3429.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
172681856Andrea Danieleexercises_braitenberglx22-BV1sim-2of5successyesdavinci-stage-05-6.2.530:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
172631855Jacopo Tanilx22-modconlx22-modconsimsuccessyesdavinci-stage-05-6.2.530:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median19.22499999999966
deviation-center-line_median1.3721613354787443
driven_lanedir_consec_median4.841383975693748
survival_time_median54.12499999999906


other stats
deviation-center-line_max1.5914149112035751
deviation-center-line_mean1.3721613354787443
deviation-center-line_min1.152907759753914
deviation-heading_max1.674447761341493
deviation-heading_mean1.4271091148342867
deviation-heading_median1.4271091148342867
deviation-heading_min1.1797704683270802
distance-from-start_max8.276240404671347
distance-from-start_mean7.378221317099997
distance-from-start_median7.378221317099997
distance-from-start_min6.480202229528647
driven_any_max8.338214588117905
driven_any_mean7.464690337549716
driven_any_median7.464690337549716
driven_any_min6.591166086981527
driven_lanedir_consec_max8.073263653003009
driven_lanedir_consec_mean4.841383975693748
driven_lanedir_consec_min1.6095042983844865
driven_lanedir_max8.073263653003009
driven_lanedir_mean4.841383975693748
driven_lanedir_median4.841383975693748
driven_lanedir_min1.6095042983844865
in-drivable-lane_max36.44999999999932
in-drivable-lane_mean19.22499999999966
in-drivable-lane_min2.000000000000001
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338214588117905, "survival_time": 59.99999999999873, "driven_lanedir": 8.073263653003009, "in-drivable-lane": 2.000000000000001, "deviation-heading": 1.1797704683270802, "distance-from-start": 8.276240404671347, "deviation-center-line": 1.5914149112035751, "driven_lanedir_consec": 8.073263653003009}, "LF-full-loop-001-ego0": {"driven_any": 6.591166086981527, "survival_time": 48.24999999999939, "driven_lanedir": 1.6095042983844865, "in-drivable-lane": 36.44999999999932, "deviation-heading": 1.674447761341493, "distance-from-start": 6.480202229528647, "deviation-center-line": 1.152907759753914, "driven_lanedir_consec": 1.6095042983844865}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean54.12499999999906
survival_time_min48.24999999999939
No reset possible
17257385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4successyesdavinci-stage-05-6.2.530:38:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.024999999999437
driven_lanedir_consec_median-3.7426185467315367
deviation-center-line_median3.286949084352202


other stats
deviation-center-line_max4.457617988376784
deviation-center-line_mean3.132681468654183
deviation-center-line_min1.4992097175355437
deviation-heading_max27.321568176507515
deviation-heading_mean24.111756013141218
deviation-heading_median26.127484091217433
deviation-heading_min16.87048769362248
distance-from-start_max0.1679623245018981
distance-from-start_mean0.16651336424207155
distance-from-start_median0.16721445973350796
distance-from-start_min0.16366221299937225
driven_any_max16.074827316880494
driven_any_mean14.054214352236633
driven_any_median14.282983277065687
driven_any_min11.576063537934663
driven_lanedir_consec_max-2.2533347949621847
driven_lanedir_consec_mean-3.476487611460497
driven_lanedir_consec_min-4.16737855741673
driven_lanedir_max-2.2533347949621847
driven_lanedir_mean-5.552203870603558
driven_lanedir_median-5.952715432800382
driven_lanedir_min-8.050049821851282
in-drivable-lane_max39.89999999999906
in-drivable-lane_mean26.14999999999937
in-drivable-lane_min16.649999999999523
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.735363188663882, "survival_time": 59.99999999999873, "driven_lanedir": -4.474975924624375, "in-drivable-lane": 27.59999999999936, "deviation-heading": 27.321568176507515, "distance-from-start": 0.16657286629549042, "deviation-center-line": 2.9938513741659, "driven_lanedir_consec": -4.16737855741673}, "zigzag-000-ego1": {"driven_any": 11.576063537934663, "survival_time": 59.99999999999873, "driven_lanedir": -2.2533347949621847, "in-drivable-lane": 39.89999999999906, "deviation-heading": 16.87048769362248, "distance-from-start": 0.16366221299937225, "deviation-center-line": 1.4992097175355437, "driven_lanedir_consec": -2.2533347949621847}, "zigzag-000-ego2": {"driven_any": 15.830603365467493, "survival_time": 59.99999999999873, "driven_lanedir": -8.050049821851282, "in-drivable-lane": 16.649999999999523, "deviation-heading": 27.194051122382533, "distance-from-start": 0.1678560531715255, "deviation-center-line": 4.457617988376784, "driven_lanedir_consec": -3.7515583881154506}, "zigzag-000-ego3": {"driven_any": 16.074827316880494, "survival_time": 59.99999999999873, "driven_lanedir": -7.430454940976389, "in-drivable-lane": 20.449999999999513, "deviation-heading": 25.06091706005233, "distance-from-start": 0.1679623245018981, "deviation-center-line": 3.580046794538504, "driven_lanedir_consec": -3.733678705347623}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17194391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4successyesdavinci-stage-05-6.2.530:30:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median7.124999999999881
driven_lanedir_consec_median-2.1479992551288447
deviation-center-line_median4.551449309644537


other stats
deviation-center-line_max5.031116416937324
deviation-center-line_mean4.491893663565692
deviation-center-line_min3.8335596180363702
deviation-heading_max32.014954249403516
deviation-heading_mean29.672354170702324
deviation-heading_median31.34873460667411
deviation-heading_min23.976993220057544
distance-from-start_max0.24087281595194696
distance-from-start_mean0.19101719929162347
distance-from-start_median0.18767357037416663
distance-from-start_min0.14784884046621363
driven_any_max15.168471551348656
driven_any_mean7.778438063219864
driven_any_median7.400439154252257
driven_any_min1.144402393026291
driven_lanedir_consec_max-0.1217492783513716
driven_lanedir_consec_mean-2.2861118230501027
driven_lanedir_consec_min-4.726699503591351
driven_lanedir_max-0.16076611159586007
driven_lanedir_mean-3.9025683668826
driven_lanedir_median-3.5011232499116405
driven_lanedir_min-8.447260856111258
in-drivable-lane_max16.149999999999416
in-drivable-lane_mean7.874999999999794
in-drivable-lane_min1.099999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 15.168471551348656, "survival_time": 59.99999999999873, "driven_lanedir": -8.447260856111258, "in-drivable-lane": 11.899999999999768, "deviation-heading": 31.260358618991624, "distance-from-start": 0.21949524162167372, "deviation-center-line": 5.031116416937324, "driven_lanedir_consec": -4.726699503591351}, "4way-000-ego1": {"driven_any": 1.144402393026291, "survival_time": 59.99999999999873, "driven_lanedir": -0.23892385418033824, "in-drivable-lane": 2.3499999999999934, "deviation-heading": 23.976993220057544, "distance-from-start": 0.15585189912665956, "deviation-center-line": 4.777400757904485, "driven_lanedir_consec": -0.23892385418033824}, "4way-000-ego2": {"driven_any": 13.297685076680684, "survival_time": 59.99999999999873, "driven_lanedir": -6.763322645642942, "in-drivable-lane": 16.149999999999416, "deviation-heading": 31.437110594356604, "distance-from-start": 0.24087281595194696, "deviation-center-line": 4.32549786138459, "driven_lanedir_consec": -4.057074656077351}, "4way-000-ego3": {"driven_any": 1.5031932318238304, "survival_time": 59.99999999999873, "driven_lanedir": -0.16076611159586007, "in-drivable-lane": 1.099999999999996, "deviation-heading": 32.014954249403516, "distance-from-start": 0.14784884046621363, "deviation-center-line": 3.8335596180363702, "driven_lanedir_consec": -0.1217492783513716}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17191392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4host-erroryesdavinci-stage-05-6.2.530:01:26
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17186393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-2of4successyesdavinci-stage-05-6.2.530:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median21.29999999999951
driven_lanedir_consec_median-2.7502038108138644
deviation-center-line_median3.369489122829619


other stats
deviation-center-line_max3.369489122829619
deviation-center-line_mean3.369489122829619
deviation-center-line_min3.369489122829619
deviation-heading_max28.537506111454856
deviation-heading_mean28.537506111454856
deviation-heading_median28.537506111454856
deviation-heading_min28.537506111454856
distance-from-start_max0.13674181209974484
distance-from-start_mean0.13674181209974484
distance-from-start_median0.13674181209974484
distance-from-start_min0.13674181209974484
driven_any_max10.727522447664018
driven_any_mean10.727522447664018
driven_any_median10.727522447664018
driven_any_min10.727522447664018
driven_lanedir_consec_max-2.7502038108138644
driven_lanedir_consec_mean-2.7502038108138644
driven_lanedir_consec_min-2.7502038108138644
driven_lanedir_max-2.7502038108138644
driven_lanedir_mean-2.7502038108138644
driven_lanedir_median-2.7502038108138644
driven_lanedir_min-2.7502038108138644
in-drivable-lane_max21.29999999999951
in-drivable-lane_mean21.29999999999951
in-drivable-lane_min21.29999999999951
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.727522447664018, "survival_time": 59.99999999999873, "driven_lanedir": -2.7502038108138644, "in-drivable-lane": 21.29999999999951, "deviation-heading": 28.537506111454856, "distance-from-start": 0.13674181209974484, "deviation-center-line": 3.369489122829619, "driven_lanedir_consec": -2.7502038108138644}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17178395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4host-erroryesdavinci-stage-05-6.2.530:03:55
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-05-6.2.53-job17178-978303, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.53-job17178-978303', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17104530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4successyesdavinci-stage-05-6.2.530:17:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.300000000000007
driven_lanedir_consec_median8.676170766478169
deviation-center-line_median3.1470927157463193


other stats
deviation-center-line_max3.1470927157463193
deviation-center-line_mean3.1470927157463193
deviation-center-line_min3.1470927157463193
deviation-heading_max16.12383122797764
deviation-heading_mean16.12383122797764
deviation-heading_median16.12383122797764
deviation-heading_min16.12383122797764
distance-from-start_max4.517163920744505
distance-from-start_mean4.517163920744505
distance-from-start_median4.517163920744505
distance-from-start_min4.517163920744505
driven_any_max9.548735910605613
driven_any_mean9.548735910605613
driven_any_median9.548735910605613
driven_any_min9.548735910605613
driven_lanedir_consec_max8.676170766478169
driven_lanedir_consec_mean8.676170766478169
driven_lanedir_consec_min8.676170766478169
driven_lanedir_max8.676170766478169
driven_lanedir_mean8.676170766478169
driven_lanedir_median8.676170766478169
driven_lanedir_min8.676170766478169
in-drivable-lane_max1.300000000000007
in-drivable-lane_mean1.300000000000007
in-drivable-lane_min1.300000000000007
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.548735910605613, "survival_time": 59.99999999999873, "driven_lanedir": 8.676170766478169, "in-drivable-lane": 1.300000000000007, "deviation-heading": 16.12383122797764, "distance-from-start": 4.517163920744505, "deviation-center-line": 3.1470927157463193, "driven_lanedir_consec": 8.676170766478169}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17099531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-2of4successyesdavinci-stage-05-6.2.530:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17095532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-1of4failedyesdavinci-stage-05-6.2.530:01:27
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17091533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-2of4failedyesdavinci-stage-05-6.2.530:01:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17086534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4failedyesdavinci-stage-05-6.2.530:01:05
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17072538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-05-6.2.530:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.55000000000029
in-drivable-lane_median0.0
driven_lanedir_consec_median5.011406663729076
deviation-center-line_median1.3183019227738335


other stats
deviation-center-line_max1.3183019227738335
deviation-center-line_mean1.3183019227738335
deviation-center-line_min1.3183019227738335
deviation-heading_max7.004891842391684
deviation-heading_mean7.004891842391684
deviation-heading_median7.004891842391684
deviation-heading_min7.004891842391684
distance-from-start_max3.465494482921472
distance-from-start_mean3.465494482921472
distance-from-start_median3.465494482921472
distance-from-start_min3.465494482921472
driven_any_max5.542589245546196
driven_any_mean5.542589245546196
driven_any_median5.542589245546196
driven_any_min5.542589245546196
driven_lanedir_consec_max5.011406663729076
driven_lanedir_consec_mean5.011406663729076
driven_lanedir_consec_min5.011406663729076
driven_lanedir_max5.31658917898965
driven_lanedir_mean5.31658917898965
driven_lanedir_median5.31658917898965
driven_lanedir_min5.31658917898965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 5.542589245546196, "survival_time": 32.55000000000029, "driven_lanedir": 5.31658917898965, "in-drivable-lane": 0.0, "deviation-heading": 7.004891842391684, "distance-from-start": 3.465494482921472, "deviation-center-line": 1.3183019227738335, "driven_lanedir_consec": 5.011406663729076}}
simulation-passed1
survival_time_max32.55000000000029
survival_time_mean32.55000000000029
survival_time_min32.55000000000029
No reset possible
17068539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-2of4successyesdavinci-stage-05-6.2.530:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17060542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successyesdavinci-stage-05-6.2.530:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
170381554Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-05-6.2.530:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170261557Andrea Danieleexercises_braitenberglx22-BV1sim-4of5successyesdavinci-stage-05-6.2.530:09:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d60-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170151597Andrea Danieleexercises_braitenberglx22-BV1sim-3of5successyesdavinci-stage-05-6.2.530:08:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
170041603Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-0of4failedyesdavinci-stage-05-6.2.530:01:16
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169931606Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4failedyesdavinci-stage-05-6.2.530:00:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169841607Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4failedyesdavinci-stage-05-6.2.530:01:11
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169791614Bea Baselines 🐤baseline-RPL-roslx22-BV1sim-3of5failedyesdavinci-stage-05-6.2.530:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169681621Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4failedyesdavinci-stage-05-6.2.530:01:18
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169621622Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-2of4failedyesdavinci-stage-05-6.2.530:01:15
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169541625Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4failedyesdavinci-stage-05-6.2.530:01:42
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169491626Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-3of4failedyesdavinci-stage-05-6.2.530:01:17
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169441627Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4failedyesdavinci-stage-05-6.2.530:01:57
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169201632Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-0of4successyesdavinci-stage-05-6.2.530:15:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.511712681694341


other stats
deviation-center-line_max2.946761767849859
deviation-center-line_mean1.5769794398758672
deviation-center-line_min0.33773062826492745
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.597265680122995
deviation-heading_min13.914341154718024
distance-from-start_max6.661338147750939e-16
distance-from-start_mean3.0054922785922e-16
distance-from-start_median2.6803154833089315e-16
distance-from-start_min0.0
driven_any_max7.993605777301127e-13
driven_any_mean3.6065907343106473e-13
driven_any_median3.216378579970732e-13
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 7.993605777301127e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.661338147750939e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}, "udem-000-ego1": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.1285169433978144, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946761767849859, "driven_lanedir_consec": 0.0}, "udem-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.33773062826492745, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169141634Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-1of4successyesdavinci-stage-05-6.2.530:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353328


other stats
deviation-center-line_max0.8948975282353328
deviation-center-line_mean0.8948975282353328
deviation-center-line_min0.8948975282353328
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353328, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
169001647Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-05-6.2.530:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.40653839040804857


other stats
deviation-center-line_max0.40653839040804857
deviation-center-line_mean0.40653839040804857
deviation-center-line_min0.40653839040804857
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.40653839040804857, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168951853Frank (Chude) Qianexercises_braitenberglx22-BV1sim-0of5successyesdavinci-stage-05-6.2.530:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.668917750556934e-17


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.668917750556934e-17
distance-from-start_median5.668917750556934e-17
distance-from-start_min5.668917750556934e-17
driven_any_max6.802701300668135e-14
driven_any_mean6.802701300668135e-14
driven_any_median6.802701300668135e-14
driven_any_min6.802701300668135e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 6.802701300668135e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 5.668917750556934e-17, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
168811646Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4host-erroryesdavinci-stage-05-6.2.530:02:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: TLS handshake timeout")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 927, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 50, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache, quiet=True)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 293, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 943, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.amazonaws.com/v3/staging/by-value/sha256/ca7180f470d1d39ab295669f219bce3e003fb4d53e078301cc67608b9071ffd6"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168701647Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4timeoutyesdavinci-stage-05-6.2.53----No reset possible
168611649Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-3of4successyesdavinci-stage-05-6.2.530:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.406522978175052
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.406522978175052
deviation-center-line_mean0.406522978175052
deviation-center-line_min0.406522978175052
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.789639601072594e-17
distance-from-start_mean5.789639601072594e-17
distance-from-start_median5.789639601072594e-17
distance-from-start_min5.789639601072594e-17
driven_any_max6.947567521287112e-14
driven_any_mean6.947567521287112e-14
driven_any_median6.947567521287112e-14
driven_any_min6.947567521287112e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.947567521287112e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.789639601072594e-17, "deviation-center-line": 0.406522978175052, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168591649Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-1of4host-erroryesdavinci-stage-05-6.2.530:01:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
168251658Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4successyesdavinci-stage-05-6.2.530:25:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median6.775000000000049
driven_lanedir_consec_median2.2636643890079
deviation-center-line_median4.9033846096028455


other stats
deviation-center-line_max5.320081671399952
deviation-center-line_mean4.426125854333181
deviation-center-line_min2.577652526727084
deviation-heading_max35.47755532291594
deviation-heading_mean23.737887831414557
deviation-heading_median21.603958747709484
deviation-heading_min16.26607850732333
distance-from-start_max3.2581165563019674
distance-from-start_mean1.6647295312771386
distance-from-start_median1.3625020420986975
distance-from-start_min0.6757974846091924
driven_any_max7.913545925414938
driven_any_mean4.750592747364193
driven_any_median3.9474992671330185
driven_any_min3.193826529775798
driven_lanedir_consec_max3.4775969639915862
driven_lanedir_consec_mean2.3574669043559924
driven_lanedir_consec_min1.4249418754165828
driven_lanedir_max5.67342878983834
driven_lanedir_mean3.260285583540707
driven_lanedir_median2.729438351428366
driven_lanedir_min1.908836841467757
in-drivable-lane_max9.399999999999846
in-drivable-lane_mean7.037499999999995
in-drivable-lane_min5.200000000000038
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.194012154231178, "survival_time": 59.99999999999873, "driven_lanedir": 2.193454267206459, "in-drivable-lane": 5.200000000000038, "deviation-heading": 22.3724506084822, "distance-from-start": 0.6757974846091924, "deviation-center-line": 5.320081671399952, "driven_lanedir_consec": 1.5673042751995974}, "autolab-000-ego1": {"driven_any": 4.700986380034859, "survival_time": 59.99999999999873, "driven_lanedir": 3.265422435650273, "in-drivable-lane": 7.050000000000029, "deviation-heading": 16.26607850732333, "distance-from-start": 3.2581165563019674, "deviation-center-line": 5.273800880206895, "driven_lanedir_consec": 2.960024502816203}, "autolab-000-ego2": {"driven_any": 3.193826529775798, "survival_time": 59.99999999999873, "driven_lanedir": 1.908836841467757, "in-drivable-lane": 6.500000000000069, "deviation-heading": 35.47755532291594, "distance-from-start": 0.8014238856297982, "deviation-center-line": 2.577652526727084, "driven_lanedir_consec": 1.4249418754165828}, "autolab-000-ego3": {"driven_any": 7.913545925414938, "survival_time": 59.99999999999873, "driven_lanedir": 5.67342878983834, "in-drivable-lane": 9.399999999999846, "deviation-heading": 20.83546688693677, "distance-from-start": 1.9235801985675969, "deviation-center-line": 4.532968338998795, "driven_lanedir_consec": 3.4775969639915862}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
168141661Bea Baselines 🐤baseline-duckietownlx22-objdetsimsuccessyesdavinci-stage-05-6.2.530:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.44999999999969
driven_lanedir_consec_median4.783450032017865


other stats
deviation-center-line_max2.0045372321783574
deviation-center-line_mean1.426639159512162
deviation-center-line_median1.426639159512162
deviation-center-line_min0.8487410868459663
deviation-heading_max2.484844846990133
deviation-heading_mean2.274997835375461
deviation-heading_median2.274997835375461
deviation-heading_min2.065150823760789
distance-from-start_max6.751793163705422
distance-from-start_mean4.800736079762185
distance-from-start_median4.800736079762185
distance-from-start_min2.849678995818949
driven_any_max6.759532038495246
driven_any_mean4.830974807972647
driven_any_median4.830974807972647
driven_any_min2.902417577450048
driven_lanedir_consec_max6.751938191870093
driven_lanedir_consec_mean4.783450032017865
driven_lanedir_consec_min2.8149618721656373
driven_lanedir_max6.751938191870093
driven_lanedir_mean4.783450032017865
driven_lanedir_median4.783450032017865
driven_lanedir_min2.8149618721656373
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean0.5000000000000071
in-drivable-lane_median0.5000000000000071
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.759532038495246, "survival_time": 51.99999999999918, "driven_lanedir": 6.751938191870093, "in-drivable-lane": 0.0, "deviation-heading": 2.065150823760789, "distance-from-start": 6.751793163705422, "deviation-center-line": 2.0045372321783574, "driven_lanedir_consec": 6.751938191870093}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.902417577450048, "survival_time": 22.90000000000019, "driven_lanedir": 2.8149618721656373, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 2.484844846990133, "distance-from-start": 2.849678995818949, "deviation-center-line": 0.8487410868459663, "driven_lanedir_consec": 2.8149618721656373}}
simulation-passed1
survival_time_max51.99999999999918
survival_time_mean37.44999999999969
survival_time_min22.90000000000019
No reset possible
168061671Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-2of4successyesdavinci-stage-05-6.2.530:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.00000000000015
in-drivable-lane_median6.750000000000085
driven_lanedir_consec_median1.2596909696333816
deviation-center-line_median1.070736218402991


other stats
deviation-center-line_max1.070736218402991
deviation-center-line_mean1.070736218402991
deviation-center-line_min1.070736218402991
deviation-heading_max4.8937791196781095
deviation-heading_mean4.8937791196781095
deviation-heading_median4.8937791196781095
deviation-heading_min4.8937791196781095
distance-from-start_max1.0711683880819656
distance-from-start_mean1.0711683880819656
distance-from-start_median1.0711683880819656
distance-from-start_min1.0711683880819656
driven_any_max2.5105452634579346
driven_any_mean2.5105452634579346
driven_any_median2.5105452634579346
driven_any_min2.5105452634579346
driven_lanedir_consec_max1.2596909696333816
driven_lanedir_consec_mean1.2596909696333816
driven_lanedir_consec_min1.2596909696333816
driven_lanedir_max1.5220783578126775
driven_lanedir_mean1.5220783578126775
driven_lanedir_median1.5220783578126775
driven_lanedir_min1.5220783578126775
in-drivable-lane_max6.750000000000085
in-drivable-lane_mean6.750000000000085
in-drivable-lane_min6.750000000000085
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.5105452634579346, "survival_time": 20.00000000000015, "driven_lanedir": 1.5220783578126775, "in-drivable-lane": 6.750000000000085, "deviation-heading": 4.8937791196781095, "distance-from-start": 1.0711683880819656, "deviation-center-line": 1.070736218402991, "driven_lanedir_consec": 1.2596909696333816}}
simulation-passed1
survival_time_max20.00000000000015
survival_time_mean20.00000000000015
survival_time_min20.00000000000015
No reset possible
167991672Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-0of4successyesdavinci-stage-05-6.2.530:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.399999999999992
in-drivable-lane_median1.499999999999995
driven_lanedir_consec_median0.293092735884636
deviation-center-line_median0.17645440368131576


other stats
deviation-center-line_max0.17645440368131576
deviation-center-line_mean0.17645440368131576
deviation-center-line_min0.17645440368131576
deviation-heading_max1.4359888200626747
deviation-heading_mean1.4359888200626747
deviation-heading_median1.4359888200626747
deviation-heading_min1.4359888200626747
distance-from-start_max0.4203883347455241
distance-from-start_mean0.4203883347455241
distance-from-start_median0.4203883347455241
distance-from-start_min0.4203883347455241
driven_any_max0.4394628655074159
driven_any_mean0.4394628655074159
driven_any_median0.4394628655074159
driven_any_min0.4394628655074159
driven_lanedir_consec_max0.293092735884636
driven_lanedir_consec_mean0.293092735884636
driven_lanedir_consec_min0.293092735884636
driven_lanedir_max0.293092735884636
driven_lanedir_mean0.293092735884636
driven_lanedir_median0.293092735884636
driven_lanedir_min0.293092735884636
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean1.499999999999995
in-drivable-lane_min1.499999999999995
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4394628655074159, "survival_time": 4.399999999999992, "driven_lanedir": 0.293092735884636, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.4359888200626747, "distance-from-start": 0.4203883347455241, "deviation-center-line": 0.17645440368131576, "driven_lanedir_consec": 0.293092735884636}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_min4.399999999999992
No reset possible
167931674Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-1of4successyesdavinci-stage-05-6.2.530:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.98256691449547
survival_time_median59.99999999999873
deviation-center-line_median2.74512682182672
in-drivable-lane_median2.199999999999921


other stats
deviation-center-line_max2.74512682182672
deviation-center-line_mean2.74512682182672
deviation-center-line_min2.74512682182672
deviation-heading_max9.32966715184804
deviation-heading_mean9.32966715184804
deviation-heading_median9.32966715184804
deviation-heading_min9.32966715184804
distance-from-start_max3.026431780848686
distance-from-start_mean3.026431780848686
distance-from-start_median3.026431780848686
distance-from-start_min3.026431780848686
driven_any_max7.907699161787227
driven_any_mean7.907699161787227
driven_any_median7.907699161787227
driven_any_min7.907699161787227
driven_lanedir_consec_max5.98256691449547
driven_lanedir_consec_mean5.98256691449547
driven_lanedir_consec_min5.98256691449547
driven_lanedir_max7.359386007677856
driven_lanedir_mean7.359386007677856
driven_lanedir_median7.359386007677856
driven_lanedir_min7.359386007677856
in-drivable-lane_max2.199999999999921
in-drivable-lane_mean2.199999999999921
in-drivable-lane_min2.199999999999921
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907699161787227, "survival_time": 59.99999999999873, "driven_lanedir": 7.359386007677856, "in-drivable-lane": 2.199999999999921, "deviation-heading": 9.32966715184804, "distance-from-start": 3.026431780848686, "deviation-center-line": 2.74512682182672, "driven_lanedir_consec": 5.98256691449547}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167771677Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-3of4successyesdavinci-stage-05-6.2.530:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.450000000000227
in-drivable-lane_median1.9500000000000135
driven_lanedir_consec_median2.8826417749839712
deviation-center-line_median1.9821576380660149


other stats
deviation-center-line_max1.9821576380660149
deviation-center-line_mean1.9821576380660149
deviation-center-line_min1.9821576380660149
deviation-heading_max4.833685767272619
deviation-heading_mean4.833685767272619
deviation-heading_median4.833685767272619
deviation-heading_min4.833685767272619
distance-from-start_max2.262600153236564
distance-from-start_mean2.262600153236564
distance-from-start_median2.262600153236564
distance-from-start_min2.262600153236564
driven_any_max3.2342937801427345
driven_any_mean3.2342937801427345
driven_any_median3.2342937801427345
driven_any_min3.2342937801427345
driven_lanedir_consec_max2.8826417749839712
driven_lanedir_consec_mean2.8826417749839712
driven_lanedir_consec_min2.8826417749839712
driven_lanedir_max2.8826417749839712
driven_lanedir_mean2.8826417749839712
driven_lanedir_median2.8826417749839712
driven_lanedir_min2.8826417749839712
in-drivable-lane_max1.9500000000000135
in-drivable-lane_mean1.9500000000000135
in-drivable-lane_min1.9500000000000135
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.2342937801427345, "survival_time": 25.450000000000227, "driven_lanedir": 2.8826417749839712, "in-drivable-lane": 1.9500000000000135, "deviation-heading": 4.833685767272619, "distance-from-start": 2.262600153236564, "deviation-center-line": 1.9821576380660149, "driven_lanedir_consec": 2.8826417749839712}}
simulation-passed1
survival_time_max25.450000000000227
survival_time_mean25.450000000000227
survival_time_min25.450000000000227
No reset possible
167641680Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-3of4successyesdavinci-stage-05-6.2.530:11:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.87044918682097
deviation-center-line_median0.1629208044133267


other stats
deviation-center-line_max3.4506790593202896
deviation-center-line_mean0.975722942917009
deviation-center-line_min0.12637110352109293
deviation-heading_max26.9052448670844
deviation-heading_mean7.787954995168265
deviation-heading_median1.622296803656659
deviation-heading_min1.001981506275341
distance-from-start_max3.1388446632722284
distance-from-start_mean1.8800227125863065
distance-from-start_median2.190623093536498
distance-from-start_min4.440892098500626e-16
driven_any_max5.732211587504052
driven_any_mean3.9710285465457744
driven_any_median5.075951299339257
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.726105869591416
driven_lanedir_consec_mean3.866751060808339
driven_lanedir_consec_min0.0
driven_lanedir_max5.72610611271169
driven_lanedir_mean3.9673328096636857
driven_lanedir_median5.071612562971525
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 4.62060007041619, "survival_time": 59.99999999999873, "driven_lanedir": 4.618548386263603, "in-drivable-lane": 0.0, "deviation-heading": 1.001981506275341, "distance-from-start": 3.1388446632722284, "deviation-center-line": 0.12637110352109293, "driven_lanedir_consec": 4.61854797027584}, "4way-001-ego1": {"driven_any": 5.732211587504052, "survival_time": 59.99999999999873, "driven_lanedir": 5.72610611271169, "in-drivable-lane": 0.0, "deviation-heading": 1.7047057639689014, "distance-from-start": 2.052047610153934, "deviation-center-line": 0.17436950864269551, "driven_lanedir_consec": 5.726105869591416}, "4way-001-ego2": {"driven_any": 5.531302528262324, "survival_time": 59.99999999999873, "driven_lanedir": 5.524676739679447, "in-drivable-lane": 0.0, "deviation-heading": 1.5398878433444168, "distance-from-start": 2.329198576919062, "deviation-center-line": 0.1514721001839579, "driven_lanedir_consec": 5.122350403366101}, "4way-001-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.4506790593202896, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167411686Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-2of4successyesdavinci-stage-05-6.2.530:12:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2917560752452353
deviation-center-line_median0.27463897897422074


other stats
deviation-center-line_max0.8490104989255264
deviation-center-line_mean0.4053497700508593
deviation-center-line_min0.2231106233294694
deviation-heading_max4.652112626803104
deviation-heading_mean3.392972578929611
deviation-heading_median3.4870395918569868
deviation-heading_min1.9456985052013656
distance-from-start_max2.3851954040258585
distance-from-start_mean1.4217930471518925
distance-from-start_median1.6509883922908557
distance-from-start_min2.220446049250313e-16
driven_any_max5.630152749474803
driven_any_mean2.559119045837817
driven_any_median2.3031617169380976
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.099440922602875
driven_lanedir_consec_mean2.4207382682733365
driven_lanedir_consec_min0.0
driven_lanedir_max5.620526100398644
driven_lanedir_mean2.5510097184456804
driven_lanedir_median2.291756386692038
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.930809165198691, "survival_time": 59.99999999999873, "driven_lanedir": 2.9200356041068973, "in-drivable-lane": 0.0, "deviation-heading": 3.5129636830313307, "distance-from-start": 2.3851954040258585, "deviation-center-line": 0.2707652624623321, "driven_lanedir_consec": 2.9200349812132913}, "4way-000-ego1": {"driven_any": 5.630152749474803, "survival_time": 59.99999999999873, "driven_lanedir": 5.620526100398644, "in-drivable-lane": 0.0, "deviation-heading": 1.9456985052013656, "distance-from-start": 2.067364738250145, "deviation-center-line": 0.2785126954861093, "driven_lanedir_consec": 5.099440922602875}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.2231106233294694, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 1.6755142686775044, "survival_time": 59.99999999999873, "driven_lanedir": 1.6634771692771788, "in-drivable-lane": 0.0, "deviation-heading": 3.461115500682643, "distance-from-start": 1.2346120463315662, "deviation-center-line": 0.8490104989255264, "driven_lanedir_consec": 1.6634771692771788}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167291689Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-1of4successyesdavinci-stage-05-6.2.530:10:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.085488757766068
deviation-center-line_median0.29109357156287574


other stats
deviation-center-line_max0.29109357156287574
deviation-center-line_mean0.29109357156287574
deviation-center-line_min0.29109357156287574
deviation-heading_max2.2331060010618957
deviation-heading_mean2.2331060010618957
deviation-heading_median2.2331060010618957
deviation-heading_min2.2331060010618957
distance-from-start_max2.255025037659017
distance-from-start_mean2.255025037659017
distance-from-start_median2.255025037659017
distance-from-start_min2.255025037659017
driven_any_max4.097561841074084
driven_any_mean4.097561841074084
driven_any_median4.097561841074084
driven_any_min4.097561841074084
driven_lanedir_consec_max4.085488757766068
driven_lanedir_consec_mean4.085488757766068
driven_lanedir_consec_min4.085488757766068
driven_lanedir_max4.085488757766068
driven_lanedir_mean4.085488757766068
driven_lanedir_median4.085488757766068
driven_lanedir_min4.085488757766068
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 4.097561841074084, "survival_time": 59.99999999999873, "driven_lanedir": 4.085488757766068, "in-drivable-lane": 0.0, "deviation-heading": 2.2331060010618957, "distance-from-start": 2.255025037659017, "deviation-center-line": 0.29109357156287574, "driven_lanedir_consec": 4.085488757766068}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167071698Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-0of4successyesdavinci-stage-05-6.2.530:18:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.181141245854967
deviation-center-line_median3.637790649976113


other stats
deviation-center-line_max4.94306639156408
deviation-center-line_mean3.6384672153214295
deviation-center-line_min2.335221169769412
deviation-heading_max8.096258955413703
deviation-heading_mean4.529231763948582
deviation-heading_median3.72621262109843
deviation-heading_min2.5682428581837655
distance-from-start_max2.691073047423519
distance-from-start_mean2.018255833360554
distance-from-start_median1.9479902375273632
distance-from-start_min1.4859698109639692
driven_any_max3.579594996204495
driven_any_mean3.415340175689185
driven_any_median3.5570850562678142
driven_any_min2.967595594016612
driven_lanedir_consec_max3.539826151958123
driven_lanedir_consec_mean2.923537151224604
driven_lanedir_consec_min1.792039961230358
driven_lanedir_max3.5660962143307464
driven_lanedir_mean3.362317352125506
driven_lanedir_median3.4666651400264885
driven_lanedir_min2.949842914118302
in-drivable-lane_max1.499999999999929
in-drivable-lane_mean0.37499999999998224
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.579594996204495, "survival_time": 59.99999999999873, "driven_lanedir": 3.5595521168819433, "in-drivable-lane": 0.0, "deviation-heading": 3.735588116547547, "distance-from-start": 2.3422362133197785, "deviation-center-line": 3.1814195463645407, "driven_lanedir_consec": 3.539826151958123}, "udem-000-ego1": {"driven_any": 3.534579691227877, "survival_time": 59.99999999999873, "driven_lanedir": 3.3737781631710337, "in-drivable-lane": 1.499999999999929, "deviation-heading": 8.096258955413703, "distance-from-start": 1.4859698109639692, "deviation-center-line": 4.094161753587684, "driven_lanedir_consec": 1.792039961230358}, "udem-000-ego2": {"driven_any": 2.967595594016612, "survival_time": 59.99999999999873, "driven_lanedir": 2.949842914118302, "in-drivable-lane": 0.0, "deviation-heading": 3.716837125649313, "distance-from-start": 1.5537442617349484, "deviation-center-line": 4.94306639156408, "driven_lanedir_consec": 2.9382421148856936}, "udem-000-ego3": {"driven_any": 3.579590421307752, "survival_time": 59.99999999999873, "driven_lanedir": 3.5660962143307464, "in-drivable-lane": 0.0, "deviation-heading": 2.5682428581837655, "distance-from-start": 2.691073047423519, "deviation-center-line": 2.335221169769412, "driven_lanedir_consec": 3.4240403768242405}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
167041696Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successyesdavinci-stage-05-6.2.530:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
166951697Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4timeoutyesdavinci-stage-05-6.2.530:00:38
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
166881700Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4successyesdavinci-stage-05-6.2.530:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3819713089277443
deviation-center-line_median3.670190139750301


other stats
deviation-center-line_max3.670190139750301
deviation-center-line_mean3.670190139750301
deviation-center-line_min3.670190139750301
deviation-heading_max4.682835183981122
deviation-heading_mean4.682835183981122
deviation-heading_median4.682835183981122
deviation-heading_min4.682835183981122
distance-from-start_max2.2320761555794064
distance-from-start_mean2.2320761555794064
distance-from-start_median2.2320761555794064
distance-from-start_min2.2320761555794064
driven_any_max3.5795864361741097
driven_any_mean3.5795864361741097
driven_any_median3.5795864361741097
driven_any_min3.5795864361741097
driven_lanedir_consec_max3.3819713089277443
driven_lanedir_consec_mean3.3819713089277443
driven_lanedir_consec_min3.3819713089277443
driven_lanedir_max3.551265460849699
driven_lanedir_mean3.551265460849699
driven_lanedir_median3.551265460849699
driven_lanedir_min3.551265460849699
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.5795864361741097, "survival_time": 59.99999999999873, "driven_lanedir": 3.551265460849699, "in-drivable-lane": 0.0, "deviation-heading": 4.682835183981122, "distance-from-start": 2.2320761555794064, "deviation-center-line": 3.670190139750301, "driven_lanedir_consec": 3.3819713089277443}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
166801699Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-3of4successyesdavinci-stage-05-6.2.530:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.89181051149263
deviation-center-line_median5.68144547559899


other stats
deviation-center-line_max5.68144547559899
deviation-center-line_mean5.68144547559899
deviation-center-line_min5.68144547559899
deviation-heading_max11.49374085929236
deviation-heading_mean11.49374085929236
deviation-heading_median11.49374085929236
deviation-heading_min11.49374085929236
distance-from-start_max2.522917038266831
distance-from-start_mean2.522917038266831
distance-from-start_median2.522917038266831
distance-from-start_min2.522917038266831
driven_any_max3.426575056819777
driven_any_mean3.426575056819777
driven_any_median3.426575056819777
driven_any_min3.426575056819777
driven_lanedir_consec_max2.89181051149263
driven_lanedir_consec_mean2.89181051149263
driven_lanedir_consec_min2.89181051149263
driven_lanedir_max3.0975603398117015
driven_lanedir_mean3.0975603398117015
driven_lanedir_median3.0975603398117015
driven_lanedir_min3.0975603398117015
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.426575056819777, "survival_time": 59.99999999999873, "driven_lanedir": 3.0975603398117015, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.49374085929236, "distance-from-start": 2.522917038266831, "deviation-center-line": 5.68144547559899, "driven_lanedir_consec": 2.89181051149263}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible