Duckietown Challenges Home Challenges Submissions

Evaluator 105

ID105
evaluatordavinci-stage-01-6.2.46
owneruser1000001
machinedavinci-stage
processdavinci-stage-01-6.2.46
version6.2.46
first heard
last heard
statusinactive
# evaluating
# success52 9098
# timeout1 11941
# failed2 11753
# error
# aborted
# host-error2 11057
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors84%
RAM total (MB)251.6 GB
RAM free (MB)239.7 GB
Disk (MB)491.1 GB
Disk available (MB)239.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11941746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4timeoutnodavinci-stage-01-6.2.46----No reset possible
11938746Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-01-6.2.460:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11918769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:27:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median9.974999999999856
driven_lanedir_consec_median3.83793298684947
deviation-center-line_median3.9351352423773154


other stats
deviation-center-line_max4.152495434988696
deviation-center-line_mean3.283377349738229
deviation-center-line_min1.110743479209589
deviation-heading_max20.95104338228384
deviation-heading_mean17.77313605608601
deviation-heading_median20.15918955241261
deviation-heading_min9.82312173723499
distance-from-start_max3.01610403076007
distance-from-start_mean2.2522442252385293
distance-from-start_median2.3427337808757764
distance-from-start_min1.307405308442494
driven_any_max7.913612004255455
driven_any_mean6.7237124207491625
driven_any_median7.913524398655854
driven_any_min3.1541888814294854
driven_lanedir_consec_max4.0385236661821455
driven_lanedir_consec_mean3.2762948541378156
driven_lanedir_consec_min1.3907897766701771
driven_lanedir_max6.125996284760838
driven_lanedir_mean4.848634137949172
driven_lanedir_median5.73029877116932
driven_lanedir_min1.807942724697208
in-drivable-lane_max42.09999999999859
in-drivable-lane_mean17.199999999999513
in-drivable-lane_min6.749999999999755
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.91346251372532, "survival_time": 59.99999999999873, "driven_lanedir": 5.422601492796221, "in-drivable-lane": 11.79999999999994, "deviation-heading": 20.405048907400115, "distance-from-start": 2.599949441125229, "deviation-center-line": 4.152495434988696, "driven_lanedir_consec": 3.8385271799906873}, "zigzag-000-ego1": {"driven_any": 7.913586283586389, "survival_time": 59.99999999999873, "driven_lanedir": 6.037996049542419, "in-drivable-lane": 8.149999999999771, "deviation-heading": 19.9133301974251, "distance-from-start": 2.0855181206263236, "deviation-center-line": 3.888091412989211, "driven_lanedir_consec": 3.837338793708253}, "zigzag-000-ego2": {"driven_any": 7.913612004255455, "survival_time": 59.99999999999873, "driven_lanedir": 6.125996284760838, "in-drivable-lane": 6.749999999999755, "deviation-heading": 20.95104338228384, "distance-from-start": 3.01610403076007, "deviation-center-line": 3.982179071765419, "driven_lanedir_consec": 4.0385236661821455}, "zigzag-000-ego3": {"driven_any": 3.1541888814294854, "survival_time": 59.99999999999873, "driven_lanedir": 1.807942724697208, "in-drivable-lane": 42.09999999999859, "deviation-heading": 9.82312173723499, "distance-from-start": 1.307405308442494, "deviation-center-line": 1.110743479209589, "driven_lanedir_consec": 1.3907897766701771}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11915770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999983
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7479615613663406
deviation-center-line_median0.5667526273649459


other stats
deviation-center-line_max0.5667526273649459
deviation-center-line_mean0.5667526273649459
deviation-center-line_min0.5667526273649459
deviation-heading_max1.4410103138243806
deviation-heading_mean1.4410103138243806
deviation-heading_median1.4410103138243806
deviation-heading_min1.4410103138243806
distance-from-start_max0.6229565430286426
distance-from-start_mean0.6229565430286426
distance-from-start_median0.6229565430286426
distance-from-start_min0.6229565430286426
driven_any_max0.7780357957301283
driven_any_mean0.7780357957301283
driven_any_median0.7780357957301283
driven_any_min0.7780357957301283
driven_lanedir_consec_max0.7479615613663406
driven_lanedir_consec_mean0.7479615613663406
driven_lanedir_consec_min0.7479615613663406
driven_lanedir_max0.7479615613663406
driven_lanedir_mean0.7479615613663406
driven_lanedir_median0.7479615613663406
driven_lanedir_min0.7479615613663406
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7780357957301283, "survival_time": 6.999999999999983, "driven_lanedir": 0.7479615613663406, "in-drivable-lane": 0.0, "deviation-heading": 1.4410103138243806, "distance-from-start": 0.6229565430286426, "deviation-center-line": 0.5667526273649459, "driven_lanedir_consec": 0.7479615613663406}}
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean6.999999999999983
survival_time_min6.999999999999983
No reset possible
11897776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-0of4successnodavinci-stage-01-6.2.460:25:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median22.5749999999992
driven_lanedir_consec_median4.128654146081839
deviation-center-line_median3.8497352976225248


other stats
deviation-center-line_max5.157533358352639
deviation-center-line_mean3.4253693406219177
deviation-center-line_min0.8444734088899813
deviation-heading_max20.966711278059964
deviation-heading_mean15.007725011862956
deviation-heading_median17.171763385767242
deviation-heading_min4.720661997857372
distance-from-start_max4.344224359381814
distance-from-start_mean3.422386171166001
distance-from-start_median3.7324959499544894
distance-from-start_min1.880328425373211
driven_any_max7.913746121434622
driven_any_mean6.14953713129694
driven_any_median7.010656013586923
driven_any_min2.663090376579292
driven_lanedir_consec_max5.8599042583181795
driven_lanedir_consec_mean3.966711778600523
driven_lanedir_consec_min1.749634563920231
driven_lanedir_max6.186690907784733
driven_lanedir_mean4.048408440967161
driven_lanedir_median4.128654146081839
driven_lanedir_min1.749634563920231
in-drivable-lane_max44.84999999999864
in-drivable-lane_mean24.087499999999235
in-drivable-lane_min6.349999999999898
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.91343506905563, "survival_time": 59.99999999999873, "driven_lanedir": 4.541201560945931, "in-drivable-lane": 19.39999999999947, "deviation-heading": 18.009219755457387, "distance-from-start": 3.617682837267715, "deviation-center-line": 4.130331979718672, "driven_lanedir_consec": 4.541201560945931}, "autolab-000-ego1": {"driven_any": 7.913746121434622, "survival_time": 59.99999999999873, "driven_lanedir": 6.186690907784733, "in-drivable-lane": 6.349999999999898, "deviation-heading": 20.966711278059964, "distance-from-start": 4.344224359381814, "deviation-center-line": 5.157533358352639, "driven_lanedir_consec": 5.8599042583181795}, "autolab-000-ego2": {"driven_any": 2.663090376579292, "survival_time": 59.99999999999873, "driven_lanedir": 1.749634563920231, "in-drivable-lane": 44.84999999999864, "deviation-heading": 4.720661997857372, "distance-from-start": 1.880328425373211, "deviation-center-line": 0.8444734088899813, "driven_lanedir_consec": 1.749634563920231}, "autolab-000-ego3": {"driven_any": 6.107876958118215, "survival_time": 59.99999999999873, "driven_lanedir": 3.716106731217749, "in-drivable-lane": 25.749999999998938, "deviation-heading": 16.3343070160771, "distance-from-start": 3.8473090626412634, "deviation-center-line": 3.5691386155263767, "driven_lanedir_consec": 3.716106731217749}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11870778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median34.550000000000175
in-drivable-lane_median5.899999999999976
driven_lanedir_consec_median3.2933744009383834
deviation-center-line_median2.170770195177747


other stats
deviation-center-line_max2.170770195177747
deviation-center-line_mean2.170770195177747
deviation-center-line_min2.170770195177747
deviation-heading_max9.13479559907976
deviation-heading_mean9.13479559907976
deviation-heading_median9.13479559907976
deviation-heading_min9.13479559907976
distance-from-start_max3.0999564613263044
distance-from-start_mean3.0999564613263044
distance-from-start_median3.0999564613263044
distance-from-start_min3.0999564613263044
driven_any_max4.442168535518886
driven_any_mean4.442168535518886
driven_any_median4.442168535518886
driven_any_min4.442168535518886
driven_lanedir_consec_max3.2933744009383834
driven_lanedir_consec_mean3.2933744009383834
driven_lanedir_consec_min3.2933744009383834
driven_lanedir_max3.395745278706993
driven_lanedir_mean3.395745278706993
driven_lanedir_median3.395745278706993
driven_lanedir_min3.395745278706993
in-drivable-lane_max5.899999999999976
in-drivable-lane_mean5.899999999999976
in-drivable-lane_min5.899999999999976
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.442168535518886, "survival_time": 34.550000000000175, "driven_lanedir": 3.395745278706993, "in-drivable-lane": 5.899999999999976, "deviation-heading": 9.13479559907976, "distance-from-start": 3.0999564613263044, "deviation-center-line": 2.170770195177747, "driven_lanedir_consec": 3.2933744009383834}}
simulation-passed1
survival_time_max34.550000000000175
survival_time_mean34.550000000000175
survival_time_min34.550000000000175
No reset possible
11809779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11805780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-2of4successnodavinci-stage-01-6.2.460:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11801781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.229616162762184
survival_time_median59.99999999999873
deviation-center-line_median4.184304534664783
in-drivable-lane_median11.649999999999764


other stats
deviation-center-line_max4.184304534664783
deviation-center-line_mean4.184304534664783
deviation-center-line_min4.184304534664783
deviation-heading_max6.187033472214127
deviation-heading_mean6.187033472214127
deviation-heading_median6.187033472214127
deviation-heading_min6.187033472214127
distance-from-start_max2.4767709108649867
distance-from-start_mean2.4767709108649867
distance-from-start_median2.4767709108649867
distance-from-start_min2.4767709108649867
driven_any_max7.907911727476473
driven_any_mean7.907911727476473
driven_any_median7.907911727476473
driven_any_min7.907911727476473
driven_lanedir_consec_max6.229616162762184
driven_lanedir_consec_mean6.229616162762184
driven_lanedir_consec_min6.229616162762184
driven_lanedir_max6.229616162762184
driven_lanedir_mean6.229616162762184
driven_lanedir_median6.229616162762184
driven_lanedir_min6.229616162762184
in-drivable-lane_max11.649999999999764
in-drivable-lane_mean11.649999999999764
in-drivable-lane_min11.649999999999764
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907911727476473, "survival_time": 59.99999999999873, "driven_lanedir": 6.229616162762184, "in-drivable-lane": 11.649999999999764, "deviation-heading": 6.187033472214127, "distance-from-start": 2.4767709108649867, "deviation-center-line": 4.184304534664783, "driven_lanedir_consec": 6.229616162762184}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11798782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11793796Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1aido-hello-sim-validationsanity-checkfailednodavinci-stage-01-6.2.460:01:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11792797Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3daido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.460:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.058497430268746875
deviation-center-line_median0.006484696318364016


other stats
deviation-center-line_max0.006484696318364016
deviation-center-line_mean0.006484696318364016
deviation-center-line_min0.006484696318364016
deviation-heading_max0.2497819789112497
deviation-heading_mean0.2497819789112497
deviation-heading_median0.2497819789112497
deviation-heading_min0.2497819789112497
distance-from-start_max0.06531914992925483
distance-from-start_mean0.06531914992925483
distance-from-start_median0.06531914992925483
distance-from-start_min0.06531914992925483
driven_any_max0.06535992222065196
driven_any_mean0.06535992222065196
driven_any_median0.06535992222065196
driven_any_min0.06535992222065196
driven_lanedir_consec_max0.058497430268746875
driven_lanedir_consec_mean0.058497430268746875
driven_lanedir_consec_min0.058497430268746875
driven_lanedir_max0.058497430268746875
driven_lanedir_mean0.058497430268746875
driven_lanedir_median0.058497430268746875
driven_lanedir_min0.058497430268746875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.06535992222065196, "survival_time": 0.49999999999999994, "driven_lanedir": 0.058497430268746875, "in-drivable-lane": 0.0, "deviation-heading": 0.2497819789112497, "distance-from-start": 0.06531914992925483, "deviation-center-line": 0.006484696318364016, "driven_lanedir_consec": 0.058497430268746875}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11780802Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551aido-hello-sim-validationsanity-checksuccessnodavinci-stage-01-6.2.460:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.04255586462327998
deviation-center-line_median0.0063953946849899905


other stats
deviation-center-line_max0.0063953946849899905
deviation-center-line_mean0.0063953946849899905
deviation-center-line_min0.0063953946849899905
deviation-heading_max0.28458116831098035
deviation-heading_mean0.28458116831098035
deviation-heading_median0.28458116831098035
deviation-heading_min0.28458116831098035
distance-from-start_max0.051947213606924135
distance-from-start_mean0.051947213606924135
distance-from-start_median0.051947213606924135
distance-from-start_min0.051947213606924135
driven_any_max0.05200534726672736
driven_any_mean0.05200534726672736
driven_any_median0.05200534726672736
driven_any_min0.05200534726672736
driven_lanedir_consec_max0.04255586462327998
driven_lanedir_consec_mean0.04255586462327998
driven_lanedir_consec_min0.04255586462327998
driven_lanedir_max0.04255586462327998
driven_lanedir_mean0.04255586462327998
driven_lanedir_median0.04255586462327998
driven_lanedir_min0.04255586462327998
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05200534726672736, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04255586462327998, "in-drivable-lane": 0.0, "deviation-heading": 0.28458116831098035, "distance-from-start": 0.051947213606924135, "deviation-center-line": 0.0063953946849899905, "driven_lanedir_consec": 0.04255586462327998}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11773806user1000001minimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
11770808Andrea Censitemplate-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999994
in-drivable-lane_median1.6499999999999972
driven_lanedir_consec_median0.4413284134549402
deviation-center-line_median0.07863297638595365


other stats
deviation-center-line_max0.07863297638595365
deviation-center-line_mean0.07863297638595365
deviation-center-line_min0.07863297638595365
deviation-heading_max1.38663091368877
deviation-heading_mean1.38663091368877
deviation-heading_median1.38663091368877
deviation-heading_min1.38663091368877
distance-from-start_max0.4891723059495441
distance-from-start_mean0.4891723059495441
distance-from-start_median0.4891723059495441
distance-from-start_min0.4891723059495441
driven_any_max0.5134230938905382
driven_any_mean0.5134230938905382
driven_any_median0.5134230938905382
driven_any_min0.5134230938905382
driven_lanedir_consec_max0.4413284134549402
driven_lanedir_consec_mean0.4413284134549402
driven_lanedir_consec_min0.4413284134549402
driven_lanedir_max0.4413284134549402
driven_lanedir_mean0.4413284134549402
driven_lanedir_median0.4413284134549402
driven_lanedir_min0.4413284134549402
in-drivable-lane_max1.6499999999999972
in-drivable-lane_mean1.6499999999999972
in-drivable-lane_min1.6499999999999972
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5134230938905382, "survival_time": 3.899999999999994, "driven_lanedir": 0.4413284134549402, "in-drivable-lane": 1.6499999999999972, "deviation-heading": 1.38663091368877, "distance-from-start": 0.4891723059495441, "deviation-center-line": 0.07863297638595365, "driven_lanedir_consec": 0.4413284134549402}}
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean3.899999999999994
survival_time_min3.899999999999994
No reset possible
11759809Andrea Censitemplate-randomaido-LFV-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.400000000000126
in-drivable-lane_median9.6500000000001
driven_lanedir_consec_median0.2737818968396458
deviation-center-line_median0.799573856657706


other stats
deviation-center-line_max0.799573856657706
deviation-center-line_mean0.799573856657706
deviation-center-line_min0.799573856657706
deviation-heading_max6.366511388189685
deviation-heading_mean6.366511388189685
deviation-heading_median6.366511388189685
deviation-heading_min6.366511388189685
distance-from-start_max0.6736010379604951
distance-from-start_mean0.6736010379604951
distance-from-start_median0.6736010379604951
distance-from-start_min0.6736010379604951
driven_any_max4.170232497072811
driven_any_mean4.170232497072811
driven_any_median4.170232497072811
driven_any_min4.170232497072811
driven_lanedir_consec_max0.2737818968396458
driven_lanedir_consec_mean0.2737818968396458
driven_lanedir_consec_min0.2737818968396458
driven_lanedir_max0.2565970421753513
driven_lanedir_mean0.2565970421753513
driven_lanedir_median0.2565970421753513
driven_lanedir_min0.2565970421753513
in-drivable-lane_max9.6500000000001
in-drivable-lane_mean9.6500000000001
in-drivable-lane_min9.6500000000001
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.170232497072811, "survival_time": 18.400000000000126, "driven_lanedir": 0.2565970421753513, "in-drivable-lane": 9.6500000000001, "deviation-heading": 6.366511388189685, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.799573856657706, "driven_lanedir_consec": 0.2737818968396458}}
simulation-passed1
survival_time_max18.400000000000126
survival_time_mean18.400000000000126
survival_time_min18.400000000000126
No reset possible
11753810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-2of4failednodavinci-stage-01-6.2.460:03:41
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11729811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.20000000000028
in-drivable-lane_median3.7500000000000537
driven_lanedir_consec_median3.142407898090302
deviation-center-line_median1.7131914243286392


other stats
deviation-center-line_max1.7131914243286392
deviation-center-line_mean1.7131914243286392
deviation-center-line_min1.7131914243286392
deviation-heading_max4.326248017171075
deviation-heading_mean4.326248017171075
deviation-heading_median4.326248017171075
deviation-heading_min4.326248017171075
distance-from-start_max2.807151207205442
distance-from-start_mean2.807151207205442
distance-from-start_median2.807151207205442
distance-from-start_min2.807151207205442
driven_any_max3.7321245787886537
driven_any_mean3.7321245787886537
driven_any_median3.7321245787886537
driven_any_min3.7321245787886537
driven_lanedir_consec_max3.142407898090302
driven_lanedir_consec_mean3.142407898090302
driven_lanedir_consec_min3.142407898090302
driven_lanedir_max3.142407898090302
driven_lanedir_mean3.142407898090302
driven_lanedir_median3.142407898090302
driven_lanedir_min3.142407898090302
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean3.7500000000000537
in-drivable-lane_min3.7500000000000537
per-episodes
details{"loop-000-ego0": {"driven_any": 3.7321245787886537, "survival_time": 29.20000000000028, "driven_lanedir": 3.142407898090302, "in-drivable-lane": 3.7500000000000537, "deviation-heading": 4.326248017171075, "distance-from-start": 2.807151207205442, "deviation-center-line": 1.7131914243286392, "driven_lanedir_consec": 3.142407898090302}}
simulation-passed1
survival_time_max29.20000000000028
survival_time_mean29.20000000000028
survival_time_min29.20000000000028
No reset possible
11726812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948943425962775


other stats
deviation-center-line_max0.8948943425962775
deviation-center-line_mean0.8948943425962775
deviation-center-line_min0.8948943425962775
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8948943425962775, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11721814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000286102294921875
survival_time_median59.99999999999873
deviation-center-line_median0.8949116056299469
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949116056299469
deviation-center-line_mean0.8949116056299469
deviation-center-line_min0.8949116056299469
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.576064361825558e-16
distance-from-start_mean2.576064361825558e-16
distance-from-start_median2.576064361825558e-16
distance-from-start_min2.576064361825558e-16
driven_any_max3.0912772341906697e-13
driven_any_mean3.0912772341906697e-13
driven_any_median3.0912772341906697e-13
driven_any_min3.0912772341906697e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.0912772341906697e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.576064361825558e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11711813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2326337047771383
survival_time_median19.800000000000143
deviation-center-line_median0.5908655341232284
in-drivable-lane_median3.300000000000037


other stats
deviation-center-line_max0.5908655341232284
deviation-center-line_mean0.5908655341232284
deviation-center-line_min0.5908655341232284
deviation-heading_max4.318489837837646
deviation-heading_mean4.318489837837646
deviation-heading_median4.318489837837646
deviation-heading_min4.318489837837646
distance-from-start_max0.762118639877034
distance-from-start_mean0.762118639877034
distance-from-start_median0.762118639877034
distance-from-start_min0.762118639877034
driven_any_max2.477464243017102
driven_any_mean2.477464243017102
driven_any_median2.477464243017102
driven_any_min2.477464243017102
driven_lanedir_consec_max1.2326337047771383
driven_lanedir_consec_mean1.2326337047771383
driven_lanedir_consec_min1.2326337047771383
driven_lanedir_max1.9707860138779103
driven_lanedir_mean1.9707860138779103
driven_lanedir_median1.9707860138779103
driven_lanedir_min1.9707860138779103
in-drivable-lane_max3.300000000000037
in-drivable-lane_mean3.300000000000037
in-drivable-lane_min3.300000000000037
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.477464243017102, "survival_time": 19.800000000000143, "driven_lanedir": 1.9707860138779103, "in-drivable-lane": 3.300000000000037, "deviation-heading": 4.318489837837646, "distance-from-start": 0.762118639877034, "deviation-center-line": 0.5908655341232284, "driven_lanedir_consec": 1.2326337047771383}}
simulation-passed1
survival_time_max19.800000000000143
survival_time_mean19.800000000000143
survival_time_min19.800000000000143
No reset possible
11709813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13352095973693667
survival_time_median2.9999999999999973
deviation-center-line_median0.1123195907718109
in-drivable-lane_median1.1999999999999964


other stats
deviation-center-line_max0.1123195907718109
deviation-center-line_mean0.1123195907718109
deviation-center-line_min0.1123195907718109
deviation-heading_max1.2274393391559542
deviation-heading_mean1.2274393391559542
deviation-heading_median1.2274393391559542
deviation-heading_min1.2274393391559542
distance-from-start_max0.23927432662563913
distance-from-start_mean0.23927432662563913
distance-from-start_median0.23927432662563913
distance-from-start_min0.23927432662563913
driven_any_max0.24692708392888063
driven_any_mean0.24692708392888063
driven_any_median0.24692708392888063
driven_any_min0.24692708392888063
driven_lanedir_consec_max0.13352095973693667
driven_lanedir_consec_mean0.13352095973693667
driven_lanedir_consec_min0.13352095973693667
driven_lanedir_max0.13352095973693667
driven_lanedir_mean0.13352095973693667
driven_lanedir_median0.13352095973693667
driven_lanedir_min0.13352095973693667
in-drivable-lane_max1.1999999999999964
in-drivable-lane_mean1.1999999999999964
in-drivable-lane_min1.1999999999999964
per-episodes
details{"loop-000-ego0": {"driven_any": 0.24692708392888063, "survival_time": 2.9999999999999973, "driven_lanedir": 0.13352095973693667, "in-drivable-lane": 1.1999999999999964, "deviation-heading": 1.2274393391559542, "distance-from-start": 0.23927432662563913, "deviation-center-line": 0.1123195907718109, "driven_lanedir_consec": 0.13352095973693667}}
simulation-passed1
survival_time_max2.9999999999999973
survival_time_mean2.9999999999999973
survival_time_min2.9999999999999973
No reset possible
11705815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.379280605881083
deviation-center-line_median0.4086426394863958


other stats
deviation-center-line_max0.4086426394863958
deviation-center-line_mean0.4086426394863958
deviation-center-line_min0.4086426394863958
deviation-heading_max3.257710113460004
deviation-heading_mean3.257710113460004
deviation-heading_median3.257710113460004
deviation-heading_min3.257710113460004
distance-from-start_max2.710848600829782
distance-from-start_mean2.710848600829782
distance-from-start_median2.710848600829782
distance-from-start_min2.710848600829782
driven_any_max5.395555302886635
driven_any_mean5.395555302886635
driven_any_median5.395555302886635
driven_any_min5.395555302886635
driven_lanedir_consec_max5.379280605881083
driven_lanedir_consec_mean5.379280605881083
driven_lanedir_consec_min5.379280605881083
driven_lanedir_max5.379280605881083
driven_lanedir_mean5.379280605881083
driven_lanedir_median5.379280605881083
driven_lanedir_min5.379280605881083
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11700816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11691817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:12:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7226359618167388
deviation-center-line_median0.5300716056782957


other stats
deviation-center-line_max3.450684914636027
deviation-center-line_mean1.1544116353398692
deviation-center-line_min0.10681841536685864
deviation-heading_max26.9052448670844
deviation-heading_mean13.564778629547629
deviation-heading_median13.197767646759738
deviation-heading_min0.958334357586633
distance-from-start_max2.6184795314376466
distance-from-start_mean1.0433272824408664
distance-from-start_median0.7774147991629091
distance-from-start_min4.440892098500626e-16
driven_any_max4.40268670413701
driven_any_mean1.962564046936972
driven_any_median1.7237847418051728
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max4.396263615957334
driven_lanedir_consec_mean1.9603838848977029
driven_lanedir_consec_min0.0
driven_lanedir_max4.396272526695297
driven_lanedir_mean1.960407277995468
driven_lanedir_median1.722678292643288
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.4475694836097963, "survival_time": 59.99999999999873, "driven_lanedir": 3.445356585286576, "in-drivable-lane": 0.0, "deviation-heading": 0.958334357586633, "distance-from-start": 1.5548295983258178, "deviation-center-line": 0.10681841536685864, "driven_lanedir_consec": 3.4452719236334777}, "udem-001-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.9270500462381008, "driven_lanedir_consec": 0.0}, "udem-001-ego2": {"driven_any": 4.40268670413701, "survival_time": 59.99999999999873, "driven_lanedir": 4.396272526695297, "in-drivable-lane": 0.0, "deviation-heading": 1.4677754959606737, "distance-from-start": 2.6184795314376466, "deviation-center-line": 0.13309316511849048, "driven_lanedir_consec": 4.396263615957334}, "udem-001-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.450684914636027, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11686818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:13:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3684768253684605
deviation-center-line_median0.26341057846251453


other stats
deviation-center-line_max0.26341057846251453
deviation-center-line_mean0.26341057846251453
deviation-center-line_min0.26341057846251453
deviation-heading_max2.2732184433064777
deviation-heading_mean2.2732184433064777
deviation-heading_median2.2732184433064777
deviation-heading_min2.2732184433064777
distance-from-start_max0.3686479402497791
distance-from-start_mean0.3686479402497791
distance-from-start_median0.3686479402497791
distance-from-start_min0.3686479402497791
driven_any_max0.3741734844735202
driven_any_mean0.3741734844735202
driven_any_median0.3741734844735202
driven_any_min0.3741734844735202
driven_lanedir_consec_max0.3684768253684605
driven_lanedir_consec_mean0.3684768253684605
driven_lanedir_consec_min0.3684768253684605
driven_lanedir_max0.3684768253684605
driven_lanedir_mean0.3684768253684605
driven_lanedir_median0.3684768253684605
driven_lanedir_min0.3684768253684605
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3741734844735202, "survival_time": 59.99999999999873, "driven_lanedir": 0.3684768253684605, "in-drivable-lane": 0.0, "deviation-heading": 2.2732184433064777, "distance-from-start": 0.3686479402497791, "deviation-center-line": 0.26341057846251453, "driven_lanedir_consec": 0.3684768253684605}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11685818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4host-errornodavinci-stage-01-6.2.460:00:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11678820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.20000000000025
in-drivable-lane_median0.0
driven_lanedir_consec_median2.8824305480707815
deviation-center-line_median0.24998323712819964


other stats
deviation-center-line_max0.24998323712819964
deviation-center-line_mean0.24998323712819964
deviation-center-line_min0.24998323712819964
deviation-heading_max2.0191141438882525
deviation-heading_mean2.0191141438882525
deviation-heading_median2.0191141438882525
deviation-heading_min2.0191141438882525
distance-from-start_max2.3237448100281095
distance-from-start_mean2.3237448100281095
distance-from-start_median2.3237448100281095
distance-from-start_min2.3237448100281095
driven_any_max2.893646045198969
driven_any_mean2.893646045198969
driven_any_median2.893646045198969
driven_any_min2.893646045198969
driven_lanedir_consec_max2.8824305480707815
driven_lanedir_consec_mean2.8824305480707815
driven_lanedir_consec_min2.8824305480707815
driven_lanedir_max2.8824305480707815
driven_lanedir_mean2.8824305480707815
driven_lanedir_median2.8824305480707815
driven_lanedir_min2.8824305480707815
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.893646045198969, "survival_time": 33.20000000000025, "driven_lanedir": 2.8824305480707815, "in-drivable-lane": 0.0, "deviation-heading": 2.0191141438882525, "distance-from-start": 2.3237448100281095, "deviation-center-line": 0.24998323712819964, "driven_lanedir_consec": 2.8824305480707815}}
simulation-passed1
survival_time_max33.20000000000025
survival_time_mean33.20000000000025
survival_time_min33.20000000000025
No reset possible
11677820Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.999999999999987
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4471248824593203
deviation-center-line_median0.055374444134471366


other stats
deviation-center-line_max0.055374444134471366
deviation-center-line_mean0.055374444134471366
deviation-center-line_min0.055374444134471366
deviation-heading_max0.6902792102151962
deviation-heading_mean0.6902792102151962
deviation-heading_median0.6902792102151962
deviation-heading_min0.6902792102151962
distance-from-start_max0.4472059249333694
distance-from-start_mean0.4472059249333694
distance-from-start_median0.4472059249333694
distance-from-start_min0.4472059249333694
driven_any_max0.4526001398092184
driven_any_mean0.4526001398092184
driven_any_median0.4526001398092184
driven_any_min0.4526001398092184
driven_lanedir_consec_max0.4471248824593203
driven_lanedir_consec_mean0.4471248824593203
driven_lanedir_consec_min0.4471248824593203
driven_lanedir_max0.4471248824593203
driven_lanedir_mean0.4471248824593203
driven_lanedir_median0.4471248824593203
driven_lanedir_min0.4471248824593203
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.4526001398092184, "survival_time": 5.999999999999987, "driven_lanedir": 0.4471248824593203, "in-drivable-lane": 0.0, "deviation-heading": 0.6902792102151962, "distance-from-start": 0.4472059249333694, "deviation-center-line": 0.055374444134471366, "driven_lanedir_consec": 0.4471248824593203}}
simulation-passed1
survival_time_max5.999999999999987
survival_time_mean5.999999999999987
survival_time_min5.999999999999987
No reset possible
11673821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.626542990464859
deviation-center-line_median0.3404045717154838


other stats
deviation-center-line_max0.3404045717154838
deviation-center-line_mean0.3404045717154838
deviation-center-line_min0.3404045717154838
deviation-heading_max2.631172234135892
deviation-heading_mean2.631172234135892
deviation-heading_median2.631172234135892
deviation-heading_min2.631172234135892
distance-from-start_max2.518618655205165
distance-from-start_mean2.518618655205165
distance-from-start_median2.518618655205165
distance-from-start_min2.518618655205165
driven_any_max5.644450866720938
driven_any_mean5.644450866720938
driven_any_median5.644450866720938
driven_any_min5.644450866720938
driven_lanedir_consec_max5.626542990464859
driven_lanedir_consec_mean5.626542990464859
driven_lanedir_consec_min5.626542990464859
driven_lanedir_max5.626542990464859
driven_lanedir_mean5.626542990464859
driven_lanedir_median5.626542990464859
driven_lanedir_min5.626542990464859
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.644450866720938, "survival_time": 59.99999999999873, "driven_lanedir": 5.626542990464859, "in-drivable-lane": 0.0, "deviation-heading": 2.631172234135892, "distance-from-start": 2.518618655205165, "deviation-center-line": 0.3404045717154838, "driven_lanedir_consec": 5.626542990464859}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11672822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-01-6.2.460:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11670822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11664823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:12:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.4902221304216643
deviation-center-line_median0.19536688317251755


other stats
deviation-center-line_max0.9914645952432184
deviation-center-line_mean0.37726774919142353
deviation-center-line_min0.12687263517744074
deviation-heading_max6.90310915540739
deviation-heading_mean3.584291121348599
deviation-heading_median3.277813735695908
deviation-heading_min0.8784278585951891
distance-from-start_max3.0051353612677523
distance-from-start_mean2.084455301337744
distance-from-start_median1.916530945045955
distance-from-start_min1.4996239539913137
driven_any_max4.04654795620778
driven_any_mean2.7128076312517138
driven_any_median2.4932925703771316
driven_any_min1.8180974280448117
driven_lanedir_consec_max4.042366489689749
driven_lanedir_consec_mean2.709571892084236
driven_lanedir_consec_min1.8154768178038676
driven_lanedir_max4.042366489689749
driven_lanedir_mean2.709571892084236
driven_lanedir_median2.4902221304216643
driven_lanedir_min1.8154768178038676
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 4.04654795620778, "survival_time": 59.99999999999873, "driven_lanedir": 4.042366489689749, "in-drivable-lane": 0.0, "deviation-heading": 0.8784278585951891, "distance-from-start": 3.0051353612677523, "deviation-center-line": 0.12687263517744074, "driven_lanedir_consec": 4.042366489689749}, "4way-001-ego1": {"driven_any": 1.8180974280448117, "survival_time": 59.99999999999873, "driven_lanedir": 1.8154768178038676, "in-drivable-lane": 0.0, "deviation-heading": 6.90310915540739, "distance-from-start": 1.7923677119883985, "deviation-center-line": 0.9914645952432184, "driven_lanedir_consec": 1.8154768178038676}, "4way-001-ego2": {"driven_any": 2.514122196259917, "survival_time": 59.99999999999873, "driven_lanedir": 2.511693622306715, "in-drivable-lane": 0.0, "deviation-heading": 4.476936368661957, "distance-from-start": 2.040694178103511, "deviation-center-line": 0.13789777321589888, "driven_lanedir_consec": 2.511693622306715}, "4way-001-ego3": {"driven_any": 2.472462944494346, "survival_time": 59.99999999999873, "driven_lanedir": 2.468750638536614, "in-drivable-lane": 0.0, "deviation-heading": 2.078691102729859, "distance-from-start": 1.4996239539913137, "deviation-center-line": 0.25283599312913624, "driven_lanedir_consec": 2.468750638536614}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11659825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-0of4successnodavinci-stage-01-6.2.460:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.4887462913109655
deviation-center-line_median0.2854816658243261


other stats
deviation-center-line_max0.3752915350856826
deviation-center-line_mean0.28671931505809656
deviation-center-line_min0.20062239349805144
deviation-heading_max2.698846366686999
deviation-heading_mean2.2894860260049468
deviation-heading_median2.431689905385528
deviation-heading_min1.5957179265617338
distance-from-start_max3.9594187814058137
distance-from-start_mean3.14389483227543
distance-from-start_median3.031745994196937
distance-from-start_min2.5526685593020315
driven_any_max5.790410601563045
driven_any_mean5.536596949907374
driven_any_median5.504217169840307
driven_any_min5.347542858385839
driven_lanedir_consec_max5.784939092705105
driven_lanedir_consec_mean5.524326274462766
driven_lanedir_consec_min5.334873422524025
driven_lanedir_max5.784939092705105
driven_lanedir_mean5.524326274462766
driven_lanedir_median5.4887462913109655
driven_lanedir_min5.334873422524025
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.393882143737957, "survival_time": 59.99999999999873, "driven_lanedir": 5.379093064606516, "in-drivable-lane": 0.0, "deviation-heading": 2.608879675904195, "distance-from-start": 3.367862803719833, "deviation-center-line": 0.2840546141440118, "driven_lanedir_consec": 5.379093064606516}, "autolab-000-ego1": {"driven_any": 5.347542858385839, "survival_time": 59.99999999999873, "driven_lanedir": 5.334873422524025, "in-drivable-lane": 0.0, "deviation-heading": 2.698846366686999, "distance-from-start": 2.6956291846740417, "deviation-center-line": 0.3752915350856826, "driven_lanedir_consec": 5.334873422524025}, "autolab-000-ego2": {"driven_any": 5.790410601563045, "survival_time": 59.99999999999873, "driven_lanedir": 5.784939092705105, "in-drivable-lane": 0.0, "deviation-heading": 1.5957179265617338, "distance-from-start": 3.9594187814058137, "deviation-center-line": 0.20062239349805144, "driven_lanedir_consec": 5.784939092705105}, "autolab-000-ego3": {"driven_any": 5.6145521959426565, "survival_time": 59.99999999999873, "driven_lanedir": 5.598399518015414, "in-drivable-lane": 0.0, "deviation-heading": 2.254500134866861, "distance-from-start": 2.5526685593020315, "deviation-center-line": 0.28690871750464036, "driven_lanedir_consec": 5.598399518015414}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11656826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.35000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median1.116943263707006
deviation-center-line_median0.11371523984155717


other stats
deviation-center-line_max0.11371523984155717
deviation-center-line_mean0.11371523984155717
deviation-center-line_min0.11371523984155717
deviation-heading_max1.1964666868192868
deviation-heading_mean1.1964666868192868
deviation-heading_median1.1964666868192868
deviation-heading_min1.1964666868192868
distance-from-start_max0.9553119406629068
distance-from-start_mean0.9553119406629068
distance-from-start_median0.9553119406629068
distance-from-start_min0.9553119406629068
driven_any_max1.1261312214304977
driven_any_mean1.1261312214304977
driven_any_median1.1261312214304977
driven_any_min1.1261312214304977
driven_lanedir_consec_max1.116943263707006
driven_lanedir_consec_mean1.116943263707006
driven_lanedir_consec_min1.116943263707006
driven_lanedir_max1.116943263707006
driven_lanedir_mean1.116943263707006
driven_lanedir_median1.116943263707006
driven_lanedir_min1.116943263707006
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1261312214304977, "survival_time": 12.35000000000004, "driven_lanedir": 1.116943263707006, "in-drivable-lane": 0.0, "deviation-heading": 1.1964666868192868, "distance-from-start": 0.9553119406629068, "deviation-center-line": 0.11371523984155717, "driven_lanedir_consec": 1.116943263707006}}
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean12.35000000000004
survival_time_min12.35000000000004
No reset possible
11641827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.823620228930529
deviation-center-line_median0.3618127573828305


other stats
deviation-center-line_max0.3618127573828305
deviation-center-line_mean0.3618127573828305
deviation-center-line_min0.3618127573828305
deviation-heading_max2.729795565656188
deviation-heading_mean2.729795565656188
deviation-heading_median2.729795565656188
deviation-heading_min2.729795565656188
distance-from-start_max1.9492246701212408
distance-from-start_mean1.9492246701212408
distance-from-start_median1.9492246701212408
distance-from-start_min1.9492246701212408
driven_any_max4.8406264605922145
driven_any_mean4.8406264605922145
driven_any_median4.8406264605922145
driven_any_min4.8406264605922145
driven_lanedir_consec_max4.823620228930529
driven_lanedir_consec_mean4.823620228930529
driven_lanedir_consec_min4.823620228930529
driven_lanedir_max4.823620228930529
driven_lanedir_mean4.823620228930529
driven_lanedir_median4.823620228930529
driven_lanedir_min4.823620228930529
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 4.8406264605922145, "survival_time": 59.99999999999873, "driven_lanedir": 4.823620228930529, "in-drivable-lane": 0.0, "deviation-heading": 2.729795565656188, "distance-from-start": 1.9492246701212408, "deviation-center-line": 0.3618127573828305, "driven_lanedir_consec": 4.823620228930529}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11622828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-0of4successnodavinci-stage-01-6.2.460:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.20000000000018
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7931242458645529
deviation-center-line_median0.1961591864911841


other stats
deviation-center-line_max0.1961591864911841
deviation-center-line_mean0.1961591864911841
deviation-center-line_min0.1961591864911841
deviation-heading_max1.690974780395429
deviation-heading_mean1.690974780395429
deviation-heading_median1.690974780395429
deviation-heading_min1.690974780395429
distance-from-start_max1.4244240674089024
distance-from-start_mean1.4244240674089024
distance-from-start_median1.4244240674089024
distance-from-start_min1.4244240674089024
driven_any_max1.805900837286754
driven_any_mean1.805900837286754
driven_any_median1.805900837286754
driven_any_min1.805900837286754
driven_lanedir_consec_max1.7931242458645529
driven_lanedir_consec_mean1.7931242458645529
driven_lanedir_consec_min1.7931242458645529
driven_lanedir_max1.7931242458645529
driven_lanedir_mean1.7931242458645529
driven_lanedir_median1.7931242458645529
driven_lanedir_min1.7931242458645529
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.805900837286754, "survival_time": 22.20000000000018, "driven_lanedir": 1.7931242458645529, "in-drivable-lane": 0.0, "deviation-heading": 1.690974780395429, "distance-from-start": 1.4244240674089024, "deviation-center-line": 0.1961591864911841, "driven_lanedir_consec": 1.7931242458645529}}
simulation-passed1
survival_time_max22.20000000000018
survival_time_mean22.20000000000018
survival_time_min22.20000000000018
No reset possible
11584830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573452
deviation-heading_mean11.057314603573452
deviation-heading_median11.057314603573452
deviation-heading_min11.057314603573452
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019539
driven_any_mean3.452076592019539
driven_any_median3.452076592019539
driven_any_min3.452076592019539
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11353831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4203998040440715
deviation-center-line_median4.904463356399461


other stats
deviation-center-line_max4.904463356399461
deviation-center-line_mean4.904463356399461
deviation-center-line_min4.904463356399461
deviation-heading_max7.745124858723169
deviation-heading_mean7.745124858723169
deviation-heading_median7.745124858723169
deviation-heading_min7.745124858723169
distance-from-start_max1.2059816832534165
distance-from-start_mean1.2059816832534165
distance-from-start_median1.2059816832534165
distance-from-start_min1.2059816832534165
driven_any_max3.485084016236962
driven_any_mean3.485084016236962
driven_any_median3.485084016236962
driven_any_min3.485084016236962
driven_lanedir_consec_max1.4203998040440715
driven_lanedir_consec_mean1.4203998040440715
driven_lanedir_consec_min1.4203998040440715
driven_lanedir_max3.2905050472289954
driven_lanedir_mean3.2905050472289954
driven_lanedir_median3.2905050472289954
driven_lanedir_min3.2905050472289954
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11346832Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11057833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4host-errornodavinci-stage-01-6.2.460:22:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 291, in upload
    aws_object.load()
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/factory.py", line 564, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/boto3/resources/action.py", line 88, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 934, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 891, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 303, in upload
    aws_object.upload_file(realfile, ExtraArgs={"ContentType": mime_type})
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 318, in object_upload_file
    return self.meta.client.upload_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/inject.py", line 143, in upload_file
    return transfer.upload_file(
  File "/usr/local/lib/python3.8/dist-packages/boto3/s3/transfer.py", line 288, in upload_file
    future.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 103, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/futures.py", line 266, in result
    raise self._exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 455, in send
    urllib_response = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 398, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 239, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/lib/python3.8/http/client.py", line 1256, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 94, in _send_request
    rval = super()._send_request(
  File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 130, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 176, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 209, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.8/dist-packages/botocore/awsrequest.py", line 218, in send
    return super().send(str)
  File "/usr/lib/python3.8/http/client.py", line 964, in send
    datablock = data.read(self.blocksize)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/utils.py", line 511, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/upload.py", line 90, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 139, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/tasks.py", line 162, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/s3transfer/upload.py", line 787, in _main
    response = client.upload_part(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 515, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 917, in _make_api_call
    http, parsed_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/botocore/client.py", line 940, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 202, in _send_request
    while self._needs_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 354, in _needs_retry
    responses = self._event_emitter.emit(
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 207, in __call__
    if self._checker(**checker_kwargs):
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 284, in __call__
    should_retry = self._should_retry(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 320, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 363, in __call__
    checker_response = checker(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 247, in __call__
    return self._check_caught_exception(
  File "/usr/local/lib/python3.8/dist-packages/botocore/retryhandler.py", line 416, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/endpoint.py", line 377, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.8/dist-packages/botocore/httpsession.py", line 484, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/staging/by-value/sha256/c0752b81cb2ecb79f87b2235ec5ffd2e276f6243882e2aca5397d908efa8ed23?uploadId=25EytKaxEXZo7FOyA.V7w3s0p5iZ7u96wppjZAZbgIksqBqGel1efJpiiDIFMabUM_wmMnmxtOCzzzK6wn0N6uy_sBKgeExLbK0or.FnUIXiUm8YdcucIt6s4QpZ8_Iw&partNumber=1"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11033834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10931835Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-3of4successnodavinci-stage-01-6.2.460:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573452
deviation-heading_mean11.057314603573452
deviation-heading_median11.057314603573452
deviation-heading_min11.057314603573452
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019539
driven_any_mean3.452076592019539
driven_any_median3.452076592019539
driven_any_min3.452076592019539
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10874836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10696838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.381377707282059
deviation-center-line_median6.627907451366884


other stats
deviation-center-line_max6.627907451366884
deviation-center-line_mean6.627907451366884
deviation-center-line_min6.627907451366884
deviation-heading_max5.432222613492037
deviation-heading_mean5.432222613492037
deviation-heading_median5.432222613492037
deviation-heading_min5.432222613492037
distance-from-start_max1.6316417714987326
distance-from-start_mean1.6316417714987326
distance-from-start_median1.6316417714987326
distance-from-start_min1.6316417714987326
driven_any_max3.509092316575648
driven_any_mean3.509092316575648
driven_any_median3.509092316575648
driven_any_min3.509092316575648
driven_lanedir_consec_max3.381377707282059
driven_lanedir_consec_mean3.381377707282059
driven_lanedir_consec_min3.381377707282059
driven_lanedir_max3.381377707282059
driven_lanedir_mean3.381377707282059
driven_lanedir_median3.381377707282059
driven_lanedir_min3.381377707282059
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"loop-000-ego0": {"driven_any": 3.509092316575648, "survival_time": 59.99999999999873, "driven_lanedir": 3.381377707282059, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222613492037, "distance-from-start": 1.6316417714987326, "deviation-center-line": 6.627907451366884, "driven_lanedir_consec": 3.381377707282059}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10532839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.515225273381777
deviation-center-line_median4.002587868292013


other stats
deviation-center-line_max4.002587868292013
deviation-center-line_mean4.002587868292013
deviation-center-line_min4.002587868292013
deviation-heading_max7.890763160970442
deviation-heading_mean7.890763160970442
deviation-heading_median7.890763160970442
deviation-heading_min7.890763160970442
distance-from-start_max2.1298711512095228
distance-from-start_mean2.1298711512095228
distance-from-start_median2.1298711512095228
distance-from-start_min2.1298711512095228
driven_any_max3.579590788379315
driven_any_mean3.579590788379315
driven_any_median3.579590788379315
driven_any_min3.579590788379315
driven_lanedir_consec_max3.515225273381777
driven_lanedir_consec_mean3.515225273381777
driven_lanedir_consec_min3.515225273381777
driven_lanedir_max3.522144272867136
driven_lanedir_mean3.522144272867136
driven_lanedir_median3.522144272867136
driven_lanedir_min3.522144272867136
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579590788379315, "survival_time": 59.99999999999873, "driven_lanedir": 3.522144272867136, "in-drivable-lane": 0.0, "deviation-heading": 7.890763160970442, "distance-from-start": 2.1298711512095228, "deviation-center-line": 4.002587868292013, "driven_lanedir_consec": 3.515225273381777}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10300840Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-1of4successnodavinci-stage-01-6.2.460:19:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.9999999999999576
driven_lanedir_consec_median2.9816913027353795
deviation-center-line_median5.999212563454321


other stats
deviation-center-line_max6.279828591515402
deviation-center-line_mean5.898869522988079
deviation-center-line_min5.317224373528271
deviation-heading_max6.908636787901559
deviation-heading_mean5.00526214896848
deviation-heading_median5.3059869154988375
deviation-heading_min2.5004379769746863
distance-from-start_max2.7163807174982693
distance-from-start_mean1.9474863406043583
distance-from-start_median2.133877457590029
distance-from-start_min0.8058097297391079
driven_any_max3.579596890608956
driven_any_mean3.1367153053144774
driven_any_median3.497838330840156
driven_any_min1.971587668968642
driven_lanedir_consec_max3.554363389555085
driven_lanedir_consec_mean2.5612811119723276
driven_lanedir_consec_min0.7273784528634657
driven_lanedir_max3.554363389555085
driven_lanedir_mean3.017264448780624
driven_lanedir_median3.337488631463687
driven_lanedir_min1.839717142640037
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean1.8624999999999492
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.971587668968642, "survival_time": 59.99999999999873, "driven_lanedir": 1.839717142640037, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.390348197280299, "distance-from-start": 0.8058097297391079, "deviation-center-line": 5.7223527739429985, "driven_lanedir_consec": 0.7273784528634657}, "loop-000-ego1": {"driven_any": 3.579596890608956, "survival_time": 59.99999999999873, "driven_lanedir": 3.554363389555085, "in-drivable-lane": 0.0, "deviation-heading": 2.5004379769746863, "distance-from-start": 2.7163807174982693, "deviation-center-line": 6.279828591515402, "driven_lanedir_consec": 3.554363389555085}, "loop-000-ego2": {"driven_any": 3.4760913988195017, "survival_time": 59.99999999999873, "driven_lanedir": 3.307439986272721, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.221625633717376, "distance-from-start": 2.1876553732781443, "deviation-center-line": 6.2760723529656435, "driven_lanedir_consec": 3.307439986272721}, "loop-000-ego3": {"driven_any": 3.51958526286081, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675372766546534, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908636787901559, "distance-from-start": 2.080099541901913, "deviation-center-line": 5.317224373528271, "driven_lanedir_consec": 2.6559426191980378}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10209842Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-0of4successnodavinci-stage-01-6.2.460:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6648897347487026
deviation-center-line_median4.9388161979484995


other stats
deviation-center-line_max4.9388161979484995
deviation-center-line_mean4.9388161979484995
deviation-center-line_min4.9388161979484995
deviation-heading_max7.489030374236871
deviation-heading_mean7.489030374236871
deviation-heading_median7.489030374236871
deviation-heading_min7.489030374236871
distance-from-start_max1.3909655084060193
distance-from-start_mean1.3909655084060193
distance-from-start_median1.3909655084060193
distance-from-start_min1.3909655084060193
driven_any_max3.519584618867418
driven_any_mean3.519584618867418
driven_any_median3.519584618867418
driven_any_min3.519584618867418
driven_lanedir_consec_max1.6648897347487026
driven_lanedir_consec_mean1.6648897347487026
driven_lanedir_consec_min1.6648897347487026
driven_lanedir_max3.362091194105441
driven_lanedir_mean3.362091194105441
driven_lanedir_median3.362091194105441
driven_lanedir_min3.362091194105441
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519584618867418, "survival_time": 59.99999999999873, "driven_lanedir": 3.362091194105441, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 7.489030374236871, "distance-from-start": 1.3909655084060193, "deviation-center-line": 4.9388161979484995, "driven_lanedir_consec": 1.6648897347487026}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10138843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655349065782646
deviation-center-line_median7.1145113238609285


other stats
deviation-center-line_max7.1145113238609285
deviation-center-line_mean7.1145113238609285
deviation-center-line_min7.1145113238609285
deviation-heading_max5.702635608894818
deviation-heading_mean5.702635608894818
deviation-heading_median5.702635608894818
deviation-heading_min5.702635608894818
distance-from-start_max1.6303678384799305
distance-from-start_mean1.6303678384799305
distance-from-start_median1.6303678384799305
distance-from-start_min1.6303678384799305
driven_any_max3.4663369172896528
driven_any_mean3.4663369172896528
driven_any_median3.4663369172896528
driven_any_min3.4663369172896528
driven_lanedir_consec_max3.2655349065782646
driven_lanedir_consec_mean3.2655349065782646
driven_lanedir_consec_min3.2655349065782646
driven_lanedir_max3.2655349065782646
driven_lanedir_mean3.2655349065782646
driven_lanedir_median3.2655349065782646
driven_lanedir_min3.2655349065782646
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172896528, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655349065782646, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635608894818, "distance-from-start": 1.6303678384799305, "deviation-center-line": 7.1145113238609285, "driven_lanedir_consec": 3.2655349065782646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10029843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.273341764774173
deviation-center-line_median5.928861955930986


other stats
deviation-center-line_max5.928861955930986
deviation-center-line_mean5.928861955930986
deviation-center-line_min5.928861955930986
deviation-heading_max8.56664395768181
deviation-heading_mean8.56664395768181
deviation-heading_median8.56664395768181
deviation-heading_min8.56664395768181
distance-from-start_max2.0613975353473006
distance-from-start_mean2.0613975353473006
distance-from-start_median2.0613975353473006
distance-from-start_min2.0613975353473006
driven_any_max3.476087222739718
driven_any_mean3.476087222739718
driven_any_median3.476087222739718
driven_any_min3.476087222739718
driven_lanedir_consec_max3.273341764774173
driven_lanedir_consec_mean3.273341764774173
driven_lanedir_consec_min3.273341764774173
driven_lanedir_max3.273341764774173
driven_lanedir_mean3.273341764774173
driven_lanedir_median3.273341764774173
driven_lanedir_min3.273341764774173
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.476087222739718, "survival_time": 59.99999999999873, "driven_lanedir": 3.273341764774173, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.56664395768181, "distance-from-start": 2.0613975353473006, "deviation-center-line": 5.928861955930986, "driven_lanedir_consec": 3.273341764774173}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9880845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:10:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median2.71866176324571
deviation-center-line_median4.5997692946661


other stats
deviation-center-line_max7.514921718660489
deviation-center-line_mean5.02392012857541
deviation-center-line_min3.3812202063089525
deviation-heading_max7.270406502417804
deviation-heading_mean4.904293629325643
deviation-heading_median4.713467903390324
deviation-heading_min2.9198322081041197
distance-from-start_max2.224084223392078
distance-from-start_mean1.8277566264239569
distance-from-start_median1.8250490950229343
distance-from-start_min1.4368440922578805
driven_any_max3.5795916194572
driven_any_mean3.0035907065383096
driven_any_median3.1970874397950695
driven_any_min2.0405963271058982
driven_lanedir_consec_max3.5171204612307574
driven_lanedir_consec_mean2.5784170438454
driven_lanedir_consec_min1.3592241876594235
driven_lanedir_max3.5592470379137566
driven_lanedir_mean2.9375048569752154
driven_lanedir_median3.105560153006043
driven_lanedir_min1.979652083975019
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.775000000000011
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.0405963271058982, "survival_time": 59.99999999999873, "driven_lanedir": 1.979652083975019, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322081041197, "distance-from-start": 1.5472498854755887, "deviation-center-line": 7.514921718660489, "driven_lanedir_consec": 1.979652083975019}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 3.5795916194572, "survival_time": 59.99999999999873, "driven_lanedir": 3.528723291693028, "in-drivable-lane": 0.0, "deviation-heading": 7.270406502417804, "distance-from-start": 2.1028483045702804, "deviation-center-line": 3.716804548754915, "driven_lanedir_consec": 3.5171204612307574}, "udem-000-ego3": {"driven_any": 2.814587847286173, "survival_time": 59.99999999999873, "driven_lanedir": 2.6823970143190583, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663418506885731, "distance-from-start": 1.4368440922578805, "deviation-center-line": 5.482734040577284, "driven_lanedir_consec": 1.3592241876594235}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9733846Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:09:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4352327805345304
deviation-center-line_median3.4976585818458954


other stats
deviation-center-line_max3.4976585818458954
deviation-center-line_mean3.4976585818458954
deviation-center-line_min3.4976585818458954
deviation-heading_max4.543459809816395
deviation-heading_mean4.543459809816395
deviation-heading_median4.543459809816395
deviation-heading_min4.543459809816395
distance-from-start_max2.277929298279453
distance-from-start_mean2.277929298279453
distance-from-start_median2.277929298279453
distance-from-start_min2.277929298279453
driven_any_max3.579588783619006
driven_any_mean3.579588783619006
driven_any_median3.579588783619006
driven_any_min3.579588783619006
driven_lanedir_consec_max3.4352327805345304
driven_lanedir_consec_mean3.4352327805345304
driven_lanedir_consec_min3.4352327805345304
driven_lanedir_max3.5560705587675905
driven_lanedir_mean3.5560705587675905
driven_lanedir_median3.5560705587675905
driven_lanedir_min3.5560705587675905
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579588783619006, "survival_time": 59.99999999999873, "driven_lanedir": 3.5560705587675905, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809816395, "distance-from-start": 2.277929298279453, "deviation-center-line": 3.4976585818458954, "driven_lanedir_consec": 3.4352327805345304}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9666848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4successnodavinci-stage-01-6.2.460:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204197100811673
deviation-center-line_median4.903600870629327


other stats
deviation-center-line_max4.903600870629327
deviation-center-line_mean4.903600870629327
deviation-center-line_min4.903600870629327
deviation-heading_max7.744574576193987
deviation-heading_mean7.744574576193987
deviation-heading_median7.744574576193987
deviation-heading_min7.744574576193987
distance-from-start_max1.2060007985322774
distance-from-start_mean1.2060007985322774
distance-from-start_median1.2060007985322774
distance-from-start_min1.2060007985322774
driven_any_max3.4850840176967317
driven_any_mean3.4850840176967317
driven_any_median3.4850840176967317
driven_any_min3.4850840176967317
driven_lanedir_consec_max1.4204197100811673
driven_lanedir_consec_mean1.4204197100811673
driven_lanedir_consec_min1.4204197100811673
driven_lanedir_max3.2905075260443173
driven_lanedir_mean3.2905075260443173
driven_lanedir_median3.2905075260443173
driven_lanedir_min3.2905075260443173
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840176967317, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905075260443173, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574576193987, "distance-from-start": 1.2060007985322774, "deviation-center-line": 4.903600870629327, "driven_lanedir_consec": 1.4204197100811673}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9589849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4successnodavinci-stage-01-6.2.460:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0528637692162603
deviation-center-line_median5.91176225472802


other stats
deviation-center-line_max5.91176225472802
deviation-center-line_mean5.91176225472802
deviation-center-line_min5.91176225472802
deviation-heading_max8.374149459714971
deviation-heading_mean8.374149459714971
deviation-heading_median8.374149459714971
deviation-heading_min8.374149459714971
distance-from-start_max0.99998148210146
distance-from-start_mean0.99998148210146
distance-from-start_median0.99998148210146
distance-from-start_min0.99998148210146
driven_any_max3.4100819966978593
driven_any_mean3.4100819966978593
driven_any_median3.4100819966978593
driven_any_min3.4100819966978593
driven_lanedir_consec_max2.0528637692162603
driven_lanedir_consec_mean2.0528637692162603
driven_lanedir_consec_min2.0528637692162603
driven_lanedir_max3.1652526226678295
driven_lanedir_mean3.1652526226678295
driven_lanedir_median3.1652526226678295
driven_lanedir_min3.1652526226678295
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4100819966978593, "survival_time": 59.99999999999873, "driven_lanedir": 3.1652526226678295, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.374149459714971, "distance-from-start": 0.99998148210146, "deviation-center-line": 5.91176225472802, "driven_lanedir_consec": 2.0528637692162603}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9426851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-3of4successnodavinci-stage-01-6.2.460:09:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5499999999999687
driven_lanedir_consec_median2.5521779367757027
deviation-center-line_median5.276797033794661


other stats
deviation-center-line_max6.817971569940922
deviation-center-line_mean5.256787362952107
deviation-center-line_min3.655583814278183
deviation-heading_max6.563252470760606
deviation-heading_mean4.458256283202012
deviation-heading_median4.3879039504116
deviation-heading_min2.4939647612242415
distance-from-start_max2.3401405715621477
distance-from-start_mean1.6789451793932146
distance-from-start_median1.760302268219467
distance-from-start_min0.8550356095717767
driven_any_max3.5795819394225035
driven_any_mean2.7065906982441787
driven_any_median2.5925965173346484
driven_any_min2.0615878188849153
driven_lanedir_consec_max3.2581674765797577
driven_lanedir_consec_mean2.284883287420443
driven_lanedir_consec_min0.7770097995506099
driven_lanedir_max3.5632993278793887
driven_lanedir_mean2.651559214610045
driven_lanedir_median2.5568251398708455
driven_lanedir_min1.9292872508191017
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.7749999999999915
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.889596956965826, "survival_time": 59.99999999999873, "driven_lanedir": 2.833003797344442, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4939647612242415, "distance-from-start": 2.3401405715621477, "deviation-center-line": 6.355081540633737, "driven_lanedir_consec": 2.833003797344442}, "4way-001-ego1": {"driven_any": 3.5795819394225035, "survival_time": 59.99999999999873, "driven_lanedir": 3.5632993278793887, "in-drivable-lane": 0.0, "deviation-heading": 3.0789990866261134, "distance-from-start": 1.9674451050311037, "deviation-center-line": 3.655583814278183, "driven_lanedir_consec": 3.2581674765797577}, "4way-001-ego2": {"driven_any": 2.0615878188849153, "survival_time": 59.99999999999873, "driven_lanedir": 1.9292872508191017, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.696808814197086, "distance-from-start": 0.8550356095717767, "deviation-center-line": 6.817971569940922, "driven_lanedir_consec": 0.7770097995506099}, "4way-001-ego3": {"driven_any": 2.2955960777034705, "survival_time": 59.99999999999873, "driven_lanedir": 2.2806464823972483, "in-drivable-lane": 0.0, "deviation-heading": 6.563252470760606, "distance-from-start": 1.55315943140783, "deviation-center-line": 4.198512526955584, "driven_lanedir_consec": 2.2713520762069628}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9247854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4successnodavinci-stage-01-6.2.460:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.4856553091076994
deviation-center-line_median7.514935466498128


other stats
deviation-center-line_max7.514935466498128
deviation-center-line_mean7.514935466498128
deviation-center-line_min7.514935466498128
deviation-heading_max2.919831926025915
deviation-heading_mean2.919831926025915
deviation-heading_median2.919831926025915
deviation-heading_min2.919831926025915
distance-from-start_max2.8766441843618256
distance-from-start_mean2.8766441843618256
distance-from-start_median2.8766441843618256
distance-from-start_min2.8766441843618256
driven_any_max3.5465963271067142
driven_any_mean3.5465963271067142
driven_any_median3.5465963271067142
driven_any_min3.5465963271067142
driven_lanedir_consec_max3.4856553091076994
driven_lanedir_consec_mean3.4856553091076994
driven_lanedir_consec_min3.4856553091076994
driven_lanedir_max3.4856553091076994
driven_lanedir_mean3.4856553091076994
driven_lanedir_median3.4856553091076994
driven_lanedir_min3.4856553091076994
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9098854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4successnodavinci-stage-01-6.2.460:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.48568324399197
deviation-center-line_median7.514954227940093


other stats
deviation-center-line_max7.514954227940093
deviation-center-line_mean7.514954227940093
deviation-center-line_min7.514954227940093
deviation-heading_max2.9198322000428
deviation-heading_mean2.9198322000428
deviation-heading_median2.9198322000428
deviation-heading_min2.9198322000428
distance-from-start_max2.8766441683061994
distance-from-start_mean2.8766441683061994
distance-from-start_median2.8766441683061994
distance-from-start_min2.8766441683061994
driven_any_max3.5465963271061254
driven_any_mean3.5465963271061254
driven_any_median3.5465963271061254
driven_any_min3.5465963271061254
driven_lanedir_consec_max3.48568324399197
driven_lanedir_consec_mean3.48568324399197
driven_lanedir_consec_min3.48568324399197
driven_lanedir_max3.48568324399197
driven_lanedir_mean3.48568324399197
driven_lanedir_median3.48568324399197
driven_lanedir_min3.48568324399197
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5465963271061254, "survival_time": 59.99999999999873, "driven_lanedir": 3.48568324399197, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322000428, "distance-from-start": 2.8766441683061994, "deviation-center-line": 7.514954227940093, "driven_lanedir_consec": 3.48568324399197}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible