Duckietown Challenges Home Challenges Submissions

Evaluator 104

ID104
evaluatordavinci-stage-04-6.2.46
owneruser1000001
machinedavinci-stage
processdavinci-stage-04-6.2.46
version6.2.46
first heard
last heard
statusinactive
# evaluating
# success58 9096
# timeout
# failed5 11756
# error
# aborted
# host-error3 10019
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors71%
RAM total (MB)251.6 GB
RAM free (MB)232.3 GB
Disk (MB)491.1 GB
Disk available (MB)235.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11930748Bea Baselines 🐤baseline-duckietown-mlaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.460:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.007457570166591001


other stats
deviation-center-line_max0.007457570166591001
deviation-center-line_mean0.007457570166591001
deviation-center-line_min0.007457570166591001
deviation-heading_max0.26874261028062396
deviation-heading_mean0.26874261028062396
deviation-heading_median0.26874261028062396
deviation-heading_min0.26874261028062396
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max5.551115123125784e-16
driven_any_mean5.551115123125784e-16
driven_any_median5.551115123125784e-16
driven_any_min5.551115123125784e-16
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 5.551115123125784e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.26874261028062396, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11927764Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.460:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013199398961138089
deviation-center-line_median0.006540784227287202


other stats
deviation-center-line_max0.006540784227287202
deviation-center-line_mean0.006540784227287202
deviation-center-line_min0.006540784227287202
deviation-heading_max0.26515597543746094
deviation-heading_mean0.26515597543746094
deviation-heading_median0.26515597543746094
deviation-heading_min0.26515597543746094
distance-from-start_max0.015078576668448775
distance-from-start_mean0.015078576668448775
distance-from-start_median0.015078576668448775
distance-from-start_min0.015078576668448775
driven_any_max0.015084424847939362
driven_any_mean0.015084424847939362
driven_any_median0.015084424847939362
driven_any_min0.015084424847939362
driven_lanedir_consec_max0.013199398961138089
driven_lanedir_consec_mean0.013199398961138089
driven_lanedir_consec_min0.013199398961138089
driven_lanedir_max0.013199398961138089
driven_lanedir_mean0.013199398961138089
driven_lanedir_median0.013199398961138089
driven_lanedir_min0.013199398961138089
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084424847939362, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013199398961138089, "in-drivable-lane": 0.0, "deviation-heading": 0.26515597543746094, "distance-from-start": 0.015078576668448775, "deviation-center-line": 0.006540784227287202, "driven_lanedir_consec": 0.013199398961138089}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11924766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailednodavinci-stage-04-6.2.460:04:59
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11920769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.35000000000013
in-drivable-lane_median2.175000000000028
driven_lanedir_consec_median0.8475016422334077
deviation-center-line_median0.8017234866932884


other stats
deviation-center-line_max1.3297574793346056
deviation-center-line_mean0.8017234866932884
deviation-center-line_min0.27368949405197124
deviation-heading_max9.862853797298914
deviation-heading_mean6.690963204226781
deviation-heading_median6.690963204226781
deviation-heading_min3.519072611154648
distance-from-start_max1.4888310189406562
distance-from-start_mean0.7444155094703281
distance-from-start_median0.7444155094703281
distance-from-start_min2.7755575615628914e-17
driven_any_max2.284960166911854
driven_any_mean1.142480083455932
driven_any_median1.142480083455932
driven_any_min1.0186296250935811e-14
driven_lanedir_consec_max1.6950032844668157
driven_lanedir_consec_mean0.8475016422334077
driven_lanedir_consec_min0.0
driven_lanedir_max1.6950032844668157
driven_lanedir_mean0.8475016422334077
driven_lanedir_median0.8475016422334077
driven_lanedir_min0.0
in-drivable-lane_max4.3500000000000565
in-drivable-lane_mean2.175000000000028
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0186296250935811e-14, "survival_time": 18.35000000000013, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 9.862853797298914, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.27368949405197124, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 2.284960166911854, "survival_time": 18.35000000000013, "driven_lanedir": 1.6950032844668157, "in-drivable-lane": 4.3500000000000565, "deviation-heading": 3.519072611154648, "distance-from-start": 1.4888310189406562, "deviation-center-line": 1.3297574793346056, "driven_lanedir_consec": 1.6950032844668157}}
simulation-passed1
survival_time_max18.35000000000013
survival_time_mean18.35000000000013
survival_time_min18.35000000000013
No reset possible
11917770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.350000000000016
in-drivable-lane_median24.049999999999955
driven_lanedir_consec_median1.3425640341331282
deviation-center-line_median1.1437049774514678


other stats
deviation-center-line_max1.1437049774514678
deviation-center-line_mean1.1437049774514678
deviation-center-line_min1.1437049774514678
deviation-heading_max4.675194572935742
deviation-heading_mean4.675194572935742
deviation-heading_median4.675194572935742
deviation-heading_min4.675194572935742
distance-from-start_max1.1153087071210386
distance-from-start_mean1.1153087071210386
distance-from-start_median1.1153087071210386
distance-from-start_min1.1153087071210386
driven_any_max4.80747410961723
driven_any_mean4.80747410961723
driven_any_median4.80747410961723
driven_any_min4.80747410961723
driven_lanedir_consec_max1.3425640341331282
driven_lanedir_consec_mean1.3425640341331282
driven_lanedir_consec_min1.3425640341331282
driven_lanedir_max1.5432839989759488
driven_lanedir_mean1.5432839989759488
driven_lanedir_median1.5432839989759488
driven_lanedir_min1.5432839989759488
in-drivable-lane_max24.049999999999955
in-drivable-lane_mean24.049999999999955
in-drivable-lane_min24.049999999999955
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.80747410961723, "survival_time": 37.350000000000016, "driven_lanedir": 1.5432839989759488, "in-drivable-lane": 24.049999999999955, "deviation-heading": 4.675194572935742, "distance-from-start": 1.1153087071210386, "deviation-center-line": 1.1437049774514678, "driven_lanedir_consec": 1.3425640341331282}}
simulation-passed1
survival_time_max37.350000000000016
survival_time_mean37.350000000000016
survival_time_min37.350000000000016
No reset possible
11912771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4successnodavinci-stage-04-6.2.460:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.650000000000315
in-drivable-lane_median1.050000000000015
driven_lanedir_consec_median3.741944134201739
deviation-center-line_median1.2709900950585178


other stats
deviation-center-line_max1.2709900950585178
deviation-center-line_mean1.2709900950585178
deviation-center-line_min1.2709900950585178
deviation-heading_max4.830221577183304
deviation-heading_mean4.830221577183304
deviation-heading_median4.830221577183304
deviation-heading_min4.830221577183304
distance-from-start_max2.800235019183532
distance-from-start_mean2.800235019183532
distance-from-start_median2.800235019183532
distance-from-start_min2.800235019183532
driven_any_max4.057384444909437
driven_any_mean4.057384444909437
driven_any_median4.057384444909437
driven_any_min4.057384444909437
driven_lanedir_consec_max3.741944134201739
driven_lanedir_consec_mean3.741944134201739
driven_lanedir_consec_min3.741944134201739
driven_lanedir_max3.786801912128552
driven_lanedir_mean3.786801912128552
driven_lanedir_median3.786801912128552
driven_lanedir_min3.786801912128552
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean1.050000000000015
in-drivable-lane_min1.050000000000015
per-episodes
details{"loop-000-ego0": {"driven_any": 4.057384444909437, "survival_time": 31.650000000000315, "driven_lanedir": 3.786801912128552, "in-drivable-lane": 1.050000000000015, "deviation-heading": 4.830221577183304, "distance-from-start": 2.800235019183532, "deviation-center-line": 1.2709900950585178, "driven_lanedir_consec": 3.741944134201739}}
simulation-passed1
survival_time_max31.650000000000315
survival_time_mean31.650000000000315
survival_time_min31.650000000000315
No reset possible
11911771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.7499999999999805
in-drivable-lane_median0.0
driven_lanedir_consec_median0.8422620354862564
deviation-center-line_median0.8348178729689266


other stats
deviation-center-line_max0.8348178729689266
deviation-center-line_mean0.8348178729689266
deviation-center-line_min0.8348178729689266
deviation-heading_max2.022431147848454
deviation-heading_mean2.022431147848454
deviation-heading_median2.022431147848454
deviation-heading_min2.022431147848454
distance-from-start_max0.6777377009582664
distance-from-start_mean0.6777377009582664
distance-from-start_median0.6777377009582664
distance-from-start_min0.6777377009582664
driven_any_max0.8775860328916176
driven_any_mean0.8775860328916176
driven_any_median0.8775860328916176
driven_any_min0.8775860328916176
driven_lanedir_consec_max0.8422620354862564
driven_lanedir_consec_mean0.8422620354862564
driven_lanedir_consec_min0.8422620354862564
driven_lanedir_max0.8422620354862564
driven_lanedir_mean0.8422620354862564
driven_lanedir_median0.8422620354862564
driven_lanedir_min0.8422620354862564
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8775860328916176, "survival_time": 7.7499999999999805, "driven_lanedir": 0.8422620354862564, "in-drivable-lane": 0.0, "deviation-heading": 2.022431147848454, "distance-from-start": 0.6777377009582664, "deviation-center-line": 0.8348178729689266, "driven_lanedir_consec": 0.8422620354862564}}
simulation-passed1
survival_time_max7.7499999999999805
survival_time_mean7.7499999999999805
survival_time_min7.7499999999999805
No reset possible
11888776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-3of4successnodavinci-stage-04-6.2.460:21:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.774999999999363
driven_lanedir_consec_median1.232387936611863
deviation-center-line_median2.6800211491304715


other stats
deviation-center-line_max3.9230614559680568
deviation-center-line_mean2.378107220119584
deviation-center-line_min0.22932512624933576
deviation-heading_max37.376252388778774
deviation-heading_mean15.845302342458035
deviation-heading_median11.764920658656008
deviation-heading_min2.475115663741362
distance-from-start_max1.7731216685685054
distance-from-start_mean0.9575356182723456
distance-from-start_median1.020967978311332
distance-from-start_min0.015084847898213209
driven_any_max7.913796087034624
driven_any_mean3.62876340064786
driven_any_median3.293086317052883
driven_any_min0.015084881451049009
driven_lanedir_consec_max3.223153674014
driven_lanedir_consec_mean1.4250002091211351
driven_lanedir_consec_min0.012071289246815107
driven_lanedir_max5.731950505852369
driven_lanedir_mean2.0521994170807276
driven_lanedir_median1.232387936611863
driven_lanedir_min0.012071289246815107
in-drivable-lane_max55.54999999999873
in-drivable-lane_mean27.27499999999937
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.9173188508159704, "survival_time": 59.99999999999873, "driven_lanedir": 0.4317178737419569, "in-drivable-lane": 55.54999999999873, "deviation-heading": 2.475115663741362, "distance-from-start": 0.6771770442186984, "deviation-center-line": 0.22932512624933576, "driven_lanedir_consec": 0.4317178737419569}, "zigzag-000-ego1": {"driven_any": 5.668853783289795, "survival_time": 59.99999999999873, "driven_lanedir": 2.0330579994817692, "in-drivable-lane": 42.64999999999861, "deviation-heading": 5.946761173345785, "distance-from-start": 1.7731216685685054, "deviation-center-line": 1.6971901010107615, "driven_lanedir_consec": 2.0330579994817692}, "zigzag-000-ego2": {"driven_any": 7.913796087034624, "survival_time": 59.99999999999873, "driven_lanedir": 5.731950505852369, "in-drivable-lane": 10.900000000000114, "deviation-heading": 17.58308014396623, "distance-from-start": 1.3647589124039656, "deviation-center-line": 3.9230614559680568, "driven_lanedir_consec": 3.223153674014}, "zigzag-000-ego3": {"driven_any": 0.015084881451049009, "survival_time": 59.99999999999873, "driven_lanedir": 0.012071289246815107, "in-drivable-lane": 0.0, "deviation-heading": 37.376252388778774, "distance-from-start": 0.015084847898213209, "deviation-center-line": 3.662852197250182, "driven_lanedir_consec": 0.012071289246815107}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11887776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4host-errornodavinci-stage-04-6.2.460:00:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 95, in docker_pull
    for ps in yield_updates(pulling):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 207, in yield_updates
    raise ZValueError(msg, all_lines=all_lines)
zuper_commons.types.exceptions.ZValueError: Weird problem - I could not get the result of the pull
all_lines:
list[2]
#0 dict[2]
   │ status: Pulling from andrea/duckietown-challenges
   │ id: registry-stage2.duckietown.org/andrea/duckietown-challenges@sha256:3aa2762e5ac4b4351b07224320ebba78b8699ef2344b697c3777cf4ffd2b2762
#1 dict[2]
   │ errorDetail:
   │ dict[1]
   │ │ message: Get https://registry-stage2.duckietown.org/v2/andrea/duckietown-challenges/manifests/sha256:c16a58e6f815b4427f892160b74078d7ff6fbc0bb5b400e9e85bb60c0f93231a: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution
   │ error: Get https://registry-stage2.duckietown.org/v2/andrea/duckietown-challenges/manifests/sha256:c16a58e6f815b4427f892160b74078d7ff6fbc0bb5b400e9e85bb60c0f93231a: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11878777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-0of4successnodavinci-stage-04-6.2.460:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.35000000000024
in-drivable-lane_median0.8000000000000114
driven_lanedir_consec_median4.033169038143963
deviation-center-line_median2.395259842514778


other stats
deviation-center-line_max2.395259842514778
deviation-center-line_mean2.395259842514778
deviation-center-line_min2.395259842514778
deviation-heading_max5.893148017044372
deviation-heading_mean5.893148017044372
deviation-heading_median5.893148017044372
deviation-heading_min5.893148017044372
distance-from-start_max2.756383170964655
distance-from-start_mean2.756383170964655
distance-from-start_median2.756383170964655
distance-from-start_min2.756383170964655
driven_any_max4.27651081754467
driven_any_mean4.27651081754467
driven_any_median4.27651081754467
driven_any_min4.27651081754467
driven_lanedir_consec_max4.033169038143963
driven_lanedir_consec_mean4.033169038143963
driven_lanedir_consec_min4.033169038143963
driven_lanedir_max4.033169038143963
driven_lanedir_mean4.033169038143963
driven_lanedir_median4.033169038143963
driven_lanedir_min4.033169038143963
in-drivable-lane_max0.8000000000000114
in-drivable-lane_mean0.8000000000000114
in-drivable-lane_min0.8000000000000114
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.27651081754467, "survival_time": 33.35000000000024, "driven_lanedir": 4.033169038143963, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 5.893148017044372, "distance-from-start": 2.756383170964655, "deviation-center-line": 2.395259842514778, "driven_lanedir_consec": 4.033169038143963}}
simulation-passed1
survival_time_max33.35000000000024
survival_time_mean33.35000000000024
survival_time_min33.35000000000024
No reset possible
11858779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11810779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median34.30000000000019
in-drivable-lane_median10.800000000000129
driven_lanedir_consec_median1.5122794881699115
deviation-center-line_median2.078631504984799


other stats
deviation-center-line_max2.078631504984799
deviation-center-line_mean2.078631504984799
deviation-center-line_min2.078631504984799
deviation-heading_max11.085276303725523
deviation-heading_mean11.085276303725523
deviation-heading_median11.085276303725523
deviation-heading_min11.085276303725523
distance-from-start_max0.9324320891552874
distance-from-start_mean0.9324320891552874
distance-from-start_median0.9324320891552874
distance-from-start_min0.9324320891552874
driven_any_max4.408632812931978
driven_any_mean4.408632812931978
driven_any_median4.408632812931978
driven_any_min4.408632812931978
driven_lanedir_consec_max1.5122794881699115
driven_lanedir_consec_mean1.5122794881699115
driven_lanedir_consec_min1.5122794881699115
driven_lanedir_max2.4807610269200775
driven_lanedir_mean2.4807610269200775
driven_lanedir_median2.4807610269200775
driven_lanedir_min2.4807610269200775
in-drivable-lane_max10.800000000000129
in-drivable-lane_mean10.800000000000129
in-drivable-lane_min10.800000000000129
per-episodes
details{"4way-000-ego0": {"driven_any": 4.408632812931978, "survival_time": 34.30000000000019, "driven_lanedir": 2.4807610269200775, "in-drivable-lane": 10.800000000000129, "deviation-heading": 11.085276303725523, "distance-from-start": 0.9324320891552874, "deviation-center-line": 2.078631504984799, "driven_lanedir_consec": 1.5122794881699115}}
simulation-passed1
survival_time_max34.30000000000019
survival_time_mean34.30000000000019
survival_time_min34.30000000000019
No reset possible
11806780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.349999999999989
in-drivable-lane_median1.999999999999995
driven_lanedir_consec_median0.11280179097022058
deviation-center-line_median0.39043336511182


other stats
deviation-center-line_max0.39043336511182
deviation-center-line_mean0.39043336511182
deviation-center-line_min0.39043336511182
deviation-heading_max2.645836968526012
deviation-heading_mean2.645836968526012
deviation-heading_median2.645836968526012
deviation-heading_min2.645836968526012
distance-from-start_max0.15279923473378268
distance-from-start_mean0.15279923473378268
distance-from-start_median0.15279923473378268
distance-from-start_min0.15279923473378268
driven_any_max0.5588631892120175
driven_any_mean0.5588631892120175
driven_any_median0.5588631892120175
driven_any_min0.5588631892120175
driven_lanedir_consec_max0.11280179097022058
driven_lanedir_consec_mean0.11280179097022058
driven_lanedir_consec_min0.11280179097022058
driven_lanedir_max0.17568873376258898
driven_lanedir_mean0.17568873376258898
driven_lanedir_median0.17568873376258898
driven_lanedir_min0.17568873376258898
in-drivable-lane_max1.999999999999995
in-drivable-lane_mean1.999999999999995
in-drivable-lane_min1.999999999999995
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.5588631892120175, "survival_time": 5.349999999999989, "driven_lanedir": 0.17568873376258898, "in-drivable-lane": 1.999999999999995, "deviation-heading": 2.645836968526012, "distance-from-start": 0.15279923473378268, "deviation-center-line": 0.39043336511182, "driven_lanedir_consec": 0.11280179097022058}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
11800781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.8045325870789215
survival_time_median59.99999999999873
deviation-center-line_median3.724232720361694
in-drivable-lane_median19.849999999999405


other stats
deviation-center-line_max3.724232720361694
deviation-center-line_mean3.724232720361694
deviation-center-line_min3.724232720361694
deviation-heading_max10.96615723632947
deviation-heading_mean10.96615723632947
deviation-heading_median10.96615723632947
deviation-heading_min10.96615723632947
distance-from-start_max1.2634587370710375
distance-from-start_mean1.2634587370710375
distance-from-start_median1.2634587370710375
distance-from-start_min1.2634587370710375
driven_any_max7.907660297488835
driven_any_mean7.907660297488835
driven_any_median7.907660297488835
driven_any_min7.907660297488835
driven_lanedir_consec_max3.8045325870789215
driven_lanedir_consec_mean3.8045325870789215
driven_lanedir_consec_min3.8045325870789215
driven_lanedir_max4.879763858008915
driven_lanedir_mean4.879763858008915
driven_lanedir_median4.879763858008915
driven_lanedir_min4.879763858008915
in-drivable-lane_max19.849999999999405
in-drivable-lane_mean19.849999999999405
in-drivable-lane_min19.849999999999405
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907660297488835, "survival_time": 59.99999999999873, "driven_lanedir": 4.879763858008915, "in-drivable-lane": 19.849999999999405, "deviation-heading": 10.96615723632947, "distance-from-start": 1.2634587370710375, "deviation-center-line": 3.724232720361694, "driven_lanedir_consec": 3.8045325870789215}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11797782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11789800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.460:04:43
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11786801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednodavinci-stage-04-6.2.460:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11781803Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984eaaido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.460:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.04441703949810316
deviation-center-line_median0.006114391297253458


other stats
deviation-center-line_max0.006114391297253458
deviation-center-line_mean0.006114391297253458
deviation-center-line_min0.006114391297253458
deviation-heading_max0.26896903688014506
deviation-heading_mean0.26896903688014506
deviation-heading_median0.26896903688014506
deviation-heading_min0.26896903688014506
distance-from-start_max0.05174996554374442
distance-from-start_mean0.05174996554374442
distance-from-start_median0.05174996554374442
distance-from-start_min0.05174996554374442
driven_any_max0.05175027779051247
driven_any_mean0.05175027779051247
driven_any_median0.05175027779051247
driven_any_min0.05175027779051247
driven_lanedir_consec_max0.04441703949810316
driven_lanedir_consec_mean0.04441703949810316
driven_lanedir_consec_min0.04441703949810316
driven_lanedir_max0.04441703949810316
driven_lanedir_mean0.04441703949810316
driven_lanedir_median0.04441703949810316
driven_lanedir_min0.04441703949810316
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05175027779051247, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04441703949810316, "in-drivable-lane": 0.0, "deviation-heading": 0.26896903688014506, "distance-from-start": 0.05174996554374442, "deviation-center-line": 0.006114391297253458, "driven_lanedir_consec": 0.04441703949810316}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11777805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checksuccessnodavinci-stage-04-6.2.460:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.007457570166591001


other stats
deviation-center-line_max0.007457570166591001
deviation-center-line_mean0.007457570166591001
deviation-center-line_min0.007457570166591001
deviation-heading_max0.26874261028062396
deviation-heading_mean0.26874261028062396
deviation-heading_median0.26874261028062396
deviation-heading_min0.26874261028062396
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max5.551115123125784e-16
driven_any_mean5.551115123125784e-16
driven_any_median5.551115123125784e-16
driven_any_min5.551115123125784e-16
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 5.551115123125784e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.26874261028062396, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11772806user1000001minimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
11769808Andrea Censitemplate-randomaido-LFV-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.65000000000003
in-drivable-lane_median4.950000000000033
driven_lanedir_consec_median0.26764605432234867
deviation-center-line_median0.6035442792313549


other stats
deviation-center-line_max0.6035442792313549
deviation-center-line_mean0.6035442792313549
deviation-center-line_min0.6035442792313549
deviation-heading_max4.043215735457215
deviation-heading_mean4.043215735457215
deviation-heading_median4.043215735457215
deviation-heading_min4.043215735457215
distance-from-start_max0.5461575079396498
distance-from-start_mean0.5461575079396498
distance-from-start_median0.5461575079396498
distance-from-start_min0.5461575079396498
driven_any_max2.4684338587867174
driven_any_mean2.4684338587867174
driven_any_median2.4684338587867174
driven_any_min2.4684338587867174
driven_lanedir_consec_max0.26764605432234867
driven_lanedir_consec_mean0.26764605432234867
driven_lanedir_consec_min0.26764605432234867
driven_lanedir_max0.262846269745866
driven_lanedir_mean0.262846269745866
driven_lanedir_median0.262846269745866
driven_lanedir_min0.262846269745866
in-drivable-lane_max4.950000000000033
in-drivable-lane_mean4.950000000000033
in-drivable-lane_min4.950000000000033
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.4684338587867174, "survival_time": 11.65000000000003, "driven_lanedir": 0.262846269745866, "in-drivable-lane": 4.950000000000033, "deviation-heading": 4.043215735457215, "distance-from-start": 0.5461575079396498, "deviation-center-line": 0.6035442792313549, "driven_lanedir_consec": 0.26764605432234867}}
simulation-passed1
survival_time_max11.65000000000003
survival_time_mean11.65000000000003
survival_time_min11.65000000000003
No reset possible
11765809Andrea Censitemplate-randomaido-LFV-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999994
in-drivable-lane_median1.6499999999999972
driven_lanedir_consec_median0.4413284134549402
deviation-center-line_median0.07863297638595365


other stats
deviation-center-line_max0.07863297638595365
deviation-center-line_mean0.07863297638595365
deviation-center-line_min0.07863297638595365
deviation-heading_max1.38663091368877
deviation-heading_mean1.38663091368877
deviation-heading_median1.38663091368877
deviation-heading_min1.38663091368877
distance-from-start_max0.4891723059495441
distance-from-start_mean0.4891723059495441
distance-from-start_median0.4891723059495441
distance-from-start_min0.4891723059495441
driven_any_max0.5134230938905382
driven_any_mean0.5134230938905382
driven_any_median0.5134230938905382
driven_any_min0.5134230938905382
driven_lanedir_consec_max0.4413284134549402
driven_lanedir_consec_mean0.4413284134549402
driven_lanedir_consec_min0.4413284134549402
driven_lanedir_max0.4413284134549402
driven_lanedir_mean0.4413284134549402
driven_lanedir_median0.4413284134549402
driven_lanedir_min0.4413284134549402
in-drivable-lane_max1.6499999999999972
in-drivable-lane_mean1.6499999999999972
in-drivable-lane_min1.6499999999999972
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5134230938905382, "survival_time": 3.899999999999994, "driven_lanedir": 0.4413284134549402, "in-drivable-lane": 1.6499999999999972, "deviation-heading": 1.38663091368877, "distance-from-start": 0.4891723059495441, "deviation-center-line": 0.07863297638595365, "driven_lanedir_consec": 0.4413284134549402}}
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean3.899999999999994
survival_time_min3.899999999999994
No reset possible
11761810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failednodavinci-stage-04-6.2.460:01:06
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11756810Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-1of4failednodavinci-stage-04-6.2.460:01:12
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11742811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.600000000000115
in-drivable-lane_median2.9500000000000366
driven_lanedir_consec_median0.9871056187546484
deviation-center-line_median0.8247517580243874


other stats
deviation-center-line_max0.8247517580243874
deviation-center-line_mean0.8247517580243874
deviation-center-line_min0.8247517580243874
deviation-heading_max5.730562822305461
deviation-heading_mean5.730562822305461
deviation-heading_median5.730562822305461
deviation-heading_min5.730562822305461
distance-from-start_max0.7578273822890654
distance-from-start_mean0.7578273822890654
distance-from-start_median0.7578273822890654
distance-from-start_min0.7578273822890654
driven_any_max2.1918721105039176
driven_any_mean2.1918721105039176
driven_any_median2.1918721105039176
driven_any_min2.1918721105039176
driven_lanedir_consec_max0.9871056187546484
driven_lanedir_consec_mean0.9871056187546484
driven_lanedir_consec_min0.9871056187546484
driven_lanedir_max1.6543595942016325
driven_lanedir_mean1.6543595942016325
driven_lanedir_median1.6543595942016325
driven_lanedir_min1.6543595942016325
in-drivable-lane_max2.9500000000000366
in-drivable-lane_mean2.9500000000000366
in-drivable-lane_min2.9500000000000366
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.1918721105039176, "survival_time": 17.600000000000115, "driven_lanedir": 1.6543595942016325, "in-drivable-lane": 2.9500000000000366, "deviation-heading": 5.730562822305461, "distance-from-start": 0.7578273822890654, "deviation-center-line": 0.8247517580243874, "driven_lanedir_consec": 0.9871056187546484}}
simulation-passed1
survival_time_max17.600000000000115
survival_time_mean17.600000000000115
survival_time_min17.600000000000115
No reset possible
11723812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:15:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353262


other stats
deviation-center-line_max0.8948975282353262
deviation-center-line_mean0.8948975282353262
deviation-center-line_min0.8948975282353262
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11714814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.460:01:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11708814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.000286102294921875
survival_time_median59.99999999999873
deviation-center-line_median0.8949116056299469
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949116056299469
deviation-center-line_mean0.8949116056299469
deviation-center-line_min0.8949116056299469
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.576064361825558e-16
distance-from-start_mean2.576064361825558e-16
distance-from-start_median2.576064361825558e-16
distance-from-start_min2.576064361825558e-16
driven_any_max3.0912772341906697e-13
driven_any_mean3.0912772341906697e-13
driven_any_median3.0912772341906697e-13
driven_any_min3.0912772341906697e-13
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean0.000286102294921875
driven_lanedir_consec_min0.000286102294921875
driven_lanedir_max0.000286102294921875
driven_lanedir_mean0.000286102294921875
driven_lanedir_median0.000286102294921875
driven_lanedir_min0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.0912772341906697e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.576064361825558e-16, "deviation-center-line": 0.8949116056299469, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11704815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353634


other stats
deviation-center-line_max0.8948975282353634
deviation-center-line_mean0.8948975282353634
deviation-center-line_min0.8948975282353634
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11699816Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11692817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.460:12:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.936310579945818
deviation-center-line_median0.26372827402668186


other stats
deviation-center-line_max2.128491974247639
deviation-center-line_mean0.7030908912030065
deviation-center-line_min0.15641504251102295
deviation-heading_max30.712966764077652
deviation-heading_mean9.10600170233707
deviation-heading_median2.0959285656971662
deviation-heading_min1.519182913876287
distance-from-start_max3.291290161140417
distance-from-start_mean2.000663875464858
distance-from-start_median2.355682670359506
distance-from-start_min2.2887833992611187e-16
driven_any_max5.472269552385587
driven_any_mean3.941216020142065
driven_any_median5.146297264091199
driven_any_min2.746540079113375e-13
driven_lanedir_consec_max5.464251838075039
driven_lanedir_consec_mean3.834218249491669
driven_lanedir_consec_min0.0
driven_lanedir_max5.464251961251795
driven_lanedir_mean3.935073893557231
driven_lanedir_median5.138021806488564
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 5.472269552385587, "survival_time": 59.99999999999873, "driven_lanedir": 5.464251961251795, "in-drivable-lane": 0.0, "deviation-heading": 1.519182913876287, "distance-from-start": 3.291290161140417, "deviation-center-line": 0.15641504251102295, "driven_lanedir_consec": 5.464251838075039}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.220571614669939, "survival_time": 59.99999999999873, "driven_lanedir": 5.2126441633627945, "in-drivable-lane": 0.0, "deviation-heading": 2.2071350622741748, "distance-from-start": 2.4394694270451596, "deviation-center-line": 0.26092105692879514, "driven_lanedir_consec": 5.2126441633627945}, "udem-000-ego3": {"driven_any": 5.072022913512461, "survival_time": 59.99999999999873, "driven_lanedir": 5.063399449614334, "in-drivable-lane": 0.0, "deviation-heading": 1.9847220691201577, "distance-from-start": 2.2718959136738524, "deviation-center-line": 0.26653549112456865, "driven_lanedir_consec": 4.659976996528842}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11687818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.331344237139176
deviation-center-line_median0.14341993721660595


other stats
deviation-center-line_max0.14341993721660595
deviation-center-line_mean0.14341993721660595
deviation-center-line_min0.14341993721660595
deviation-heading_max1.3020944572743824
deviation-heading_mean1.3020944572743824
deviation-heading_median1.3020944572743824
deviation-heading_min1.3020944572743824
distance-from-start_max2.952739272534191
distance-from-start_mean2.952739272534191
distance-from-start_median2.952739272534191
distance-from-start_min2.952739272534191
driven_any_max5.629455349358906
driven_any_mean5.629455349358906
driven_any_median5.629455349358906
driven_any_min5.629455349358906
driven_lanedir_consec_max5.331344237139176
driven_lanedir_consec_mean5.331344237139176
driven_lanedir_consec_min5.331344237139176
driven_lanedir_max5.62600246220405
driven_lanedir_mean5.62600246220405
driven_lanedir_median5.62600246220405
driven_lanedir_min5.62600246220405
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.629455349358906, "survival_time": 59.99999999999873, "driven_lanedir": 5.62600246220405, "in-drivable-lane": 0.0, "deviation-heading": 1.3020944572743824, "distance-from-start": 2.952739272534191, "deviation-center-line": 0.14341993721660595, "driven_lanedir_consec": 5.331344237139176}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11681819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation347successyesdavinci-stage-04-6.2.460:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.381330906743559
deviation-center-line_median0.3759399942892944


other stats
deviation-center-line_max0.4050492367024026
deviation-center-line_mean0.3759399942892944
deviation-center-line_min0.346830751876186
deviation-heading_max3.1141410438173027
deviation-heading_mean3.1134951286938968
deviation-heading_median3.1134951286938968
deviation-heading_min3.1128492135704913
distance-from-start_max1.5440903882735502
distance-from-start_mean1.3058755968972466
distance-from-start_median1.3058755968972466
distance-from-start_min1.0676608055209431
driven_any_max5.64000698925217
driven_any_mean5.394808261278103
driven_any_median5.394808261278103
driven_any_min5.149609533304037
driven_lanedir_consec_max5.624383264436496
driven_lanedir_consec_mean5.381330906743559
driven_lanedir_consec_min5.138278549050622
driven_lanedir_max5.624383264436496
driven_lanedir_mean5.381330906743559
driven_lanedir_median5.381330906743559
driven_lanedir_min5.138278549050622
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.64000698925217, "survival_time": 59.99999999999873, "driven_lanedir": 5.624383264436496, "in-drivable-lane": 0.0, "deviation-heading": 3.1128492135704913, "distance-from-start": 1.0676608055209431, "deviation-center-line": 0.4050492367024026, "driven_lanedir_consec": 5.624383264436496}, "loop2-000-ego1": {"driven_any": 5.149609533304037, "survival_time": 59.99999999999873, "driven_lanedir": 5.138278549050622, "in-drivable-lane": 0.0, "deviation-heading": 3.1141410438173027, "distance-from-start": 1.5440903882735502, "deviation-center-line": 0.346830751876186, "driven_lanedir_consec": 5.138278549050622}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11674821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-3of4successnodavinci-stage-04-6.2.460:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.0002213201227618811
deviation-center-line_median0.4065062534344534


other stats
deviation-center-line_max0.4065062534344534
deviation-center-line_mean0.4065062534344534
deviation-center-line_min0.4065062534344534
deviation-heading_max40.96738790126906
deviation-heading_mean40.96738790126906
deviation-heading_median40.96738790126906
deviation-heading_min40.96738790126906
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max-0.0002213201227618811
driven_lanedir_consec_mean-0.0002213201227618811
driven_lanedir_consec_min-0.0002213201227618811
driven_lanedir_max-0.0002213201227618811
driven_lanedir_mean-0.0002213201227618811
driven_lanedir_median-0.0002213201227618811
driven_lanedir_min-0.0002213201227618811
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.0002213201227618811, "in-drivable-lane": 0.0, "deviation-heading": 40.96738790126906, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.4065062534344534, "driven_lanedir_consec": -0.0002213201227618811}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11667823Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.718735763136104
deviation-center-line_median0.3055318569062805


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.056094724894972
deviation-center-line_min0.14491946458638674
deviation-heading_max18.309428016005143
deviation-heading_mean5.962038133066249
deviation-heading_median2.1016846099383484
deviation-heading_min1.3353552963831563
distance-from-start_max3.3735529930090653
distance-from-start_mean2.2469544876361525
distance-from-start_median2.8071324787677723
distance-from-start_min4.440892098500626e-16
driven_any_max5.809528586384186
driven_any_mean3.815527957610135
driven_any_median4.726291622027912
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.79391764651065
driven_lanedir_consec_mean3.8078472931957146
driven_lanedir_consec_min0.0
driven_lanedir_max5.79391764651065
driven_lanedir_mean3.8078491425629943
driven_lanedir_median4.718739461870664
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.678536302590251, "survival_time": 59.99999999999873, "driven_lanedir": 3.6670970298429166, "in-drivable-lane": 0.0, "deviation-heading": 2.004432813280444, "distance-from-start": 2.640003754342585, "deviation-center-line": 0.32324970166177724, "driven_lanedir_consec": 3.667089757433403}, "udem-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.7740469414655715, "survival_time": 59.99999999999873, "driven_lanedir": 5.770381893898411, "in-drivable-lane": 0.0, "deviation-heading": 1.3353552963831563, "distance-from-start": 3.3735529930090653, "deviation-center-line": 0.14491946458638674, "driven_lanedir_consec": 5.7703817688388055}, "udem-000-ego3": {"driven_any": 5.809528586384186, "survival_time": 59.99999999999873, "driven_lanedir": 5.79391764651065, "in-drivable-lane": 0.0, "deviation-heading": 2.1989364065962533, "distance-from-start": 2.97426120319296, "deviation-center-line": 0.2878140121507838, "driven_lanedir_consec": 5.79391764651065}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11662824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.936558467770946
deviation-center-line_median0.704072479117435


other stats
deviation-center-line_max0.704072479117435
deviation-center-line_mean0.704072479117435
deviation-center-line_min0.704072479117435
deviation-heading_max3.2476993641319134
deviation-heading_mean3.2476993641319134
deviation-heading_median3.2476993641319134
deviation-heading_min3.2476993641319134
distance-from-start_max2.4908879599333775
distance-from-start_mean2.4908879599333775
distance-from-start_median2.4908879599333775
distance-from-start_min2.4908879599333775
driven_any_max4.95168286773776
driven_any_mean4.95168286773776
driven_any_median4.95168286773776
driven_any_min4.95168286773776
driven_lanedir_consec_max4.936558467770946
driven_lanedir_consec_mean4.936558467770946
driven_lanedir_consec_min4.936558467770946
driven_lanedir_max4.936558467770946
driven_lanedir_mean4.936558467770946
driven_lanedir_median4.936558467770946
driven_lanedir_min4.936558467770946
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 4.95168286773776, "survival_time": 59.99999999999873, "driven_lanedir": 4.936558467770946, "in-drivable-lane": 0.0, "deviation-heading": 3.2476993641319134, "distance-from-start": 2.4908879599333775, "deviation-center-line": 0.704072479117435, "driven_lanedir_consec": 4.936558467770946}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11660825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.666632590007421
deviation-center-line_median0.31140873000764646


other stats
deviation-center-line_max0.36025561964774255
deviation-center-line_mean0.31140873000764646
deviation-center-line_min0.2625618403675503
deviation-heading_max2.4450188093470064
deviation-heading_mean2.41067092677401
deviation-heading_median2.41067092677401
deviation-heading_min2.3763230442010137
distance-from-start_max1.5561803536011607
distance-from-start_mean1.5387418886345556
distance-from-start_median1.5387418886345556
distance-from-start_min1.5213034236679508
driven_any_max5.681963014330128
driven_any_mean5.678653750290054
driven_any_median5.678653750290054
driven_any_min5.67534448624998
driven_lanedir_consec_max5.667494145070765
driven_lanedir_consec_mean5.666632590007421
driven_lanedir_consec_min5.665771034944077
driven_lanedir_max5.667494145070765
driven_lanedir_mean5.666632590007421
driven_lanedir_median5.666632590007421
driven_lanedir_min5.665771034944077
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.681963014330128, "survival_time": 59.99999999999873, "driven_lanedir": 5.667494145070765, "in-drivable-lane": 0.0, "deviation-heading": 2.4450188093470064, "distance-from-start": 1.5213034236679508, "deviation-center-line": 0.2625618403675503, "driven_lanedir_consec": 5.667494145070765}, "loop2-000-ego1": {"driven_any": 5.67534448624998, "survival_time": 59.99999999999873, "driven_lanedir": 5.665771034944077, "in-drivable-lane": 0.0, "deviation-heading": 2.3763230442010137, "distance-from-start": 1.5561803536011607, "deviation-center-line": 0.36025561964774255, "driven_lanedir_consec": 5.665771034944077}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11651826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.460:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.795272886866324
deviation-center-line_median0.18526753481713515


other stats
deviation-center-line_max0.18526753481713515
deviation-center-line_mean0.18526753481713515
deviation-center-line_min0.18526753481713515
deviation-heading_max1.7039527742064555
deviation-heading_mean1.7039527742064555
deviation-heading_median1.7039527742064555
deviation-heading_min1.7039527742064555
distance-from-start_max3.2668493430789716
distance-from-start_mean3.2668493430789716
distance-from-start_median3.2668493430789716
distance-from-start_min3.2668493430789716
driven_any_max5.803361618445096
driven_any_mean5.803361618445096
driven_any_median5.803361618445096
driven_any_min5.803361618445096
driven_lanedir_consec_max5.795272886866324
driven_lanedir_consec_mean5.795272886866324
driven_lanedir_consec_min5.795272886866324
driven_lanedir_max5.795272886866324
driven_lanedir_mean5.795272886866324
driven_lanedir_median5.795272886866324
driven_lanedir_min5.795272886866324
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.803361618445096, "survival_time": 59.99999999999873, "driven_lanedir": 5.795272886866324, "in-drivable-lane": 0.0, "deviation-heading": 1.7039527742064555, "distance-from-start": 3.2668493430789716, "deviation-center-line": 0.18526753481713515, "driven_lanedir_consec": 5.795272886866324}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11629827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.324198327059039
deviation-center-line_median0.5519609227418314


other stats
deviation-center-line_max0.5519609227418314
deviation-center-line_mean0.5519609227418314
deviation-center-line_min0.5519609227418314
deviation-heading_max3.5883206576626248
deviation-heading_mean3.5883206576626248
deviation-heading_median3.5883206576626248
deviation-heading_min3.5883206576626248
distance-from-start_max1.0638230176113956
distance-from-start_mean1.0638230176113956
distance-from-start_median1.0638230176113956
distance-from-start_min1.0638230176113956
driven_any_max5.347239209519233
driven_any_mean5.347239209519233
driven_any_median5.347239209519233
driven_any_min5.347239209519233
driven_lanedir_consec_max5.324198327059039
driven_lanedir_consec_mean5.324198327059039
driven_lanedir_consec_min5.324198327059039
driven_lanedir_max5.324198327059039
driven_lanedir_mean5.324198327059039
driven_lanedir_median5.324198327059039
driven_lanedir_min5.324198327059039
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.347239209519233, "survival_time": 59.99999999999873, "driven_lanedir": 5.324198327059039, "in-drivable-lane": 0.0, "deviation-heading": 3.5883206576626248, "distance-from-start": 1.0638230176113956, "deviation-center-line": 0.5519609227418314, "driven_lanedir_consec": 5.324198327059039}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11609828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.450000000000056
in-drivable-lane_median0.0
driven_lanedir_consec_median1.239051419614633
deviation-center-line_median0.0997629919452237


other stats
deviation-center-line_max0.0997629919452237
deviation-center-line_mean0.0997629919452237
deviation-center-line_min0.0997629919452237
deviation-heading_max0.96870438500335
deviation-heading_mean0.96870438500335
deviation-heading_median0.96870438500335
deviation-heading_min0.96870438500335
distance-from-start_max1.2390725918040948
distance-from-start_mean1.2390725918040948
distance-from-start_median1.2390725918040948
distance-from-start_min1.2390725918040948
driven_any_max1.2494632844349631
driven_any_mean1.2494632844349631
driven_any_median1.2494632844349631
driven_any_min1.2494632844349631
driven_lanedir_consec_max1.239051419614633
driven_lanedir_consec_mean1.239051419614633
driven_lanedir_consec_min1.239051419614633
driven_lanedir_max1.239051419614633
driven_lanedir_mean1.239051419614633
driven_lanedir_median1.239051419614633
driven_lanedir_min1.239051419614633
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.2494632844349631, "survival_time": 13.450000000000056, "driven_lanedir": 1.239051419614633, "in-drivable-lane": 0.0, "deviation-heading": 0.96870438500335, "distance-from-start": 1.2390725918040948, "deviation-center-line": 0.0997629919452237, "driven_lanedir_consec": 1.239051419614633}}
simulation-passed1
survival_time_max13.450000000000056
survival_time_mean13.450000000000056
survival_time_min13.450000000000056
No reset possible
11586830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.949999999999186
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median2.780669378492081
deviation-center-line_median5.9832374225219125


other stats
deviation-center-line_max5.9832374225219125
deviation-center-line_mean5.9832374225219125
deviation-center-line_min5.9832374225219125
deviation-heading_max5.351741767067895
deviation-heading_mean5.351741767067895
deviation-heading_median5.351741767067895
deviation-heading_min5.351741767067895
distance-from-start_max1.6305272648718805
distance-from-start_mean1.6305272648718805
distance-from-start_median1.6305272648718805
distance-from-start_min1.6305272648718805
driven_any_max2.951091089513758
driven_any_mean2.951091089513758
driven_any_median2.951091089513758
driven_any_min2.951091089513758
driven_lanedir_consec_max2.780669378492081
driven_lanedir_consec_mean2.780669378492081
driven_lanedir_consec_min2.780669378492081
driven_lanedir_max2.780669378492081
driven_lanedir_mean2.780669378492081
driven_lanedir_median2.780669378492081
driven_lanedir_min2.780669378492081
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.951091089513758, "survival_time": 51.949999999999186, "driven_lanedir": 2.780669378492081, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067895, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.9832374225219125, "driven_lanedir_consec": 2.780669378492081}}
simulation-passed1
survival_time_max51.949999999999186
survival_time_mean51.949999999999186
survival_time_min51.949999999999186
No reset possible
11355831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.90000000000032
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.75808746862099
deviation-center-line_median2.1921593565779376


other stats
deviation-center-line_max2.1921593565779376
deviation-center-line_mean2.1921593565779376
deviation-center-line_min2.1921593565779376
deviation-heading_max2.829688003254758
deviation-heading_mean2.829688003254758
deviation-heading_median2.829688003254758
deviation-heading_min2.829688003254758
distance-from-start_max1.6014839059621049
distance-from-start_mean1.6014839059621049
distance-from-start_median1.6014839059621049
distance-from-start_min1.6014839059621049
driven_any_max1.818596388397189
driven_any_mean1.818596388397189
driven_any_median1.818596388397189
driven_any_min1.818596388397189
driven_lanedir_consec_max1.75808746862099
driven_lanedir_consec_mean1.75808746862099
driven_lanedir_consec_min1.75808746862099
driven_lanedir_max1.75808746862099
driven_lanedir_mean1.75808746862099
driven_lanedir_median1.75808746862099
driven_lanedir_min1.75808746862099
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.818596388397189, "survival_time": 31.90000000000032, "driven_lanedir": 1.75808746862099, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.829688003254758, "distance-from-start": 1.6014839059621049, "deviation-center-line": 2.1921593565779376, "driven_lanedir_consec": 1.75808746862099}}
simulation-passed1
survival_time_max31.90000000000032
survival_time_mean31.90000000000032
survival_time_min31.90000000000032
No reset possible
11348832Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11061833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-1of4successnodavinci-stage-04-6.2.460:18:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.8249999999998965
driven_lanedir_consec_median2.089362646121113
deviation-center-line_median5.1606969042445545


other stats
deviation-center-line_max5.884537088976699
deviation-center-line_mean4.608902728622449
deviation-center-line_min2.229680017023988
deviation-heading_max33.00132974561592
deviation-heading_mean11.086939889451044
deviation-heading_median5.3156324990396016
deviation-heading_min0.7151648141090522
distance-from-start_max2.400773804592291
distance-from-start_mean1.855033439894366
distance-from-start_median1.8031549983915716
distance-from-start_min1.4130499582020293
driven_any_max3.5300951074200313
driven_any_mean2.5187726211552675
driven_any_median2.5310927358554984
driven_any_min1.4828099054900417
driven_lanedir_consec_max3.4375556548524067
driven_lanedir_consec_mean2.243867367124486
driven_lanedir_consec_min1.359188521403314
driven_lanedir_max3.4375556548524067
driven_lanedir_mean2.430771337654275
driven_lanedir_median2.4562457120319685
driven_lanedir_min1.373038271700757
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4124999999999552
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5425992768883967, "survival_time": 59.99999999999873, "driven_lanedir": 1.537863345389593, "in-drivable-lane": 0.0, "deviation-heading": 0.7151648141090522, "distance-from-start": 1.538166429460106, "deviation-center-line": 2.229680017023988, "driven_lanedir_consec": 1.537863345389593}, "loop-000-ego1": {"driven_any": 3.5195861948226006, "survival_time": 59.99999999999873, "driven_lanedir": 3.3746280786743443, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.2883954590350015, "distance-from-start": 2.068143567323037, "deviation-center-line": 5.233752335699729, "driven_lanedir_consec": 2.640861946852633}, "loop-000-ego2": {"driven_any": 3.5300951074200313, "survival_time": 59.99999999999873, "driven_lanedir": 3.4375556548524067, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342869539044202, "distance-from-start": 2.400773804592291, "deviation-center-line": 5.884537088976699, "driven_lanedir_consec": 3.4375556548524067}, "loop-000-ego3": {"driven_any": 1.4828099054900417, "survival_time": 59.99999999999873, "driven_lanedir": 1.373038271700757, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 33.00132974561592, "distance-from-start": 1.4130499582020293, "deviation-center-line": 5.08764147278938, "driven_lanedir_consec": 1.359188521403314}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11040834Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11000835Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.500000000000256
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.4937232631898305
deviation-center-line_median2.6227097047460575


other stats
deviation-center-line_max2.6227097047460575
deviation-center-line_mean2.6227097047460575
deviation-center-line_min2.6227097047460575
deviation-heading_max2.9200558502635636
deviation-heading_mean2.9200558502635636
deviation-heading_median2.9200558502635636
deviation-heading_min2.9200558502635636
distance-from-start_max1.2100420266422205
distance-from-start_mean1.2100420266422205
distance-from-start_median1.2100420266422205
distance-from-start_min1.2100420266422205
driven_any_max1.5545963269619407
driven_any_mean1.5545963269619407
driven_any_median1.5545963269619407
driven_any_min1.5545963269619407
driven_lanedir_consec_max1.4937232631898305
driven_lanedir_consec_mean1.4937232631898305
driven_lanedir_consec_min1.4937232631898305
driven_lanedir_max1.4937232631898305
driven_lanedir_mean1.4937232631898305
driven_lanedir_median1.4937232631898305
driven_lanedir_min1.4937232631898305
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.5545963269619407, "survival_time": 27.500000000000256, "driven_lanedir": 1.4937232631898305, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200558502635636, "distance-from-start": 1.2100420266422205, "deviation-center-line": 2.6227097047460575, "driven_lanedir_consec": 1.4937232631898305}}
simulation-passed1
survival_time_max27.500000000000256
survival_time_mean27.500000000000256
survival_time_min27.500000000000256
No reset possible
10917836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.800000000000075
in-drivable-lane_median0.0
driven_lanedir_consec_median0.6855199039137942
deviation-center-line_median1.1151363222094262


other stats
deviation-center-line_max1.1151363222094262
deviation-center-line_mean1.1151363222094262
deviation-center-line_min1.1151363222094262
deviation-heading_max1.8997107406045024
deviation-heading_mean1.8997107406045024
deviation-heading_median1.8997107406045024
deviation-heading_min1.8997107406045024
distance-from-start_max0.6890064417552494
distance-from-start_mean0.6890064417552494
distance-from-start_median0.6890064417552494
distance-from-start_min0.6890064417552494
driven_any_max0.8255923756486474
driven_any_mean0.8255923756486474
driven_any_median0.8255923756486474
driven_any_min0.8255923756486474
driven_lanedir_consec_max0.6855199039137942
driven_lanedir_consec_mean0.6855199039137942
driven_lanedir_consec_min0.6855199039137942
driven_lanedir_max0.8113565710261739
driven_lanedir_mean0.8113565710261739
driven_lanedir_median0.8113565710261739
driven_lanedir_min0.8113565710261739
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.8255923756486474, "survival_time": 14.800000000000075, "driven_lanedir": 0.8113565710261739, "in-drivable-lane": 0.0, "deviation-heading": 1.8997107406045024, "distance-from-start": 0.6890064417552494, "deviation-center-line": 1.1151363222094262, "driven_lanedir_consec": 0.6855199039137942}}
simulation-passed1
survival_time_max14.800000000000075
survival_time_mean14.800000000000075
survival_time_min14.800000000000075
No reset possible
10793837Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-0of4successnodavinci-stage-04-6.2.460:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.485872931964064
deviation-center-line_median4.220405873962668


other stats
deviation-center-line_max4.220405873962668
deviation-center-line_mean4.220405873962668
deviation-center-line_min4.220405873962668
deviation-heading_max2.9174896774298857
deviation-heading_mean2.9174896774298857
deviation-heading_median2.9174896774298857
deviation-heading_min2.9174896774298857
distance-from-start_max2.8928218615311083
distance-from-start_mean2.8928218615311083
distance-from-start_median2.8928218615311083
distance-from-start_min2.8928218615311083
driven_any_max3.5465963319759144
driven_any_mean3.5465963319759144
driven_any_median3.5465963319759144
driven_any_min3.5465963319759144
driven_lanedir_consec_max3.485872931964064
driven_lanedir_consec_mean3.485872931964064
driven_lanedir_consec_min3.485872931964064
driven_lanedir_max3.485872931964064
driven_lanedir_mean3.485872931964064
driven_lanedir_median3.485872931964064
driven_lanedir_min3.485872931964064
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963319759144, "survival_time": 59.99999999999873, "driven_lanedir": 3.485872931964064, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.9174896774298857, "distance-from-start": 2.8928218615311083, "deviation-center-line": 4.220405873962668, "driven_lanedir_consec": 3.485872931964064}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10748837Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.200000000000053
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7222898911877377
deviation-center-line_median0.6263425139703784


other stats
deviation-center-line_max0.6263425139703784
deviation-center-line_mean0.6263425139703784
deviation-center-line_min0.6263425139703784
deviation-heading_max1.417085318647224
deviation-heading_mean1.417085318647224
deviation-heading_median1.417085318647224
deviation-heading_min1.417085318647224
distance-from-start_max0.7201981002422111
distance-from-start_mean0.7201981002422111
distance-from-start_median0.7201981002422111
distance-from-start_min0.7201981002422111
driven_any_max0.7295990048299438
driven_any_mean0.7295990048299438
driven_any_median0.7295990048299438
driven_any_min0.7295990048299438
driven_lanedir_consec_max0.7222898911877377
driven_lanedir_consec_mean0.7222898911877377
driven_lanedir_consec_min0.7222898911877377
driven_lanedir_max0.7222898911877377
driven_lanedir_mean0.7222898911877377
driven_lanedir_median0.7222898911877377
driven_lanedir_min0.7222898911877377
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7295990048299438, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877377, "in-drivable-lane": 0.0, "deviation-heading": 1.417085318647224, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703784, "driven_lanedir_consec": 0.7222898911877377}}
simulation-passed1
survival_time_max13.200000000000053
survival_time_mean13.200000000000053
survival_time_min13.200000000000053
No reset possible
10629838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091626784820886
deviation-center-line_median5.917240573756968


other stats
deviation-center-line_max5.917240573756968
deviation-center-line_mean5.917240573756968
deviation-center-line_min5.917240573756968
deviation-heading_max8.389433025698892
deviation-heading_mean8.389433025698892
deviation-heading_median8.389433025698892
deviation-heading_min8.389433025698892
distance-from-start_max1.0307831250305386
distance-from-start_mean1.0307831250305386
distance-from-start_median1.0307831250305386
distance-from-start_min1.0307831250305386
driven_any_max3.4490819837243656
driven_any_mean3.4490819837243656
driven_any_median3.4490819837243656
driven_any_min3.4490819837243656
driven_lanedir_consec_max2.091626784820886
driven_lanedir_consec_mean2.091626784820886
driven_lanedir_consec_min2.091626784820886
driven_lanedir_max3.203992280226659
driven_lanedir_mean3.203992280226659
driven_lanedir_median3.203992280226659
driven_lanedir_min3.203992280226659
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10589839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10535839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.460:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10291840Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.460:21:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.92499999999992
driven_lanedir_consec_median1.6962974393876302
deviation-center-line_median5.6660077048179875


other stats
deviation-center-line_max9.920539816203728
deviation-center-line_mean6.424810657621769
deviation-center-line_min4.446687404647375
deviation-heading_max10.760072335048156
deviation-heading_mean7.75849277281716
deviation-heading_median9.162709521693651
deviation-heading_min1.9484797128331772
distance-from-start_max2.9523651631034435
distance-from-start_mean1.7043556043896877
distance-from-start_median1.5711589276694409
distance-from-start_min0.7227393991164262
driven_any_max3.524085546529847
driven_any_mean2.8239999291942457
driven_any_median3.4851575826810635
driven_any_min0.8015990048850082
driven_lanedir_consec_max3.348811260212561
driven_lanedir_consec_mean1.8837014899010265
driven_lanedir_consec_min0.7933998206162842
driven_lanedir_max3.351348627110138
driven_lanedir_mean2.6742463059555184
driven_lanedir_median3.276118388047826
driven_lanedir_min0.7933998206162842
in-drivable-lane_max4.299999999999898
in-drivable-lane_mean2.0374999999999344
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.5197332868688487, "survival_time": 59.99999999999873, "driven_lanedir": 3.351348627110138, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 9.476018293244575, "distance-from-start": 2.0738235372013047, "deviation-center-line": 4.446687404647375, "driven_lanedir_consec": 2.179559038524113}, "zigzag-000-ego1": {"driven_any": 3.4505818784932787, "survival_time": 59.99999999999873, "driven_lanedir": 3.203425515883091, "in-drivable-lane": 4.299999999999898, "deviation-heading": 8.84940075014273, "distance-from-start": 1.068494318137577, "deviation-center-line": 5.899268750309402, "driven_lanedir_consec": 1.2130358402511474}, "zigzag-000-ego2": {"driven_any": 0.8015990048850082, "survival_time": 59.99999999999873, "driven_lanedir": 0.7933998206162842, "in-drivable-lane": 0.0, "deviation-heading": 1.9484797128331772, "distance-from-start": 0.7227393991164262, "deviation-center-line": 9.920539816203728, "driven_lanedir_consec": 0.7933998206162842}, "zigzag-000-ego3": {"driven_any": 3.524085546529847, "survival_time": 59.99999999999873, "driven_lanedir": 3.348811260212561, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 10.760072335048156, "distance-from-start": 2.9523651631034435, "deviation-center-line": 5.432746659326572, "driven_lanedir_consec": 3.348811260212561}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10265841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-3of4successnodavinci-stage-04-6.2.460:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10173842Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091635105125694
deviation-center-line_median5.91724099846388


other stats
deviation-center-line_max5.91724099846388
deviation-center-line_mean5.91724099846388
deviation-center-line_min5.91724099846388
deviation-heading_max8.389432963329451
deviation-heading_mean8.389432963329451
deviation-heading_median8.389432963329451
deviation-heading_min8.389432963329451
distance-from-start_max1.0307831055466792
distance-from-start_mean1.0307831055466792
distance-from-start_median1.0307831055466792
distance-from-start_min1.0307831055466792
driven_any_max3.449081983724458
driven_any_mean3.449081983724458
driven_any_median3.449081983724458
driven_any_min3.449081983724458
driven_lanedir_consec_max2.091635105125694
driven_lanedir_consec_mean2.091635105125694
driven_lanedir_consec_min2.091635105125694
driven_lanedir_max3.2040239450792463
driven_lanedir_mean3.2040239450792463
driven_lanedir_median3.2040239450792463
driven_lanedir_min3.2040239450792463
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.449081983724458, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040239450792463, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432963329451, "distance-from-start": 1.0307831055466792, "deviation-center-line": 5.91724099846388, "driven_lanedir_consec": 2.091635105125694}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10139844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-04-6.2.460:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10054843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successnodavinci-stage-04-6.2.460:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0499999999998835
driven_lanedir_consec_median2.5903446787225497
deviation-center-line_median4.845050204100621


other stats
deviation-center-line_max4.845050204100621
deviation-center-line_mean4.845050204100621
deviation-center-line_min4.845050204100621
deviation-heading_max5.268596966876985
deviation-heading_mean5.268596966876985
deviation-heading_median5.268596966876985
deviation-heading_min5.268596966876985
distance-from-start_max2.0328181009471
distance-from-start_mean2.0328181009471
distance-from-start_median2.0328181009471
distance-from-start_min2.0328181009471
driven_any_max3.5180872153630816
driven_any_mean3.5180872153630816
driven_any_median3.5180872153630816
driven_any_min3.5180872153630816
driven_lanedir_consec_max2.5903446787225497
driven_lanedir_consec_mean2.5903446787225497
driven_lanedir_consec_min2.5903446787225497
driven_lanedir_max3.3813728794222344
driven_lanedir_mean3.3813728794222344
driven_lanedir_median3.3813728794222344
driven_lanedir_min3.3813728794222344
in-drivable-lane_max2.0499999999998835
in-drivable-lane_mean2.0499999999998835
in-drivable-lane_min2.0499999999998835
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5180872153630816, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813728794222344, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.268596966876985, "distance-from-start": 2.0328181009471, "deviation-center-line": 4.845050204100621, "driven_lanedir_consec": 2.5903446787225497}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10019844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-0of4host-errornodavinci-stage-04-6.2.460:00:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9848845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median3.1375523833453323
deviation-center-line_median5.303403086153199


other stats
deviation-center-line_max5.768512378827251
deviation-center-line_mean5.317250841410395
deviation-center-line_min4.8936848145079335
deviation-heading_max7.241657133894289
deviation-heading_mean4.871041152307471
deviation-heading_median4.326444806464443
deviation-heading_min3.5896178624067088
distance-from-start_max2.8752332419301623
distance-from-start_mean2.179559752231285
distance-from-start_median2.128871896043904
distance-from-start_min1.58526197490717
driven_any_max3.5465916471185097
driven_any_mean3.2177189075870865
driven_any_median3.215844330234903
driven_any_min2.8925953227600307
driven_lanedir_consec_max3.446981475702289
driven_lanedir_consec_mean3.1459203042368187
driven_lanedir_consec_min2.86159497455432
driven_lanedir_max3.446981475702289
driven_lanedir_mean3.1530896237663053
driven_lanedir_median3.146203629193863
driven_lanedir_min2.8729697609752045
in-drivable-lane_max2.349999999999945
in-drivable-lane_mean0.86249999999999
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.922595524241338, "survival_time": 59.99999999999873, "driven_lanedir": 2.9054993634872437, "in-drivable-lane": 0.0, "deviation-heading": 3.5896178624067088, "distance-from-start": 1.58526197490717, "deviation-center-line": 5.092329076449342, "driven_lanedir_consec": 2.8881969363835927}, "udem-001-ego1": {"driven_any": 2.8925953227600307, "survival_time": 59.99999999999873, "driven_lanedir": 2.8729697609752045, "in-drivable-lane": 0.0, "deviation-heading": 3.9504852000994535, "distance-from-start": 1.5897417389314648, "deviation-center-line": 4.8936848145079335, "driven_lanedir_consec": 2.86159497455432}, "udem-001-ego2": {"driven_any": 3.5090931362284685, "survival_time": 59.99999999999873, "driven_lanedir": 3.3869078949004825, "in-drivable-lane": 2.349999999999945, "deviation-heading": 4.702404412829432, "distance-from-start": 2.6680020531563433, "deviation-center-line": 5.768512378827251, "driven_lanedir_consec": 3.386907830307072}, "udem-001-ego3": {"driven_any": 3.5465916471185097, "survival_time": 59.99999999999873, "driven_lanedir": 3.446981475702289, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.241657133894289, "distance-from-start": 2.8752332419301623, "deviation-center-line": 5.514477095857055, "driven_lanedir_consec": 3.446981475702289}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9724847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation345successyesdavinci-stage-04-6.2.460:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.354349999154554
deviation-center-line_median6.1904900915885825


other stats
deviation-center-line_max7.342897137212387
deviation-center-line_mean5.815429153599174
deviation-center-line_min3.5378392940071444
deviation-heading_max8.643847239934157
deviation-heading_mean5.769308033824521
deviation-heading_median5.462417882322539
deviation-heading_min3.5085491307188437
distance-from-start_max2.1932800589165744
distance-from-start_mean1.7770214145992558
distance-from-start_median1.7822126331012849
distance-from-start_min1.3503803332778783
driven_any_max3.519587859801343
driven_any_mean3.0189647101082344
driven_any_median3.38758803636824
driven_any_min1.7810949078951157
driven_lanedir_consec_max3.321041838958641
driven_lanedir_consec_mean2.428232836144684
driven_lanedir_consec_min1.6831895073109888
driven_lanedir_max3.387629081863654
driven_lanedir_mean2.883329777932324
driven_lanedir_median3.231250261277327
driven_lanedir_min1.6831895073109888
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.2780872163787773, "survival_time": 59.99999999999873, "driven_lanedir": 3.1414586835960128, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.270318376228316, "distance-from-start": 2.1932800589165744, "deviation-center-line": 3.5378392940071444, "driven_lanedir_consec": 2.5904401579936844}, "autolab-000-ego1": {"driven_any": 1.7810949078951157, "survival_time": 59.99999999999873, "driven_lanedir": 1.6831895073109888, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.5085491307188437, "distance-from-start": 1.3503803332778783, "deviation-center-line": 7.342897137212387, "driven_lanedir_consec": 1.6831895073109888}, "autolab-000-ego2": {"driven_any": 3.4970888563577023, "survival_time": 59.99999999999873, "driven_lanedir": 3.321041838958641, "in-drivable-lane": 2.749999999999872, "deviation-heading": 8.643847239934157, "distance-from-start": 2.062725629892184, "deviation-center-line": 5.639409153019825, "driven_lanedir_consec": 3.321041838958641}, "autolab-000-ego3": {"driven_any": 3.519587859801343, "survival_time": 59.99999999999873, "driven_lanedir": 3.387629081863654, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654517388416762, "distance-from-start": 1.5016996363103856, "deviation-center-line": 6.74157103015734, "driven_lanedir_consec": 2.1182598403154227}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9634848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-0of4successnodavinci-stage-04-6.2.460:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.99999999999901
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.420452979729076
deviation-center-line_median4.299642636408967


other stats
deviation-center-line_max4.299642636408967
deviation-center-line_mean4.299642636408967
deviation-center-line_min4.299642636408967
deviation-heading_max7.737882401817608
deviation-heading_mean7.737882401817608
deviation-heading_median7.737882401817608
deviation-heading_min7.737882401817608
distance-from-start_max1.206000789659136
distance-from-start_mean1.206000789659136
distance-from-start_median1.206000789659136
distance-from-start_min1.206000789659136
driven_any_max3.1430848844498547
driven_any_mean3.1430848844498547
driven_any_median3.1430848844498547
driven_any_min3.1430848844498547
driven_lanedir_consec_max1.420452979729076
driven_lanedir_consec_mean1.420452979729076
driven_lanedir_consec_min1.420452979729076
driven_lanedir_max2.9486964161761877
driven_lanedir_mean2.9486964161761877
driven_lanedir_median2.9486964161761877
driven_lanedir_min2.9486964161761877
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.1430848844498547, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486964161761877, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.737882401817608, "distance-from-start": 1.206000789659136, "deviation-center-line": 4.299642636408967, "driven_lanedir_consec": 1.420452979729076}}
simulation-passed1
survival_time_max54.99999999999901
survival_time_mean54.99999999999901
survival_time_min54.99999999999901
No reset possible
9538850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.460:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1500000000000163
driven_lanedir_consec_median3.1664224879101597
deviation-center-line_median4.250268254472467


other stats
deviation-center-line_max4.250268254472467
deviation-center-line_mean4.250268254472467
deviation-center-line_min4.250268254472467
deviation-heading_max6.786712714590221
deviation-heading_mean6.786712714590221
deviation-heading_median6.786712714590221
deviation-heading_min6.786712714590221
distance-from-start_max2.581801799408845
distance-from-start_mean2.581801799408845
distance-from-start_median2.581801799408845
distance-from-start_min2.581801799408845
driven_any_max3.5450774401287584
driven_any_mean3.5450774401287584
driven_any_median3.5450774401287584
driven_any_min3.5450774401287584
driven_lanedir_consec_max3.1664224879101597
driven_lanedir_consec_mean3.1664224879101597
driven_lanedir_consec_min3.1664224879101597
driven_lanedir_max3.428172822833071
driven_lanedir_mean3.428172822833071
driven_lanedir_median3.428172822833071
driven_lanedir_min3.428172822833071
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean1.1500000000000163
in-drivable-lane_min1.1500000000000163
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5450774401287584, "survival_time": 59.99999999999873, "driven_lanedir": 3.428172822833071, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 6.786712714590221, "distance-from-start": 2.581801799408845, "deviation-center-line": 4.250268254472467, "driven_lanedir_consec": 3.1664224879101597}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9511850Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-2of4successnodavinci-stage-04-6.2.460:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
9343851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-1of4successnodavinci-stage-04-6.2.460:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.524999999999913
driven_lanedir_consec_median3.308912230691319
deviation-center-line_median5.839787488914961


other stats
deviation-center-line_max6.75698913278279
deviation-center-line_mean5.607974470532437
deviation-center-line_min3.995333771517034
deviation-heading_max5.165930098360049
deviation-heading_mean3.4922882996813627
deviation-heading_median3.1489691860187023
deviation-heading_min2.505284728327996
distance-from-start_max2.844526796079213
distance-from-start_mean2.6321833509136905
distance-from-start_median2.6691116440946443
distance-from-start_min2.345983319386262
driven_any_max3.546596859746292
driven_any_mean3.3294948001229945
driven_any_median3.4483923771628326
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.48918283336121
driven_lanedir_consec_mean3.2409226052967446
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.4891830167308333
driven_lanedir_mean3.240922684725338
driven_lanedir_median3.3089122779817615
driven_lanedir_min2.856683166206994
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean1.6624999999999472
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "udem-000-ego1": {"driven_any": 3.4250950541374743, "survival_time": 59.99999999999873, "driven_lanedir": 3.325682803155688, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2941102114411605, "distance-from-start": 2.844526796079213, "deviation-center-line": 6.15361634775796, "driven_lanedir_consec": 3.325682803155688}, "udem-000-ego2": {"driven_any": 3.546596859746292, "survival_time": 59.99999999999873, "driven_lanedir": 3.4891830167308333, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.505284728327996, "distance-from-start": 2.6431774016078946, "deviation-center-line": 3.995333771517034, "driven_lanedir_consec": 3.48918283336121}, "udem-000-ego3": {"driven_any": 3.4716897001881915, "survival_time": 59.99999999999873, "driven_lanedir": 3.2921417528078356, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165930098360049, "distance-from-start": 2.6950458865813935, "deviation-center-line": 6.75698913278279, "driven_lanedir_consec": 3.29214165822695}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9205860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-04-6.2.460:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.200000000000134
in-drivable-lane_median13.850000000000117
driven_lanedir_consec_median0.172391103681939
deviation-center-line_median0.4257961412678387


other stats
deviation-center-line_max0.4257961412678387
deviation-center-line_mean0.4257961412678387
deviation-center-line_min0.4257961412678387
deviation-heading_max4.544107207983272
deviation-heading_mean4.544107207983272
deviation-heading_median4.544107207983272
deviation-heading_min4.544107207983272
distance-from-start_max0.3635225569425481
distance-from-start_mean0.3635225569425481
distance-from-start_median0.3635225569425481
distance-from-start_min0.3635225569425481
driven_any_max1.789585893596688
driven_any_mean1.789585893596688
driven_any_median1.789585893596688
driven_any_min1.789585893596688
driven_lanedir_consec_max0.172391103681939
driven_lanedir_consec_mean0.172391103681939
driven_lanedir_consec_min0.172391103681939
driven_lanedir_max0.27634781290939325
driven_lanedir_mean0.27634781290939325
driven_lanedir_median0.27634781290939325
driven_lanedir_min0.27634781290939325
in-drivable-lane_max13.850000000000117
in-drivable-lane_mean13.850000000000117
in-drivable-lane_min13.850000000000117
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.789585893596688, "survival_time": 19.200000000000134, "driven_lanedir": 0.27634781290939325, "in-drivable-lane": 13.850000000000117, "deviation-heading": 4.544107207983272, "distance-from-start": 0.3635225569425481, "deviation-center-line": 0.4257961412678387, "driven_lanedir_consec": 0.172391103681939}}
simulation-passed1
survival_time_max19.200000000000134
survival_time_mean19.200000000000134
survival_time_min19.200000000000134
No reset possible
9096852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4successnodavinci-stage-04-6.2.460:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.999999999999865
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.2478265130959194
deviation-center-line_median5.152132780323252


other stats
deviation-center-line_max5.152132780323252
deviation-center-line_mean5.152132780323252
deviation-center-line_min5.152132780323252
deviation-heading_max2.495559265059334
deviation-heading_mean2.495559265059334
deviation-heading_median2.495559265059334
deviation-heading_min2.495559265059334
distance-from-start_max1.7870695980437394
distance-from-start_mean1.7870695980437394
distance-from-start_median1.7870695980437394
distance-from-start_min1.7870695980437394
driven_any_max2.3045969519229774
driven_any_mean2.3045969519229774
driven_any_median2.3045969519229774
driven_any_min2.3045969519229774
driven_lanedir_consec_max2.2478265130959194
driven_lanedir_consec_mean2.2478265130959194
driven_lanedir_consec_min2.2478265130959194
driven_lanedir_max2.2478265130959194
driven_lanedir_mean2.2478265130959194
driven_lanedir_median2.2478265130959194
driven_lanedir_min2.2478265130959194
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-001-ego0": {"driven_any": 2.3045969519229774, "survival_time": 39.999999999999865, "driven_lanedir": 2.2478265130959194, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.495559265059334, "distance-from-start": 1.7870695980437394, "deviation-center-line": 5.152132780323252, "driven_lanedir_consec": 2.2478265130959194}}
simulation-passed1
survival_time_max39.999999999999865
survival_time_mean39.999999999999865
survival_time_min39.999999999999865
No reset possible