Duckietown Challenges Home Challenges Submissions

Evaluator 101

ID101
evaluatordavinci-stage-02-6.2.46
owneruser1000001
machinedavinci-stage
processdavinci-stage-02-6.2.46
version6.2.46
first heard
last heard
statusinactive
# evaluating
# success56 9082
# timeout1 11946
# failed2 11787
# error
# aborted
# host-error2 9230
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors85%
RAM total (MB)251.6 GB
RAM free (MB)229.5 GB
Disk (MB)491.1 GB
Disk available (MB)236.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11946745Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-3of4timeoutnodavinci-stage-02-6.2.46----No reset possible
11928763Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.460:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.03059452042078714
deviation-center-line_median0.005589718966405544


other stats
deviation-center-line_max0.005589718966405544
deviation-center-line_mean0.005589718966405544
deviation-center-line_min0.005589718966405544
deviation-heading_max0.25777352746122356
deviation-heading_mean0.25777352746122356
deviation-heading_median0.25777352746122356
deviation-heading_min0.25777352746122356
distance-from-start_max0.03470011857015614
distance-from-start_mean0.03470011857015614
distance-from-start_median0.03470011857015614
distance-from-start_min0.03470011857015614
driven_any_max0.03470306042420724
driven_any_mean0.03470306042420724
driven_any_median0.03470306042420724
driven_any_min0.03470306042420724
driven_lanedir_consec_max0.03059452042078714
driven_lanedir_consec_mean0.03059452042078714
driven_lanedir_consec_min0.03059452042078714
driven_lanedir_max0.03059452042078714
driven_lanedir_mean0.03059452042078714
driven_lanedir_median0.03059452042078714
driven_lanedir_min0.03059452042078714
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03470306042420724, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03059452042078714, "in-drivable-lane": 0.0, "deviation-heading": 0.25777352746122356, "distance-from-start": 0.03470011857015614, "deviation-center-line": 0.005589718966405544, "driven_lanedir_consec": 0.03059452042078714}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11926765Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802aido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.460:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02119228463694789
deviation-center-line_median0.005461910667399036


other stats
deviation-center-line_max0.005461910667399036
deviation-center-line_mean0.005461910667399036
deviation-center-line_min0.005461910667399036
deviation-heading_max0.3109294887465121
deviation-heading_mean0.3109294887465121
deviation-heading_median0.3109294887465121
deviation-heading_min0.3109294887465121
distance-from-start_max0.02841204510534442
distance-from-start_mean0.02841204510534442
distance-from-start_median0.02841204510534442
distance-from-start_min0.02841204510534442
driven_any_max0.028559154519486617
driven_any_mean0.028559154519486617
driven_any_median0.028559154519486617
driven_any_min0.028559154519486617
driven_lanedir_consec_max0.02119228463694789
driven_lanedir_consec_mean0.02119228463694789
driven_lanedir_consec_min0.02119228463694789
driven_lanedir_max0.02119228463694789
driven_lanedir_mean0.02119228463694789
driven_lanedir_median0.02119228463694789
driven_lanedir_min0.02119228463694789
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.028559154519486617, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02119228463694789, "in-drivable-lane": 0.0, "deviation-heading": 0.3109294887465121, "distance-from-start": 0.02841204510534442, "deviation-center-line": 0.005461910667399036, "driven_lanedir_consec": 0.02119228463694789}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11922768Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484aido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.460:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.009278681037743208
deviation-center-line_median0.007005513692561462


other stats
deviation-center-line_max0.007005513692561462
deviation-center-line_mean0.007005513692561462
deviation-center-line_min0.007005513692561462
deviation-heading_max0.26336905085970874
deviation-heading_mean0.26336905085970874
deviation-heading_median0.26336905085970874
deviation-heading_min0.26336905085970874
distance-from-start_max0.010492587570749548
distance-from-start_mean0.010492587570749548
distance-from-start_median0.010492587570749548
distance-from-start_min0.010492587570749548
driven_any_max0.010496654309411447
driven_any_mean0.010496654309411447
driven_any_median0.010496654309411447
driven_any_min0.010496654309411447
driven_lanedir_consec_max0.009278681037743208
driven_lanedir_consec_mean0.009278681037743208
driven_lanedir_consec_min0.009278681037743208
driven_lanedir_max0.009278681037743208
driven_lanedir_mean0.009278681037743208
driven_lanedir_median0.009278681037743208
driven_lanedir_min0.009278681037743208
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.010496654309411447, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009278681037743208, "in-drivable-lane": 0.0, "deviation-heading": 0.26336905085970874, "distance-from-start": 0.010492587570749548, "deviation-center-line": 0.007005513692561462, "driven_lanedir_consec": 0.009278681037743208}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11913771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:14:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353262


other stats
deviation-center-line_max0.8948975282353262
deviation-center-line_mean0.8948975282353262
deviation-center-line_min0.8948975282353262
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11906772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-1of4successnodavinci-stage-02-6.2.460:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median34.40000000000018
in-drivable-lane_median6.599999999999973
driven_lanedir_consec_median2.629714897484002
deviation-center-line_median1.6678459219291568


other stats
deviation-center-line_max1.6678459219291568
deviation-center-line_mean1.6678459219291568
deviation-center-line_min1.6678459219291568
deviation-heading_max5.654700257785572
deviation-heading_mean5.654700257785572
deviation-heading_median5.654700257785572
deviation-heading_min5.654700257785572
distance-from-start_max2.554354723616289
distance-from-start_mean2.554354723616289
distance-from-start_median2.554354723616289
distance-from-start_min2.554354723616289
driven_any_max4.4224854258072535
driven_any_mean4.4224854258072535
driven_any_median4.4224854258072535
driven_any_min4.4224854258072535
driven_lanedir_consec_max2.629714897484002
driven_lanedir_consec_mean2.629714897484002
driven_lanedir_consec_min2.629714897484002
driven_lanedir_max3.460630688749065
driven_lanedir_mean3.460630688749065
driven_lanedir_median3.460630688749065
driven_lanedir_min3.460630688749065
in-drivable-lane_max6.599999999999973
in-drivable-lane_mean6.599999999999973
in-drivable-lane_min6.599999999999973
per-episodes
details{"4way-000-ego0": {"driven_any": 4.4224854258072535, "survival_time": 34.40000000000018, "driven_lanedir": 3.460630688749065, "in-drivable-lane": 6.599999999999973, "deviation-heading": 5.654700257785572, "distance-from-start": 2.554354723616289, "deviation-center-line": 1.6678459219291568, "driven_lanedir_consec": 2.629714897484002}}
simulation-passed1
survival_time_max34.40000000000018
survival_time_mean34.40000000000018
survival_time_min34.40000000000018
No reset possible
11903773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11902773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11900775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-02-6.2.460:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.450000000000028
in-drivable-lane_median0.6999999999999983
driven_lanedir_consec_median0.4133514852526836
deviation-center-line_median1.2642205282290808


other stats
deviation-center-line_max1.6422748961513538
deviation-center-line_mean1.1666750531182484
deviation-center-line_min0.4959842598634781
deviation-heading_max12.464231805340384
deviation-heading_mean8.098285563349222
deviation-heading_median8.898018071147316
deviation-heading_min2.1328743057618693
distance-from-start_max1.1444318772870006
distance-from-start_mean0.5987756660476432
distance-from-start_median0.4299417776705759
distance-from-start_min0.3907872315624206
driven_any_max1.375479220433876
driven_any_mean0.7149251631440889
driven_any_median0.5356572420914834
driven_any_min0.41290694795951305
driven_lanedir_consec_max1.2618067560075457
driven_lanedir_consec_mean0.5984543174522505
driven_lanedir_consec_min0.305307543296089
driven_lanedir_max1.2618067560075457
driven_lanedir_mean0.5984543174522505
driven_lanedir_median0.4133514852526836
driven_lanedir_min0.305307543296089
in-drivable-lane_max1.200000000000017
in-drivable-lane_mean0.6500000000000035
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.375479220433876, "survival_time": 11.450000000000028, "driven_lanedir": 1.2618067560075457, "in-drivable-lane": 1.200000000000017, "deviation-heading": 2.1328743057618693, "distance-from-start": 1.1444318772870006, "deviation-center-line": 0.4959842598634781, "driven_lanedir_consec": 1.2618067560075457}, "udem-000-ego1": {"driven_any": 0.47923704234245645, "survival_time": 11.450000000000028, "driven_lanedir": 0.305307543296089, "in-drivable-lane": 0.7499999999999989, "deviation-heading": 7.946675469391188, "distance-from-start": 0.40078970362846345, "deviation-center-line": 1.3459702966024352, "driven_lanedir_consec": 0.305307543296089}, "udem-000-ego2": {"driven_any": 0.41290694795951305, "survival_time": 11.450000000000028, "driven_lanedir": 0.3657344090323482, "in-drivable-lane": 0.0, "deviation-heading": 12.464231805340384, "distance-from-start": 0.3907872315624206, "deviation-center-line": 1.6422748961513538, "driven_lanedir_consec": 0.3657344090323482}, "udem-000-ego3": {"driven_any": 0.5920774418405103, "survival_time": 11.450000000000028, "driven_lanedir": 0.460968561473019, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 9.849360672903442, "distance-from-start": 0.45909385171268846, "deviation-center-line": 1.1824707598557265, "driven_lanedir_consec": 0.460968561473019}}
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean11.450000000000028
survival_time_min11.450000000000028
No reset possible
11898775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11884777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.0499999999999
driven_lanedir_consec_median6.595792992854295
deviation-center-line_median4.202486072587921


other stats
deviation-center-line_max4.202486072587921
deviation-center-line_mean4.202486072587921
deviation-center-line_min4.202486072587921
deviation-heading_max12.75685804799978
deviation-heading_mean12.75685804799978
deviation-heading_median12.75685804799978
deviation-heading_min12.75685804799978
distance-from-start_max2.83697826197125
distance-from-start_mean2.83697826197125
distance-from-start_median2.83697826197125
distance-from-start_min2.83697826197125
driven_any_max7.907740670517925
driven_any_mean7.907740670517925
driven_any_median7.907740670517925
driven_any_min7.907740670517925
driven_lanedir_consec_max6.595792992854295
driven_lanedir_consec_mean6.595792992854295
driven_lanedir_consec_min6.595792992854295
driven_lanedir_max6.828839538675067
driven_lanedir_mean6.828839538675067
driven_lanedir_median6.828839538675067
driven_lanedir_min6.828839538675067
in-drivable-lane_max5.0499999999999
in-drivable-lane_mean5.0499999999999
in-drivable-lane_min5.0499999999999
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.907740670517925, "survival_time": 59.99999999999873, "driven_lanedir": 6.828839538675067, "in-drivable-lane": 5.0499999999999, "deviation-heading": 12.75685804799978, "distance-from-start": 2.83697826197125, "deviation-center-line": 4.202486072587921, "driven_lanedir_consec": 6.595792992854295}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11877777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4successnodavinci-stage-02-6.2.460:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.300000000000153
in-drivable-lane_median18.60000000000015
driven_lanedir_consec_median0.12252303784042208
deviation-center-line_median0.11808274737603992


other stats
deviation-center-line_max0.11808274737603992
deviation-center-line_mean0.11808274737603992
deviation-center-line_min0.11808274737603992
deviation-heading_max1.212549030511736
deviation-heading_mean1.212549030511736
deviation-heading_median1.212549030511736
deviation-heading_min1.212549030511736
distance-from-start_max1.2760332200245663
distance-from-start_mean1.2760332200245663
distance-from-start_median1.2760332200245663
distance-from-start_min1.2760332200245663
driven_any_max2.5438214489648594
driven_any_mean2.5438214489648594
driven_any_median2.5438214489648594
driven_any_min2.5438214489648594
driven_lanedir_consec_max0.12252303784042208
driven_lanedir_consec_mean0.12252303784042208
driven_lanedir_consec_min0.12252303784042208
driven_lanedir_max0.12252303784042208
driven_lanedir_mean0.12252303784042208
driven_lanedir_median0.12252303784042208
driven_lanedir_min0.12252303784042208
in-drivable-lane_max18.60000000000015
in-drivable-lane_mean18.60000000000015
in-drivable-lane_min18.60000000000015
per-episodes
details{"loop-000-ego0": {"driven_any": 2.5438214489648594, "survival_time": 20.300000000000153, "driven_lanedir": 0.12252303784042208, "in-drivable-lane": 18.60000000000015, "deviation-heading": 1.212549030511736, "distance-from-start": 1.2760332200245663, "deviation-center-line": 0.11808274737603992, "driven_lanedir_consec": 0.12252303784042208}}
simulation-passed1
survival_time_max20.300000000000153
survival_time_mean20.300000000000153
survival_time_min20.300000000000153
No reset possible
11873778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4successnodavinci-stage-02-6.2.460:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.84999999999998
in-drivable-lane_median5.099999999999982
driven_lanedir_consec_median0.2281465692051801
deviation-center-line_median0.2458662450241987


other stats
deviation-center-line_max0.2458662450241987
deviation-center-line_mean0.2458662450241987
deviation-center-line_min0.2458662450241987
deviation-heading_max1.7538321023418728
deviation-heading_mean1.7538321023418728
deviation-heading_median1.7538321023418728
deviation-heading_min1.7538321023418728
distance-from-start_max0.7504458143219682
distance-from-start_mean0.7504458143219682
distance-from-start_median0.7504458143219682
distance-from-start_min0.7504458143219682
driven_any_max0.8975361152531085
driven_any_mean0.8975361152531085
driven_any_median0.8975361152531085
driven_any_min0.8975361152531085
driven_lanedir_consec_max0.2281465692051801
driven_lanedir_consec_mean0.2281465692051801
driven_lanedir_consec_min0.2281465692051801
driven_lanedir_max0.2349211893410308
driven_lanedir_mean0.2349211893410308
driven_lanedir_median0.2349211893410308
driven_lanedir_min0.2349211893410308
in-drivable-lane_max5.099999999999982
in-drivable-lane_mean5.099999999999982
in-drivable-lane_min5.099999999999982
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8975361152531085, "survival_time": 7.84999999999998, "driven_lanedir": 0.2349211893410308, "in-drivable-lane": 5.099999999999982, "deviation-heading": 1.7538321023418728, "distance-from-start": 0.7504458143219682, "deviation-center-line": 0.2458662450241987, "driven_lanedir_consec": 0.2281465692051801}}
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean7.84999999999998
survival_time_min7.84999999999998
No reset possible
11808779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:12:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.39999999999997726
driven_lanedir_consec_median6.406138458956091
deviation-center-line_median3.792630774745968


other stats
deviation-center-line_max3.792630774745968
deviation-center-line_mean3.792630774745968
deviation-center-line_min3.792630774745968
deviation-heading_max10.786728798082512
deviation-heading_mean10.786728798082512
deviation-heading_median10.786728798082512
deviation-heading_min10.786728798082512
distance-from-start_max2.9361509547431393
distance-from-start_mean2.9361509547431393
distance-from-start_median2.9361509547431393
distance-from-start_min2.9361509547431393
driven_any_max7.914367654242932
driven_any_mean7.914367654242932
driven_any_median7.914367654242932
driven_any_min7.914367654242932
driven_lanedir_consec_max6.406138458956091
driven_lanedir_consec_mean6.406138458956091
driven_lanedir_consec_min6.406138458956091
driven_lanedir_max7.537363816047078
driven_lanedir_mean7.537363816047078
driven_lanedir_median7.537363816047078
driven_lanedir_min7.537363816047078
in-drivable-lane_max0.39999999999997726
in-drivable-lane_mean0.39999999999997726
in-drivable-lane_min0.39999999999997726
per-episodes
details{"udem-000-ego0": {"driven_any": 7.914367654242932, "survival_time": 59.99999999999873, "driven_lanedir": 7.537363816047078, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 10.786728798082512, "distance-from-start": 2.9361509547431393, "deviation-center-line": 3.792630774745968, "driven_lanedir_consec": 6.406138458956091}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11804780Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
11799782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-1of4successnodavinci-stage-02-6.2.460:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.250000000000025
in-drivable-lane_median1.250000000000016
driven_lanedir_consec_median0.43859224629881666
deviation-center-line_median0.7885102299338609


other stats
deviation-center-line_max0.9536702696243732
deviation-center-line_mean0.6647487461760964
deviation-center-line_min0.12830425521229072
deviation-heading_max8.125427807001703
deviation-heading_mean4.8155462190267215
deviation-heading_median5.150157834661471
deviation-heading_min0.8364413997822427
distance-from-start_max1.144807682203056
distance-from-start_mean0.5612532869618118
distance-from-start_median0.4416439955332233
distance-from-start_min0.2169174745777445
driven_any_max1.3488887811096872
driven_any_mean0.63527416602065
driven_any_median0.4693184148345353
driven_any_min0.2535710533038423
driven_lanedir_consec_max0.9185979926200272
driven_lanedir_consec_mean0.5013910928185102
driven_lanedir_consec_min0.20978188605638048
driven_lanedir_max0.9251013929161104
driven_lanedir_mean0.5030169428925311
driven_lanedir_median0.43859224629881666
driven_lanedir_min0.20978188605638048
in-drivable-lane_max6.950000000000032
in-drivable-lane_mean2.362500000000016
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.2535710533038423, "survival_time": 11.250000000000025, "driven_lanedir": 0.20978188605638048, "in-drivable-lane": 0.0, "deviation-heading": 6.941135668749319, "distance-from-start": 0.2169174745777445, "deviation-center-line": 0.8730869797774721, "driven_lanedir_consec": 0.20978188605638048}, "4way-000-ego1": {"driven_any": 0.4195412317744449, "survival_time": 11.250000000000025, "driven_lanedir": 0.4017382771236513, "in-drivable-lane": 0.0, "deviation-heading": 8.125427807001703, "distance-from-start": 0.4019210410178838, "deviation-center-line": 0.9536702696243732, "driven_lanedir_consec": 0.4017382771236513}, "4way-000-ego2": {"driven_any": 0.5190955978946257, "survival_time": 11.250000000000025, "driven_lanedir": 0.475446215473982, "in-drivable-lane": 6.950000000000032, "deviation-heading": 0.8364413997822427, "distance-from-start": 0.4813669500485629, "deviation-center-line": 0.12830425521229072, "driven_lanedir_consec": 0.475446215473982}, "4way-000-ego3": {"driven_any": 1.3488887811096872, "survival_time": 11.250000000000025, "driven_lanedir": 0.9251013929161104, "in-drivable-lane": 2.500000000000032, "deviation-heading": 3.3591800005736228, "distance-from-start": 1.144807682203056, "deviation-center-line": 0.7039334800902496, "driven_lanedir_consec": 0.9185979926200272}}
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean11.250000000000025
survival_time_min11.250000000000025
No reset possible
11796791Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71daido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.460:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.013220226681785352
deviation-center-line_median0.006545250944492689


other stats
deviation-center-line_max0.006545250944492689
deviation-center-line_mean0.006545250944492689
deviation-center-line_min0.006545250944492689
deviation-heading_max0.2645649530541569
deviation-heading_mean0.2645649530541569
deviation-heading_median0.2645649530541569
deviation-heading_min0.2645649530541569
distance-from-start_max0.0150786463098234
distance-from-start_mean0.0150786463098234
distance-from-start_median0.0150786463098234
distance-from-start_min0.0150786463098234
driven_any_max0.015084437929537668
driven_any_mean0.015084437929537668
driven_any_median0.015084437929537668
driven_any_min0.015084437929537668
driven_lanedir_consec_max0.013220226681785352
driven_lanedir_consec_mean0.013220226681785352
driven_lanedir_consec_min0.013220226681785352
driven_lanedir_max0.013220226681785352
driven_lanedir_mean0.013220226681785352
driven_lanedir_median0.013220226681785352
driven_lanedir_min0.013220226681785352
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.015084437929537668, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013220226681785352, "in-drivable-lane": 0.0, "deviation-heading": 0.2645649530541569, "distance-from-start": 0.0150786463098234, "deviation-center-line": 0.006545250944492689, "driven_lanedir_consec": 0.013220226681785352}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11790800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednodavinci-stage-02-6.2.460:04:43
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11787801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednodavinci-stage-02-6.2.460:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11779804Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2aido-hello-sim-validationsanity-checksuccessnodavinci-stage-02-6.2.460:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.06148731405559315
deviation-center-line_median0.006535749059604603


other stats
deviation-center-line_max0.006535749059604603
deviation-center-line_mean0.006535749059604603
deviation-center-line_min0.006535749059604603
deviation-heading_max0.24864805731739287
deviation-heading_mean0.24864805731739287
deviation-heading_median0.24864805731739287
deviation-heading_min0.24864805731739287
distance-from-start_max0.06854722017944499
distance-from-start_mean0.06854722017944499
distance-from-start_median0.06854722017944499
distance-from-start_min0.06854722017944499
driven_any_max0.06857994813955536
driven_any_mean0.06857994813955536
driven_any_median0.06857994813955536
driven_any_min0.06857994813955536
driven_lanedir_consec_max0.06148731405559315
driven_lanedir_consec_mean0.06148731405559315
driven_lanedir_consec_min0.06148731405559315
driven_lanedir_max0.06148731405559315
driven_lanedir_mean0.06148731405559315
driven_lanedir_median0.06148731405559315
driven_lanedir_min0.06148731405559315
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.06857994813955536, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06148731405559315, "in-drivable-lane": 0.0, "deviation-heading": 0.24864805731739287, "distance-from-start": 0.06854722017944499, "deviation-center-line": 0.006535749059604603, "driven_lanedir_consec": 0.06148731405559315}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
11775806user1000001minimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.460:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
11760809Andrea Censitemplate-randomaido-LFV-sim-validationsim-1of4successnodavinci-stage-02-6.2.460:12:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.271834711171973
deviation-center-line_median0.7655520909538922


other stats
deviation-center-line_max0.7655520909538922
deviation-center-line_mean0.7655520909538922
deviation-center-line_min0.7655520909538922
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max1.044224797669198
distance-from-start_mean1.044224797669198
distance-from-start_median1.044224797669198
distance-from-start_min1.044224797669198
driven_any_max11.376062002465094
driven_any_mean11.376062002465094
driven_any_median11.376062002465094
driven_any_min11.376062002465094
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.271834711171973
driven_lanedir_consec_min0.271834711171973
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.25382999559920805
driven_lanedir_median0.25382999559920805
driven_lanedir_min0.25382999559920805
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
11751811Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:05:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.7000000000003
in-drivable-lane_median10.200000000000143
driven_lanedir_consec_median2.204507029290708
deviation-center-line_median1.6198378353951173


other stats
deviation-center-line_max1.6198378353951173
deviation-center-line_mean1.6198378353951173
deviation-center-line_min1.6198378353951173
deviation-heading_max5.968465188687281
deviation-heading_mean5.968465188687281
deviation-heading_median5.968465188687281
deviation-heading_min5.968465188687281
distance-from-start_max1.150317558691735
distance-from-start_mean1.150317558691735
distance-from-start_median1.150317558691735
distance-from-start_min1.150317558691735
driven_any_max3.924408810241565
driven_any_mean3.924408810241565
driven_any_median3.924408810241565
driven_any_min3.924408810241565
driven_lanedir_consec_max2.204507029290708
driven_lanedir_consec_mean2.204507029290708
driven_lanedir_consec_min2.204507029290708
driven_lanedir_max2.450836588886575
driven_lanedir_mean2.450836588886575
driven_lanedir_median2.450836588886575
driven_lanedir_min2.450836588886575
in-drivable-lane_max10.200000000000143
in-drivable-lane_mean10.200000000000143
in-drivable-lane_min10.200000000000143
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.924408810241565, "survival_time": 30.7000000000003, "driven_lanedir": 2.450836588886575, "in-drivable-lane": 10.200000000000143, "deviation-heading": 5.968465188687281, "distance-from-start": 1.150317558691735, "deviation-center-line": 1.6198378353951173, "driven_lanedir_consec": 2.204507029290708}}
simulation-passed1
survival_time_max30.7000000000003
survival_time_mean30.7000000000003
survival_time_min30.7000000000003
No reset possible
11724812Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4successnodavinci-stage-02-6.2.460:14:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.8949084199909547


other stats
deviation-center-line_max0.8949084199909547
deviation-center-line_mean0.8949084199909547
deviation-center-line_min0.8949084199909547
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max9.714451465470121e-17
distance-from-start_mean9.714451465470121e-17
distance-from-start_median9.714451465470121e-17
distance-from-start_min9.714451465470121e-17
driven_any_max1.1657341758564146e-13
driven_any_mean1.1657341758564146e-13
driven_any_median1.1657341758564146e-13
driven_any_min1.1657341758564146e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.1657341758564146e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 9.714451465470121e-17, "deviation-center-line": 0.8949084199909547, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11712813Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6017417553703126e-06
survival_time_median59.99999999999873
deviation-center-line_median0.8949077950231444
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11706814Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4successnodavinci-stage-02-6.2.460:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8949084199908882
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949084199908882
deviation-center-line_mean0.8949084199908882
deviation-center-line_min0.8949084199908882
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.8949084199908882, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11702815Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.5342392748923
deviation-center-line_median0.219904045457012


other stats
deviation-center-line_max0.219904045457012
deviation-center-line_mean0.219904045457012
deviation-center-line_min0.219904045457012
deviation-heading_max2.302069906172969
deviation-heading_mean2.302069906172969
deviation-heading_median2.302069906172969
deviation-heading_min2.302069906172969
distance-from-start_max1.5178953029412718
distance-from-start_mean1.5178953029412718
distance-from-start_median1.5178953029412718
distance-from-start_min1.5178953029412718
driven_any_max5.543896156524706
driven_any_mean5.543896156524706
driven_any_median5.543896156524706
driven_any_min5.543896156524706
driven_lanedir_consec_max5.5342392748923
driven_lanedir_consec_mean5.5342392748923
driven_lanedir_consec_min5.5342392748923
driven_lanedir_max5.5342392748923
driven_lanedir_mean5.5342392748923
driven_lanedir_median5.5342392748923
driven_lanedir_min5.5342392748923
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.543896156524706, "survival_time": 59.99999999999873, "driven_lanedir": 5.5342392748923, "in-drivable-lane": 0.0, "deviation-heading": 2.302069906172969, "distance-from-start": 1.5178953029412718, "deviation-center-line": 0.219904045457012, "driven_lanedir_consec": 5.5342392748923}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11693817Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:12:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02620788009815445
deviation-center-line_median0.5078452545325405


other stats
deviation-center-line_max0.927053231877248
deviation-center-line_mean0.5493180342782131
deviation-center-line_min0.2545283961705238
deviation-heading_max24.927759797558803
deviation-heading_mean12.75886411102093
deviation-heading_median12.083790865588464
deviation-heading_min1.940114915347987
distance-from-start_max2.463697137894826
distance-from-start_mean0.6299095496275323
distance-from-start_median0.0279705303076513
distance-from-start_min4.440892098500626e-16
driven_any_max5.995138898638472
driven_any_mean1.5127928534510304
driven_any_median0.028016257582558556
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.580966757799386
driven_lanedir_consec_mean1.4083456294989238
driven_lanedir_consec_min0.0
driven_lanedir_max5.983208605322819
driven_lanedir_mean1.508906091379782
driven_lanedir_median0.02620788009815445
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 9.946396239005722, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.3027462438305415, "driven_lanedir_consec": 0.0}, "4way-001-ego1": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 0.927053231877248, "driven_lanedir_consec": 0.0}, "4way-001-ego2": {"driven_any": 0.056032515164580056, "survival_time": 59.99999999999873, "driven_lanedir": 0.05241576019630889, "in-drivable-lane": 0.0, "deviation-heading": 14.22118549217121, "distance-from-start": 0.05594106061530216, "deviation-center-line": 0.7129442652345395, "driven_lanedir_consec": 0.05241576019630889}, "4way-001-ego3": {"driven_any": 5.995138898638472, "survival_time": 59.99999999999873, "driven_lanedir": 5.983208605322819, "in-drivable-lane": 0.0, "deviation-heading": 1.940114915347987, "distance-from-start": 2.463697137894826, "deviation-center-line": 0.2545283961705238, "driven_lanedir_consec": 5.580966757799386}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11688818Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.68215125613533
deviation-center-line_median0.07395327503038837


other stats
deviation-center-line_max0.07395327503038837
deviation-center-line_mean0.07395327503038837
deviation-center-line_min0.07395327503038837
deviation-heading_max0.5851001197983932
deviation-heading_mean0.5851001197983932
deviation-heading_median0.5851001197983932
deviation-heading_min0.5851001197983932
distance-from-start_max2.029871473762164
distance-from-start_mean2.029871473762164
distance-from-start_median2.029871473762164
distance-from-start_min2.029871473762164
driven_any_max2.684176116815528
driven_any_mean2.684176116815528
driven_any_median2.684176116815528
driven_any_min2.684176116815528
driven_lanedir_consec_max2.68215125613533
driven_lanedir_consec_mean2.68215125613533
driven_lanedir_consec_min2.68215125613533
driven_lanedir_max2.6821513356789115
driven_lanedir_mean2.6821513356789115
driven_lanedir_median2.6821513356789115
driven_lanedir_min2.6821513356789115
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.684176116815528, "survival_time": 59.99999999999873, "driven_lanedir": 2.6821513356789115, "in-drivable-lane": 0.0, "deviation-heading": 0.5851001197983932, "distance-from-start": 2.029871473762164, "deviation-center-line": 0.07395327503038837, "driven_lanedir_consec": 2.68215125613533}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11680819Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation346successyesdavinci-stage-02-6.2.460:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3002634346487274
deviation-center-line_median0.7196587394263382


other stats
deviation-center-line_max2.946747690455274
deviation-center-line_mean1.1476127366277404
deviation-center-line_min0.20438577720301088
deviation-heading_max14.481564596168331
deviation-heading_mean7.741984297971248
deviation-heading_median7.028384188277798
deviation-heading_min2.429604219161062
distance-from-start_max3.2396193091764305
distance-from-start_mean1.334325698944544
distance-from-start_median1.0488417433008723
distance-from-start_min4.47545209131181e-16
driven_any_max5.606562725658094
driven_any_mean2.053995095327341
driven_any_median1.3047088278253671
driven_any_min5.370542509574138e-13
driven_lanedir_consec_max5.594025281629358
driven_lanedir_consec_mean2.048638037731703
driven_lanedir_consec_min0.0
driven_lanedir_max5.594025281629358
driven_lanedir_mean2.048638037731703
driven_lanedir_median1.3002634346487274
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.9556664137081567, "survival_time": 59.99999999999873, "driven_lanedir": 1.9489815249615767, "in-drivable-lane": 0.0, "deviation-heading": 4.451378386780232, "distance-from-start": 1.471444190689407, "deviation-center-line": 0.20438577720301088, "driven_lanedir_consec": 1.9489815249615767}, "loop-000-ego1": {"driven_any": 5.606562725658094, "survival_time": 59.99999999999873, "driven_lanedir": 5.594025281629358, "in-drivable-lane": 0.0, "deviation-heading": 2.429604219161062, "distance-from-start": 3.2396193091764305, "deviation-center-line": 0.3255000542191074, "driven_lanedir_consec": 5.594025281629358}, "loop-000-ego2": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 2.946747690455274, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.6537512419425775, "survival_time": 59.99999999999873, "driven_lanedir": 0.6515453443358781, "in-drivable-lane": 0.0, "deviation-heading": 9.605389989775365, "distance-from-start": 0.6262392959123381, "deviation-center-line": 1.113817424633569, "driven_lanedir_consec": 0.6515453443358781}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11676821Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.6173794793891885
deviation-center-line_median0.3790863571459804


other stats
deviation-center-line_max0.3790863571459804
deviation-center-line_mean0.3790863571459804
deviation-center-line_min0.3790863571459804
deviation-heading_max2.844192295741865
deviation-heading_mean2.844192295741865
deviation-heading_median2.844192295741865
deviation-heading_min2.844192295741865
distance-from-start_max2.723986924723346
distance-from-start_mean2.723986924723346
distance-from-start_median2.723986924723346
distance-from-start_min2.723986924723346
driven_any_max5.636243490208466
driven_any_mean5.636243490208466
driven_any_median5.636243490208466
driven_any_min5.636243490208466
driven_lanedir_consec_max5.6173794793891885
driven_lanedir_consec_mean5.6173794793891885
driven_lanedir_consec_min5.6173794793891885
driven_lanedir_max5.6173794793891885
driven_lanedir_mean5.6173794793891885
driven_lanedir_median5.6173794793891885
driven_lanedir_min5.6173794793891885
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11669822Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median6.008901010886451
deviation-center-line_median0.30597991997662005


other stats
deviation-center-line_max0.30597991997662005
deviation-center-line_mean0.30597991997662005
deviation-center-line_min0.30597991997662005
deviation-heading_max2.2018930022147423
deviation-heading_mean2.2018930022147423
deviation-heading_median2.2018930022147423
deviation-heading_min2.2018930022147423
distance-from-start_max2.7090569978004524
distance-from-start_mean2.7090569978004524
distance-from-start_median2.7090569978004524
distance-from-start_min2.7090569978004524
driven_any_max6.026055195101287
driven_any_mean6.026055195101287
driven_any_median6.026055195101287
driven_any_min6.026055195101287
driven_lanedir_consec_max6.008901010886451
driven_lanedir_consec_mean6.008901010886451
driven_lanedir_consec_min6.008901010886451
driven_lanedir_max6.008901010886451
driven_lanedir_mean6.008901010886451
driven_lanedir_median6.008901010886451
driven_lanedir_min6.008901010886451
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 6.026055195101287, "survival_time": 59.99999999999873, "driven_lanedir": 6.008901010886451, "in-drivable-lane": 0.0, "deviation-heading": 2.2018930022147423, "distance-from-start": 2.7090569978004524, "deviation-center-line": 0.30597991997662005, "driven_lanedir_consec": 6.008901010886451}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11665824Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-1of4successnodavinci-stage-02-6.2.460:12:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.619340458553207
deviation-center-line_median0.29362362810082904


other stats
deviation-center-line_max0.29362362810082904
deviation-center-line_mean0.29362362810082904
deviation-center-line_min0.29362362810082904
deviation-heading_max2.404267084079743
deviation-heading_mean2.404267084079743
deviation-heading_median2.404267084079743
deviation-heading_min2.404267084079743
distance-from-start_max2.3421142281734313
distance-from-start_mean2.3421142281734313
distance-from-start_median2.3421142281734313
distance-from-start_min2.3421142281734313
driven_any_max4.634748572927819
driven_any_mean4.634748572927819
driven_any_median4.634748572927819
driven_any_min4.634748572927819
driven_lanedir_consec_max4.619340458553207
driven_lanedir_consec_mean4.619340458553207
driven_lanedir_consec_min4.619340458553207
driven_lanedir_max4.6193404722652875
driven_lanedir_mean4.6193404722652875
driven_lanedir_median4.6193404722652875
driven_lanedir_min4.6193404722652875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 4.634748572927819, "survival_time": 59.99999999999873, "driven_lanedir": 4.6193404722652875, "in-drivable-lane": 0.0, "deviation-heading": 2.404267084079743, "distance-from-start": 2.3421142281734313, "deviation-center-line": 0.29362362810082904, "driven_lanedir_consec": 4.619340458553207}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11658825Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.293807887862121
deviation-center-line_median0.417556197927667


other stats
deviation-center-line_max0.4788119027447813
deviation-center-line_mean0.38425873048239617
deviation-center-line_min0.2231106233294694
deviation-heading_max4.652112626803104
deviation-heading_mean3.667961558670906
deviation-heading_median3.597719749437933
deviation-heading_min2.8242941090046534
distance-from-start_max3.3013861756867433
distance-from-start_mean2.2100546361683504
distance-from-start_median2.7694161844933296
distance-from-start_min2.220446049250313e-16
driven_any_max5.5948873493535904
driven_any_mean4.054721847884187
driven_any_median5.312000021091446
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.571268137204079
driven_lanedir_consec_mean4.03972097823208
driven_lanedir_consec_min0.0
driven_lanedir_max5.571268137204079
driven_lanedir_mean4.03972097823208
driven_lanedir_median5.293807887862121
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.5948873493535904, "survival_time": 59.99999999999873, "driven_lanedir": 5.571268137204079, "in-drivable-lane": 0.0, "deviation-heading": 3.859259059290984, "distance-from-start": 3.3013861756867433, "deviation-center-line": 0.4788119027447813, "driven_lanedir_consec": 5.571268137204079}, "zigzag-000-ego1": {"driven_any": 5.168733567764957, "survival_time": 59.99999999999873, "driven_lanedir": 5.151583839955128, "in-drivable-lane": 0.0, "deviation-heading": 2.8242941090046534, "distance-from-start": 2.805316210020219, "deviation-center-line": 0.36023058448263773, "driven_lanedir_consec": 5.151583839955128}, "zigzag-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.2231106233294694, "driven_lanedir_consec": 0.0}, "zigzag-000-ego3": {"driven_any": 5.455266474417934, "survival_time": 59.99999999999873, "driven_lanedir": 5.436031935769113, "in-drivable-lane": 0.0, "deviation-heading": 3.3361804395848824, "distance-from-start": 2.7335161589664403, "deviation-center-line": 0.4748818113726963, "driven_lanedir_consec": 5.436031935769113}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11655826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11652826Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4host-errornodavinci-stage-02-6.2.460:01:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11642827Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7199000882778759
deviation-center-line_median0.16571411064010536


other stats
deviation-center-line_max0.16571411064010536
deviation-center-line_mean0.16571411064010536
deviation-center-line_min0.16571411064010536
deviation-heading_max1.3921530764896437
deviation-heading_mean1.3921530764896437
deviation-heading_median1.3921530764896437
deviation-heading_min1.3921530764896437
distance-from-start_max0.6832017558427702
distance-from-start_mean0.6832017558427702
distance-from-start_median0.6832017558427702
distance-from-start_min0.6832017558427702
driven_any_max0.7330980289948952
driven_any_mean0.7330980289948952
driven_any_median0.7330980289948952
driven_any_min0.7330980289948952
driven_lanedir_consec_max0.7199000882778759
driven_lanedir_consec_mean0.7199000882778759
driven_lanedir_consec_min0.7199000882778759
driven_lanedir_max0.7199000882778759
driven_lanedir_mean0.7199000882778759
driven_lanedir_median0.7199000882778759
driven_lanedir_min0.7199000882778759
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7330980289948952, "survival_time": 9.750000000000004, "driven_lanedir": 0.7199000882778759, "in-drivable-lane": 0.0, "deviation-heading": 1.3921530764896437, "distance-from-start": 0.6832017558427702, "deviation-center-line": 0.16571411064010536, "driven_lanedir_consec": 0.7199000882778759}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
11611828Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.460:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524993


other stats
deviation-center-line_max0.4065274986524993
deviation-center-line_mean0.4065274986524993
deviation-center-line_min0.4065274986524993
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065274986524993, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11597829Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4successnodavinci-stage-02-6.2.460:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.200000000000298
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.6557496945576338
deviation-center-line_median3.0292371299157934


other stats
deviation-center-line_max3.0292371299157934
deviation-center-line_mean3.0292371299157934
deviation-center-line_min3.0292371299157934
deviation-heading_max2.9200444744909024
deviation-heading_mean2.9200444744909024
deviation-heading_median2.9200444744909024
deviation-heading_min2.9200444744909024
distance-from-start_max1.3121126948157773
distance-from-start_mean1.3121126948157773
distance-from-start_median1.3121126948157773
distance-from-start_min1.3121126948157773
driven_any_max1.7165963269618534
driven_any_mean1.7165963269618534
driven_any_median1.7165963269618534
driven_any_min1.7165963269618534
driven_lanedir_consec_max1.6557496945576338
driven_lanedir_consec_mean1.6557496945576338
driven_lanedir_consec_min1.6557496945576338
driven_lanedir_max1.6557496945576338
driven_lanedir_mean1.6557496945576338
driven_lanedir_median1.6557496945576338
driven_lanedir_min1.6557496945576338
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"4way-000-ego0": {"driven_any": 1.7165963269618534, "survival_time": 30.200000000000298, "driven_lanedir": 1.6557496945576338, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200444744909024, "distance-from-start": 1.3121126948157773, "deviation-center-line": 3.0292371299157934, "driven_lanedir_consec": 1.6557496945576338}}
simulation-passed1
survival_time_max30.200000000000298
survival_time_mean30.200000000000298
survival_time_min30.200000000000298
No reset possible
11356830Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-0of4successnodavinci-stage-02-6.2.460:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.485872931964064
deviation-center-line_median4.220405873962668


other stats
deviation-center-line_max4.220405873962668
deviation-center-line_mean4.220405873962668
deviation-center-line_min4.220405873962668
deviation-heading_max2.9174896774298857
deviation-heading_mean2.9174896774298857
deviation-heading_median2.9174896774298857
deviation-heading_min2.9174896774298857
distance-from-start_max2.8928218615311083
distance-from-start_mean2.8928218615311083
distance-from-start_median2.8928218615311083
distance-from-start_min2.8928218615311083
driven_any_max3.5465963319759144
driven_any_mean3.5465963319759144
driven_any_median3.5465963319759144
driven_any_min3.5465963319759144
driven_lanedir_consec_max3.485872931964064
driven_lanedir_consec_mean3.485872931964064
driven_lanedir_consec_min3.485872931964064
driven_lanedir_max3.485872931964064
driven_lanedir_mean3.485872931964064
driven_lanedir_median3.485872931964064
driven_lanedir_min3.485872931964064
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963319759144, "survival_time": 59.99999999999873, "driven_lanedir": 3.485872931964064, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.9174896774298857, "distance-from-start": 2.8928218615311083, "deviation-center-line": 4.220405873962668, "driven_lanedir_consec": 3.485872931964064}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11354831Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.500000000000213
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3888839040115122
deviation-center-line_median1.4738039593225314


other stats
deviation-center-line_max1.4738039593225314
deviation-center-line_mean1.4738039593225314
deviation-center-line_min1.4738039593225314
deviation-heading_max3.246880369897966
deviation-heading_mean3.246880369897966
deviation-heading_median3.246880369897966
deviation-heading_min3.246880369897966
distance-from-start_max1.289007654085733
distance-from-start_mean1.289007654085733
distance-from-start_median1.289007654085733
distance-from-start_min1.289007654085733
driven_any_max1.4075976974295576
driven_any_mean1.4075976974295576
driven_any_median1.4075976974295576
driven_any_min1.4075976974295576
driven_lanedir_consec_max1.3888839040115122
driven_lanedir_consec_mean1.3888839040115122
driven_lanedir_consec_min1.3888839040115122
driven_lanedir_max1.3888839040115122
driven_lanedir_mean1.3888839040115122
driven_lanedir_median1.3888839040115122
driven_lanedir_min1.3888839040115122
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.4075976974295576, "survival_time": 24.500000000000213, "driven_lanedir": 1.3888839040115122, "in-drivable-lane": 0.0, "deviation-heading": 3.246880369897966, "distance-from-start": 1.289007654085733, "deviation-center-line": 1.4738039593225314, "driven_lanedir_consec": 1.3888839040115122}}
simulation-passed1
survival_time_max24.500000000000213
survival_time_mean24.500000000000213
survival_time_min24.500000000000213
No reset possible
11349833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1249999999999662
driven_lanedir_consec_median1.4456503520453423
deviation-center-line_median5.2165714063097


other stats
deviation-center-line_max5.528679809125458
deviation-center-line_mean5.2165714063097
deviation-center-line_min4.904463003493942
deviation-heading_max8.48735406391615
deviation-heading_mean8.116239531071809
deviation-heading_median8.116239531071809
deviation-heading_min7.7451249982274675
distance-from-start_max1.242743835742773
distance-from-start_mean1.2243627584318864
distance-from-start_median1.2243627584318864
distance-from-start_min1.205981681121
driven_any_max3.4865832572710787
driven_any_mean3.4858336367538625
driven_any_median3.4858336367538625
driven_any_min3.4850840162366463
driven_lanedir_consec_max1.4708900970780958
driven_lanedir_consec_mean1.4456503520453423
driven_lanedir_consec_min1.4204106070125888
driven_lanedir_max3.2904966241055256
driven_lanedir_mean3.288148700061684
driven_lanedir_median3.288148700061684
driven_lanedir_min3.285800776017842
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1249999999999662
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840162366463, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904966241055256, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7451249982274675, "distance-from-start": 1.205981681121, "deviation-center-line": 4.904463003493942, "driven_lanedir_consec": 1.4204106070125888}, "loop2-000-ego1": {"driven_any": 3.4865832572710787, "survival_time": 59.99999999999873, "driven_lanedir": 3.285800776017842, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.48735406391615, "distance-from-start": 1.242743835742773, "deviation-center-line": 5.528679809125458, "driven_lanedir_consec": 1.4708900970780958}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11063833Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-0of4successnodavinci-stage-02-6.2.460:21:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.4749999999999552
driven_lanedir_consec_median3.4002821622357984
deviation-center-line_median5.992377953630339


other stats
deviation-center-line_max7.516029088900642
deviation-center-line_mean6.078065413935748
deviation-center-line_min4.81147665958167
deviation-heading_max12.168685206029926
deviation-heading_mean6.8808867794243
deviation-heading_median6.217393990233779
deviation-heading_min2.9200739311997133
distance-from-start_max3.0901348300566136
distance-from-start_mean2.5082472337191244
distance-from-start_median2.747884262658891
distance-from-start_min1.4470855795021027
driven_any_max3.549582457242765
driven_any_mean3.534964335885894
driven_any_median3.5353456174417777
driven_any_min3.5195836514172565
driven_lanedir_consec_max3.485653904322902
driven_lanedir_consec_mean3.0923220036529804
driven_lanedir_consec_min2.0830697858174214
driven_lanedir_max3.485653904322902
driven_lanedir_mean3.409680770298687
driven_lanedir_median3.4002821622357984
driven_lanedir_min3.3525048524002488
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4874999999999703
in-drivable-lane_min0.9999999999999432
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963269625904, "survival_time": 59.99999999999873, "driven_lanedir": 3.485653904322902, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200739311997133, "distance-from-start": 2.876631299535302, "deviation-center-line": 7.516029088900642, "driven_lanedir_consec": 3.485653904322902}, "autolab-000-ego1": {"driven_any": 3.524094907920965, "survival_time": 59.99999999999873, "driven_lanedir": 3.4260604158491743, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.516330158155915, "distance-from-start": 2.6191372257824805, "deviation-center-line": 6.510873598064531, "driven_lanedir_consec": 3.4260604158491743}, "autolab-000-ego2": {"driven_any": 3.549582457242765, "survival_time": 59.99999999999873, "driven_lanedir": 3.3745039086224224, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 12.168685206029926, "distance-from-start": 3.0901348300566136, "deviation-center-line": 4.81147665958167, "driven_lanedir_consec": 3.3745039086224224}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10928836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9499999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.903013185974951
deviation-center-line_median3.78943987331601


other stats
deviation-center-line_max3.78943987331601
deviation-center-line_mean3.78943987331601
deviation-center-line_min3.78943987331601
deviation-heading_max4.334690003953373
deviation-heading_mean4.334690003953373
deviation-heading_median4.334690003953373
deviation-heading_min4.334690003953373
distance-from-start_max1.5738876609453012
distance-from-start_mean1.5738876609453012
distance-from-start_median1.5738876609453012
distance-from-start_min1.5738876609453012
driven_any_max2.934594724791732
driven_any_mean2.934594724791732
driven_any_median2.934594724791732
driven_any_min2.934594724791732
driven_lanedir_consec_max2.903013185974951
driven_lanedir_consec_mean2.903013185974951
driven_lanedir_consec_min2.903013185974951
driven_lanedir_max2.9099324876731436
driven_lanedir_mean2.9099324876731436
driven_lanedir_median2.9099324876731436
driven_lanedir_min2.9099324876731436
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.934594724791732, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099324876731436, "in-drivable-lane": 0.0, "deviation-heading": 4.334690003953373, "distance-from-start": 1.5738876609453012, "deviation-center-line": 3.78943987331601, "driven_lanedir_consec": 2.903013185974951}}
simulation-passed1
survival_time_max49.9499999999993
survival_time_mean49.9499999999993
survival_time_min49.9499999999993
No reset possible
10876836Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-2of4successnodavinci-stage-02-6.2.460:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10759837Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573452
deviation-heading_mean11.057314603573452
deviation-heading_median11.057314603573452
deviation-heading_min11.057314603573452
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019539
driven_any_mean3.452076592019539
driven_any_median3.452076592019539
driven_any_min3.452076592019539
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10695838Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.70000000000006
in-drivable-lane_median0.0
driven_lanedir_consec_median0.746673767524618
deviation-center-line_median0.7161949626619292


other stats
deviation-center-line_max0.7161949626619292
deviation-center-line_mean0.7161949626619292
deviation-center-line_min0.7161949626619292
deviation-heading_max2.160741888859268
deviation-heading_mean2.160741888859268
deviation-heading_median2.160741888859268
deviation-heading_min2.160741888859268
distance-from-start_max0.7031149433813478
distance-from-start_mean0.7031149433813478
distance-from-start_median0.7031149433813478
distance-from-start_min0.7031149433813478
driven_any_max0.7595982247497333
driven_any_mean0.7595982247497333
driven_any_median0.7595982247497333
driven_any_min0.7595982247497333
driven_lanedir_consec_max0.746673767524618
driven_lanedir_consec_mean0.746673767524618
driven_lanedir_consec_min0.746673767524618
driven_lanedir_max0.746673767524618
driven_lanedir_mean0.746673767524618
driven_lanedir_median0.746673767524618
driven_lanedir_min0.746673767524618
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7595982247497333, "survival_time": 13.70000000000006, "driven_lanedir": 0.746673767524618, "in-drivable-lane": 0.0, "deviation-heading": 2.160741888859268, "distance-from-start": 0.7031149433813478, "deviation-center-line": 0.7161949626619292, "driven_lanedir_consec": 0.746673767524618}}
simulation-passed1
survival_time_max13.70000000000006
survival_time_mean13.70000000000006
survival_time_min13.70000000000006
No reset possible
10531839Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.249999999999958
driven_lanedir_consec_median2.186789824803002
deviation-center-line_median5.756192467557295


other stats
deviation-center-line_max5.756192467557295
deviation-center-line_mean5.756192467557295
deviation-center-line_min5.756192467557295
deviation-heading_max6.2307698813353865
deviation-heading_mean6.2307698813353865
deviation-heading_median6.2307698813353865
deviation-heading_min6.2307698813353865
distance-from-start_max1.6298009498956398
distance-from-start_mean1.6298009498956398
distance-from-start_median1.6298009498956398
distance-from-start_min1.6298009498956398
driven_any_max3.483691022699812
driven_any_mean3.483691022699812
driven_any_median3.483691022699812
driven_any_min3.483691022699812
driven_lanedir_consec_max2.186789824803002
driven_lanedir_consec_mean2.186789824803002
driven_lanedir_consec_min2.186789824803002
driven_lanedir_max3.299163918160777
driven_lanedir_mean3.299163918160777
driven_lanedir_median3.299163918160777
driven_lanedir_min3.299163918160777
in-drivable-lane_max3.249999999999958
in-drivable-lane_mean3.249999999999958
in-drivable-lane_min3.249999999999958
per-episodes
details{"4way-000-ego0": {"driven_any": 3.483691022699812, "survival_time": 59.99999999999873, "driven_lanedir": 3.299163918160777, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.2307698813353865, "distance-from-start": 1.6298009498956398, "deviation-center-line": 5.756192467557295, "driven_lanedir_consec": 2.186789824803002}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10277841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:21:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.133472186206734
deviation-center-line_median3.5692749184210433


other stats
deviation-center-line_max5.1851715974128805
deviation-center-line_mean3.738598388104289
deviation-center-line_min2.6306721181621886
deviation-heading_max8.12390911081905
deviation-heading_mean4.904445207680925
deviation-heading_median3.9916054069886826
deviation-heading_min3.5106609059272844
distance-from-start_max2.230934169509707
distance-from-start_mean1.8422550059061231
distance-from-start_median1.83762780726357
distance-from-start_min1.4628302395876456
driven_any_max3.5795876791383257
driven_any_mean3.408211238652514
driven_any_median3.559331275339633
driven_any_min2.934594724792462
driven_lanedir_consec_max3.4288085645898976
driven_lanedir_consec_mean2.8688896370650867
driven_lanedir_consec_min1.779805611256981
driven_lanedir_max3.561567679231453
driven_lanedir_mean3.351579340793875
driven_lanedir_median3.467420167967693
driven_lanedir_min2.909909348008662
in-drivable-lane_max1.3499999999999446
in-drivable-lane_mean0.33749999999998614
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.934594724792462, "survival_time": 59.99999999999873, "driven_lanedir": 2.909909348008662, "in-drivable-lane": 0.0, "deviation-heading": 4.334701504286533, "distance-from-start": 1.5738876834742443, "deviation-center-line": 5.1851715974128805, "driven_lanedir_consec": 2.9029908891375724}, "udem-000-ego1": {"driven_any": 3.539079376082114, "survival_time": 59.99999999999873, "driven_lanedir": 3.3772467891566187, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 8.12390911081905, "distance-from-start": 1.4628302395876456, "deviation-center-line": 4.14966050504133, "driven_lanedir_consec": 1.779805611256981}, "udem-000-ego2": {"driven_any": 3.5795876791383257, "survival_time": 59.99999999999873, "driven_lanedir": 3.561567679231453, "in-drivable-lane": 0.0, "deviation-heading": 3.5106609059272844, "distance-from-start": 2.230934169509707, "deviation-center-line": 2.6306721181621886, "driven_lanedir_consec": 3.4288085645898976}, "udem-000-ego3": {"driven_any": 3.5795831745971527, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575935467787665, "in-drivable-lane": 0.0, "deviation-heading": 3.648509309690832, "distance-from-start": 2.101367931052896, "deviation-center-line": 2.988889331800756, "driven_lanedir_consec": 3.3639534832758957}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10228841Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-2of4successnodavinci-stage-02-6.2.460:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10144843Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.8920792929900845
deviation-center-line_median5.680288946152966


other stats
deviation-center-line_max5.680288946152966
deviation-center-line_mean5.680288946152966
deviation-center-line_min5.680288946152966
deviation-heading_max11.490175070254152
deviation-heading_mean11.490175070254152
deviation-heading_median11.490175070254152
deviation-heading_min11.490175070254152
distance-from-start_max2.5229792435928395
distance-from-start_mean2.5229792435928395
distance-from-start_median2.5229792435928395
distance-from-start_min2.5229792435928395
driven_any_max3.4265750684858305
driven_any_mean3.4265750684858305
driven_any_median3.4265750684858305
driven_any_min3.4265750684858305
driven_lanedir_consec_max2.8920792929900845
driven_lanedir_consec_mean2.8920792929900845
driven_lanedir_consec_min2.8920792929900845
driven_lanedir_max3.0978303472366893
driven_lanedir_mean3.0978303472366893
driven_lanedir_median3.0978303472366893
driven_lanedir_min3.0978303472366893
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4265750684858305, "survival_time": 59.99999999999873, "driven_lanedir": 3.0978303472366893, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.490175070254152, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.680288946152966, "driven_lanedir_consec": 2.8920792929900845}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
10083844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
10027844Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
9861845Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnodavinci-stage-02-6.2.460:10:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median2.7045955609117347
deviation-center-line_median5.298353292175556


other stats
deviation-center-line_max6.7415423051179255
deviation-center-line_mean5.28094688646254
deviation-center-line_min3.785538656381124
deviation-heading_max13.312014280207482
deviation-heading_mean6.591214978958582
deviation-heading_median4.957876569877463
deviation-heading_min3.137092495871918
distance-from-start_max2.2873183363783496
distance-from-start_mean1.7377713014167755
distance-from-start_median1.9053628015189592
distance-from-start_min0.8530412662508342
driven_any_max3.579587180103618
driven_any_mean2.867838687646443
driven_any_median2.919589855341645
driven_any_min2.052587859798864
driven_lanedir_consec_max3.384490798043468
driven_lanedir_consec_mean2.391979057772581
driven_lanedir_consec_min0.7742343112233858
driven_lanedir_max3.5625563105123215
driven_lanedir_mean2.790015327019447
driven_lanedir_median2.838407939721475
driven_lanedir_min1.9206891181225152
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean1.1249999999999716
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.259597875697513, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590471343353, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280207482, "distance-from-start": 1.740927094321447, "deviation-center-line": 6.213697824668821, "driven_lanedir_consec": 2.0736045752466756}, "4way-000-ego1": {"driven_any": 3.5795818349857766, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625563105123215, "in-drivable-lane": 0.0, "deviation-heading": 3.137092495871918, "distance-from-start": 2.069798508716472, "deviation-center-line": 3.785538656381124, "driven_lanedir_consec": 3.3355865465767938}, "4way-000-ego2": {"driven_any": 3.579587180103618, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589568323086147, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646358412, "distance-from-start": 2.2873183363783496, "deviation-center-line": 4.3830087596822915, "driven_lanedir_consec": 3.384490798043468}, "4way-000-ego3": {"driven_any": 2.052587859798864, "survival_time": 59.99999999999873, "driven_lanedir": 1.9206891181225152, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545204933965145, "distance-from-start": 0.8530412662508342, "deviation-center-line": 6.7415423051179255, "driven_lanedir_consec": 0.7742343112233858}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9719847Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation348successyesdavinci-stage-02-6.2.460:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.3499999999998895
driven_lanedir_consec_median2.2675849461568647
deviation-center-line_median5.560918027752658


other stats
deviation-center-line_max5.665543834003993
deviation-center-line_mean5.3727149067087066
deviation-center-line_min4.703479737325517
deviation-heading_max10.454471793859122
deviation-heading_mean9.605748204053755
deviation-heading_median9.670620842366962
deviation-heading_min8.627279337621992
distance-from-start_max3.0406853340722217
distance-from-start_mean2.0347241290700784
distance-from-start_median2.024381858976593
distance-from-start_min1.0494474642549068
driven_any_max3.5795904164549563
driven_any_mean3.481407758763025
driven_any_median3.4491559187079543
driven_any_min3.447728781181236
driven_lanedir_consec_max3.500351716832338
driven_lanedir_consec_mean2.3551359976981656
driven_lanedir_consec_min1.385022381646594
driven_lanedir_max3.500351716832338
driven_lanedir_mean3.2651576913078557
driven_lanedir_median3.1933040571981905
driven_lanedir_min3.173670934002705
in-drivable-lane_max4.399999999999963
in-drivable-lane_mean3.2749999999999355
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.449081931990942, "survival_time": 59.99999999999873, "driven_lanedir": 3.2020361174014584, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279337621992, "distance-from-start": 1.0494474642549068, "deviation-center-line": 5.586766604699417, "driven_lanedir_consec": 1.385022381646594}, "zigzag-000-ego1": {"driven_any": 3.447728781181236, "survival_time": 59.99999999999873, "driven_lanedir": 3.173670934002705, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.454471793859122, "distance-from-start": 1.5345351360434751, "deviation-center-line": 5.665543834003993, "driven_lanedir_consec": 1.63302491241896}, "zigzag-000-ego2": {"driven_any": 3.5795904164549563, "survival_time": 59.99999999999873, "driven_lanedir": 3.500351716832338, "in-drivable-lane": 0.0, "deviation-heading": 9.518767283173348, "distance-from-start": 3.0406853340722217, "deviation-center-line": 4.703479737325517, "driven_lanedir_consec": 3.500351716832338}, "zigzag-000-ego3": {"driven_any": 3.4492299054249664, "survival_time": 59.99999999999873, "driven_lanedir": 3.184571996994922, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.822474401560571, "distance-from-start": 2.5142285819097103, "deviation-center-line": 5.535069450805898, "driven_lanedir_consec": 2.9021449798947696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9622848Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4successnodavinci-stage-02-6.2.460:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median58.999999999998785
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.8920792929900845
deviation-center-line_median5.6806740116942835


other stats
deviation-center-line_max5.6806740116942835
deviation-center-line_mean5.6806740116942835
deviation-center-line_min5.6806740116942835
deviation-heading_max11.30344108488696
deviation-heading_mean11.30344108488696
deviation-heading_median11.30344108488696
deviation-heading_min11.30344108488696
distance-from-start_max2.5229792435928395
distance-from-start_mean2.5229792435928395
distance-from-start_median2.5229792435928395
distance-from-start_min2.5229792435928395
driven_any_max3.3245754522163784
driven_any_mean3.3245754522163784
driven_any_median3.3245754522163784
driven_any_min3.3245754522163784
driven_lanedir_consec_max2.8920792929900845
driven_lanedir_consec_mean2.8920792929900845
driven_lanedir_consec_min2.8920792929900845
driven_lanedir_max2.9981420562404173
driven_lanedir_mean2.9981420562404173
driven_lanedir_median2.9981420562404173
driven_lanedir_min2.9981420562404173
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3245754522163784, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420562404173, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.30344108488696, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.6806740116942835, "driven_lanedir_consec": 2.8920792929900845}}
simulation-passed1
survival_time_max58.999999999998785
survival_time_mean58.999999999998785
survival_time_min58.999999999998785
No reset possible
9561849Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.04999999999986
in-drivable-lane_median2.5000000000000098
driven_lanedir_consec_median1.160366146360421
deviation-center-line_median2.940039735198709


other stats
deviation-center-line_max2.940039735198709
deviation-center-line_mean2.940039735198709
deviation-center-line_min2.940039735198709
deviation-heading_max9.167157492761987
deviation-heading_mean9.167157492761987
deviation-heading_median9.167157492761987
deviation-heading_min9.167157492761987
distance-from-start_max1.1396211983149378
distance-from-start_mean1.1396211983149378
distance-from-start_median1.1396211983149378
distance-from-start_min1.1396211983149378
driven_any_max2.265732411375476
driven_any_mean2.265732411375476
driven_any_median2.265732411375476
driven_any_min2.265732411375476
driven_lanedir_consec_max1.160366146360421
driven_lanedir_consec_mean1.160366146360421
driven_lanedir_consec_min1.160366146360421
driven_lanedir_max2.08337576497627
driven_lanedir_mean2.08337576497627
driven_lanedir_median2.08337576497627
driven_lanedir_min2.08337576497627
in-drivable-lane_max2.5000000000000098
in-drivable-lane_mean2.5000000000000098
in-drivable-lane_min2.5000000000000098
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.265732411375476, "survival_time": 40.04999999999986, "driven_lanedir": 2.08337576497627, "in-drivable-lane": 2.5000000000000098, "deviation-heading": 9.167157492761987, "distance-from-start": 1.1396211983149378, "deviation-center-line": 2.940039735198709, "driven_lanedir_consec": 1.160366146360421}}
simulation-passed1
survival_time_max40.04999999999986
survival_time_mean40.04999999999986
survival_time_min40.04999999999986
No reset possible
9392851Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4successnodavinci-stage-02-6.2.460:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.2000000000000313
driven_lanedir_consec_median2.398726594458411
deviation-center-line_median5.385973951445022


other stats
deviation-center-line_max6.768119261305023
deviation-center-line_mean5.141910550077539
deviation-center-line_min3.027575036115088
deviation-heading_max18.81946877878392
deviation-heading_mean8.820040813941052
deviation-heading_median5.631621361292126
deviation-heading_min5.197451754396037
distance-from-start_max2.6950459245155516
distance-from-start_mean1.825294574395911
distance-from-start_median1.900162687326769
distance-from-start_min0.8058069984145542
driven_any_max3.465429040061589
driven_any_mean2.7198217462465735
driven_any_median2.716635137969776
driven_any_min1.9805876689851512
driven_lanedir_consec_max3.2592891649667823
driven_lanedir_consec_mean2.198266437088204
driven_lanedir_consec_min0.736323394469212
driven_lanedir_max3.3234641052144616
driven_lanedir_mean2.5697421917278698
driven_lanedir_median2.5539937726256654
driven_lanedir_min1.8475171164456856
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean2.3374999999999924
in-drivable-lane_min1.3499999999999446
per-episodes
details{"4way-000-ego0": {"driven_any": 1.9805876689851512, "survival_time": 59.99999999999873, "driven_lanedir": 1.8486983802845485, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.38991345016137, "distance-from-start": 0.8058069984145542, "deviation-center-line": 5.720664140368309, "driven_lanedir_consec": 0.736323394469212}, "4way-000-ego1": {"driven_any": 2.000247935197531, "survival_time": 59.99999999999873, "driven_lanedir": 1.8475171164456856, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 18.81946877878392, "distance-from-start": 1.4628422402543046, "deviation-center-line": 5.051283762521735, "driven_lanedir_consec": 1.7798051238862296}, "4way-000-ego2": {"driven_any": 3.465429040061589, "survival_time": 59.99999999999873, "driven_lanedir": 3.3234641052144616, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.873329272422881, "distance-from-start": 2.3374831343992333, "deviation-center-line": 3.027575036115088, "driven_lanedir_consec": 3.017648065030592}, "4way-000-ego3": {"driven_any": 3.4330223407420215, "survival_time": 59.99999999999873, "driven_lanedir": 3.2592891649667823, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.197451754396037, "distance-from-start": 2.6950459245155516, "deviation-center-line": 6.768119261305023, "driven_lanedir_consec": 3.2592891649667823}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9241852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4successnodavinci-stage-02-6.2.460:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.0183982038959174
deviation-center-line_median5.116869283415678


other stats
deviation-center-line_max5.116869283415678
deviation-center-line_mean5.116869283415678
deviation-center-line_min5.116869283415678
deviation-heading_max5.091155339747139
deviation-heading_mean5.091155339747139
deviation-heading_median5.091155339747139
deviation-heading_min5.091155339747139
distance-from-start_max1.6832286746350418
distance-from-start_mean1.6832286746350418
distance-from-start_median1.6832286746350418
distance-from-start_min1.6832286746350418
driven_any_max3.5045866946371738
driven_any_mean3.5045866946371738
driven_any_median3.5045866946371738
driven_any_min3.5045866946371738
driven_lanedir_consec_max2.0183982038959174
driven_lanedir_consec_mean2.0183982038959174
driven_lanedir_consec_min2.0183982038959174
driven_lanedir_max3.36042557719213
driven_lanedir_mean3.36042557719213
driven_lanedir_median3.36042557719213
driven_lanedir_min3.36042557719213
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-001-ego0": {"driven_any": 3.5045866946371738, "survival_time": 59.99999999999873, "driven_lanedir": 3.36042557719213, "in-drivable-lane": 2.499999999999858, "deviation-heading": 5.091155339747139, "distance-from-start": 1.6832286746350418, "deviation-center-line": 5.116869283415678, "driven_lanedir_consec": 2.0183982038959174}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
9230853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4host-errornodavinci-stage-02-6.2.460:00:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon' 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9082853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4successnodavinci-stage-02-6.2.460:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.549999999999912
driven_lanedir_consec_median3.4373147503288832
deviation-center-line_median5.543408016755537


other stats
deviation-center-line_max7.09102922648354
deviation-center-line_mean5.54329471184905
deviation-center-line_min3.995333587401586
deviation-heading_max7.066664369148437
deviation-heading_mean5.842960213142369
deviation-heading_median6.8999459874551246
deviation-heading_min2.505284508510791
distance-from-start_max2.955798853097406
distance-from-start_mean2.4988165096278374
distance-from-start_median2.699886878673919
distance-from-start_min1.6396934280661062
driven_any_max3.579593246505303
driven_any_mean3.521842404663172
driven_any_median3.5330944521151153
driven_any_min3.441587467917153
driven_lanedir_consec_max3.525823359544204
driven_lanedir_consec_mean3.4022655912637405
driven_lanedir_consec_min3.2086095048529906
driven_lanedir_max3.525823359544204
driven_lanedir_mean3.4022655912637405
driven_lanedir_median3.4373147503288832
driven_lanedir_min3.2086095048529906
in-drivable-lane_max4.5999999999999055
in-drivable-lane_mean1.9249999999999323
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.51959204448395, "survival_time": 59.99999999999873, "driven_lanedir": 3.385438564236927, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066664369148437, "distance-from-start": 2.7565963439290773, "deviation-center-line": 5.430438899566171, "driven_lanedir_consec": 3.385438564236927}, "autolab-000-ego2": {"driven_any": 3.5465968597462805, "survival_time": 59.99999999999873, "driven_lanedir": 3.48919093642084, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.505284508510791, "distance-from-start": 2.643177413418761, "deviation-center-line": 3.995333587401586, "driven_lanedir_consec": 3.48919093642084}, "autolab-000-ego3": {"driven_any": 3.441587467917153, "survival_time": 59.99999999999873, "driven_lanedir": 3.2086095048529906, "in-drivable-lane": 4.5999999999999055, "deviation-heading": 6.977755733974964, "distance-from-start": 1.6396934280661062, "deviation-center-line": 7.09102922648354, "driven_lanedir_consec": 3.2086095048529906}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible