Duckietown Challenges Home Challenges Submissions

Submission 721

Submission721
Competinguser retired
Challengeaido-LFV_multi-state-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 8036 sim-1of4: 8034 sim-2of4: 8035 sim-3of4: 8037
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

8037

Click the images to see detailed statistics about the episode.

autolab-000

8036

Click the images to see detailed statistics about the episode.

zigzag-000

8035

Click the images to see detailed statistics about the episode.

loop-000

8034

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
8037348successyes0:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.3543500771721333
deviation-center-line_median6.190490090892524


other stats
deviation-center-line_max7.342897133571408
deviation-center-line_mean5.815429151776418
deviation-center-line_min3.537839291749216
deviation-heading_max8.643847237807897
deviation-heading_mean5.76930803334383
deviation-heading_median5.4624178823709
deviation-heading_min3.5085491308256205
distance-from-start_max2.193280058841909
distance-from-start_mean1.7770214145879324
distance-from-start_median1.782212633108848
distance-from-start_min1.350380333292125
driven_any_max3.5195878597993744
driven_any_mean3.0189647101076136
driven_any_median3.3875880363680313
driven_any_min1.7810949078950165
driven_lanedir_consec_max3.321041772578862
driven_lanedir_consec_mean2.4282328710653815
driven_lanedir_consec_min1.6831895573383966
driven_lanedir_max3.387629211991127
driven_lanedir_mean2.883329810013805
driven_lanedir_median3.231250235362848
driven_lanedir_min1.6831895573383966
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.2780872163786823, "survival_time": 59.99999999999873, "driven_lanedir": 3.141458698146834, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.2703183754430984, "distance-from-start": 2.193280058841909, "deviation-center-line": 3.537839291749216, "driven_lanedir_consec": 2.590440128989314}, "autolab-000-ego1": {"driven_any": 1.7810949078950165, "survival_time": 59.99999999999873, "driven_lanedir": 1.6831895573383966, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.5085491308256205, "distance-from-start": 1.350380333292125, "deviation-center-line": 7.342897133571408, "driven_lanedir_consec": 1.6831895573383966}, "autolab-000-ego2": {"driven_any": 3.4970888563573808, "survival_time": 59.99999999999873, "driven_lanedir": 3.321041772578862, "in-drivable-lane": 2.749999999999872, "deviation-heading": 8.643847237807897, "distance-from-start": 2.062725630049209, "deviation-center-line": 5.639409156018586, "driven_lanedir_consec": 3.321041772578862}, "autolab-000-ego3": {"driven_any": 3.5195878597993744, "survival_time": 59.99999999999873, "driven_lanedir": 3.387629211991127, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654517389298703, "distance-from-start": 1.501699636168487, "deviation-center-line": 6.741571025766462, "driven_lanedir_consec": 2.1182600253549526}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8036345successyes0:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.3499999999998895
driven_lanedir_consec_median2.267585593147171
deviation-center-line_median5.560918014665912


other stats
deviation-center-line_max5.665543792144511
deviation-center-line_mean5.372714900745724
deviation-center-line_min4.703479781506561
deviation-heading_max10.454471906775368
deviation-heading_mean9.60574823600536
deviation-heading_median9.670620861388786
deviation-heading_min8.627279314468504
distance-from-start_max3.040685334864981
distance-from-start_mean2.034724130591448
distance-from-start_median2.024381861625972
distance-from-start_min1.0494474642488678
driven_any_max3.579590416454709
driven_any_mean3.4814077587627867
driven_any_median3.4491559187077225
driven_any_min3.4477287811809942
driven_lanedir_consec_max3.5003518584529596
driven_lanedir_consec_mean2.3551363596409516
driven_lanedir_consec_min1.3850223938165058
driven_lanedir_max3.5003518584529596
driven_lanedir_mean3.2651579535505793
driven_lanedir_median3.1933047146361604
driven_lanedir_min3.1736705264770393
in-drivable-lane_max4.399999999999963
in-drivable-lane_mean3.2749999999999355
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4490819319908037, "survival_time": 59.99999999999873, "driven_lanedir": 3.2020366210440554, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279314468504, "distance-from-start": 1.0494474642488678, "deviation-center-line": 5.586766623668063, "driven_lanedir_consec": 1.3850223938165058}, "zigzag-000-ego1": {"driven_any": 3.4477287811809942, "survival_time": 59.99999999999873, "driven_lanedir": 3.1736705264770393, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.454471906775368, "distance-from-start": 1.5345351376129468, "deviation-center-line": 5.665543792144511, "driven_lanedir_consec": 1.63302493923022}, "zigzag-000-ego2": {"driven_any": 3.579590416454709, "survival_time": 59.99999999999873, "driven_lanedir": 3.5003518584529596, "in-drivable-lane": 0.0, "deviation-heading": 9.518767273314904, "distance-from-start": 3.040685334864981, "deviation-center-line": 4.703479781506561, "driven_lanedir_consec": 3.5003518584529596}, "zigzag-000-ego3": {"driven_any": 3.449229905424642, "survival_time": 59.99999999999873, "driven_lanedir": 3.184572808228265, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.822474449462668, "distance-from-start": 2.514228585638997, "deviation-center-line": 5.535069405663762, "driven_lanedir_consec": 2.9021462470641213}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8035347successyes0:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.2749999999998938
driven_lanedir_consec_median2.7120051214998897
deviation-center-line_median6.830233665514818


other stats
deviation-center-line_max7.154226729483074
deviation-center-line_mean6.80468016793723
deviation-center-line_min6.404026611236209
deviation-heading_max8.100880505602532
deviation-heading_mean5.9731680892918515
deviation-heading_median5.501308317705954
deviation-heading_min4.789175216152964
distance-from-start_max2.4160153980396744
distance-from-start_mean1.6093143701035804
distance-from-start_median1.5660334941622691
distance-from-start_min0.8891750940501092
driven_any_max3.519587859797628
driven_any_mean3.4828384673822983
driven_any_median3.481341572069042
driven_any_min3.4490828655934807
driven_lanedir_consec_max3.3303389838909694
driven_lanedir_consec_mean2.6711178717712896
driven_lanedir_consec_min1.9301222601944088
driven_lanedir_max3.3876166768750724
driven_lanedir_mean3.3082911459990787
driven_lanedir_median3.318066301460249
driven_lanedir_min3.2094153042007436
in-drivable-lane_max4.349999999999898
in-drivable-lane_mean3.2249999999999286
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 3.476091095800351, "survival_time": 59.99999999999873, "driven_lanedir": 3.305793619029529, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097215753208, "distance-from-start": 1.6303675548965662, "deviation-center-line": 7.154226729483074, "driven_lanedir_consec": 3.305793619029529}, "loop-000-ego1": {"driven_any": 3.486592048337733, "survival_time": 59.99999999999873, "driven_lanedir": 3.3303389838909694, "in-drivable-lane": 3.0999999999999055, "deviation-heading": 4.789175216152964, "distance-from-start": 2.4160153980396744, "deviation-center-line": 6.918889908889863, "driven_lanedir_consec": 3.3303389838909694}, "loop-000-ego2": {"driven_any": 3.4490828655934807, "survival_time": 59.99999999999873, "driven_lanedir": 3.2094153042007436, "in-drivable-lane": 4.349999999999898, "deviation-heading": 8.100880505602532, "distance-from-start": 0.8891750940501092, "deviation-center-line": 6.404026611236209, "driven_lanedir_consec": 1.9301222601944088}, "loop-000-ego3": {"driven_any": 3.519587859797628, "survival_time": 59.99999999999873, "driven_lanedir": 3.3876166768750724, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545194196587, "distance-from-start": 1.501699433427972, "deviation-center-line": 6.741577422139774, "driven_lanedir_consec": 2.118216623970251}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8034346successyes0:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.6749999999999297
driven_lanedir_consec_median2.3321110407089
deviation-center-line_median6.1369806192729595


other stats
deviation-center-line_max7.370362495690404
deviation-center-line_mean6.1369806192729595
deviation-center-line_min4.903598742855515
deviation-heading_max7.744574536560539
deviation-heading_mean7.1066352689292085
deviation-heading_median7.1066352689292085
deviation-heading_min6.468696001297878
distance-from-start_max1.6480964227602637
distance-from-start_mean1.427048605296939
distance-from-start_median1.427048605296939
distance-from-start_min1.206000787833615
driven_any_max3.4850840176973694
driven_any_mean3.4693367131669
driven_any_median3.4693367131669
driven_any_min3.4535894086364305
driven_lanedir_consec_max3.243830288342226
driven_lanedir_consec_mean2.3321110407089
driven_lanedir_consec_min1.4203917930755745
driven_lanedir_max3.2905371589856234
driven_lanedir_mean3.2671837236639245
driven_lanedir_median3.2671837236639245
driven_lanedir_min3.243830288342226
in-drivable-lane_max4.199999999999893
in-drivable-lane_mean3.6749999999999297
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840176973694, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905371589856234, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574536560539, "distance-from-start": 1.206000787833615, "deviation-center-line": 4.903598742855515, "driven_lanedir_consec": 1.4203917930755745}, "loop2-000-ego1": {"driven_any": 3.4535894086364305, "survival_time": 59.99999999999873, "driven_lanedir": 3.243830288342226, "in-drivable-lane": 4.199999999999893, "deviation-heading": 6.468696001297878, "distance-from-start": 1.6480964227602637, "deviation-center-line": 7.370362495690404, "driven_lanedir_consec": 3.243830288342226}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6367283successyes0:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6366284successyes0:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6365282successyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6364285successyes0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5495277successyes0:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5494275successyes0:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5492274successyes0:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5491276successyes0:07:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible