Duckietown Challenges Home Challenges Submissions

Submission 1746

Submission1746
Competingyes
Challengeaido-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16506 sim-1of4: 16504 sim-2of4: 16503 sim-3of4: 16502
Next
User labelminimal-agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16506sim-0of4successyes0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.800000000000075
in-drivable-lane_median10.375000000000036
driven_lanedir_consec_median0.2917316817322182
deviation-center-line_median0.3629004861869609


other stats
deviation-center-line_max0.8581383651069324
deviation-center-line_mean0.42294435916773776
deviation-center-line_min0.1078380991900969
deviation-heading_max2.3443591222660065
deviation-heading_mean1.288863217377771
deviation-heading_median1.0259544132050231
deviation-heading_min0.7591849208350303
distance-from-start_max2.2726748388714895
distance-from-start_mean0.9481278044889968
distance-from-start_median0.535788907847825
distance-from-start_min0.4482585633888487
driven_any_max2.2731784865558287
driven_any_mean0.9482607511676968
driven_any_median0.5357988542299352
driven_any_min0.4482668096550876
driven_lanedir_consec_max1.1053767537677208
driven_lanedir_consec_mean0.4508020778201367
driven_lanedir_consec_min0.1143681940483896
driven_lanedir_max1.1053767537677208
driven_lanedir_mean0.4508020778201367
driven_lanedir_median0.2917316817322182
driven_lanedir_min0.1143681940483896
in-drivable-lane_max13.600000000000076
in-drivable-lane_mean8.587500000000038
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4482668096550913, "survival_time": 14.800000000000075, "driven_lanedir": 0.13665955970746824, "in-drivable-lane": 13.400000000000077, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4482585633888487, "deviation-center-line": 0.1078380991900969, "driven_lanedir_consec": 0.13665955970746824}, "autolab-000-ego1": {"driven_any": 2.2731784865558287, "survival_time": 14.800000000000075, "driven_lanedir": 1.1053767537677208, "in-drivable-lane": 7.349999999999999, "deviation-heading": 2.3443591222660065, "distance-from-start": 2.2726748388714895, "deviation-center-line": 0.6095492402054283, "driven_lanedir_consec": 1.1053767537677208}, "autolab-000-ego2": {"driven_any": 0.4482668096550876, "survival_time": 14.800000000000075, "driven_lanedir": 0.44680380375696815, "in-drivable-lane": 0.0, "deviation-heading": 1.1011039835751082, "distance-from-start": 0.44825856338885, "deviation-center-line": 0.8581383651069324, "driven_lanedir_consec": 0.44680380375696815}, "autolab-000-ego3": {"driven_any": 0.6233308988047791, "survival_time": 14.800000000000075, "driven_lanedir": 0.1143681940483896, "in-drivable-lane": 13.600000000000076, "deviation-heading": 0.7591849208350303, "distance-from-start": 0.6233192523068, "deviation-center-line": 0.11625173216849344, "driven_lanedir_consec": 0.1143681940483896}}
simulation-passed1
survival_time_max14.800000000000075
survival_time_mean14.800000000000075
survival_time_min14.800000000000075
No reset possible
16504sim-1of4successyes0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.200000000000069
in-drivable-lane_median11.000000000000057
driven_lanedir_consec_median0.3152938274760638
deviation-center-line_median0.26684016190284265


other stats
deviation-center-line_max0.3356902421161755
deviation-center-line_mean0.24640550413561532
deviation-center-line_min0.11625145062060036
deviation-heading_max2.486301423131022
deviation-heading_mean1.563252755154394
deviation-heading_median1.5495075837941936
deviation-heading_min0.6676944298981667
distance-from-start_max2.173942193160628
distance-from-start_mean1.5951256386014727
distance-from-start_median1.745851963918557
distance-from-start_min0.7148564334081484
driven_any_max2.174275713561512
driven_any_mean1.595266942374297
driven_any_median1.7459619017485188
driven_any_min0.7148682524386378
driven_lanedir_consec_max0.6842972359477595
driven_lanedir_consec_mean0.3573150593764172
driven_lanedir_consec_min0.11437534660578176
driven_lanedir_max0.6842972359477595
driven_lanedir_mean0.3573150593764172
driven_lanedir_median0.3152938274760638
driven_lanedir_min0.11437534660578176
in-drivable-lane_max13.000000000000068
in-drivable-lane_mean11.162500000000064
in-drivable-lane_min9.650000000000077
per-episodes
details{"loop-000-ego0": {"driven_any": 2.174275713561512, "survival_time": 14.200000000000069, "driven_lanedir": 0.3224767982503016, "in-drivable-lane": 11.050000000000042, "deviation-heading": 2.486301423131022, "distance-from-start": 2.173942193160628, "deviation-center-line": 0.27411484919814116, "driven_lanedir_consec": 0.3224767982503016}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 14.200000000000069, "driven_lanedir": 0.30811085670182603, "in-drivable-lane": 10.95000000000007, "deviation-heading": 2.339830246753357, "distance-from-start": 1.7251591376367597, "deviation-center-line": 0.3356902421161755, "driven_lanedir_consec": 0.30811085670182603}, "loop-000-ego2": {"driven_any": 1.766654784250807, "survival_time": 14.200000000000069, "driven_lanedir": 0.6842972359477595, "in-drivable-lane": 9.650000000000077, "deviation-heading": 0.6676944298981667, "distance-from-start": 1.7665447902003542, "deviation-center-line": 0.2595654746075442, "driven_lanedir_consec": 0.6842972359477595}, "loop-000-ego3": {"driven_any": 0.7148682524386378, "survival_time": 14.200000000000069, "driven_lanedir": 0.11437534660578176, "in-drivable-lane": 13.000000000000068, "deviation-heading": 0.7591849208350301, "distance-from-start": 0.7148564334081484, "deviation-center-line": 0.11625145062060036, "driven_lanedir_consec": 0.11437534660578176}}
simulation-passed1
survival_time_max14.200000000000069
survival_time_mean14.200000000000069
survival_time_min14.200000000000069
No reset possible
16503sim-2of4successyes0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.650000000000002
in-drivable-lane_median7.325000000000005
driven_lanedir_consec_median0.22238961894840312
deviation-center-line_median0.2217639861515468


other stats
deviation-center-line_max0.3356899474445727
deviation-center-line_mean0.2217639861515468
deviation-center-line_min0.10783802485852088
deviation-heading_max2.3398302467533574
deviation-heading_mean1.645317544794148
deviation-heading_median1.645317544794148
deviation-heading_min0.9508048428349386
distance-from-start_max1.4215609490996366
distance-from-start_mean1.232352636856231
distance-from-start_median1.232352636856231
distance-from-start_min1.0431443246128251
driven_any_max1.421667748584305
driven_any_mean1.2324324663788455
driven_any_median1.2324324663788455
driven_any_min1.043197184173386
driven_lanedir_consec_max0.3081134793062541
driven_lanedir_consec_mean0.22238961894840312
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.3081134793062541
driven_lanedir_mean0.22238961894840312
driven_lanedir_median0.22238961894840312
driven_lanedir_min0.1366657585905522
in-drivable-lane_max8.250000000000002
in-drivable-lane_mean7.325000000000005
in-drivable-lane_min6.400000000000007
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.043197184173386, "survival_time": 9.650000000000002, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.250000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128251, "deviation-center-line": 0.10783802485852088, "driven_lanedir_consec": 0.1366657585905522}, "loop2-000-ego1": {"driven_any": 1.421667748584305, "survival_time": 9.650000000000002, "driven_lanedir": 0.3081134793062541, "in-drivable-lane": 6.400000000000007, "deviation-heading": 2.3398302467533574, "distance-from-start": 1.4215609490996366, "deviation-center-line": 0.3356899474445727, "driven_lanedir_consec": 0.3081134793062541}}
simulation-passed1
survival_time_max9.650000000000002
survival_time_mean9.650000000000002
survival_time_min9.650000000000002
No reset possible
16502sim-3of4successyes0:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.200000000000166
in-drivable-lane_median19.625000000000163
driven_lanedir_consec_median0.17676532608959172
deviation-center-line_median0.12055883486711412


other stats
deviation-center-line_max0.8045746318533537
deviation-center-line_mean0.2853942640066456
deviation-center-line_min0.09588475443900028
deviation-heading_max5.2482884111975086
deviation-heading_mean1.8371274357323064
deviation-heading_median0.7612914460035247
deviation-heading_min0.5776384397246679
distance-from-start_max3.3354107982510546
distance-from-start_mean2.2110865327147784
distance-from-start_median2.191605904940471
distance-from-start_min1.1257235227271165
driven_any_max3.3361297078559655
driven_any_mean2.2114839832360524
driven_any_median2.1920133941339253
driven_any_min1.1257794368203942
driven_lanedir_consec_max1.1849271720723111
driven_lanedir_consec_mean0.4079658658358902
driven_lanedir_consec_min0.09340563909206612
driven_lanedir_max1.1849271720723111
driven_lanedir_mean0.4079658658358902
driven_lanedir_median0.17676532608959172
driven_lanedir_min0.09340563909206612
in-drivable-lane_max20.100000000000165
in-drivable-lane_mean17.837500000000155
in-drivable-lane_min12.00000000000012
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3361297078559655, "survival_time": 21.200000000000166, "driven_lanedir": 1.1849271720723111, "in-drivable-lane": 12.00000000000012, "deviation-heading": 5.2482884111975086, "distance-from-start": 3.3354107982510546, "deviation-center-line": 0.8045746318533537, "driven_lanedir_consec": 1.1849271720723111}, "zigzag-000-ego1": {"driven_any": 2.855019965863893, "survival_time": 21.200000000000166, "driven_lanedir": 0.14869325237796405, "in-drivable-lane": 19.850000000000165, "deviation-heading": 0.5776384397246679, "distance-from-start": 2.8543136070620254, "deviation-center-line": 0.1372078405659203, "driven_lanedir_consec": 0.14869325237796405}, "zigzag-000-ego2": {"driven_any": 1.5290068224039577, "survival_time": 21.200000000000166, "driven_lanedir": 0.20483739980121937, "in-drivable-lane": 19.40000000000017, "deviation-heading": 0.7499200019270054, "distance-from-start": 1.5288982028189169, "deviation-center-line": 0.09588475443900028, "driven_lanedir_consec": 0.20483739980121937}, "zigzag-000-ego3": {"driven_any": 1.1257794368203942, "survival_time": 21.200000000000166, "driven_lanedir": 0.09340563909206612, "in-drivable-lane": 20.100000000000165, "deviation-heading": 0.772662890080044, "distance-from-start": 1.1257235227271165, "deviation-center-line": 0.10390982916830796, "driven_lanedir_consec": 0.09340563909206612}}
simulation-passed1
survival_time_max21.200000000000166
survival_time_mean21.200000000000166
survival_time_min21.200000000000166
No reset possible