Duckietown Challenges Home Challenges Submissions

Submission 1688

Submission1688
Competingyes
Challengeaido-LFV_multi-state-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16732 sim-1of4: 16734 sim-2of4: 16733 sim-3of4: 16730
Next
User labelbaseline-simple-yield
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16734sim-1of4successyes0:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.432891091920204
deviation-center-line_median0.289208824985897


other stats
deviation-center-line_max0.3421554544578389
deviation-center-line_mean0.28103246849939895
deviation-center-line_min0.20355676956796287
deviation-heading_max2.532090128626256
deviation-heading_mean2.1233379748915846
deviation-heading_median2.091598288393426
deviation-heading_min1.77806519415323
distance-from-start_max3.1537593976013736
distance-from-start_mean2.7244723642293835
distance-from-start_median2.704318718385367
distance-from-start_min2.3354926225454276
driven_any_max5.681727317187617
driven_any_mean5.356790518866223
driven_any_median5.444463301686621
driven_any_min4.856508154904032
driven_lanedir_consec_max5.66768880982045
driven_lanedir_consec_mean5.346200743455493
driven_lanedir_consec_min4.851331980161115
driven_lanedir_max5.66768880982045
driven_lanedir_mean5.346200743455493
driven_lanedir_median5.432891091920204
driven_lanedir_min4.851331980161115
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.292009447895602, "survival_time": 59.99999999999873, "driven_lanedir": 5.278658727024759, "in-drivable-lane": 0.0, "deviation-heading": 2.532090128626256, "distance-from-start": 2.693777297091483, "deviation-center-line": 0.295448770789397, "driven_lanedir_consec": 5.278658727024759}, "loop-000-ego1": {"driven_any": 5.596917155477642, "survival_time": 59.99999999999873, "driven_lanedir": 5.5871234568156485, "in-drivable-lane": 0.0, "deviation-heading": 2.16404711059614, "distance-from-start": 2.3354926225454276, "deviation-center-line": 0.3421554544578389, "driven_lanedir_consec": 5.5871234568156485}, "loop-000-ego2": {"driven_any": 4.856508154904032, "survival_time": 59.99999999999873, "driven_lanedir": 4.851331980161115, "in-drivable-lane": 0.0, "deviation-heading": 1.77806519415323, "distance-from-start": 3.1537593976013736, "deviation-center-line": 0.20355676956796287, "driven_lanedir_consec": 4.851331980161115}, "loop-000-ego3": {"driven_any": 5.681727317187617, "survival_time": 59.99999999999873, "driven_lanedir": 5.66768880982045, "in-drivable-lane": 0.0, "deviation-heading": 2.0191494661907115, "distance-from-start": 2.7148601396792507, "deviation-center-line": 0.282968879182397, "driven_lanedir_consec": 5.66768880982045}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16733sim-2of4successyes0:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.007019068997936
deviation-center-line_median0.38011035127619336


other stats
deviation-center-line_max0.4837985399042229
deviation-center-line_mean0.38011035127619336
deviation-center-line_min0.2764221626481639
deviation-heading_max3.0253232596119735
deviation-heading_mean2.714016045259945
deviation-heading_median2.714016045259945
deviation-heading_min2.4027088309079163
distance-from-start_max1.521674143069448
distance-from-start_mean1.2769944684334753
distance-from-start_median1.2769944684334753
distance-from-start_min1.0323147937975024
driven_any_max5.08623281214027
driven_any_mean5.021228797880976
driven_any_median5.021228797880976
driven_any_min4.956224783621684
driven_lanedir_consec_max5.0705723110226515
driven_lanedir_consec_mean5.007019068997936
driven_lanedir_consec_min4.94346582697322
driven_lanedir_max5.0705723110226515
driven_lanedir_mean5.007019068997936
driven_lanedir_median5.007019068997936
driven_lanedir_min4.94346582697322
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.956224783621684, "survival_time": 59.99999999999873, "driven_lanedir": 4.94346582697322, "in-drivable-lane": 0.0, "deviation-heading": 2.4027088309079163, "distance-from-start": 1.521674143069448, "deviation-center-line": 0.2764221626481639, "driven_lanedir_consec": 4.94346582697322}, "loop2-000-ego1": {"driven_any": 5.08623281214027, "survival_time": 59.99999999999873, "driven_lanedir": 5.0705723110226515, "in-drivable-lane": 0.0, "deviation-heading": 3.0253232596119735, "distance-from-start": 1.0323147937975024, "deviation-center-line": 0.4837985399042229, "driven_lanedir_consec": 5.0705723110226515}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16732sim-0of4successyes0:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.806165216596741
deviation-center-line_median0.346929751854674


other stats
deviation-center-line_max3.4683962371431485
deviation-center-line_mean1.0771419870569272
deviation-center-line_min0.14631220737521272
deviation-heading_max18.309428016005143
deviation-heading_mean6.183544615708726
deviation-heading_median2.5217690015662964
deviation-heading_min1.3812124436971696
distance-from-start_max3.2999669320195104
distance-from-start_mean1.5546858371442225
distance-from-start_median1.459388208278689
distance-from-start_min3.1401849173675503e-16
driven_any_max5.037078959860759
driven_any_mean2.168309320245248
driven_any_median1.818079160559928
driven_any_min3.7682219008410875e-13
driven_lanedir_consec_max5.026911335982149
driven_lanedir_consec_mean2.159846205080773
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max5.026911335982149
driven_lanedir_mean2.159846205080773
driven_lanedir_median1.806165216596741
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.631893286204257, "survival_time": 59.99999999999873, "driven_lanedir": 1.6201843097857167, "in-drivable-lane": 0.0, "deviation-heading": 1.3812124436971696, "distance-from-start": 1.2742263432539964, "deviation-center-line": 0.14631220737521272, "driven_lanedir_consec": 1.6201843097857167}, "autolab-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 3.4683962371431485, "driven_lanedir_consec": 0.0001430511474609375}, "autolab-000-ego2": {"driven_any": 5.037078959860759, "survival_time": 59.99999999999873, "driven_lanedir": 5.026911335982149, "in-drivable-lane": 0.0, "deviation-heading": 2.8050873323880503, "distance-from-start": 3.2999669320195104, "deviation-center-line": 0.3909808473609087, "driven_lanedir_consec": 5.026911335982149}, "autolab-000-ego3": {"driven_any": 2.0042650349155986, "survival_time": 59.99999999999873, "driven_lanedir": 1.992146123407765, "in-drivable-lane": 0.0, "deviation-heading": 2.2384506707445424, "distance-from-start": 1.644550073303382, "deviation-center-line": 0.3028786563484393, "driven_lanedir_consec": 1.992146123407765}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16730sim-3of4successyes0:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.354121751024167
deviation-center-line_median1.5907898424502358


other stats
deviation-center-line_max3.468394386342305
deviation-center-line_mean1.7204870668180092
deviation-center-line_min0.23197419602925975
deviation-heading_max37.822937304744066
deviation-heading_mean15.410893192415545
deviation-heading_median10.924693244125017
deviation-heading_min1.9712489766680776
distance-from-start_max4.757326687346635
distance-from-start_mean1.9702948065027592
distance-from-start_median1.5619262693322007
distance-from-start_min2.220446049250313e-16
driven_any_max5.8896577604958456
driven_any_mean2.651059104566359
driven_any_median2.357289328884662
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.867756494746063
driven_lanedir_consec_mean2.6439994058236502
driven_lanedir_consec_min-2.3734997967039817e-06
driven_lanedir_max5.867756494746063
driven_lanedir_mean2.6439994058236502
driven_lanedir_median2.354121751024167
driven_lanedir_min-2.3734997967039817e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.8896577604958456, "survival_time": 59.99999999999873, "driven_lanedir": 5.867756494746063, "in-drivable-lane": 0.0, "deviation-heading": 3.5399584722448916, "distance-from-start": 4.757326687346635, "deviation-center-line": 0.4191165927509713, "driven_lanedir_consec": 5.867756494746063}, "zigzag-000-ego1": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.468394386342305, "driven_lanedir_consec": 0.0}, "zigzag-000-ego2": {"driven_any": 4.714578657768775, "survival_time": 59.99999999999873, "driven_lanedir": 4.708243502048335, "in-drivable-lane": 0.0, "deviation-heading": 1.9712489766680776, "distance-from-start": 3.123852538664401, "deviation-center-line": 0.23197419602925975, "driven_lanedir_consec": 4.708243502048335}, "zigzag-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.3734997967039817e-06, "in-drivable-lane": 0.0, "deviation-heading": 37.822937304744066, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624630921495004, "driven_lanedir_consec": -2.3734997967039817e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible