Duckietown Challenges Home Challenges Submissions

Submission 1697

Submission1697
Competingyes
Challengeaido-LFV_multi-full-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16709 sim-1of4: 16712 sim-2of4: 16706 sim-3of4: 16699
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

16712

Click the images to see detailed statistics about the episode.

loop-000

16709

Click the images to see detailed statistics about the episode.

autolab-000

16706

Click the images to see detailed statistics about the episode.

loop2-000

16699

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16712sim-1of4successyes0:16:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.9999999999999822
driven_lanedir_consec_median3.396874188758651
deviation-center-line_median6.848336335212338


other stats
deviation-center-line_max7.516036575940118
deviation-center-line_mean6.209131018472381
deviation-center-line_min3.6238148275247304
deviation-heading_max7.032818929812941
deviation-heading_mean4.55196967857351
deviation-heading_median4.199788237499533
deviation-heading_min2.7754833094820346
distance-from-start_max2.9834410770695685
distance-from-start_mean2.4797248726783128
distance-from-start_median2.446473764157263
distance-from-start_min2.0425108853291554
driven_any_max3.579596486578675
driven_any_mean3.314094256325256
driven_any_median3.5210921058800326
driven_any_min2.6345963269622827
driven_lanedir_consec_max3.551753017565808
driven_lanedir_consec_mean3.229798941754201
driven_lanedir_consec_min2.573694371933692
driven_lanedir_max3.551753017565808
driven_lanedir_mean3.229798941754201
driven_lanedir_median3.396874188758651
driven_lanedir_min2.573694371933692
in-drivable-lane_max2.9999999999998295
in-drivable-lane_mean1.2499999999999485
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6345963269622827, "survival_time": 59.99999999999873, "driven_lanedir": 2.573694371933692, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920074235215898, "distance-from-start": 2.0425108853291554, "deviation-center-line": 7.516036575940118, "driven_lanedir_consec": 2.573694371933692}, "loop-000-ego1": {"driven_any": 3.579596486578675, "survival_time": 59.99999999999873, "driven_lanedir": 3.551753017565808, "in-drivable-lane": 0.0, "deviation-heading": 2.7754833094820346, "distance-from-start": 2.724162342686075, "deviation-center-line": 6.299841022357562, "driven_lanedir_consec": 3.551753017565808}, "loop-000-ego2": {"driven_any": 3.5525920285820543, "survival_time": 59.99999999999873, "driven_lanedir": 3.458623985525704, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 7.032818929812941, "distance-from-start": 2.9834410770695685, "deviation-center-line": 3.6238148275247304, "driven_lanedir_consec": 3.458623985525704}, "loop-000-ego3": {"driven_any": 3.489592183178011, "survival_time": 59.99999999999873, "driven_lanedir": 3.335124391991598, "in-drivable-lane": 2.9999999999998295, "deviation-heading": 5.479502239783168, "distance-from-start": 2.168785185628451, "deviation-center-line": 7.396831648067114, "driven_lanedir_consec": 3.335124391991598}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16709sim-0of4successyes0:18:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.7186759709641253
deviation-center-line_median5.862131942992704


other stats
deviation-center-line_max6.8926428573142395
deviation-center-line_mean5.678345665140167
deviation-center-line_min4.0964759172610234
deviation-heading_max8.918457822311643
deviation-heading_mean7.081123884150349
deviation-heading_median7.087670971017298
deviation-heading_min5.2306957722551575
distance-from-start_max2.8296782642090292
distance-from-start_mean1.888864829800502
distance-from-start_median1.639347737745438
distance-from-start_min1.4470855795021027
driven_any_max3.524090671773667
driven_any_mean3.5147133774298376
driven_any_median3.518834998148701
driven_any_min3.4970928416482807
driven_lanedir_consec_max3.391077995430446
driven_lanedir_consec_mean2.708466243383813
driven_lanedir_consec_min2.0054350361765554
driven_lanedir_max3.391077995430446
driven_lanedir_mean3.3679532290440797
driven_lanedir_median3.3641150341728117
driven_lanedir_min3.3525048524002488
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5180863448801456, "survival_time": 59.99999999999873, "driven_lanedir": 3.373947912234794, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 6.8453385018692146, "distance-from-start": 1.6666260059194336, "deviation-center-line": 4.0964759172610234, "driven_lanedir_consec": 2.0054350361765554}, "autolab-000-ego1": {"driven_any": 3.524090671773667, "survival_time": 59.99999999999873, "driven_lanedir": 3.391077995430446, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 7.33000344016538, "distance-from-start": 2.8296782642090292, "deviation-center-line": 6.250381576789261, "driven_lanedir_consec": 3.391077995430446}, "autolab-000-ego2": {"driven_any": 3.4970928416482807, "survival_time": 59.99999999999873, "driven_lanedir": 3.354282156110829, "in-drivable-lane": 2.749999999999872, "deviation-heading": 5.2306957722551575, "distance-from-start": 1.612069469571442, "deviation-center-line": 6.8926428573142395, "driven_lanedir_consec": 3.354282156110829}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16706sim-2of4successyes0:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.949999999999754
in-drivable-lane_median2.0999999999999854
driven_lanedir_consec_median1.6184374408409197
deviation-center-line_median5.314566823663881


other stats
deviation-center-line_max5.605898707577726
deviation-center-line_mean5.314566823663881
deviation-center-line_min5.0232349397500355
deviation-heading_max12.492151788067773
deviation-heading_mean8.7311003580401
deviation-heading_median8.7311003580401
deviation-heading_min4.970048928012427
distance-from-start_max1.619836734308344
distance-from-start_mean1.309141287354286
distance-from-start_median1.309141287354286
distance-from-start_min0.998445840400228
driven_any_max2.3617420337632864
driven_any_mean1.724083393442756
driven_any_median1.724083393442756
driven_any_min1.0864247531222258
driven_lanedir_consec_max2.2050573724797125
driven_lanedir_consec_mean1.6184374408409197
driven_lanedir_consec_min1.031817509202127
driven_lanedir_max2.2050573724797125
driven_lanedir_mean1.6184374408409197
driven_lanedir_median1.6184374408409197
driven_lanedir_min1.031817509202127
in-drivable-lane_max3.0999999999999552
in-drivable-lane_mean2.0999999999999854
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0864247531222258, "survival_time": 41.949999999999754, "driven_lanedir": 1.031817509202127, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 12.492151788067773, "distance-from-start": 0.998445840400228, "deviation-center-line": 5.605898707577726, "driven_lanedir_consec": 1.031817509202127}, "loop2-000-ego1": {"driven_any": 2.3617420337632864, "survival_time": 41.949999999999754, "driven_lanedir": 2.2050573724797125, "in-drivable-lane": 3.0999999999999552, "deviation-heading": 4.970048928012427, "distance-from-start": 1.619836734308344, "deviation-center-line": 5.0232349397500355, "driven_lanedir_consec": 2.2050573724797125}}
simulation-passed1
survival_time_max41.949999999999754
survival_time_mean41.949999999999754
survival_time_min41.949999999999754
No reset possible
16699sim-3of4successyes0:21:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999863
driven_lanedir_consec_median2.2674023788849116
deviation-center-line_median5.536893088323296


other stats
deviation-center-line_max5.653870952725518
deviation-center-line_mean5.457974501938994
deviation-center-line_min5.104240878383868
deviation-heading_max10.449364417109743
deviation-heading_mean10.11792868792557
deviation-heading_median10.098710996708824
deviation-heading_min9.824928341174887
distance-from-start_max2.5614095423342453
distance-from-start_mean2.0332734037963895
distance-from-start_median2.023972936634097
distance-from-start_min1.523738199583119
driven_any_max3.4820813210684833
driven_any_mean3.4569958269192997
driven_any_median3.4490866130099316
driven_any_min3.447728760588852
driven_lanedir_consec_max3.143458087423762
driven_lanedir_consec_mean2.322116699583174
driven_lanedir_consec_min1.610203953139111
driven_lanedir_max3.2610750728685343
driven_lanedir_mean3.200371790495466
driven_lanedir_median3.1833277569609386
driven_lanedir_min3.173756575191452
in-drivable-lane_max4.399999999999963
in-drivable-lane_mean4.0874999999999115
in-drivable-lane_min3.249999999999958
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4490933302185676, "survival_time": 59.99999999999873, "driven_lanedir": 3.182424665546428, "in-drivable-lane": 4.3499999999998415, "deviation-heading": 10.087643041980582, "distance-from-start": 2.5614095423342453, "deviation-center-line": 5.533862530350289, "driven_lanedir_consec": 3.143458087423762}, "zigzag-000-ego1": {"driven_any": 3.447728760588852, "survival_time": 59.99999999999873, "driven_lanedir": 3.173756575191452, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.449364417109743, "distance-from-start": 1.5342133784714156, "deviation-center-line": 5.653870952725518, "driven_lanedir_consec": 1.6329981415649488}, "zigzag-000-ego2": {"driven_any": 3.4820813210684833, "survival_time": 59.99999999999873, "driven_lanedir": 3.2610750728685343, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778951437065, "distance-from-start": 1.523738199583119, "deviation-center-line": 5.104240878383868, "driven_lanedir_consec": 1.610203953139111}, "zigzag-000-ego3": {"driven_any": 3.4490798958012956, "survival_time": 59.99999999999873, "driven_lanedir": 3.184230848375449, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.824928341174887, "distance-from-start": 2.5137324947967783, "deviation-center-line": 5.5399236462963035, "driven_lanedir_consec": 2.901806616204875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16695sim-2of4timeoutyes0:00:38
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16694sim-1of4timeoutyes0:01:05
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16693sim-0of4timeoutyes0:04:10
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible