Duckietown Challenges Home Challenges Submissions

Submission 1716

Submission1716
Competingyes
Challengeaido-LFVI_multi-state-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16588 sim-1of4: 16587 sim-2of4: 16585 sim-3of4: 16586
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16588sim-0of4successyes0:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median2.825841304293628
deviation-center-line_median6.148412844000683


other stats
deviation-center-line_max7.459308588139718
deviation-center-line_mean5.79704956898892
deviation-center-line_min3.4320639998145963
deviation-heading_max5.71924387882506
deviation-heading_mean3.762143800377421
deviation-heading_median3.459178970777112
deviation-heading_min2.410973381130398
distance-from-start_max2.3395282410041216
distance-from-start_mean1.7201588165346102
distance-from-start_median1.841509860392298
distance-from-start_min0.8580873043497238
driven_any_max3.579593143168887
driven_any_mean2.845719156432434
driven_any_median2.859597815206898
driven_any_min2.0840878521470536
driven_lanedir_consec_max3.541021205942728
driven_lanedir_consec_mean2.496966407955825
driven_lanedir_consec_min0.795161817293316
driven_lanedir_max3.5571658869822893
driven_lanedir_mean2.7899921003455295
driven_lanedir_median2.8258414934613327
driven_lanedir_min1.9511195274771624
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.7875000000000112
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.889596951730418, "survival_time": 59.99999999999873, "driven_lanedir": 2.8328219934740586, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.497059451447388, "distance-from-start": 2.1662522780274744, "deviation-center-line": 7.459308588139718, "driven_lanedir_consec": 2.8328219934740586}, "udem-001-ego1": {"driven_any": 2.0840878521470536, "survival_time": 59.99999999999873, "driven_lanedir": 1.9511195274771624, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.71924387882506, "distance-from-start": 0.8580873043497238, "deviation-center-line": 6.835139580883994, "driven_lanedir_consec": 0.795161817293316}, "udem-001-ego2": {"driven_any": 2.8295986786833778, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486073, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130398, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113197}, "udem-001-ego3": {"driven_any": 3.579593143168887, "survival_time": 59.99999999999873, "driven_lanedir": 3.5571658869822893, "in-drivable-lane": 0.0, "deviation-heading": 4.421298490106836, "distance-from-start": 1.5167674427571216, "deviation-center-line": 3.4320639998145963, "driven_lanedir_consec": 3.541021205942728}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16587sim-1of4successyes0:10:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.04999999999999716
driven_lanedir_consec_median3.105242381638413
deviation-center-line_median4.2838554583648385


other stats
deviation-center-line_max6.480635029684861
deviation-center-line_mean4.233458533023654
deviation-center-line_min1.8854881856800791
deviation-heading_max6.074433982916035
deviation-heading_mean4.437287043141697
deviation-heading_median4.190213879538641
deviation-heading_min3.2942864305734707
distance-from-start_max2.6219633070118125
distance-from-start_mean2.3834433501492436
distance-from-start_median2.3769915028957085
distance-from-start_min2.157827087793745
driven_any_max3.5765946322989515
driven_any_mean3.229717557359504
driven_any_median3.2158432856394445
driven_any_min2.9105890258601756
driven_lanedir_consec_max3.4606351955763963
driven_lanedir_consec_mean3.0987684797264516
driven_lanedir_consec_min2.723953960052584
driven_lanedir_max3.5302995839808413
driven_lanedir_mean3.1848735445261127
driven_lanedir_median3.161506104690779
driven_lanedir_min2.8861823847420505
in-drivable-lane_max1.9499999999998892
in-drivable-lane_mean0.5124999999999709
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.9105890258601756, "survival_time": 59.99999999999873, "driven_lanedir": 2.8861823847420505, "in-drivable-lane": 0.0, "deviation-heading": 6.074433982916035, "distance-from-start": 2.157827087793745, "deviation-center-line": 3.0576160910267776, "driven_lanedir_consec": 2.723953960052584}, "udem-000-ego1": {"driven_any": 3.521095053928605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4216564650122128, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2942864305734707, "distance-from-start": 2.6219633070118125, "deviation-center-line": 6.480635029684861, "driven_lanedir_consec": 3.4216564650122128}, "udem-000-ego2": {"driven_any": 2.9105915173502845, "survival_time": 59.99999999999873, "driven_lanedir": 2.9013557443693445, "in-drivable-lane": 0.0, "deviation-heading": 3.947864180395224, "distance-from-start": 2.395368409966694, "deviation-center-line": 1.8854881856800791, "driven_lanedir_consec": 2.7888282982646126}, "udem-000-ego3": {"driven_any": 3.5765946322989515, "survival_time": 59.99999999999873, "driven_lanedir": 3.5302995839808413, "in-drivable-lane": 0.09999999999999432, "deviation-heading": 4.432563578682058, "distance-from-start": 2.3586145958247235, "deviation-center-line": 5.5100948257029, "driven_lanedir_consec": 3.4606351955763963}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16586sim-3of4successyes0:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median1.857807625020336
deviation-center-line_median5.28259065053435


other stats
deviation-center-line_max6.835139014020123
deviation-center-line_mean5.43336239298157
deviation-center-line_min4.333129256837456
deviation-heading_max10.8119794492084
deviation-heading_mean6.0042732735036015
deviation-heading_median4.89679221006279
deviation-heading_min3.4115292246804296
distance-from-start_max2.2673905887925794
distance-from-start_mean1.383447713974703
distance-from-start_median1.2056823254161633
distance-from-start_min0.8550356162739062
driven_any_max3.5795879547671228
driven_any_mean2.5262149201005553
driven_any_median2.515341830463492
driven_any_min1.494588064708115
driven_lanedir_consec_max3.438860731479879
driven_lanedir_consec_mean1.982872428209739
driven_lanedir_consec_min0.7770137313184056
driven_lanedir_max3.560278357516038
driven_lanedir_mean2.4513049805698603
driven_lanedir_median2.440455044725664
driven_lanedir_min1.3640314753120752
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean1.0125000000000144
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 3.5795879547671228, "survival_time": 59.99999999999873, "driven_lanedir": 3.560278357516038, "in-drivable-lane": 0.0, "deviation-heading": 4.074339221369879, "distance-from-start": 2.2673905887925794, "deviation-center-line": 4.333129256837456, "driven_lanedir_consec": 3.438860731479879}, "4way-001-ego1": {"driven_any": 2.0840878521440405, "survival_time": 59.99999999999873, "driven_lanedir": 1.951170455689099, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.7192451987557, "distance-from-start": 0.8580872602580342, "deviation-center-line": 6.835139014020123, "driven_lanedir_consec": 0.7951700224687287}, "4way-001-ego2": {"driven_any": 1.494588064708115, "survival_time": 59.99999999999873, "driven_lanedir": 1.3640314753120752, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 10.8119794492084, "distance-from-start": 0.8550356162739062, "deviation-center-line": 5.503515330064552, "driven_lanedir_consec": 0.7770137313184056}, "4way-001-ego3": {"driven_any": 2.946595808782943, "survival_time": 59.99999999999873, "driven_lanedir": 2.929739633762229, "in-drivable-lane": 0.0, "deviation-heading": 3.4115292246804296, "distance-from-start": 1.5532773905742925, "deviation-center-line": 5.061665971004148, "driven_lanedir_consec": 2.9204452275719435}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16585sim-2of4successyes0:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0050106271821506
deviation-center-line_median4.908963644722344


other stats
deviation-center-line_max6.01198792060873
deviation-center-line_mean4.593358939184355
deviation-center-line_min2.5435205466839994
deviation-heading_max5.727471290631747
deviation-heading_mean4.526175130231045
deviation-heading_median4.686700534848095
deviation-heading_min3.003828160596244
distance-from-start_max2.5613241003039633
distance-from-start_mean1.914912599777095
distance-from-start_median1.98188247541307
distance-from-start_min1.134561347978277
driven_any_max3.579580754957026
driven_any_mean3.2360870781772753
driven_any_median3.2450849856660264
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.211958001358496
driven_lanedir_consec_mean3.019665595541482
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.5310621633486874
driven_lanedir_mean3.181338396476557
driven_lanedir_median3.1688041281752737
driven_lanedir_min2.856683166206994
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.5500000000000078
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "4way-000-ego1": {"driven_any": 2.9765951859105204, "survival_time": 59.99999999999873, "driven_lanedir": 2.9585702681138724, "in-drivable-lane": 0.0, "deviation-heading": 3.74577370363053, "distance-from-start": 1.6177816314398783, "deviation-center-line": 6.01198792060873, "driven_lanedir_consec": 2.9318251947402816}, "4way-000-ego2": {"driven_any": 3.513574785421533, "survival_time": 59.99999999999873, "driven_lanedir": 3.379037988236675, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.62762736606566, "distance-from-start": 2.5613241003039633, "deviation-center-line": 2.5435205466839994, "driven_lanedir_consec": 3.0781960596240197}, "4way-000-ego3": {"driven_any": 3.579580754957026, "survival_time": 59.99999999999873, "driven_lanedir": 3.5310621633486874, "in-drivable-lane": 0.0, "deviation-heading": 5.727471290631747, "distance-from-start": 1.134561347978277, "deviation-center-line": 4.291968659372725, "driven_lanedir_consec": 3.211958001358496}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible