Duckietown Challenges Home Challenges Submissions

Submission 1718

Submission1718
Competingyes
Challengeaido-LFV_multi-state-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16579 sim-1of4: 16578 sim-2of4: 16580 sim-3of4: 16577
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16580sim-2of4successyes0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.3499999999998806
driven_lanedir_consec_median2.380746158820441
deviation-center-line_median6.07518739971563


other stats
deviation-center-line_max6.5629821214913955
deviation-center-line_mean6.07518739971563
deviation-center-line_min5.587392677939865
deviation-heading_max8.266160603781476
deviation-heading_mean7.316254408081507
deviation-heading_median7.316254408081507
deviation-heading_min6.3663482123815385
distance-from-start_max1.6314589686392718
distance-from-start_mean1.433307130896814
distance-from-start_median1.433307130896814
distance-from-start_min1.235155293154356
driven_any_max3.4865836169069464
driven_any_mean3.479150653763286
driven_any_median3.479150653763286
driven_any_min3.471717690619625
driven_lanedir_consec_max3.2882116374610164
driven_lanedir_consec_mean2.380746158820441
driven_lanedir_consec_min1.4732806801798657
driven_lanedir_max3.2882116374610164
driven_lanedir_mean3.2881134223745017
driven_lanedir_median3.2881134223745017
driven_lanedir_min3.2880152072879874
in-drivable-lane_max3.5999999999997954
in-drivable-lane_mean3.3499999999998806
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.471717690619625, "survival_time": 59.99999999999873, "driven_lanedir": 3.2882116374610164, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.3663482123815385, "distance-from-start": 1.6314589686392718, "deviation-center-line": 6.5629821214913955, "driven_lanedir_consec": 3.2882116374610164}, "loop2-000-ego1": {"driven_any": 3.4865836169069464, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880152072879874, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.266160603781476, "distance-from-start": 1.235155293154356, "deviation-center-line": 5.587392677939865, "driven_lanedir_consec": 1.4732806801798657}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16579sim-0of4successyes0:08:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.1499999999999257
driven_lanedir_consec_median3.3746337017701507
deviation-center-line_median6.057454700328478


other stats
deviation-center-line_max6.384332084814334
deviation-center-line_mean6.038904654854047
deviation-center-line_min5.656377133944901
deviation-heading_max7.471247478120028
deviation-heading_mean6.581525379111778
deviation-heading_median6.501228349070126
deviation-heading_min5.8523973401868306
distance-from-start_max2.955798853097406
distance-from-start_mean2.2776980078429148
distance-from-start_median2.4208015729281067
distance-from-start_min1.313390032418041
driven_any_max3.579593246505303
driven_any_mean3.529302881163586
driven_any_median3.515090515356918
driven_any_min3.5074372474352056
driven_lanedir_consec_max3.525823359544204
driven_lanedir_consec_mean3.062863916917712
driven_lanedir_consec_min1.9763649045863416
driven_lanedir_max3.525823359544204
driven_lanedir_mean3.4097663351344685
driven_lanedir_median3.3746337017701507
driven_lanedir_min3.3639745774533676
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.6749999999999714
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.5195908422465023, "survival_time": 59.99999999999873, "driven_lanedir": 3.384110905730893, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.471247478120028, "distance-from-start": 2.2087786070849105, "deviation-center-line": 5.794137771901705, "driven_lanedir_consec": 3.384110905730893}, "autolab-000-ego2": {"driven_any": 3.5074372474352056, "survival_time": 59.99999999999873, "driven_lanedir": 3.3639745774533676, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8523973401868306, "distance-from-start": 1.313390032418041, "deviation-center-line": 6.320771628755251, "driven_lanedir_consec": 1.9763649045863416}, "autolab-000-ego3": {"driven_any": 3.5105901884673334, "survival_time": 59.99999999999873, "driven_lanedir": 3.365156497809408, "in-drivable-lane": 2.299999999999965, "deviation-heading": 6.180320457204967, "distance-from-start": 2.6328245387713025, "deviation-center-line": 6.384332084814334, "driven_lanedir_consec": 3.365156497809408}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16578sim-1of4successyes0:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.7499999999999003
driven_lanedir_consec_median3.413654775946143
deviation-center-line_median5.825136539085346


other stats
deviation-center-line_max7.271389663591529
deviation-center-line_mean5.643680285819743
deviation-center-line_min3.653058401516753
deviation-heading_max7.874648432322972
deviation-heading_mean6.124556829055049
deviation-heading_median6.375210937656442
deviation-heading_min3.873157008584335
distance-from-start_max2.9910037406399708
distance-from-start_mean2.647919639528748
distance-from-start_median2.691628549092109
distance-from-start_min2.2174177192908053
driven_any_max3.546591928181605
driven_any_mean3.512845634385255
driven_any_median3.527100534458862
driven_any_min3.4505895404416917
driven_lanedir_consec_max3.4489608990054887
driven_lanedir_consec_mean3.3789582924454376
driven_lanedir_consec_min3.2395627188839757
driven_lanedir_max3.4489608990054887
driven_lanedir_mean3.3789582924454376
driven_lanedir_median3.413654775946143
driven_lanedir_min3.2395627188839757
in-drivable-lane_max4.299999999999894
in-drivable-lane_mean2.2249999999999277
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop-000-ego0": {"driven_any": 3.543607782867822, "survival_time": 59.99999999999873, "driven_lanedir": 3.4359237462525183, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 7.874648432322972, "distance-from-start": 2.7860421196308716, "deviation-center-line": 4.889961247945737, "driven_lanedir_consec": 3.4359237462525183}, "loop-000-ego1": {"driven_any": 3.4505895404416917, "survival_time": 59.99999999999873, "driven_lanedir": 3.2395627188839757, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.05385337048463, "distance-from-start": 2.2174177192908053, "deviation-center-line": 7.271389663591529, "driven_lanedir_consec": 3.2395627188839757}, "loop-000-ego2": {"driven_any": 3.546591928181605, "survival_time": 59.99999999999873, "driven_lanedir": 3.4489608990054887, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 6.696568504828256, "distance-from-start": 2.9910037406399708, "deviation-center-line": 3.653058401516753, "driven_lanedir_consec": 3.4489608990054887}, "loop-000-ego3": {"driven_any": 3.5105932860499025, "survival_time": 59.99999999999873, "driven_lanedir": 3.391385805639767, "in-drivable-lane": 2.2999999999998693, "deviation-heading": 3.873157008584335, "distance-from-start": 2.597214978553346, "deviation-center-line": 6.760311830224953, "driven_lanedir_consec": 3.391385805639767}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16577sim-3of4successyes0:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.174999999999917
driven_lanedir_consec_median2.6226225453427174
deviation-center-line_median5.3031846613240265


other stats
deviation-center-line_max5.816265976116539
deviation-center-line_mean5.196634927837193
deviation-center-line_min4.363904412584181
deviation-heading_max13.510507170954757
deviation-heading_mean10.821915690706016
deviation-heading_median10.428621244524829
deviation-heading_min8.919913102819658
distance-from-start_max2.9580871089811698
distance-from-start_mean2.332849013698153
distance-from-start_median2.410604919303986
distance-from-start_min1.55209910720347
driven_any_max3.579590098610528
driven_any_mean3.3933509000885236
driven_any_median3.464904539716091
driven_any_min3.064004422311384
driven_lanedir_consec_max3.4992371353936753
driven_lanedir_consec_mean2.597829668578795
driven_lanedir_consec_min1.64683644823607
driven_lanedir_max3.4992371353936753
driven_lanedir_mean3.216224003341642
driven_lanedir_median3.212923209015736
driven_lanedir_min2.939812459941421
in-drivable-lane_max4.299999999999949
in-drivable-lane_mean2.162499999999946
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.579590098610528, "survival_time": 59.99999999999873, "driven_lanedir": 3.4992371353936753, "in-drivable-lane": 0.0, "deviation-heading": 8.919913102819658, "distance-from-start": 2.9580871089811698, "deviation-center-line": 4.363904412584181, "driven_lanedir_consec": 3.4992371353936753}, "zigzag-000-ego1": {"driven_any": 3.4790808241674496, "survival_time": 59.99999999999873, "driven_lanedir": 3.252574528929212, "in-drivable-lane": 3.3499999999998913, "deviation-heading": 10.055957232850009, "distance-from-start": 2.114012987076784, "deviation-center-line": 5.136572055912668, "driven_lanedir_consec": 2.305432630744014}, "zigzag-000-ego2": {"driven_any": 3.064004422311384, "survival_time": 59.99999999999873, "driven_lanedir": 2.939812459941421, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 13.510507170954757, "distance-from-start": 2.707196851531188, "deviation-center-line": 5.469797266735385, "driven_lanedir_consec": 2.939812459941421}, "zigzag-000-ego3": {"driven_any": 3.4507282552647327, "survival_time": 59.99999999999873, "driven_lanedir": 3.17327188910226, "in-drivable-lane": 4.299999999999949, "deviation-heading": 10.80128525619965, "distance-from-start": 1.55209910720347, "deviation-center-line": 5.816265976116539, "driven_lanedir_consec": 1.64683644823607}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible