Duckietown Challenges Home Challenges Submissions

Submission 183

Submission183
Competinguser retired
Challengeaido-LFVI_multi-state-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1443 sim-1of4: 1466 sim-2of4: 1456 sim-3of4: 1451
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

1466

Click the images to see detailed statistics about the episode.

udem-000

1456

Click the images to see detailed statistics about the episode.

4way-000

1451

Click the images to see detailed statistics about the episode.

4way-001

1443

Click the images to see detailed statistics about the episode.

udem-001

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1466sim-1of4successno0:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median2.7186616784701183
deviation-center-line_median4.599769293479638


other stats
deviation-center-line_max7.514921718660486
deviation-center-line_mean5.02392012736605
deviation-center-line_min3.381220203844434
deviation-heading_max7.270406502939624
deviation-heading_mean4.90429362962882
deviation-heading_median4.7134679037357685
deviation-heading_min2.919832208104118
distance-from-start_max2.2240842234424347
distance-from-start_mean1.827756626432071
distance-from-start_median1.8250490950139848
distance-from-start_min1.4368440922578805
driven_any_max3.579591619457166
driven_any_mean3.0035907065383545
driven_any_median3.1970874397950677
driven_any_min2.0405963271061154
driven_lanedir_consec_max3.5171201587674483
driven_lanedir_consec_mean2.5784169258417777
driven_lanedir_consec_min1.359224187659427
driven_lanedir_max3.559246867730854
driven_lanedir_mean2.9375047405391155
driven_lanedir_median3.1055600052248993
driven_lanedir_min1.9796520839758105
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.775000000000011
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.0405963271061154, "survival_time": 59.99999999999873, "driven_lanedir": 1.9796520839758105, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919832208104118, "distance-from-start": 1.5472498854755894, "deviation-center-line": 7.514921718660486, "driven_lanedir_consec": 1.9796520839758105}, "udem-000-ego1": {"driven_any": 3.5795870323039667, "survival_time": 59.99999999999873, "driven_lanedir": 3.559246867730854, "in-drivable-lane": 0.0, "deviation-heading": 3.763517300585809, "distance-from-start": 2.2240842234424347, "deviation-center-line": 3.381220203844434, "driven_lanedir_consec": 3.4576712729644257}, "udem-000-ego2": {"driven_any": 3.579591619457166, "survival_time": 59.99999999999873, "driven_lanedir": 3.528722996130699, "in-drivable-lane": 0.0, "deviation-heading": 7.270406502939624, "distance-from-start": 2.1028483045523796, "deviation-center-line": 3.7168045463819968, "driven_lanedir_consec": 3.5171201587674483}, "udem-000-ego3": {"driven_any": 2.814587847286169, "survival_time": 59.99999999999873, "driven_lanedir": 2.682397014319099, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663418506885729, "distance-from-start": 1.4368440922578805, "deviation-center-line": 5.48273404057728, "driven_lanedir_consec": 1.359224187659427}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1456sim-2of4successno0:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median2.7045959417287095
deviation-center-line_median5.298353291226202


other stats
deviation-center-line_max6.7415423051179255
deviation-center-line_mean5.280946894421918
deviation-center-line_min3.785538690117345
deviation-heading_max13.312014280207482
deviation-heading_mean6.591214968902556
deviation-heading_median4.957876569882227
deviation-heading_min3.137092455638288
distance-from-start_max2.28731833637835
distance-from-start_mean1.737771300760496
distance-from-start_median1.9053628002064
distance-from-start_min0.8530412662508338
driven_any_max3.579587180103607
driven_any_mean2.867838687646424
driven_any_median2.9195898553416098
driven_any_min2.05258785979887
driven_lanedir_consec_max3.3844907951148357
driven_lanedir_consec_mean2.39197924744891
driven_lanedir_consec_min0.7742343112233847
driven_lanedir_max3.5625572879162624
driven_lanedir_mean2.790015570638227
driven_lanedir_median2.838407938257063
driven_lanedir_min1.9206891181225183
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean1.1249999999999716
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.2595978756975144, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590471341474, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280207482, "distance-from-start": 1.740927094321448, "deviation-center-line": 6.213697824668821, "driven_lanedir_consec": 2.073604575246684}, "4way-000-ego1": {"driven_any": 3.579581834985705, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625572879162624, "in-drivable-lane": 0.0, "deviation-heading": 3.137092455638288, "distance-from-start": 2.069798506091352, "deviation-center-line": 3.785538690117345, "driven_lanedir_consec": 3.3355873082107355}, "4way-000-ego2": {"driven_any": 3.579587180103607, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589568293799783, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646367942, "distance-from-start": 2.28731833637835, "deviation-center-line": 4.383008757783583, "driven_lanedir_consec": 3.3844907951148357}, "4way-000-ego3": {"driven_any": 2.05258785979887, "survival_time": 59.99999999999873, "driven_lanedir": 1.9206891181225183, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654520493396514, "distance-from-start": 0.8530412662508338, "deviation-center-line": 6.7415423051179255, "driven_lanedir_consec": 0.7742343112233847}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1453sim-1of4host-errorno0:08:07
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1451sim-3of4successno0:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.973903892209939
deviation-center-line_median3.9875676961692768


other stats
deviation-center-line_max6.3553546069743065
deviation-center-line_mean4.250566785501844
deviation-center-line_min2.671777142694516
deviation-heading_max6.378578140638581
deviation-heading_mean3.851864326503278
deviation-heading_median3.299904356349614
deviation-heading_min2.4290704526753046
distance-from-start_max2.6228466214589203
distance-from-start_mean1.9359200828336067
distance-from-start_median2.127382276693697
distance-from-start_min0.866069156488112
driven_any_max3.5795837364268217
driven_any_mean3.026803348499914
driven_any_median3.137096506981714
driven_any_min2.253436643609407
driven_lanedir_consec_max3.483685021840386
driven_lanedir_consec_mean2.5668657451689656
driven_lanedir_consec_min0.8359701744156002
driven_lanedir_max3.5606366264510267
driven_lanedir_mean2.9552898085757713
driven_lanedir_median3.077183665318915
driven_lanedir_min2.1061552772142287
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.1499999999999773
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.727596918833003, "survival_time": 59.99999999999873, "driven_lanedir": 2.670682308797444, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4290704526753046, "distance-from-start": 2.2619366930709424, "deviation-center-line": 4.511110212780197, "driven_lanedir_consec": 2.6706819709513177}, "4way-001-ego1": {"driven_any": 3.5795837364268217, "survival_time": 59.99999999999873, "driven_lanedir": 3.5606366264510267, "in-drivable-lane": 0.0, "deviation-heading": 3.3435162390362447, "distance-from-start": 1.9928278603164524, "deviation-center-line": 2.671777142694516, "driven_lanedir_consec": 3.27712581346856}, "4way-001-ego2": {"driven_any": 3.5465960951304254, "survival_time": 59.99999999999873, "driven_lanedir": 3.483685021840386, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.2562924736629832, "distance-from-start": 2.6228466214589203, "deviation-center-line": 3.464025179558356, "driven_lanedir_consec": 3.483685021840386}, "4way-001-ego3": {"driven_any": 2.253436643609407, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061552772142287, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140638581, "distance-from-start": 0.866069156488112, "deviation-center-line": 6.3553546069743065, "driven_lanedir_consec": 0.8359701744156002}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1446sim-2of4host-errorno0:06:24
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1444sim-3of4host-errorno0:05:50
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1443sim-0of4successno0:10:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median3.137552563032484
deviation-center-line_median5.303403093120579


other stats
deviation-center-line_max5.768512336672949
deviation-center-line_mean5.317250857912507
deviation-center-line_min4.893684908735921
deviation-heading_max7.241657133282214
deviation-heading_mean4.871041153648761
deviation-heading_median4.32644480945297
deviation-heading_min3.5896178624068913
distance-from-start_max2.875233242078688
distance-from-start_mean2.1795597522589074
distance-from-start_median2.1288718960248865
distance-from-start_min1.5852619749071697
driven_any_max3.5465916471185217
driven_any_mean3.2177189075870913
driven_any_median3.215844330234898
driven_any_min2.8925953227600485
driven_lanedir_consec_max3.4469814741057134
driven_lanedir_consec_mean3.145920477050178
driven_lanedir_consec_min2.861595308030029
driven_lanedir_max3.4469814741057134
driven_lanedir_mean3.1530897965541453
driven_lanedir_median3.1462038088299833
driven_lanedir_min2.8729700944508996
in-drivable-lane_max2.349999999999945
in-drivable-lane_mean0.86249999999999
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 2.92259552424134, "survival_time": 59.99999999999873, "driven_lanedir": 2.9054993461053225, "in-drivable-lane": 0.0, "deviation-heading": 3.5896178624068913, "distance-from-start": 1.5852619749071697, "deviation-center-line": 5.092329087336189, "driven_lanedir_consec": 2.888196919001675}, "udem-001-ego1": {"driven_any": 2.8925953227600485, "survival_time": 59.99999999999873, "driven_lanedir": 2.8729700944508996, "in-drivable-lane": 0.0, "deviation-heading": 3.950485200101096, "distance-from-start": 1.589741738931466, "deviation-center-line": 4.893684908735921, "driven_lanedir_consec": 2.861595308030029}, "udem-001-ego2": {"driven_any": 3.5090931362284556, "survival_time": 59.99999999999873, "driven_lanedir": 3.3869082715546446, "in-drivable-lane": 2.349999999999945, "deviation-heading": 4.702404418804844, "distance-from-start": 2.668002053118307, "deviation-center-line": 5.768512336672949, "driven_lanedir_consec": 3.3869082070632928}, "udem-001-ego3": {"driven_any": 3.5465916471185217, "survival_time": 59.99999999999873, "driven_lanedir": 3.4469814741057134, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.241657133282214, "distance-from-start": 2.875233242078688, "deviation-center-line": 5.51447709890497, "driven_lanedir_consec": 3.4469814741057134}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible