Duckietown Challenges Home Challenges Submissions

Submission 398

Submission398
Competingyes
Challengeaido-LFVI_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17168 sim-1of4: 17185 sim-2of4: 17169 sim-3of4: 17164
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
17185sim-1of4successyes0:25:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.47500000000003
driven_lanedir_consec_median-0.8215220025046082
deviation-center-line_median4.305546563658694


other stats
deviation-center-line_max5.171450978020262
deviation-center-line_mean4.02137097027396
deviation-center-line_min2.302939775758191
deviation-heading_max51.54852365041183
deviation-heading_mean37.77639908639871
deviation-heading_median37.21995841671929
deviation-heading_min25.117155861744457
distance-from-start_max0.18588748101368505
distance-from-start_mean0.15097018252610117
distance-from-start_median0.15088783296052174
distance-from-start_min0.11621758316967618
driven_any_max12.513551063996816
driven_any_mean4.944719751362862
driven_any_median3.2864427123964366
driven_any_min0.6924425166617605
driven_lanedir_consec_max-0.08097562554351923
driven_lanedir_consec_mean-1.2372144502765563
driven_lanedir_consec_min-3.224838170553489
driven_lanedir_max-0.08097562554351923
driven_lanedir_mean-1.3912337042022092
driven_lanedir_median-1.129560510355914
driven_lanedir_min-3.224838170553489
in-drivable-lane_max31.749999999999183
in-drivable-lane_mean10.92499999999981
in-drivable-lane_min0.9999999999999964
per-episodes
details{"4way-000-ego0": {"driven_any": 1.5810350339117762, "survival_time": 59.99999999999873, "driven_lanedir": -0.4173333373772574, "in-drivable-lane": 3.049999999999989, "deviation-heading": 51.54852365041183, "distance-from-start": 0.1343846756175076, "deviation-center-line": 4.285342187795043, "driven_lanedir_consec": -0.4173583943376329}, "4way-000-ego1": {"driven_any": 0.6924425166617605, "survival_time": 59.99999999999873, "driven_lanedir": -0.08097562554351923, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 47.88331506265053, "distance-from-start": 0.11621758316967618, "deviation-center-line": 5.171450978020262, "driven_lanedir_consec": -0.08097562554351923}, "4way-000-ego2": {"driven_any": 4.991850390881097, "survival_time": 59.99999999999873, "driven_lanedir": -1.8417876833345703, "in-drivable-lane": 7.90000000000007, "deviation-heading": 26.55660177078805, "distance-from-start": 0.16739099030353588, "deviation-center-line": 4.325750939522345, "driven_lanedir_consec": -1.2256856106715834}, "4way-000-ego3": {"driven_any": 12.513551063996816, "survival_time": 59.99999999999873, "driven_lanedir": -3.224838170553489, "in-drivable-lane": 31.749999999999183, "deviation-heading": 25.117155861744457, "distance-from-start": 0.18588748101368505, "deviation-center-line": 2.302939775758191, "driven_lanedir_consec": -3.224838170553489}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17169sim-2of4successyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17168sim-0of4successyes0:36:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.67499999999936
driven_lanedir_consec_median-3.302064229661129
deviation-center-line_median2.773960414552408


other stats
deviation-center-line_max7.497764103349187
deviation-center-line_mean3.776091470660392
deviation-center-line_min2.058680950187566
deviation-heading_max30.672324569221225
deviation-heading_mean22.570758873765136
deviation-heading_median26.486417545942533
deviation-heading_min6.637875833954247
distance-from-start_max0.2650720368240896
distance-from-start_mean0.1824183138007309
distance-from-start_median0.17104423455583095
distance-from-start_min0.1225127492671721
driven_any_max12.643642130986928
driven_any_mean9.414060914730172
driven_any_median12.114605091938252
driven_any_min0.7833913440572575
driven_lanedir_consec_max-0.13986650270625778
driven_lanedir_consec_mean-2.600121999524806
driven_lanedir_consec_min-3.6564930360707097
driven_lanedir_max-0.13986650270625778
driven_lanedir_mean-2.600121999524806
driven_lanedir_median-3.302064229661129
driven_lanedir_min-3.6564930360707097
in-drivable-lane_max29.89999999999928
in-drivable-lane_mean21.1999999999995
in-drivable-lane_min1.5499999999999945
per-episodes
details{"udem-000-ego0": {"driven_any": 11.879515626026524, "survival_time": 59.99999999999873, "driven_lanedir": -3.0971569809914508, "in-drivable-lane": 28.34999999999925, "deviation-heading": 26.81414532371177, "distance-from-start": 0.14499833539102558, "deviation-center-line": 2.7851128942395453, "driven_lanedir_consec": -3.0971569809914508}, "udem-000-ego1": {"driven_any": 0.7833913440572575, "survival_time": 59.99999999999873, "driven_lanedir": -0.13986650270625778, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 6.637875833954247, "distance-from-start": 0.1225127492671721, "deviation-center-line": 7.497764103349187, "driven_lanedir_consec": -0.13986650270625778}, "udem-000-ego2": {"driven_any": 12.643642130986928, "survival_time": 59.99999999999873, "driven_lanedir": -3.6564930360707097, "in-drivable-lane": 24.99999999999947, "deviation-heading": 30.672324569221225, "distance-from-start": 0.2650720368240896, "deviation-center-line": 2.058680950187566, "driven_lanedir_consec": -3.6564930360707097}, "udem-000-ego3": {"driven_any": 12.349694557849984, "survival_time": 59.99999999999873, "driven_lanedir": -3.5069714783308066, "in-drivable-lane": 29.89999999999928, "deviation-heading": 26.158689768173296, "distance-from-start": 0.1970901337206363, "deviation-center-line": 2.7628079348652705, "driven_lanedir_consec": -3.5069714783308066}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17165sim-1of4host-erroryes0:05:27
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-03-6.2.53-job17165-933576, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-03-6.2.53-job17165-933576', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17164sim-3of4successyes0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible