Duckietown Challenges Home Challenges Submissions

Submission 1771

Submission1771
Competingyes
Challengeaido-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 16437 sim-1of4: 16434 sim-2of4: 16435 sim-3of4: 16436
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
16437sim-0of4successyes0:29:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.7249999999987
driven_lanedir_consec_median0.454921297017584
deviation-center-line_median0.6974749749431727


other stats
deviation-center-line_max1.2289107234352754
deviation-center-line_mean0.7465183199466825
deviation-center-line_min0.36221260646510905
deviation-heading_max10.747669890048885
deviation-heading_mean5.217075000618098
deviation-heading_median3.8575509611233407
deviation-heading_min2.405528190176829
distance-from-start_max0.8906349158843042
distance-from-start_mean0.5509638453554111
distance-from-start_median0.49618840737134856
distance-from-start_min0.32084365079464316
driven_any_max9.594225342584588
driven_any_mean5.398565670873957
driven_any_median4.556579801155596
driven_any_min2.886877738600047
driven_lanedir_consec_max0.7994021954471623
driven_lanedir_consec_mean0.4823888295893775
driven_lanedir_consec_min0.22031052887517985
driven_lanedir_max0.9831299842680968
driven_lanedir_mean0.6456489561290962
driven_lanedir_median0.6895776556865543
driven_lanedir_min0.22031052887517985
in-drivable-lane_max56.59999999999874
in-drivable-lane_mean52.44999999999869
in-drivable-lane_min45.7499999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.886877738600047, "survival_time": 59.99999999999873, "driven_lanedir": 0.5797531159259464, "in-drivable-lane": 54.59999999999873, "deviation-heading": 3.764327276744409, "distance-from-start": 0.32084365079464316, "deviation-center-line": 0.4035703760651697, "driven_lanedir_consec": 0.5797531159259464}, "autolab-000-ego1": {"driven_any": 9.594225342584588, "survival_time": 59.99999999999873, "driven_lanedir": 0.7994021954471623, "in-drivable-lane": 52.84999999999867, "deviation-heading": 3.950774645502272, "distance-from-start": 0.8906349158843042, "deviation-center-line": 0.9913795738211756, "driven_lanedir_consec": 0.7994021954471623}, "autolab-000-ego2": {"driven_any": 5.897718708388023, "survival_time": 59.99999999999873, "driven_lanedir": 0.9831299842680968, "in-drivable-lane": 45.7499999999986, "deviation-heading": 10.747669890048885, "distance-from-start": 0.6582850667234794, "deviation-center-line": 1.2289107234352754, "driven_lanedir_consec": 0.3300894781092216}, "autolab-000-ego3": {"driven_any": 3.2154408939231685, "survival_time": 59.99999999999873, "driven_lanedir": 0.22031052887517985, "in-drivable-lane": 56.59999999999874, "deviation-heading": 2.405528190176829, "distance-from-start": 0.3340917480192177, "deviation-center-line": 0.36221260646510905, "driven_lanedir_consec": 0.22031052887517985}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16436sim-3of4successyes0:16:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median40.79999999999982
in-drivable-lane_median34.649999999999814
driven_lanedir_consec_median0.5201778335215335
deviation-center-line_median0.5033983244535749


other stats
deviation-center-line_max0.8091889962960607
deviation-center-line_mean0.473695219513447
deviation-center-line_min0.07879523285057742
deviation-heading_max8.826955184088073
deviation-heading_mean4.52880939310061
deviation-heading_median4.43299018341178
deviation-heading_min0.4223020214908056
distance-from-start_max0.5670452882835323
distance-from-start_mean0.389037812148862
distance-from-start_median0.4019432918468391
distance-from-start_min0.1852193766182376
driven_any_max7.210987597390302
driven_any_mean2.699233463724466
driven_any_median1.5268782790043518
driven_any_min0.5321896994988577
driven_lanedir_consec_max1.4619927474008945
driven_lanedir_consec_mean0.6535540991632546
driven_lanedir_consec_min0.11186798220905692
driven_lanedir_max1.4619927474008945
driven_lanedir_mean0.6535540991632546
driven_lanedir_median0.5201778335215335
driven_lanedir_min0.11186798220905692
in-drivable-lane_max39.94999999999982
in-drivable-lane_mean34.412499999999795
in-drivable-lane_min28.39999999999971
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.210987597390302, "survival_time": 40.79999999999982, "driven_lanedir": 1.4619927474008945, "in-drivable-lane": 28.39999999999971, "deviation-heading": 8.826955184088073, "distance-from-start": 0.5670452882835323, "deviation-center-line": 0.8091889962960607, "driven_lanedir_consec": 1.4619927474008945}, "zigzag-000-ego1": {"driven_any": 0.5321896994988577, "survival_time": 40.79999999999982, "driven_lanedir": 0.11186798220905692, "in-drivable-lane": 39.94999999999982, "deviation-heading": 0.4223020214908056, "distance-from-start": 0.4757396962419171, "deviation-center-line": 0.07879523285057742, "driven_lanedir_consec": 0.11186798220905692}, "zigzag-000-ego2": {"driven_any": 2.066026288700556, "survival_time": 40.79999999999982, "driven_lanedir": 0.8098012840229142, "in-drivable-lane": 33.04999999999981, "deviation-heading": 5.423814646503306, "distance-from-start": 0.3281468874517611, "deviation-center-line": 0.4526197809221165, "driven_lanedir_consec": 0.8098012840229142}, "zigzag-000-ego3": {"driven_any": 0.9877302693081476, "survival_time": 40.79999999999982, "driven_lanedir": 0.23055438302015263, "in-drivable-lane": 36.249999999999815, "deviation-heading": 3.4421657203202543, "distance-from-start": 0.1852193766182376, "deviation-center-line": 0.5541768679850334, "driven_lanedir_consec": 0.23055438302015263}}
simulation-passed1
survival_time_max40.79999999999982
survival_time_mean40.79999999999982
survival_time_min40.79999999999982
No reset possible
16435sim-2of4successyes0:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.52499999999945
driven_lanedir_consec_median0.7312050318520338
deviation-center-line_median4.64142184647317


other stats
deviation-center-line_max7.864930353253185
deviation-center-line_mean4.64142184647317
deviation-center-line_min1.4179133396931558
deviation-heading_max58.594238392181985
deviation-heading_mean35.19497413114783
deviation-heading_median35.19497413114783
deviation-heading_min11.79570987011368
distance-from-start_max0.5537485138327338
distance-from-start_mean0.4711620793373573
distance-from-start_median0.4711620793373573
distance-from-start_min0.38857564484198087
driven_any_max12.391120681421244
driven_any_mean6.416154017366627
driven_any_median6.416154017366627
driven_any_min0.44118735331200926
driven_lanedir_consec_max1.0826791687483188
driven_lanedir_consec_mean0.7312050318520338
driven_lanedir_consec_min0.37973089495574874
driven_lanedir_max1.397891358469339
driven_lanedir_mean0.888811126712544
driven_lanedir_median0.888811126712544
driven_lanedir_min0.37973089495574874
in-drivable-lane_max47.0499999999989
in-drivable-lane_mean23.52499999999945
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.44118735331200926, "survival_time": 59.99999999999873, "driven_lanedir": 0.37973089495574874, "in-drivable-lane": 0.0, "deviation-heading": 58.594238392181985, "distance-from-start": 0.38857564484198087, "deviation-center-line": 7.864930353253185, "driven_lanedir_consec": 0.37973089495574874}, "loop2-000-ego1": {"driven_any": 12.391120681421244, "survival_time": 59.99999999999873, "driven_lanedir": 1.397891358469339, "in-drivable-lane": 47.0499999999989, "deviation-heading": 11.79570987011368, "distance-from-start": 0.5537485138327338, "deviation-center-line": 1.4179133396931558, "driven_lanedir_consec": 1.0826791687483188}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16434sim-1of4successyes0:30:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median52.4499999999987
driven_lanedir_consec_median0.6842354165610253
deviation-center-line_median0.6623226574937954


other stats
deviation-center-line_max2.4782553540663956
deviation-center-line_mean1.08967109897621
deviation-center-line_min0.5557837268508531
deviation-heading_max16.398648152756845
deviation-heading_mean8.146230785254525
deviation-heading_median5.780530067484655
deviation-heading_min4.625214853291949
distance-from-start_max1.181893793644939
distance-from-start_mean0.7215631682047746
distance-from-start_median0.6259909331251148
distance-from-start_min0.45237701292393007
driven_any_max11.760589265793776
driven_any_mean8.430932011074608
driven_any_median8.089389056979083
driven_any_min5.784360664546489
driven_lanedir_consec_max1.0365407881338131
driven_lanedir_consec_mean0.6814267762652612
driven_lanedir_consec_min0.32069548380518076
driven_lanedir_max1.0412587662477932
driven_lanedir_mean0.9179049045040844
driven_lanedir_median0.920941001449056
driven_lanedir_min0.7884788488704322
in-drivable-lane_max53.299999999998676
in-drivable-lane_mean49.94999999999884
in-drivable-lane_min41.59999999999928
per-episodes
details{"loop-000-ego0": {"driven_any": 5.784360664546489, "survival_time": 59.99999999999873, "driven_lanedir": 0.7884788488704322, "in-drivable-lane": 53.299999999998676, "deviation-heading": 5.488139061262694, "distance-from-start": 0.7453166748002049, "deviation-center-line": 0.5557837268508531, "driven_lanedir_consec": 0.5239066075310246}, "loop-000-ego1": {"driven_any": 5.897883645347082, "survival_time": 59.99999999999873, "driven_lanedir": 0.997317777307086, "in-drivable-lane": 41.59999999999928, "deviation-heading": 16.398648152756845, "distance-from-start": 0.5066651914500245, "deviation-center-line": 2.4782553540663956, "driven_lanedir_consec": 0.32069548380518076}, "loop-000-ego2": {"driven_any": 11.760589265793776, "survival_time": 59.99999999999873, "driven_lanedir": 1.0412587662477932, "in-drivable-lane": 51.799999999998704, "deviation-heading": 6.072921073706616, "distance-from-start": 1.181893793644939, "deviation-center-line": 0.721637250884025, "driven_lanedir_consec": 1.0365407881338131}, "loop-000-ego3": {"driven_any": 10.280894468611086, "survival_time": 59.99999999999873, "driven_lanedir": 0.844564225591026, "in-drivable-lane": 53.0999999999987, "deviation-heading": 4.625214853291949, "distance-from-start": 0.45237701292393007, "deviation-center-line": 0.6030080641035658, "driven_lanedir_consec": 0.844564225591026}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible