Duckietown Challenges Home Challenges Submissions

Submission 147

Submission147
Competinguser retired
Challengeaido-LFP-full-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1714 sim-1of4: 1713 sim-2of4: 1710 sim-3of4: 1715
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1715sim-3of4successno0:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.587330865151801
deviation-center-line_median5.442861880459047


other stats
deviation-center-line_max5.442861880459047
deviation-center-line_mean5.442861880459047
deviation-center-line_min5.442861880459047
deviation-heading_max11.057314601935014
deviation-heading_mean11.057314601935014
deviation-heading_median11.057314601935014
deviation-heading_min11.057314601935014
distance-from-start_max1.5192445510405317
distance-from-start_mean1.5192445510405317
distance-from-start_median1.5192445510405317
distance-from-start_min1.5192445510405317
driven_any_max3.4520765920195307
driven_any_mean3.4520765920195307
driven_any_median3.4520765920195307
driven_any_min3.4520765920195307
driven_lanedir_consec_max1.587330865151801
driven_lanedir_consec_mean1.587330865151801
driven_lanedir_consec_min1.587330865151801
driven_lanedir_max3.1639215965864955
driven_lanedir_mean3.1639215965864955
driven_lanedir_median3.1639215965864955
driven_lanedir_min3.1639215965864955
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4520765920195307, "survival_time": 59.99999999999873, "driven_lanedir": 3.1639215965864955, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935014, "distance-from-start": 1.5192445510405317, "deviation-center-line": 5.442861880459047, "driven_lanedir_consec": 1.587330865151801}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1714sim-0of4successno0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.949999999999186
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median2.7806693784920817
deviation-center-line_median5.983237422521911


other stats
deviation-center-line_max5.983237422521911
deviation-center-line_mean5.983237422521911
deviation-center-line_min5.983237422521911
deviation-heading_max5.351741767067894
deviation-heading_mean5.351741767067894
deviation-heading_median5.351741767067894
deviation-heading_min5.351741767067894
distance-from-start_max1.6305272648718805
distance-from-start_mean1.6305272648718805
distance-from-start_median1.6305272648718805
distance-from-start_min1.6305272648718805
driven_any_max2.9510910895137585
driven_any_mean2.9510910895137585
driven_any_median2.9510910895137585
driven_any_min2.9510910895137585
driven_lanedir_consec_max2.7806693784920817
driven_lanedir_consec_mean2.7806693784920817
driven_lanedir_consec_min2.7806693784920817
driven_lanedir_max2.7806693784920817
driven_lanedir_mean2.7806693784920817
driven_lanedir_median2.7806693784920817
driven_lanedir_min2.7806693784920817
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9510910895137585, "survival_time": 51.949999999999186, "driven_lanedir": 2.7806693784920817, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067894, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.983237422521911, "driven_lanedir_consec": 2.7806693784920817}}
simulation-passed1
survival_time_max51.949999999999186
survival_time_mean51.949999999999186
survival_time_min51.949999999999186
No reset possible
1713sim-1of4successno0:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.4858729319640545
deviation-center-line_median4.220405873962665


other stats
deviation-center-line_max4.220405873962665
deviation-center-line_mean4.220405873962665
deviation-center-line_min4.220405873962665
deviation-heading_max2.917489677429886
deviation-heading_mean2.917489677429886
deviation-heading_median2.917489677429886
deviation-heading_min2.917489677429886
distance-from-start_max2.892821861531108
distance-from-start_mean2.892821861531108
distance-from-start_median2.892821861531108
distance-from-start_min2.892821861531108
driven_any_max3.5465963319759135
driven_any_mean3.5465963319759135
driven_any_median3.5465963319759135
driven_any_min3.5465963319759135
driven_lanedir_consec_max3.4858729319640545
driven_lanedir_consec_mean3.4858729319640545
driven_lanedir_consec_min3.4858729319640545
driven_lanedir_max3.4858729319640545
driven_lanedir_mean3.4858729319640545
driven_lanedir_median3.4858729319640545
driven_lanedir_min3.4858729319640545
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963319759135, "survival_time": 59.99999999999873, "driven_lanedir": 3.4858729319640545, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.917489677429886, "distance-from-start": 2.892821861531108, "deviation-center-line": 4.220405873962665, "driven_lanedir_consec": 3.4858729319640545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1710sim-2of4successno0:11:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.4858726845389234
deviation-center-line_median4.220405841276127


other stats
deviation-center-line_max4.220405841276127
deviation-center-line_mean4.220405841276127
deviation-center-line_min4.220405841276127
deviation-heading_max2.9174896176689957
deviation-heading_mean2.9174896176689957
deviation-heading_median2.9174896176689957
deviation-heading_min2.9174896176689957
distance-from-start_max2.8928218596598874
distance-from-start_mean2.8928218596598874
distance-from-start_median2.8928218596598874
distance-from-start_min2.8928218596598874
driven_any_max3.5465963319759606
driven_any_mean3.5465963319759606
driven_any_median3.5465963319759606
driven_any_min3.5465963319759606
driven_lanedir_consec_max3.4858726845389234
driven_lanedir_consec_mean3.4858726845389234
driven_lanedir_consec_min3.4858726845389234
driven_lanedir_max3.4858726845389234
driven_lanedir_mean3.4858726845389234
driven_lanedir_median3.4858726845389234
driven_lanedir_min3.4858726845389234
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963319759606, "survival_time": 59.99999999999873, "driven_lanedir": 3.4858726845389234, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.9174896176689957, "distance-from-start": 2.8928218596598874, "deviation-center-line": 4.220405841276127, "driven_lanedir_consec": 3.4858726845389234}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1709sim-1of4timeoutno0:00:17
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1702sim-1of4host-errorno0:01:38
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible