Duckietown Challenges Home Challenges Submissions

Submission 40

Submission40
Competinguser retired
Challengeaido-LF-full-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 626 sim-1of4: 624 sim-2of4: 625 sim-3of4: 627
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

627

Click the images to see detailed statistics about the episode.

zigzag-000

626

Click the images to see detailed statistics about the episode.

loop2-000

625

Click the images to see detailed statistics about the episode.

autolab-000

624

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
627sim-3of4successno0:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.587330865151801
deviation-center-line_median5.442861880459047


other stats
deviation-center-line_max5.442861880459047
deviation-center-line_mean5.442861880459047
deviation-center-line_min5.442861880459047
deviation-heading_max11.057314601935014
deviation-heading_mean11.057314601935014
deviation-heading_median11.057314601935014
deviation-heading_min11.057314601935014
distance-from-start_max1.5192445510405317
distance-from-start_mean1.5192445510405317
distance-from-start_median1.5192445510405317
distance-from-start_min1.5192445510405317
driven_any_max3.4520765920195307
driven_any_mean3.4520765920195307
driven_any_median3.4520765920195307
driven_any_min3.4520765920195307
driven_lanedir_consec_max1.587330865151801
driven_lanedir_consec_mean1.587330865151801
driven_lanedir_consec_min1.587330865151801
driven_lanedir_max3.1639215965864955
driven_lanedir_mean3.1639215965864955
driven_lanedir_median3.1639215965864955
driven_lanedir_min3.1639215965864955
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4520765920195307, "survival_time": 59.99999999999873, "driven_lanedir": 3.1639215965864955, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935014, "distance-from-start": 1.5192445510405317, "deviation-center-line": 5.442861880459047, "driven_lanedir_consec": 1.587330865151801}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
626sim-0of4successno0:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.500000000000256
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.4937232631899593
deviation-center-line_median2.622709704746049


other stats
deviation-center-line_max2.622709704746049
deviation-center-line_mean2.622709704746049
deviation-center-line_min2.622709704746049
deviation-heading_max2.920055850263564
deviation-heading_mean2.920055850263564
deviation-heading_median2.920055850263564
deviation-heading_min2.920055850263564
distance-from-start_max1.2100420266422205
distance-from-start_mean1.2100420266422205
distance-from-start_median1.2100420266422205
distance-from-start_min1.2100420266422205
driven_any_max1.5545963269619447
driven_any_mean1.5545963269619447
driven_any_median1.5545963269619447
driven_any_min1.5545963269619447
driven_lanedir_consec_max1.4937232631899593
driven_lanedir_consec_mean1.4937232631899593
driven_lanedir_consec_min1.4937232631899593
driven_lanedir_max1.4937232631899593
driven_lanedir_mean1.4937232631899593
driven_lanedir_median1.4937232631899593
driven_lanedir_min1.4937232631899593
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.5545963269619447, "survival_time": 27.500000000000256, "driven_lanedir": 1.4937232631899593, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920055850263564, "distance-from-start": 1.2100420266422205, "deviation-center-line": 2.622709704746049, "driven_lanedir_consec": 1.4937232631899593}}
simulation-passed1
survival_time_max27.500000000000256
survival_time_mean27.500000000000256
survival_time_min27.500000000000256
No reset possible
625sim-2of4successno0:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.899999999999892
driven_lanedir_consec_median3.40640170732006
deviation-center-line_median5.159547195129483


other stats
deviation-center-line_max5.159547195129483
deviation-center-line_mean5.159547195129483
deviation-center-line_min5.159547195129483
deviation-heading_max7.059107454008588
deviation-heading_mean7.059107454008588
deviation-heading_median7.059107454008588
deviation-heading_min7.059107454008588
distance-from-start_max2.2176127613608925
distance-from-start_mean2.2176127613608925
distance-from-start_median2.2176127613608925
distance-from-start_min2.2176127613608925
driven_any_max3.532579606984142
driven_any_mean3.532579606984142
driven_any_median3.532579606984142
driven_any_min3.532579606984142
driven_lanedir_consec_max3.40640170732006
driven_lanedir_consec_mean3.40640170732006
driven_lanedir_consec_min3.40640170732006
driven_lanedir_max3.40640170732006
driven_lanedir_mean3.40640170732006
driven_lanedir_median3.40640170732006
driven_lanedir_min3.40640170732006
in-drivable-lane_max1.899999999999892
in-drivable-lane_mean1.899999999999892
in-drivable-lane_min1.899999999999892
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.532579606984142, "survival_time": 59.99999999999873, "driven_lanedir": 3.40640170732006, "in-drivable-lane": 1.899999999999892, "deviation-heading": 7.059107454008588, "distance-from-start": 2.2176127613608925, "deviation-center-line": 5.159547195129483, "driven_lanedir_consec": 3.40640170732006}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
624sim-1of4successno0:10:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873308651520088
deviation-center-line_median5.442861880459055


other stats
deviation-center-line_max5.442861880459055
deviation-center-line_mean5.442861880459055
deviation-center-line_min5.442861880459055
deviation-heading_max11.057314601935024
deviation-heading_mean11.057314601935024
deviation-heading_median11.057314601935024
deviation-heading_min11.057314601935024
distance-from-start_max1.5192445510405312
distance-from-start_mean1.5192445510405312
distance-from-start_median1.5192445510405312
distance-from-start_min1.5192445510405312
driven_any_max3.452076592019545
driven_any_mean3.452076592019545
driven_any_median3.452076592019545
driven_any_min3.452076592019545
driven_lanedir_consec_max1.5873308651520088
driven_lanedir_consec_mean1.5873308651520088
driven_lanedir_consec_min1.5873308651520088
driven_lanedir_max3.163921596586153
driven_lanedir_mean3.163921596586153
driven_lanedir_median3.163921596586153
driven_lanedir_min3.163921596586153
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019545, "survival_time": 59.99999999999873, "driven_lanedir": 3.163921596586153, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935024, "distance-from-start": 1.5192445510405312, "deviation-center-line": 5.442861880459055, "driven_lanedir_consec": 1.5873308651520088}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
229sim-2of4successno0:08:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228sim-3of4successno0:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227sim-2of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("login attempt to https://registry-stage2.duckietown.org/v2/ failed with status: 502 Bad Gateway")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225sim-0of4successno0:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224sim-1of4successno0:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible