Duckietown Challenges Home Challenges Submissions

Evaluator 95

ID95
evaluatordavinci-stage-01
owneruser1000001
machinedavinci-stage
processdavinci-stage-01
version6.2.45
first heard
last heard
statusinactive
# evaluating
# success12 8239
# timeout1 9058
# failed
# error
# aborted
# host-error6 8234
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors78%
RAM total (MB)251.6 GB
RAM free (MB)230.0 GB
Disk (MB)491.1 GB
Disk available (MB)172.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
9058860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4timeoutnodavinci-stage-01----No reset possible
8981860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-010:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.950000000000106
in-drivable-lane_median9.400000000000064
driven_lanedir_consec_median0.4584246231828164
deviation-center-line_median0.6975971357426043


other stats
deviation-center-line_max0.6975971357426043
deviation-center-line_mean0.6975971357426043
deviation-center-line_min0.6975971357426043
deviation-heading_max5.702196138865396
deviation-heading_mean5.702196138865396
deviation-heading_median5.702196138865396
deviation-heading_min5.702196138865396
distance-from-start_max0.2415507629236197
distance-from-start_mean0.2415507629236197
distance-from-start_median0.2415507629236197
distance-from-start_min0.2415507629236197
driven_any_max1.705316862288115
driven_any_mean1.705316862288115
driven_any_median1.705316862288115
driven_any_min1.705316862288115
driven_lanedir_consec_max0.4584246231828164
driven_lanedir_consec_mean0.4584246231828164
driven_lanedir_consec_min0.4584246231828164
driven_lanedir_max0.4584246231828164
driven_lanedir_mean0.4584246231828164
driven_lanedir_median0.4584246231828164
driven_lanedir_min0.4584246231828164
in-drivable-lane_max9.400000000000064
in-drivable-lane_mean9.400000000000064
in-drivable-lane_min9.400000000000064
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.705316862288115, "survival_time": 16.950000000000106, "driven_lanedir": 0.4584246231828164, "in-drivable-lane": 9.400000000000064, "deviation-heading": 5.702196138865396, "distance-from-start": 0.2415507629236197, "deviation-center-line": 0.6975971357426043, "driven_lanedir_consec": 0.4584246231828164}}
simulation-passed1
survival_time_max16.950000000000106
survival_time_mean16.950000000000106
survival_time_min16.950000000000106
No reset possible
8886860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-010:09:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.900000000000105
in-drivable-lane_median9.100000000000064
driven_lanedir_consec_median0.4430498641320328
deviation-center-line_median0.22397739460529187


other stats
deviation-center-line_max0.22397739460529187
deviation-center-line_mean0.22397739460529187
deviation-center-line_min0.22397739460529187
deviation-heading_max6.215479802206541
deviation-heading_mean6.215479802206541
deviation-heading_median6.215479802206541
deviation-heading_min6.215479802206541
distance-from-start_max0.2415123477844477
distance-from-start_mean0.2415123477844477
distance-from-start_median0.2415123477844477
distance-from-start_min0.2415123477844477
driven_any_max1.691245206127114
driven_any_mean1.691245206127114
driven_any_median1.691245206127114
driven_any_min1.691245206127114
driven_lanedir_consec_max0.4430498641320328
driven_lanedir_consec_mean0.4430498641320328
driven_lanedir_consec_min0.4430498641320328
driven_lanedir_max0.4430498641320328
driven_lanedir_mean0.4430498641320328
driven_lanedir_median0.4430498641320328
driven_lanedir_min0.4430498641320328
in-drivable-lane_max9.100000000000064
in-drivable-lane_mean9.100000000000064
in-drivable-lane_min9.100000000000064
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.691245206127114, "survival_time": 16.900000000000105, "driven_lanedir": 0.4430498641320328, "in-drivable-lane": 9.100000000000064, "deviation-heading": 6.215479802206541, "distance-from-start": 0.2415123477844477, "deviation-center-line": 0.22397739460529187, "driven_lanedir_consec": 0.4430498641320328}}
simulation-passed1
survival_time_max16.900000000000105
survival_time_mean16.900000000000105
survival_time_min16.900000000000105
No reset possible
8731860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4successnodavinci-stage-010:20:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median54.44999999999872
driven_lanedir_consec_median0.3098973464465351
deviation-center-line_median0.596040362977547


other stats
deviation-center-line_max0.596040362977547
deviation-center-line_mean0.596040362977547
deviation-center-line_min0.596040362977547
deviation-heading_max4.3486570653054795
deviation-heading_mean4.3486570653054795
deviation-heading_median4.3486570653054795
deviation-heading_min4.3486570653054795
distance-from-start_max0.5079940801657485
distance-from-start_mean0.5079940801657485
distance-from-start_median0.5079940801657485
distance-from-start_min0.5079940801657485
driven_any_max5.939437046098013
driven_any_mean5.939437046098013
driven_any_median5.939437046098013
driven_any_min5.939437046098013
driven_lanedir_consec_max0.3098973464465351
driven_lanedir_consec_mean0.3098973464465351
driven_lanedir_consec_min0.3098973464465351
driven_lanedir_max0.3098973464465351
driven_lanedir_mean0.3098973464465351
driven_lanedir_median0.3098973464465351
driven_lanedir_min0.3098973464465351
in-drivable-lane_max54.44999999999872
in-drivable-lane_mean54.44999999999872
in-drivable-lane_min54.44999999999872
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.939437046098013, "survival_time": 59.99999999999873, "driven_lanedir": 0.3098973464465351, "in-drivable-lane": 54.44999999999872, "deviation-heading": 4.3486570653054795, "distance-from-start": 0.5079940801657485, "deviation-center-line": 0.596040362977547, "driven_lanedir_consec": 0.3098973464465351}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8706861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successnodavinci-stage-010:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.000000000000001
in-drivable-lane_median1.0500000000000007
driven_lanedir_consec_median0.024207570533736567
deviation-center-line_median0.02244096996290546


other stats
deviation-center-line_max0.02244096996290546
deviation-center-line_mean0.02244096996290546
deviation-center-line_min0.02244096996290546
deviation-heading_max0.8675584750600399
deviation-heading_mean0.8675584750600399
deviation-heading_median0.8675584750600399
deviation-heading_min0.8675584750600399
distance-from-start_max0.09036767838780842
distance-from-start_mean0.09036767838780842
distance-from-start_median0.09036767838780842
distance-from-start_min0.09036767838780842
driven_any_max0.09847865693630103
driven_any_mean0.09847865693630103
driven_any_median0.09847865693630103
driven_any_min0.09847865693630103
driven_lanedir_consec_max0.024207570533736567
driven_lanedir_consec_mean0.024207570533736567
driven_lanedir_consec_min0.024207570533736567
driven_lanedir_max0.024207570533736567
driven_lanedir_mean0.024207570533736567
driven_lanedir_median0.024207570533736567
driven_lanedir_min0.024207570533736567
in-drivable-lane_max1.0500000000000007
in-drivable-lane_mean1.0500000000000007
in-drivable-lane_min1.0500000000000007
per-episodes
details{"4way-000-ego0": {"driven_any": 0.09847865693630103, "survival_time": 2.000000000000001, "driven_lanedir": 0.024207570533736567, "in-drivable-lane": 1.0500000000000007, "deviation-heading": 0.8675584750600399, "distance-from-start": 0.09036767838780842, "deviation-center-line": 0.02244096996290546, "driven_lanedir_consec": 0.024207570533736567}}
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean2.000000000000001
survival_time_min2.000000000000001
No reset possible
8586860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4successnodavinci-stage-010:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.04999999999902
driven_lanedir_consec_median2.049079580701304
deviation-center-line_median2.493624965656414


other stats
deviation-center-line_max2.493624965656414
deviation-center-line_mean2.493624965656414
deviation-center-line_min2.493624965656414
deviation-heading_max14.516896098349092
deviation-heading_mean14.516896098349092
deviation-heading_median14.516896098349092
deviation-heading_min14.516896098349092
distance-from-start_max0.6592303673216534
distance-from-start_mean0.6592303673216534
distance-from-start_median0.6592303673216534
distance-from-start_min0.6592303673216534
driven_any_max7.92247334193447
driven_any_mean7.92247334193447
driven_any_median7.92247334193447
driven_any_min7.92247334193447
driven_lanedir_consec_max2.049079580701304
driven_lanedir_consec_mean2.049079580701304
driven_lanedir_consec_min2.049079580701304
driven_lanedir_max2.049079580701304
driven_lanedir_mean2.049079580701304
driven_lanedir_median2.049079580701304
driven_lanedir_min2.049079580701304
in-drivable-lane_max37.04999999999902
in-drivable-lane_mean37.04999999999902
in-drivable-lane_min37.04999999999902
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.92247334193447, "survival_time": 59.99999999999873, "driven_lanedir": 2.049079580701304, "in-drivable-lane": 37.04999999999902, "deviation-heading": 14.516896098349092, "distance-from-start": 0.6592303673216534, "deviation-center-line": 2.493624965656414, "driven_lanedir_consec": 2.049079580701304}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8580861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4host-errornodavinci-stage-010:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8564862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnodavinci-stage-010:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8554862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4host-errornodavinci-stage-010:00:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8344864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-010:27:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median49.27499999999877
driven_lanedir_consec_median0.35321864480632503
deviation-center-line_median1.0182234438951827


other stats
deviation-center-line_max2.771711906088405
deviation-center-line_mean1.2123745128067251
deviation-center-line_min0.04133925734813025
deviation-heading_max20.468899019236083
deviation-heading_mean9.671410115582614
deviation-heading_median8.706695791317129
deviation-heading_min0.8033498604601156
distance-from-start_max0.368955356785707
distance-from-start_mean0.238271515645366
distance-from-start_median0.23404832609816828
distance-from-start_min0.1160340535994204
driven_any_max10.623387168139676
driven_any_mean3.418378577769733
driven_any_median1.4581328345343514
driven_any_min0.13386147387055247
driven_lanedir_consec_max4.935275573704814
driven_lanedir_consec_mean1.421549717999163
driven_lanedir_consec_min0.044486008679187394
driven_lanedir_max4.935275573704814
driven_lanedir_mean1.4224621313779076
driven_lanedir_median0.35504347156381444
driven_lanedir_min0.044486008679187394
in-drivable-lane_max58.99999999999873
in-drivable-lane_mean45.362499999998946
in-drivable-lane_min23.89999999999953
per-episodes
details{"4way-000-ego0": {"driven_any": 2.6907711432727264, "survival_time": 59.99999999999873, "driven_lanedir": 0.6484092072100487, "in-drivable-lane": 39.699999999998816, "deviation-heading": 16.555859889307122, "distance-from-start": 0.35019781578428105, "deviation-center-line": 1.9639528338451844, "driven_lanedir_consec": 0.6447595536950699}, "4way-000-ego1": {"driven_any": 0.13386147387055247, "survival_time": 59.99999999999873, "driven_lanedir": 0.044486008679187394, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.857531693327135, "distance-from-start": 0.11789883641205554, "deviation-center-line": 0.07249405394518095, "driven_lanedir_consec": 0.044486008679187394}, "4way-000-ego2": {"driven_any": 0.22549452579597648, "survival_time": 59.99999999999873, "driven_lanedir": 0.06167773591758019, "in-drivable-lane": 58.84999999999873, "deviation-heading": 0.8033498604601156, "distance-from-start": 0.1160340535994204, "deviation-center-line": 0.04133925734813025, "driven_lanedir_consec": 0.06167773591758019}, "4way-000-ego3": {"driven_any": 10.623387168139676, "survival_time": 59.99999999999873, "driven_lanedir": 4.935275573704814, "in-drivable-lane": 23.89999999999953, "deviation-heading": 20.468899019236083, "distance-from-start": 0.368955356785707, "deviation-center-line": 2.771711906088405, "driven_lanedir_consec": 4.935275573704814}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8319865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successnodavinci-stage-010:13:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median43.099999999998914
driven_lanedir_consec_median1.107360312560185
deviation-center-line_median1.4436053278321332


other stats
deviation-center-line_max1.90520892294596
deviation-center-line_mean1.4436053278321332
deviation-center-line_min0.9820017327183064
deviation-heading_max19.05269944323249
deviation-heading_mean14.890145119610327
deviation-heading_median14.890145119610327
deviation-heading_min10.727590795988164
distance-from-start_max0.5415020217120032
distance-from-start_mean0.510473799772289
distance-from-start_median0.510473799772289
distance-from-start_min0.4794455778325748
driven_any_max8.169631466818839
driven_any_mean6.97079780957959
driven_any_median6.97079780957959
driven_any_min5.771964152340342
driven_lanedir_consec_max1.2850571106799014
driven_lanedir_consec_mean1.107360312560185
driven_lanedir_consec_min0.9296635144404686
driven_lanedir_max1.3074868141268976
driven_lanedir_mean1.2962719624033996
driven_lanedir_median1.2962719624033996
driven_lanedir_min1.2850571106799014
in-drivable-lane_max48.349999999998744
in-drivable-lane_mean43.099999999998914
in-drivable-lane_min37.84999999999908
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.169631466818839, "survival_time": 59.99999999999873, "driven_lanedir": 1.2850571106799014, "in-drivable-lane": 48.349999999998744, "deviation-heading": 10.727590795988164, "distance-from-start": 0.5415020217120032, "deviation-center-line": 0.9820017327183064, "driven_lanedir_consec": 1.2850571106799014}, "loop2-000-ego1": {"driven_any": 5.771964152340342, "survival_time": 59.99999999999873, "driven_lanedir": 1.3074868141268976, "in-drivable-lane": 37.84999999999908, "deviation-heading": 19.05269944323249, "distance-from-start": 0.4794455778325748, "deviation-center-line": 1.90520892294596, "driven_lanedir_consec": 0.9296635144404686}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8282866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4successnodavinci-stage-010:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median50.649999999998826
driven_lanedir_consec_median0.5444914815867281
deviation-center-line_median1.136604643971699


other stats
deviation-center-line_max1.136604643971699
deviation-center-line_mean1.136604643971699
deviation-center-line_min1.136604643971699
deviation-heading_max6.557852904443348
deviation-heading_mean6.557852904443348
deviation-heading_median6.557852904443348
deviation-heading_min6.557852904443348
distance-from-start_max0.3580407987966158
distance-from-start_mean0.3580407987966158
distance-from-start_median0.3580407987966158
distance-from-start_min0.3580407987966158
driven_any_max5.605874470185926
driven_any_mean5.605874470185926
driven_any_median5.605874470185926
driven_any_min5.605874470185926
driven_lanedir_consec_max0.5444914815867281
driven_lanedir_consec_mean0.5444914815867281
driven_lanedir_consec_min0.5444914815867281
driven_lanedir_max0.5444914815867281
driven_lanedir_mean0.5444914815867281
driven_lanedir_median0.5444914815867281
driven_lanedir_min0.5444914815867281
in-drivable-lane_max50.649999999998826
in-drivable-lane_mean50.649999999998826
in-drivable-lane_min50.649999999998826
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.605874470185926, "survival_time": 59.99999999999873, "driven_lanedir": 0.5444914815867281, "in-drivable-lane": 50.649999999998826, "deviation-heading": 6.557852904443348, "distance-from-start": 0.3580407987966158, "deviation-center-line": 1.136604643971699, "driven_lanedir_consec": 0.5444914815867281}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8279866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-1of4host-errornodavinci-stage-010:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8273866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-3of4host-errornodavinci-stage-010:00:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8255872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-0of4successnodavinci-stage-010:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.149999999999997
in-drivable-lane_median4.500000000000005
driven_lanedir_consec_median0.26312423953822783
deviation-center-line_median0.21530760361726045


other stats
deviation-center-line_max0.21530760361726045
deviation-center-line_mean0.21530760361726045
deviation-center-line_min0.21530760361726045
deviation-heading_max3.4248644379746476
deviation-heading_mean3.4248644379746476
deviation-heading_median3.4248644379746476
deviation-heading_min3.4248644379746476
distance-from-start_max0.1821540846373655
distance-from-start_mean0.1821540846373655
distance-from-start_median0.1821540846373655
distance-from-start_min0.1821540846373655
driven_any_max0.6783066265049112
driven_any_mean0.6783066265049112
driven_any_median0.6783066265049112
driven_any_min0.6783066265049112
driven_lanedir_consec_max0.26312423953822783
driven_lanedir_consec_mean0.26312423953822783
driven_lanedir_consec_min0.26312423953822783
driven_lanedir_max0.26312423953822783
driven_lanedir_mean0.26312423953822783
driven_lanedir_median0.26312423953822783
driven_lanedir_min0.26312423953822783
in-drivable-lane_max4.500000000000005
in-drivable-lane_mean4.500000000000005
in-drivable-lane_min4.500000000000005
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.6783066265049112, "survival_time": 9.149999999999997, "driven_lanedir": 0.26312423953822783, "in-drivable-lane": 4.500000000000005, "deviation-heading": 3.4248644379746476, "distance-from-start": 0.1821540846373655, "deviation-center-line": 0.21530760361726045, "driven_lanedir_consec": 0.26312423953822783}}
simulation-passed1
survival_time_max9.149999999999997
survival_time_mean9.149999999999997
survival_time_min9.149999999999997
No reset possible
8241873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successnodavinci-stage-010:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8239874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnodavinci-stage-010:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8237874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4host-errornodavinci-stage-010:01:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8234874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4host-errornodavinci-stage-010:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible