Duckietown Challenges Home Challenges Submissions

Submission 189

Submission189
Competinguser retired
Challengeaido-LFVI_multi-state-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1450 sim-1of4: 1382 sim-2of4: 1442 sim-3of4: 1403
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1450sim-0of4successno0:10:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.2750000000000039
driven_lanedir_consec_median2.2621322347475266
deviation-center-line_median5.455124522064782


other stats
deviation-center-line_max6.730071690278923
deviation-center-line_mean5.3635565728342005
deviation-center-line_min3.813905556928312
deviation-heading_max5.398374386296502
deviation-heading_mean3.4911759245746
deviation-heading_median3.07767796543575
deviation-heading_min2.4109733811303986
distance-from-start_max2.360894719942372
distance-from-start_mean1.8716522437215768
distance-from-start_median1.8806284295314877
distance-from-start_min1.3644573958809592
driven_any_max3.579595591754465
driven_any_mean2.913869978092253
driven_any_median3.1653932899371378
driven_any_min1.7450977407402684
driven_lanedir_consec_max3.5416191197832916
driven_lanedir_consec_mean2.401627193128855
driven_lanedir_consec_min1.540625183237075
driven_lanedir_max3.5637141538597508
driven_lanedir_mean2.8551542176763727
driven_lanedir_median3.0757494312319427
driven_lanedir_min1.7054038543818544
in-drivable-lane_max2.9499999999999744
in-drivable-lane_mean0.8749999999999956
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.579595591754465, "survival_time": 59.99999999999873, "driven_lanedir": 3.5637141538597508, "in-drivable-lane": 0.0, "deviation-heading": 3.2731562869441526, "distance-from-start": 2.360894719942372, "deviation-center-line": 3.813905556928312, "driven_lanedir_consec": 3.5416191197832916}, "udem-001-ego1": {"driven_any": 1.7450977407402684, "survival_time": 59.99999999999873, "driven_lanedir": 1.7054038543818544, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 2.8821996439273474, "distance-from-start": 1.3644573958809592, "deviation-center-line": 6.730071690278923, "driven_lanedir_consec": 1.7054038543818544}, "udem-001-ego2": {"driven_any": 2.829598678683391, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486095, "in-drivable-lane": 0.0, "deviation-heading": 2.4109733811303986, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113199}, "udem-001-ego3": {"driven_any": 3.5011879011908844, "survival_time": 59.99999999999873, "driven_lanedir": 3.332637869015276, "in-drivable-lane": 2.9499999999999744, "deviation-heading": 5.398374386296502, "distance-from-start": 1.4217286180588535, "deviation-center-line": 5.448562937012193, "driven_lanedir_consec": 1.540625183237075}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1442sim-2of4successno0:10:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.2000000000000313
driven_lanedir_consec_median2.39872659445854
deviation-center-line_median5.3859739514451626


other stats
deviation-center-line_max6.768119501529214
deviation-center-line_mean5.141910610133651
deviation-center-line_min3.027575036115065
deviation-heading_max18.81946877878392
deviation-heading_mean8.820040804686782
deviation-heading_median5.631621361292124
deviation-heading_min5.197451717378955
distance-from-start_max2.6950459261694424
distance-from-start_mean1.8252945748093836
distance-from-start_median1.9001626873267696
distance-from-start_min0.8058069984145536
driven_any_max3.465429040061585
driven_any_mean2.719821746246536
driven_any_median2.7166351379698175
driven_any_min1.980587668984925
driven_lanedir_consec_max3.2592904416252275
driven_lanedir_consec_mean2.1982667562526492
driven_lanedir_consec_min0.7363233944682888
driven_lanedir_max3.323464105214593
driven_lanedir_mean2.5697425108920915
driven_lanedir_median2.553994410954179
driven_lanedir_min1.8475171164454145
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean2.3374999999999924
in-drivable-lane_min1.3499999999999446
per-episodes
details{"4way-000-ego0": {"driven_any": 1.980587668984925, "survival_time": 59.99999999999873, "driven_lanedir": 1.8486983802831305, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.389913450161367, "distance-from-start": 0.8058069984145536, "deviation-center-line": 5.720664140368595, "driven_lanedir_consec": 0.7363233944682888}, "4way-000-ego1": {"driven_any": 2.000247935197532, "survival_time": 59.99999999999873, "driven_lanedir": 1.8475171164454145, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 18.81946877878392, "distance-from-start": 1.4628422402543055, "deviation-center-line": 5.051283762521729, "driven_lanedir_consec": 1.7798051238863204}, "4way-000-ego2": {"driven_any": 3.465429040061585, "survival_time": 59.99999999999873, "driven_lanedir": 3.323464105214593, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8733292724228825, "distance-from-start": 2.3374831343992333, "deviation-center-line": 3.027575036115065, "driven_lanedir_consec": 3.01764806503076}, "4way-000-ego3": {"driven_any": 3.4330223407421028, "survival_time": 59.99999999999873, "driven_lanedir": 3.2592904416252275, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.197451717378955, "distance-from-start": 2.6950459261694424, "deviation-center-line": 6.768119501529214, "driven_lanedir_consec": 3.2592904416252275}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1438sim-0of4host-errorno0:08:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1436sim-2of4timeoutno0:00:28
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1430sim-2of4host-errorno0:02:59
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1429sim-0of4host-errorno0:03:21
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1418sim-0of4host-errorno0:03:30
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1416sim-2of4host-errorno0:02:44
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1405sim-0of4host-errorno0:04:19
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1403sim-3of4successno0:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5499999999999687
driven_lanedir_consec_median2.552177936775677
deviation-center-line_median5.276797033794661


other stats
deviation-center-line_max6.817971770901333
deviation-center-line_mean5.2567874131922085
deviation-center-line_min3.655583814278179
deviation-heading_max6.563252470760606
deviation-heading_mean4.458256283202885
deviation-heading_median4.387903950413346
deviation-heading_min2.493964761224241
distance-from-start_max2.340140571562148
distance-from-start_mean1.6789451793932146
distance-from-start_median1.7603022682194664
distance-from-start_min0.8550356095717773
driven_any_max3.5795819394225075
driven_any_mean2.70659069824424
driven_any_median2.592596517334651
driven_any_min2.061587818885152
driven_lanedir_consec_max3.258167476579532
driven_lanedir_consec_mean2.2848832874203717
driven_lanedir_consec_min0.7770097995506012
driven_lanedir_max3.5632993278791676
driven_lanedir_mean2.6515592501763843
driven_lanedir_median2.5568251398708197
driven_lanedir_min1.929287393084729
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.7749999999999915
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.8895969569658213, "survival_time": 59.99999999999873, "driven_lanedir": 2.8330037973445834, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.493964761224241, "distance-from-start": 2.340140571562148, "deviation-center-line": 6.355081540633737, "driven_lanedir_consec": 2.8330037973445834}, "4way-001-ego1": {"driven_any": 3.5795819394225075, "survival_time": 59.99999999999873, "driven_lanedir": 3.5632993278791676, "in-drivable-lane": 0.0, "deviation-heading": 3.078999086626112, "distance-from-start": 1.9674451050311033, "deviation-center-line": 3.655583814278179, "driven_lanedir_consec": 3.258167476579532}, "4way-001-ego2": {"driven_any": 2.061587818885152, "survival_time": 59.99999999999873, "driven_lanedir": 1.929287393084729, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.69680881420058, "distance-from-start": 0.8550356095717773, "deviation-center-line": 6.817971770901333, "driven_lanedir_consec": 0.7770097995506012}, "4way-001-ego3": {"driven_any": 2.2955960777034803, "survival_time": 59.99999999999873, "driven_lanedir": 2.2806464823970556, "in-drivable-lane": 0.0, "deviation-heading": 6.563252470760606, "distance-from-start": 1.55315943140783, "deviation-center-line": 4.198512526955584, "driven_lanedir_consec": 2.271352076206771}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1396sim-0of4host-errorno0:04:45
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1393sim-3of4host-errorno0:03:17
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1390sim-2of4host-errorno0:03:38
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1382sim-1of4successno0:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.524999999999913
driven_lanedir_consec_median3.308911931921706
deviation-center-line_median5.839787504898322


other stats
deviation-center-line_max6.756988894128237
deviation-center-line_mean5.607974409302587
deviation-center-line_min3.995333733285469
deviation-heading_max5.165930135057995
deviation-heading_mean3.492288316564716
deviation-heading_median3.1489691860189213
deviation-heading_min2.5052847591630254
distance-from-start_max2.8445267960792138
distance-from-start_mean2.632183350467539
distance-from-start_median2.669111642833085
distance-from-start_min2.345983320124772
driven_any_max3.5465968597462285
driven_any_mean3.329494800122975
driven_any_median3.448392377162826
driven_any_min2.8745975864200184
driven_lanedir_consec_max3.489182613495724
driven_lanedir_consec_mean3.240922448166742
driven_lanedir_consec_min2.85668331532783
driven_lanedir_max3.489182796899873
driven_lanedir_mean3.240922527593834
driven_lanedir_median3.308911979191884
driven_lanedir_min2.856683355091693
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean1.6624999999999472
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8745975864200184, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683355091693, "in-drivable-lane": 0.0, "deviation-heading": 3.0038281605966826, "distance-from-start": 2.345983320124772, "deviation-center-line": 5.525958662038684, "driven_lanedir_consec": 2.85668331532783}, "udem-000-ego1": {"driven_any": 3.425095054137486, "survival_time": 59.99999999999873, "driven_lanedir": 3.325682803155688, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.29411021144116, "distance-from-start": 2.8445267960792138, "deviation-center-line": 6.15361634775796, "driven_lanedir_consec": 3.325682803155688}, "udem-000-ego2": {"driven_any": 3.5465968597462285, "survival_time": 59.99999999999873, "driven_lanedir": 3.489182796899873, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.5052847591630254, "distance-from-start": 2.6431774005847783, "deviation-center-line": 3.995333733285469, "driven_lanedir_consec": 3.489182613495724}, "udem-000-ego3": {"driven_any": 3.471689700188166, "survival_time": 59.99999999999873, "driven_lanedir": 3.2921411552280806, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165930135057995, "distance-from-start": 2.6950458850813908, "deviation-center-line": 6.756988894128237, "driven_lanedir_consec": 3.2921410606877237}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1368sim-3of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1366sim-0of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1361sim-2of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1360sim-1of4host-errorno0:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1347sim-3of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1339sim-2of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1332sim-2of4host-errorno0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.40/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.40/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible