Duckietown Challenges Home Challenges Submissions

Evaluator 14

ID14
evaluatornogpu-staging-spot-0-05
owneruser1000001
machinenogpu-staging-spot-0
processnogpu-staging-spot-0-05
version6.2.34
first heard
last heard
statusinactive
# evaluating
# success97 588
# timeout6 1810
# failed1 4837
# error
# aborted39 643
# host-error176 741
arm0
x86_641
Mac0
gpu available0
Number of processors16
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)29.4 GB
RAM free (MB)28.1 GB
Disk (MB)969.3 GB
Disk available (MB)965.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5103311Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4successnonogpu-staging-spot-0-050:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
5099312Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15434789028874651
survival_time_median6.249999999999986
deviation-center-line_median0.05996574123885577
in-drivable-lane_median5.249999999999986


other stats
deviation-center-line_max0.05996574123885577
deviation-center-line_mean0.05996574123885577
deviation-center-line_min0.05996574123885577
deviation-heading_max0.6404783791895872
deviation-heading_mean0.6404783791895872
deviation-heading_median0.6404783791895872
deviation-heading_min0.6404783791895872
distance-from-start_max1.5025486186157355
distance-from-start_mean1.5025486186157355
distance-from-start_median1.5025486186157355
distance-from-start_min1.5025486186157355
driven_any_max1.6070043253471935
driven_any_mean1.6070043253471935
driven_any_median1.6070043253471935
driven_any_min1.6070043253471935
driven_lanedir_consec_max0.15434789028874651
driven_lanedir_consec_mean0.15434789028874651
driven_lanedir_consec_min0.15434789028874651
driven_lanedir_max0.15434789028874651
driven_lanedir_mean0.15434789028874651
driven_lanedir_median0.15434789028874651
driven_lanedir_min0.15434789028874651
in-drivable-lane_max5.249999999999986
in-drivable-lane_mean5.249999999999986
in-drivable-lane_min5.249999999999986
per-episodes
details{"loop-000-ego0": {"driven_any": 1.6070043253471935, "survival_time": 6.249999999999986, "driven_lanedir": 0.15434789028874651, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.6404783791895872, "distance-from-start": 1.5025486186157355, "deviation-center-line": 0.05996574123885577, "driven_lanedir_consec": 0.15434789028874651}}
simulation-passed1
survival_time_max6.249999999999986
survival_time_mean6.249999999999986
survival_time_min6.249999999999986
No reset possible
5090356Liam Paulltemplate-rosaido-LF-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2107574561944907
survival_time_median3.4499999999999957
deviation-center-line_median0.06857609266971607
in-drivable-lane_median2.349999999999995


other stats
deviation-center-line_max0.06857609266971607
deviation-center-line_mean0.06857609266971607
deviation-center-line_min0.06857609266971607
deviation-heading_max0.5732121431844022
deviation-heading_mean0.5732121431844022
deviation-heading_median0.5732121431844022
deviation-heading_min0.5732121431844022
distance-from-start_max0.7830289870753281
distance-from-start_mean0.7830289870753281
distance-from-start_median0.7830289870753281
distance-from-start_min0.7830289870753281
driven_any_max0.7883618671467201
driven_any_mean0.7883618671467201
driven_any_median0.7883618671467201
driven_any_min0.7883618671467201
driven_lanedir_consec_max0.2107574561944907
driven_lanedir_consec_mean0.2107574561944907
driven_lanedir_consec_min0.2107574561944907
driven_lanedir_max0.2107574561944907
driven_lanedir_mean0.2107574561944907
driven_lanedir_median0.2107574561944907
driven_lanedir_min0.2107574561944907
in-drivable-lane_max2.349999999999995
in-drivable-lane_mean2.349999999999995
in-drivable-lane_min2.349999999999995
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7883618671467201, "survival_time": 3.4499999999999957, "driven_lanedir": 0.2107574561944907, "in-drivable-lane": 2.349999999999995, "deviation-heading": 0.5732121431844022, "distance-from-start": 0.7830289870753281, "deviation-center-line": 0.06857609266971607, "driven_lanedir_consec": 0.2107574561944907}}
simulation-passed1
survival_time_max3.4499999999999957
survival_time_mean3.4499999999999957
survival_time_min3.4499999999999957
No reset possible
5076360Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-1of4successnonogpu-staging-spot-0-050:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.000000000000001
in-drivable-lane_median0.9000000000000006
driven_lanedir_consec_median0.21167371071212604
deviation-center-line_median0.07385770568653427


other stats
deviation-center-line_max0.07385770568653427
deviation-center-line_mean0.07385770568653427
deviation-center-line_min0.07385770568653427
deviation-heading_max0.5909711509212289
deviation-heading_mean0.5909711509212289
deviation-heading_median0.5909711509212289
deviation-heading_min0.5909711509212289
distance-from-start_max0.3072482547716387
distance-from-start_mean0.3072482547716387
distance-from-start_median0.3072482547716387
distance-from-start_min0.3072482547716387
driven_any_max0.3076918248411279
driven_any_mean0.3076918248411279
driven_any_median0.3076918248411279
driven_any_min0.3076918248411279
driven_lanedir_consec_max0.21167371071212604
driven_lanedir_consec_mean0.21167371071212604
driven_lanedir_consec_min0.21167371071212604
driven_lanedir_max0.21167371071212604
driven_lanedir_mean0.21167371071212604
driven_lanedir_median0.21167371071212604
driven_lanedir_min0.21167371071212604
in-drivable-lane_max0.9000000000000006
in-drivable-lane_mean0.9000000000000006
in-drivable-lane_min0.9000000000000006
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3076918248411279, "survival_time": 2.000000000000001, "driven_lanedir": 0.21167371071212604, "in-drivable-lane": 0.9000000000000006, "deviation-heading": 0.5909711509212289, "distance-from-start": 0.3072482547716387, "deviation-center-line": 0.07385770568653427, "driven_lanedir_consec": 0.21167371071212604}}
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean2.000000000000001
survival_time_min2.000000000000001
No reset possible
5067362Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4successnonogpu-staging-spot-0-050:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6559916124480865
survival_time_median13.100000000000051
deviation-center-line_median0.36429047969877126
in-drivable-lane_median9.85000000000004


other stats
deviation-center-line_max0.36429047969877126
deviation-center-line_mean0.36429047969877126
deviation-center-line_min0.36429047969877126
deviation-heading_max1.7020040870562334
deviation-heading_mean1.7020040870562334
deviation-heading_median1.7020040870562334
deviation-heading_min1.7020040870562334
distance-from-start_max3.3982316182431305
distance-from-start_mean3.3982316182431305
distance-from-start_median3.3982316182431305
distance-from-start_min3.3982316182431305
driven_any_max3.52816912179111
driven_any_mean3.52816912179111
driven_any_median3.52816912179111
driven_any_min3.52816912179111
driven_lanedir_consec_max0.6559916124480865
driven_lanedir_consec_mean0.6559916124480865
driven_lanedir_consec_min0.6559916124480865
driven_lanedir_max0.6866685589646044
driven_lanedir_mean0.6866685589646044
driven_lanedir_median0.6866685589646044
driven_lanedir_min0.6866685589646044
in-drivable-lane_max9.85000000000004
in-drivable-lane_mean9.85000000000004
in-drivable-lane_min9.85000000000004
per-episodes
details{"loop-000-ego0": {"driven_any": 3.52816912179111, "survival_time": 13.100000000000051, "driven_lanedir": 0.6866685589646044, "in-drivable-lane": 9.85000000000004, "deviation-heading": 1.7020040870562334, "distance-from-start": 3.3982316182431305, "deviation-center-line": 0.36429047969877126, "driven_lanedir_consec": 0.6559916124480865}}
simulation-passed1
survival_time_max13.100000000000051
survival_time_mean13.100000000000051
survival_time_min13.100000000000051
No reset possible
5063363Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnonogpu-staging-spot-0-050:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5054365Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4successnonogpu-staging-spot-0-050:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.349999999999996
in-drivable-lane_median2.4499999999999957
driven_lanedir_consec_median0.09432344458181952
deviation-center-line_median0.06085224005716756


other stats
deviation-center-line_max0.06085224005716756
deviation-center-line_mean0.06085224005716756
deviation-center-line_min0.06085224005716756
deviation-heading_max0.7586829458512032
deviation-heading_mean0.7586829458512032
deviation-heading_median0.7586829458512032
deviation-heading_min0.7586829458512032
distance-from-start_max0.6483757866074261
distance-from-start_mean0.6483757866074261
distance-from-start_median0.6483757866074261
distance-from-start_min0.6483757866074261
driven_any_max0.6617764477346312
driven_any_mean0.6617764477346312
driven_any_median0.6617764477346312
driven_any_min0.6617764477346312
driven_lanedir_consec_max0.09432344458181952
driven_lanedir_consec_mean0.09432344458181952
driven_lanedir_consec_min0.09432344458181952
driven_lanedir_max0.09455118630724613
driven_lanedir_mean0.09455118630724613
driven_lanedir_median0.09455118630724613
driven_lanedir_min0.09455118630724613
in-drivable-lane_max2.4499999999999957
in-drivable-lane_mean2.4499999999999957
in-drivable-lane_min2.4499999999999957
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.6617764477346312, "survival_time": 3.349999999999996, "driven_lanedir": 0.09455118630724613, "in-drivable-lane": 2.4499999999999957, "deviation-heading": 0.7586829458512032, "distance-from-start": 0.6483757866074261, "deviation-center-line": 0.06085224005716756, "driven_lanedir_consec": 0.09432344458181952}}
simulation-passed1
survival_time_max3.349999999999996
survival_time_mean3.349999999999996
survival_time_min3.349999999999996
No reset possible
5046367Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnonogpu-staging-spot-0-050:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5042368Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-1of4successnonogpu-staging-spot-0-050:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.5999999999999988
in-drivable-lane_median1.749999999999999
driven_lanedir_consec_median0.1329966014633137
deviation-center-line_median0.05587808268808443


other stats
deviation-center-line_max0.05587808268808443
deviation-center-line_mean0.05587808268808443
deviation-center-line_min0.05587808268808443
deviation-heading_max0.5853230482415116
deviation-heading_mean0.5853230482415116
deviation-heading_median0.5853230482415116
deviation-heading_min0.5853230482415116
distance-from-start_max0.4622906333024876
distance-from-start_mean0.4622906333024876
distance-from-start_median0.4622906333024876
distance-from-start_min0.4622906333024876
driven_any_max0.47677743617658885
driven_any_mean0.47677743617658885
driven_any_median0.47677743617658885
driven_any_min0.47677743617658885
driven_lanedir_consec_max0.1329966014633137
driven_lanedir_consec_mean0.1329966014633137
driven_lanedir_consec_min0.1329966014633137
driven_lanedir_max0.1329966014633137
driven_lanedir_mean0.1329966014633137
driven_lanedir_median0.1329966014633137
driven_lanedir_min0.1329966014633137
in-drivable-lane_max1.749999999999999
in-drivable-lane_mean1.749999999999999
in-drivable-lane_min1.749999999999999
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.47677743617658885, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1329966014633137, "in-drivable-lane": 1.749999999999999, "deviation-heading": 0.5853230482415116, "distance-from-start": 0.4622906333024876, "deviation-center-line": 0.05587808268808443, "driven_lanedir_consec": 0.1329966014633137}}
simulation-passed1
survival_time_max2.5999999999999988
survival_time_mean2.5999999999999988
survival_time_min2.5999999999999988
No reset possible
5036369Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successnonogpu-staging-spot-0-050:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27966279025697593
survival_time_median5.04999999999999
deviation-center-line_median0.12073278481534612
in-drivable-lane_median3.6999999999999895


other stats
deviation-center-line_max0.12073278481534612
deviation-center-line_mean0.12073278481534612
deviation-center-line_min0.12073278481534612
deviation-heading_max0.6005163987566192
deviation-heading_mean0.6005163987566192
deviation-heading_median0.6005163987566192
deviation-heading_min0.6005163987566192
distance-from-start_max1.220255678673462
distance-from-start_mean1.220255678673462
distance-from-start_median1.220255678673462
distance-from-start_min1.220255678673462
driven_any_max1.2387498092884135
driven_any_mean1.2387498092884135
driven_any_median1.2387498092884135
driven_any_min1.2387498092884135
driven_lanedir_consec_max0.27966279025697593
driven_lanedir_consec_mean0.27966279025697593
driven_lanedir_consec_min0.27966279025697593
driven_lanedir_max0.27966279025697593
driven_lanedir_mean0.27966279025697593
driven_lanedir_median0.27966279025697593
driven_lanedir_min0.27966279025697593
in-drivable-lane_max3.6999999999999895
in-drivable-lane_mean3.6999999999999895
in-drivable-lane_min3.6999999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.2387498092884135, "survival_time": 5.04999999999999, "driven_lanedir": 0.27966279025697593, "in-drivable-lane": 3.6999999999999895, "deviation-heading": 0.6005163987566192, "distance-from-start": 1.220255678673462, "deviation-center-line": 0.12073278481534612, "driven_lanedir_consec": 0.27966279025697593}}
simulation-passed1
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_min5.04999999999999
No reset possible
5029371Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:02:33
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5022370Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4successnonogpu-staging-spot-0-050:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5014373Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:08:04
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5009371Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:07
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4998371Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:05:02
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4973373Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:18:07
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4969374Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
4953377Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successnonogpu-staging-spot-0-050:08:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.900000000000034
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5555385145321523
deviation-center-line_median1.20467770153301


other stats
deviation-center-line_max1.422420087452746
deviation-center-line_mean1.0287007543328914
deviation-center-line_min0.2830275268127998
deviation-heading_max8.1027612634676
deviation-heading_mean4.242484734703611
deviation-heading_median3.0938416963123236
deviation-heading_min2.6794942827221986
distance-from-start_max1.1533081156055185
distance-from-start_mean0.6874541818354767
distance-from-start_median0.5462906719548797
distance-from-start_min0.5039272678266291
driven_any_max1.4351967733511444
driven_any_mean0.7879517682993056
driven_any_median0.5887880695743306
driven_any_min0.5390341606974169
driven_lanedir_consec_max1.2742680525066976
driven_lanedir_consec_mean0.7223060149347533
driven_lanedir_consec_min0.5038789781680111
driven_lanedir_max1.2742680525066976
driven_lanedir_mean0.7227530880362827
driven_lanedir_median0.5564326607352112
driven_lanedir_min0.5038789781680111
in-drivable-lane_max1.40000000000002
in-drivable-lane_mean0.350000000000005
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.4351967733511444, "survival_time": 11.900000000000034, "driven_lanedir": 1.2742680525066976, "in-drivable-lane": 1.40000000000002, "deviation-heading": 2.6794942827221986, "distance-from-start": 1.1533081156055185, "deviation-center-line": 0.2830275268127998, "driven_lanedir_consec": 1.2742680525066976}, "udem-000-ego1": {"driven_any": 0.605369476738047, "survival_time": 11.900000000000034, "driven_lanedir": 0.564994016888674, "in-drivable-lane": 0.0, "deviation-heading": 2.8291757161526028, "distance-from-start": 0.5472874450774521, "deviation-center-line": 1.3466534980466782, "driven_lanedir_consec": 0.563773832516573}, "udem-000-ego2": {"driven_any": 0.5722066624106142, "survival_time": 11.900000000000034, "driven_lanedir": 0.5478713045817485, "in-drivable-lane": 0.0, "deviation-heading": 3.3585076764720445, "distance-from-start": 0.5452938988323073, "deviation-center-line": 1.422420087452746, "driven_lanedir_consec": 0.5473031965477317}, "udem-000-ego3": {"driven_any": 0.5390341606974169, "survival_time": 11.900000000000034, "driven_lanedir": 0.5038789781680111, "in-drivable-lane": 0.0, "deviation-heading": 8.1027612634676, "distance-from-start": 0.5039272678266291, "deviation-center-line": 1.0627019050193416, "driven_lanedir_consec": 0.5038789781680111}}
simulation-passed1
survival_time_max11.900000000000034
survival_time_mean11.900000000000034
survival_time_min11.900000000000034
No reset possible
4941377Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-0of4successnonogpu-staging-spot-0-050:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.450000000000028
in-drivable-lane_median2.9749999999999965
driven_lanedir_consec_median0.5441140442431311
deviation-center-line_median0.6464253131143085


other stats
deviation-center-line_max0.849466083355394
deviation-center-line_mean0.655504063042916
deviation-center-line_min0.4796995425876528
deviation-heading_max8.598197728009023
deviation-heading_mean4.223364345304914
deviation-heading_median2.930754894920069
deviation-heading_min2.433749863370494
distance-from-start_max0.8669144573561646
distance-from-start_mean0.66578417497315
distance-from-start_median0.6643133622930424
distance-from-start_min0.46759551795035054
driven_any_max1.3752691751788813
driven_any_mean1.0401438412976238
driven_any_median1.1496869351772547
driven_any_min0.4859323196571052
driven_lanedir_consec_max0.6506037378221481
driven_lanedir_consec_mean0.5507093197802125
driven_lanedir_consec_min0.46400545281243977
driven_lanedir_max0.9191413769446976
driven_lanedir_mean0.6475594056000143
driven_lanedir_median0.6035453963214601
driven_lanedir_min0.46400545281243977
in-drivable-lane_max3.9499999999999913
in-drivable-lane_mean2.474999999999996
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.156325515574664, "survival_time": 11.450000000000028, "driven_lanedir": 0.5564870548207721, "in-drivable-lane": 3.9499999999999913, "deviation-heading": 2.433749863370494, "distance-from-start": 0.8669144573561646, "deviation-center-line": 0.4796995425876528, "driven_lanedir_consec": 0.5564870548207721}, "4way-000-ego1": {"driven_any": 1.3752691751788813, "survival_time": 11.450000000000028, "driven_lanedir": 0.9191413769446976, "in-drivable-lane": 3.3000000000000025, "deviation-heading": 2.9737572860373573, "distance-from-start": 0.46759551795035054, "deviation-center-line": 0.51607031367578, "driven_lanedir_consec": 0.5317410336654902}, "4way-000-ego2": {"driven_any": 1.1430483547798451, "survival_time": 11.450000000000028, "driven_lanedir": 0.6506037378221481, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 2.887752503802781, "distance-from-start": 0.8603529949076117, "deviation-center-line": 0.7767803125528371, "driven_lanedir_consec": 0.6506037378221481}, "4way-000-ego3": {"driven_any": 0.4859323196571052, "survival_time": 11.450000000000028, "driven_lanedir": 0.46400545281243977, "in-drivable-lane": 0.0, "deviation-heading": 8.598197728009023, "distance-from-start": 0.468273729678473, "deviation-center-line": 0.849466083355394, "driven_lanedir_consec": 0.46400545281243977}}
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean11.450000000000028
survival_time_min11.450000000000028
No reset possible
4930378Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:02:46
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4916380Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:05:52
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4900378Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:08:56
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4892378Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:04:42
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4875378Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:08:07
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4873377Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4timeoutnonogpu-staging-spot-0-050:01:34
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4857378Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:05:37
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4845379Bea Baselines 🐤baseline-duckietownaido-LFP-sim-testingsim-2of4successnonogpu-staging-spot-0-050:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median34.200000000000195
in-drivable-lane_median6.900000000000048
driven_lanedir_consec_median3.1829628895750925
deviation-center-line_median1.4925359836717738


other stats
deviation-center-line_max1.4925359836717738
deviation-center-line_mean1.4925359836717738
deviation-center-line_min1.4925359836717738
deviation-heading_max7.646220573225928
deviation-heading_mean7.646220573225928
deviation-heading_median7.646220573225928
deviation-heading_min7.646220573225928
distance-from-start_max2.779115803047038
distance-from-start_mean2.779115803047038
distance-from-start_median2.779115803047038
distance-from-start_min2.779115803047038
driven_any_max4.395706084980886
driven_any_mean4.395706084980886
driven_any_median4.395706084980886
driven_any_min4.395706084980886
driven_lanedir_consec_max3.1829628895750925
driven_lanedir_consec_mean3.1829628895750925
driven_lanedir_consec_min3.1829628895750925
driven_lanedir_max3.1829628895750925
driven_lanedir_mean3.1829628895750925
driven_lanedir_median3.1829628895750925
driven_lanedir_min3.1829628895750925
in-drivable-lane_max6.900000000000048
in-drivable-lane_mean6.900000000000048
in-drivable-lane_min6.900000000000048
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.395706084980886, "survival_time": 34.200000000000195, "driven_lanedir": 3.1829628895750925, "in-drivable-lane": 6.900000000000048, "deviation-heading": 7.646220573225928, "distance-from-start": 2.779115803047038, "deviation-center-line": 1.4925359836717738, "driven_lanedir_consec": 3.1829628895750925}}
simulation-passed1
survival_time_max34.200000000000195
survival_time_mean34.200000000000195
survival_time_min34.200000000000195
No reset possible
4837381Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-1of4failednonogpu-staging-spot-0-050:03:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4823380Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-0of4successnonogpu-staging-spot-0-050:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.15000000000028
in-drivable-lane_median8.20000000000006
driven_lanedir_consec_median2.2489263079796284
deviation-center-line_median2.325559258614224


other stats
deviation-center-line_max2.325559258614224
deviation-center-line_mean2.325559258614224
deviation-center-line_min2.325559258614224
deviation-heading_max4.421352377869084
deviation-heading_mean4.421352377869084
deviation-heading_median4.421352377869084
deviation-heading_min4.421352377869084
distance-from-start_max1.2010840673216496
distance-from-start_mean1.2010840673216496
distance-from-start_median1.2010840673216496
distance-from-start_min1.2010840673216496
driven_any_max3.725498284991163
driven_any_mean3.725498284991163
driven_any_median3.725498284991163
driven_any_min3.725498284991163
driven_lanedir_consec_max2.2489263079796284
driven_lanedir_consec_mean2.2489263079796284
driven_lanedir_consec_min2.2489263079796284
driven_lanedir_max2.5854423807466977
driven_lanedir_mean2.5854423807466977
driven_lanedir_median2.5854423807466977
driven_lanedir_min2.5854423807466977
in-drivable-lane_max8.20000000000006
in-drivable-lane_mean8.20000000000006
in-drivable-lane_min8.20000000000006
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.725498284991163, "survival_time": 29.15000000000028, "driven_lanedir": 2.5854423807466977, "in-drivable-lane": 8.20000000000006, "deviation-heading": 4.421352377869084, "distance-from-start": 1.2010840673216496, "deviation-center-line": 2.325559258614224, "driven_lanedir_consec": 2.2489263079796284}}
simulation-passed1
survival_time_max29.15000000000028
survival_time_mean29.15000000000028
survival_time_min29.15000000000028
No reset possible
4814381Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:05:17
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/containers/5c6b25c649f64dfe99646cec1821df98ac2cb43abd7b2b2445234b926bcfbe83/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.41/containers/5c6b25c649f64dfe99646cec1821df98ac2cb43abd7b2b2445234b926bcfbe83/json: Not Found ("No such container: 5c6b25c649f64dfe99646cec1821df98ac2cb43abd7b2b2445234b926bcfbe83")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4796380Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:07:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4792380Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4779381Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-3of4successnonogpu-staging-spot-0-050:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
4772381Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-testingsim-2of4successnonogpu-staging-spot-0-050:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
4739384Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:06:46
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4718383Bea Baselines 🐤baseline-duckietownaido-LF-sim-testingsim-0of4successnonogpu-staging-spot-0-050:10:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.108670175638084
survival_time_median59.99999999999873
deviation-center-line_median4.498605199561048
in-drivable-lane_median27.099999999999312


other stats
deviation-center-line_max4.498605199561048
deviation-center-line_mean4.498605199561048
deviation-center-line_min4.498605199561048
deviation-heading_max7.526428432368896
deviation-heading_mean7.526428432368896
deviation-heading_median7.526428432368896
deviation-heading_min7.526428432368896
distance-from-start_max0.9362447187384252
distance-from-start_mean0.9362447187384252
distance-from-start_median0.9362447187384252
distance-from-start_min0.9362447187384252
driven_any_max7.907280884760288
driven_any_mean7.907280884760288
driven_any_median7.907280884760288
driven_any_min7.907280884760288
driven_lanedir_consec_max4.108670175638084
driven_lanedir_consec_mean4.108670175638084
driven_lanedir_consec_min4.108670175638084
driven_lanedir_max4.108670175638084
driven_lanedir_mean4.108670175638084
driven_lanedir_median4.108670175638084
driven_lanedir_min4.108670175638084
in-drivable-lane_max27.099999999999312
in-drivable-lane_mean27.099999999999312
in-drivable-lane_min27.099999999999312
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.907280884760288, "survival_time": 59.99999999999873, "driven_lanedir": 4.108670175638084, "in-drivable-lane": 27.099999999999312, "deviation-heading": 7.526428432368896, "distance-from-start": 0.9362447187384252, "deviation-center-line": 4.498605199561048, "driven_lanedir_consec": 4.108670175638084}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4710384Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:03:18
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4688451Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:17:27
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4667449Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4successnonogpu-staging-spot-0-050:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40649934386321146


other stats
deviation-center-line_max0.40649934386321146
deviation-center-line_mean0.40649934386321146
deviation-center-line_min0.40649934386321146
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 0.0, "deviation-center-line": 0.40649934386321146, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4627500Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-0of4successnonogpu-staging-spot-0-050:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.000000000000277
in-drivable-lane_median20.025000000000247
driven_lanedir_consec_median0.23004863869940056
deviation-center-line_median0.7278799269429306


other stats
deviation-center-line_max0.8194317074657906
deviation-center-line_mean0.7278799269429306
deviation-center-line_min0.6363281464200705
deviation-heading_max6.73261632177244
deviation-heading_mean6.633830808409963
deviation-heading_median6.633830808409963
deviation-heading_min6.535045295047486
distance-from-start_max0.8626308120701064
distance-from-start_mean0.8293644349619179
distance-from-start_median0.8293644349619179
distance-from-start_min0.7960980578537294
driven_any_max7.222519405652156
driven_any_mean6.586737153678611
driven_any_median6.586737153678611
driven_any_min5.950954901705066
driven_lanedir_consec_max0.26576074471389377
driven_lanedir_consec_mean0.23004863869940056
driven_lanedir_consec_min0.19433653268490736
driven_lanedir_max0.24775126076977572
driven_lanedir_mean0.21437974622313744
driven_lanedir_median0.21437974622313744
driven_lanedir_min0.18100823167649915
in-drivable-lane_max20.30000000000025
in-drivable-lane_mean20.025000000000247
in-drivable-lane_min19.750000000000245
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.950954901705066, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977572, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537294, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.26576074471389377}, "loop2-000-ego1": {"driven_any": 7.222519405652156, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167649915, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701064, "deviation-center-line": 0.6363281464200705, "driven_lanedir_consec": 0.19433653268490736}}
simulation-passed1
survival_time_max29.000000000000277
survival_time_mean29.000000000000277
survival_time_min29.000000000000277
No reset possible
4516507Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:41:55
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4504508Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-1of4successnonogpu-staging-spot-0-050:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.750000000000203
in-drivable-lane_median18.450000000000163
driven_lanedir_consec_median0.02131905156671587
deviation-center-line_median0.43050856325619097


other stats
deviation-center-line_max0.43050856325619097
deviation-center-line_mean0.43050856325619097
deviation-center-line_min0.43050856325619097
deviation-heading_max4.072119010163631
deviation-heading_mean4.072119010163631
deviation-heading_median4.072119010163631
deviation-heading_min4.072119010163631
distance-from-start_max0.7357883576773695
distance-from-start_mean0.7357883576773695
distance-from-start_median0.7357883576773695
distance-from-start_min0.7357883576773695
driven_any_max5.629722876849649
driven_any_mean5.629722876849649
driven_any_median5.629722876849649
driven_any_min5.629722876849649
driven_lanedir_consec_max0.02131905156671587
driven_lanedir_consec_mean0.02131905156671587
driven_lanedir_consec_min0.02131905156671587
driven_lanedir_max0.004357978552197217
driven_lanedir_mean0.004357978552197217
driven_lanedir_median0.004357978552197217
driven_lanedir_min0.004357978552197217
in-drivable-lane_max18.450000000000163
in-drivable-lane_mean18.450000000000163
in-drivable-lane_min18.450000000000163
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.629722876849649, "survival_time": 23.750000000000203, "driven_lanedir": 0.004357978552197217, "in-drivable-lane": 18.450000000000163, "deviation-heading": 4.072119010163631, "distance-from-start": 0.7357883576773695, "deviation-center-line": 0.43050856325619097, "driven_lanedir_consec": 0.02131905156671587}}
simulation-passed1
survival_time_max23.750000000000203
survival_time_mean23.750000000000203
survival_time_min23.750000000000203
No reset possible
4498508Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnonogpu-staging-spot-0-050:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.022350044024311844
deviation-center-line_median0.02664350798512652


other stats
deviation-center-line_max0.02664350798512652
deviation-center-line_mean0.02664350798512652
deviation-center-line_min0.02664350798512652
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.4028556303039825
distance-from-start_mean0.4028556303039825
distance-from-start_median0.4028556303039825
distance-from-start_min0.4028556303039825
driven_any_max0.4240764502839735
driven_any_mean0.4240764502839735
driven_any_median0.4240764502839735
driven_any_min0.4240764502839735
driven_lanedir_consec_max0.022350044024311844
driven_lanedir_consec_mean0.022350044024311844
driven_lanedir_consec_min0.022350044024311844
driven_lanedir_max0.022350044024311844
driven_lanedir_mean0.022350044024311844
driven_lanedir_median0.022350044024311844
driven_lanedir_min0.022350044024311844
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4240764502839735, "survival_time": 3.7499999999999942, "driven_lanedir": 0.022350044024311844, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 1.126574172093021, "distance-from-start": 0.4028556303039825, "deviation-center-line": 0.02664350798512652, "driven_lanedir_consec": 0.022350044024311844}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
4486510Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-1of4successnonogpu-staging-spot-0-050:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02948511522371433
deviation-center-line_median0.3268413798803088


other stats
deviation-center-line_max0.3268413798803088
deviation-center-line_mean0.3268413798803088
deviation-center-line_min0.3268413798803088
deviation-heading_max2.54887264951439
deviation-heading_mean2.54887264951439
deviation-heading_median2.54887264951439
deviation-heading_min2.54887264951439
distance-from-start_max0.5461575079396541
distance-from-start_mean0.5461575079396541
distance-from-start_median0.5461575079396541
distance-from-start_min0.5461575079396541
driven_any_max2.2955250818765145
driven_any_mean2.2955250818765145
driven_any_median2.2955250818765145
driven_any_min2.2955250818765145
driven_lanedir_consec_max0.02948511522371433
driven_lanedir_consec_mean0.02948511522371433
driven_lanedir_consec_min0.02948511522371433
driven_lanedir_max0.03283062285727567
driven_lanedir_mean0.03283062285727567
driven_lanedir_median0.03283062285727567
driven_lanedir_min0.03283062285727567
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"udem-000-ego0": {"driven_any": 2.2955250818765145, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283062285727567, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.54887264951439, "distance-from-start": 0.5461575079396541, "deviation-center-line": 0.3268413798803088, "driven_lanedir_consec": 0.02948511522371433}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
4471511Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-0of4successnonogpu-staging-spot-0-050:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02948472541340319
deviation-center-line_median0.3268416970813497


other stats
deviation-center-line_max0.3268416970813497
deviation-center-line_mean0.3268416970813497
deviation-center-line_min0.3268416970813497
deviation-heading_max2.548872596322993
deviation-heading_mean2.548872596322993
deviation-heading_median2.548872596322993
deviation-heading_min2.548872596322993
distance-from-start_max0.5461575079396523
distance-from-start_mean0.5461575079396523
distance-from-start_median0.5461575079396523
distance-from-start_min0.5461575079396523
driven_any_max2.2955250818765194
driven_any_mean2.2955250818765194
driven_any_median2.2955250818765194
driven_any_min2.2955250818765194
driven_lanedir_consec_max0.02948472541340319
driven_lanedir_consec_mean0.02948472541340319
driven_lanedir_consec_min0.02948472541340319
driven_lanedir_max0.032831067512037126
driven_lanedir_mean0.032831067512037126
driven_lanedir_median0.032831067512037126
driven_lanedir_min0.032831067512037126
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"4way-000-ego0": {"driven_any": 2.2955250818765194, "survival_time": 11.350000000000026, "driven_lanedir": 0.032831067512037126, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.548872596322993, "distance-from-start": 0.5461575079396523, "deviation-center-line": 0.3268416970813497, "driven_lanedir_consec": 0.02948472541340319}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
4443513Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successnonogpu-staging-spot-0-050:12:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.80000000000009
in-drivable-lane_median12.250000000000089
driven_lanedir_consec_median0.1976657309045995
deviation-center-line_median0.30916297118874164


other stats
deviation-center-line_max0.5167734001966479
deviation-center-line_mean0.2904356927295703
deviation-center-line_min0.026643428344150132
deviation-heading_max3.648554139524216
deviation-heading_mean2.1866076734990423
deviation-heading_median1.9856511911894663
deviation-heading_min1.126574172093021
distance-from-start_max0.6297514211539125
distance-from-start_mean0.5152552969251188
distance-from-start_median0.5284445727545999
distance-from-start_min0.3743806210373633
driven_any_max3.5922095903913815
driven_any_mean1.7403199031741243
driven_any_median1.4873198912093584
driven_any_min0.3944302398863988
driven_lanedir_consec_max0.30624803336021755
driven_lanedir_consec_mean0.18098238479843215
driven_lanedir_consec_min0.022350044024312066
driven_lanedir_max0.30624803336021755
driven_lanedir_mean0.17754217371916875
driven_lanedir_median0.1907853087460727
driven_lanedir_min0.022350044024312066
in-drivable-lane_max14.30000000000009
in-drivable-lane_mean11.862500000000091
in-drivable-lane_min8.650000000000095
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5356334840761573, "survival_time": 15.80000000000009, "driven_lanedir": 0.022350044024312066, "in-drivable-lane": 14.30000000000009, "deviation-heading": 1.126574172093021, "distance-from-start": 0.5107316375695493, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350044024312066}, "udem-000-ego1": {"driven_any": 3.5922095903913815, "survival_time": 15.80000000000009, "driven_lanedir": 0.23530327637400592, "in-drivable-lane": 8.650000000000095, "deviation-heading": 3.648554139524216, "distance-from-start": 0.6297514211539125, "deviation-center-line": 0.5167734001966479, "driven_lanedir_consec": 0.24249463032549556}, "udem-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 15.80000000000009, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 10.750000000000083, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "udem-000-ego3": {"driven_any": 0.3944302398863988, "survival_time": 15.80000000000009, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 13.750000000000092, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.3743806210373633, "deviation-center-line": 0.10402505233140706, "driven_lanedir_consec": 0.30624803336021755}}
simulation-passed1
survival_time_max15.80000000000009
survival_time_mean15.80000000000009
survival_time_min15.80000000000009
No reset possible
4436400Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-3of4successnonogpu-staging-spot-0-050:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.200000000000053
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7222898911877377
deviation-center-line_median0.6263425139703784


other stats
deviation-center-line_max0.6263425139703784
deviation-center-line_mean0.6263425139703784
deviation-center-line_min0.6263425139703784
deviation-heading_max1.417085318647224
deviation-heading_mean1.417085318647224
deviation-heading_median1.417085318647224
deviation-heading_min1.417085318647224
distance-from-start_max0.7201981002422111
distance-from-start_mean0.7201981002422111
distance-from-start_median0.7201981002422111
distance-from-start_min0.7201981002422111
driven_any_max0.7295990048299447
driven_any_mean0.7295990048299447
driven_any_median0.7295990048299447
driven_any_min0.7295990048299447
driven_lanedir_consec_max0.7222898911877377
driven_lanedir_consec_mean0.7222898911877377
driven_lanedir_consec_min0.7222898911877377
driven_lanedir_max0.7222898911877377
driven_lanedir_mean0.7222898911877377
driven_lanedir_median0.7222898911877377
driven_lanedir_min0.7222898911877377
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7295990048299447, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877377, "in-drivable-lane": 0.0, "deviation-heading": 1.417085318647224, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703784, "driven_lanedir_consec": 0.7222898911877377}}
simulation-passed1
survival_time_max13.200000000000053
survival_time_mean13.200000000000053
survival_time_min13.200000000000053
No reset possible
4425402Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-0of4successnonogpu-staging-spot-0-050:10:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.304480726222847
deviation-center-line_median3.302753458049455


other stats
deviation-center-line_max3.302753458049455
deviation-center-line_mean3.302753458049455
deviation-center-line_min3.302753458049455
deviation-heading_max3.2546442407727656
deviation-heading_mean3.2546442407727656
deviation-heading_median3.2546442407727656
deviation-heading_min3.2546442407727656
distance-from-start_max2.0440638909568793
distance-from-start_mean2.0440638909568793
distance-from-start_median2.0440638909568793
distance-from-start_min2.0440638909568793
driven_any_max3.5795815550659227
driven_any_mean3.5795815550659227
driven_any_median3.5795815550659227
driven_any_min3.5795815550659227
driven_lanedir_consec_max3.304480726222847
driven_lanedir_consec_mean3.304480726222847
driven_lanedir_consec_min3.304480726222847
driven_lanedir_max3.5615615055523557
driven_lanedir_mean3.5615615055523557
driven_lanedir_median3.5615615055523557
driven_lanedir_min3.5615615055523557
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795815550659227, "survival_time": 59.99999999999873, "driven_lanedir": 3.5615615055523557, "in-drivable-lane": 0.0, "deviation-heading": 3.2546442407727656, "distance-from-start": 2.0440638909568793, "deviation-center-line": 3.302753458049455, "driven_lanedir_consec": 3.304480726222847}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4406407Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successnonogpu-staging-spot-0-050:10:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573454
deviation-heading_mean11.057314603573454
deviation-heading_median11.057314603573454
deviation-heading_min11.057314603573454
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019541
driven_any_mean3.452076592019541
driven_any_median3.452076592019541
driven_any_min3.452076592019541
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019541, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573454, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4384460Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-3of4successnonogpu-staging-spot-0-050:15:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.5500000000000078
driven_lanedir_consec_median2.718661763245714
deviation-center-line_median4.5997692880971215


other stats
deviation-center-line_max7.514921718660501
deviation-center-line_mean5.023920125290924
deviation-center-line_min3.3812202063089525
deviation-heading_max7.270406502444227
deviation-heading_mean4.9042936293322485
deviation-heading_median4.713467903390324
deviation-heading_min2.919832208104121
distance-from-start_max2.224084223392078
distance-from-start_mean1.8277566260066989
distance-from-start_median1.8250490941884188
distance-from-start_min1.4368440922578805
driven_any_max3.5795916194571973
driven_any_mean3.0035907065383096
driven_any_median3.1970874397950704
driven_any_min2.0405963271059
driven_lanedir_consec_max3.5171201735604205
driven_lanedir_consec_mean2.5784169719278185
driven_lanedir_consec_min1.3592241876594235
driven_lanedir_max3.5592470379137566
driven_lanedir_mean2.9375047850576332
driven_lanedir_median3.1055600091708744
driven_lanedir_min1.9796520839750271
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.775000000000011
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.0405963271059, "survival_time": 59.99999999999873, "driven_lanedir": 1.9796520839750271, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919832208104121, "distance-from-start": 1.5472498854755887, "deviation-center-line": 7.514921718660501, "driven_lanedir_consec": 1.9796520839750271}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949167, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 3.5795916194571973, "survival_time": 59.99999999999873, "driven_lanedir": 3.528723004022691, "in-drivable-lane": 0.0, "deviation-heading": 7.270406502444227, "distance-from-start": 2.102848302901249, "deviation-center-line": 3.7168045356169577, "driven_lanedir_consec": 3.5171201735604205}, "udem-000-ego3": {"driven_any": 2.8145878472861754, "survival_time": 59.99999999999873, "driven_lanedir": 2.6823970143190583, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663418506885731, "distance-from-start": 1.4368440922578805, "deviation-center-line": 5.482734040577284, "driven_lanedir_consec": 1.3592241876594235}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4358465Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-0of4successnonogpu-staging-spot-0-050:17:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1500000000000163
driven_lanedir_consec_median3.1664224879105047
deviation-center-line_median4.250268254472453


other stats
deviation-center-line_max4.250268254472453
deviation-center-line_mean4.250268254472453
deviation-center-line_min4.250268254472453
deviation-heading_max6.786712714590211
deviation-heading_mean6.786712714590211
deviation-heading_median6.786712714590211
deviation-heading_min6.786712714590211
distance-from-start_max2.5818017994088462
distance-from-start_mean2.5818017994088462
distance-from-start_median2.5818017994088462
distance-from-start_min2.5818017994088462
driven_any_max3.545077440128745
driven_any_mean3.545077440128745
driven_any_median3.545077440128745
driven_any_min3.545077440128745
driven_lanedir_consec_max3.1664224879105047
driven_lanedir_consec_mean3.1664224879105047
driven_lanedir_consec_min3.1664224879105047
driven_lanedir_max3.428172822833446
driven_lanedir_mean3.428172822833446
driven_lanedir_median3.428172822833446
driven_lanedir_min3.428172822833446
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean1.1500000000000163
in-drivable-lane_min1.1500000000000163
per-episodes
details{"4way-000-ego0": {"driven_any": 3.545077440128745, "survival_time": 59.99999999999873, "driven_lanedir": 3.428172822833446, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 6.786712714590211, "distance-from-start": 2.5818017994088462, "deviation-center-line": 4.250268254472453, "driven_lanedir_consec": 3.1664224879105047}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4338475Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:17:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 419, in copy
    copymode(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 307, in copymode
    st = stat_func(src)
  File "/usr/lib/python3.8/shutil.py", line 229, in _stat
    return fn.stat() if isinstance(fn, os.DirEntry) else os.stat(fn)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFVI-state-sim-validation/submission475/sim-2of4-nogpu-staging-spot-0-05-job4338-a-wd/challenge-evaluation-output/episodes/udem-001/log.gs2.cbor.tmp'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4317474Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:20:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFVI_multi-state-sim-validation/submission474/sim-1of4-nogpu-staging-spot-0-05-job4317-a-wd/challenge-evaluation-output/episodes/4way-001/ui_image.mp4-active.avi'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4302478Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4successnonogpu-staging-spot-0-050:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.724276796699463
deviation-center-line_median0.3909716849234727


other stats
deviation-center-line_max0.3909716849234727
deviation-center-line_mean0.3909716849234727
deviation-center-line_min0.3909716849234727
deviation-heading_max2.927962001412338
deviation-heading_mean2.927962001412338
deviation-heading_median2.927962001412338
deviation-heading_min2.927962001412338
distance-from-start_max2.7253140969543077
distance-from-start_mean2.7253140969543077
distance-from-start_median2.7253140969543077
distance-from-start_min2.7253140969543077
driven_any_max5.744474915234454
driven_any_mean5.744474915234454
driven_any_median5.744474915234454
driven_any_min5.744474915234454
driven_lanedir_consec_max5.724276796699463
driven_lanedir_consec_mean5.724276796699463
driven_lanedir_consec_min5.724276796699463
driven_lanedir_max5.724276796699463
driven_lanedir_mean5.724276796699463
driven_lanedir_median5.724276796699463
driven_lanedir_min5.724276796699463
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.744474915234454, "survival_time": 59.99999999999873, "driven_lanedir": 5.724276796699463, "in-drivable-lane": 0.0, "deviation-heading": 2.927962001412338, "distance-from-start": 2.7253140969543077, "deviation-center-line": 0.3909716849234727, "driven_lanedir_consec": 5.724276796699463}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4297479Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnonogpu-staging-spot-0-050:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
4283483Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnonogpu-staging-spot-0-050:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.91404290851461
deviation-center-line_median0.1707277827044376


other stats
deviation-center-line_max0.1707277827044376
deviation-center-line_mean0.1707277827044376
deviation-center-line_min0.1707277827044376
deviation-heading_max1.7145628845088283
deviation-heading_mean1.7145628845088283
deviation-heading_median1.7145628845088283
deviation-heading_min1.7145628845088283
distance-from-start_max3.263606283870319
distance-from-start_mean3.263606283870319
distance-from-start_median3.263606283870319
distance-from-start_min3.263606283870319
driven_any_max5.921925727121802
driven_any_mean5.921925727121802
driven_any_median5.921925727121802
driven_any_min5.921925727121802
driven_lanedir_consec_max5.91404290851461
driven_lanedir_consec_mean5.91404290851461
driven_lanedir_consec_min5.91404290851461
driven_lanedir_max5.91404290851461
driven_lanedir_mean5.91404290851461
driven_lanedir_median5.91404290851461
driven_lanedir_min5.91404290851461
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.921925727121802, "survival_time": 59.99999999999873, "driven_lanedir": 5.91404290851461, "in-drivable-lane": 0.0, "deviation-heading": 1.7145628845088283, "distance-from-start": 3.263606283870319, "deviation-center-line": 0.1707277827044376, "driven_lanedir_consec": 5.91404290851461}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4274485Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successnonogpu-staging-spot-0-050:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7984001635146272
deviation-center-line_median0.202089549970632


other stats
deviation-center-line_max0.202089549970632
deviation-center-line_mean0.202089549970632
deviation-center-line_min0.202089549970632
deviation-heading_max1.6724736715018902
deviation-heading_mean1.6724736715018902
deviation-heading_median1.6724736715018902
deviation-heading_min1.6724736715018902
distance-from-start_max1.425966254242628
distance-from-start_mean1.425966254242628
distance-from-start_median1.425966254242628
distance-from-start_min1.425966254242628
driven_any_max1.8112460773347143
driven_any_mean1.8112460773347143
driven_any_median1.8112460773347143
driven_any_min1.8112460773347143
driven_lanedir_consec_max1.7984001635146272
driven_lanedir_consec_mean1.7984001635146272
driven_lanedir_consec_min1.7984001635146272
driven_lanedir_max1.7984001635146272
driven_lanedir_mean1.7984001635146272
driven_lanedir_median1.7984001635146272
driven_lanedir_min1.7984001635146272
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.8112460773347143, "survival_time": 20.70000000000016, "driven_lanedir": 1.7984001635146272, "in-drivable-lane": 0.0, "deviation-heading": 1.6724736715018902, "distance-from-start": 1.425966254242628, "deviation-center-line": 0.202089549970632, "driven_lanedir_consec": 1.7984001635146272}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
4262488Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4successnonogpu-staging-spot-0-050:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
4255489Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4successnonogpu-staging-spot-0-050:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median0.0
driven_lanedir_consec_median0.1855313235047669
deviation-center-line_median0.23128930214039792


other stats
deviation-center-line_max0.23128930214039792
deviation-center-line_mean0.23128930214039792
deviation-center-line_min0.23128930214039792
deviation-heading_max1.2772144939748085
deviation-heading_mean1.2772144939748085
deviation-heading_median1.2772144939748085
deviation-heading_min1.2772144939748085
distance-from-start_max0.2167455424653449
distance-from-start_mean0.2167455424653449
distance-from-start_median0.2167455424653449
distance-from-start_min0.2167455424653449
driven_any_max0.21674864008014844
driven_any_mean0.21674864008014844
driven_any_median0.21674864008014844
driven_any_min0.21674864008014844
driven_lanedir_consec_max0.1855313235047669
driven_lanedir_consec_mean0.1855313235047669
driven_lanedir_consec_min0.1855313235047669
driven_lanedir_max0.1855313235047669
driven_lanedir_mean0.1855313235047669
driven_lanedir_median0.1855313235047669
driven_lanedir_min0.1855313235047669
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.21674864008014844, "survival_time": 2.3499999999999996, "driven_lanedir": 0.1855313235047669, "in-drivable-lane": 0.0, "deviation-heading": 1.2772144939748085, "distance-from-start": 0.2167455424653449, "deviation-center-line": 0.23128930214039792, "driven_lanedir_consec": 0.1855313235047669}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
4244492Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4successnonogpu-staging-spot-0-050:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.250000000000068
in-drivable-lane_median11.000000000000073
driven_lanedir_consec_median0.3959648974675054
deviation-center-line_median0.2727383614229232


other stats
deviation-center-line_max0.3711792475730154
deviation-center-line_mean0.2630702395458521
deviation-center-line_min0.1356249877645468
deviation-heading_max2.5383505748046193
deviation-heading_mean1.5839274061600843
deviation-heading_median1.530547580682912
deviation-heading_min0.7362638884698944
distance-from-start_max2.1822334065150604
distance-from-start_mean1.3494658762364755
distance-from-start_median1.425414625444724
distance-from-start_min0.3648008475413942
driven_any_max2.1825812783726986
driven_any_mean1.3495961616000154
driven_any_median1.425498088235544
driven_any_min0.3648071915562748
driven_lanedir_consec_max0.6388981877279706
driven_lanedir_consec_mean0.39763107862429714
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.6388981877279706
driven_lanedir_mean0.39763107862429714
driven_lanedir_median0.3959648974675054
driven_lanedir_min0.15969633183420706
in-drivable-lane_max12.800000000000068
in-drivable-lane_mean11.012500000000074
in-drivable-lane_min9.250000000000078
per-episodes
details{"4way-000-ego0": {"driven_any": 1.1588419001142332, "survival_time": 14.250000000000068, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 10.950000000000072, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}, "4way-000-ego1": {"driven_any": 0.3648071915562748, "survival_time": 14.250000000000068, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 12.800000000000068, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.3648008475413942, "deviation-center-line": 0.1356249877645468, "driven_lanedir_consec": 0.15969633183420706}, "4way-000-ego2": {"driven_any": 1.6921542763568551, "survival_time": 14.250000000000068, "driven_lanedir": 0.6388981877279706, "in-drivable-lane": 9.250000000000078, "deviation-heading": 2.3132856904184864, "distance-from-start": 1.69204440510258, "deviation-center-line": 0.3711792475730154, "driven_lanedir_consec": 0.6388981877279706}, "4way-000-ego3": {"driven_any": 2.1825812783726986, "survival_time": 14.250000000000068, "driven_lanedir": 0.4607007325695238, "in-drivable-lane": 11.050000000000072, "deviation-heading": 0.7362638884698944, "distance-from-start": 2.1822334065150604, "deviation-center-line": 0.2757414134419876, "driven_lanedir_consec": 0.4607007325695238}}
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean14.250000000000068
survival_time_min14.250000000000068
No reset possible
4239493Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-0of4successnonogpu-staging-spot-0-050:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.324999999999993
driven_lanedir_consec_median0.1871224013646781
deviation-center-line_median0.15552364466166196


other stats
deviation-center-line_max0.20320919013322583
deviation-center-line_mean0.15552364466166196
deviation-center-line_min0.10783809919009804
deviation-heading_max0.9508048428349386
deviation-heading_mean0.7622210804954066
deviation-heading_median0.7622210804954066
deviation-heading_min0.5736373181558745
distance-from-start_max0.4813616860528347
distance-from-start_mean0.481361686052834
distance-from-start_median0.481361686052834
distance-from-start_min0.4813616860528333
driven_any_max0.4813712171148974
driven_any_mean0.4813712171148972
driven_any_median0.4813712171148972
driven_any_min0.48137121711489694
driven_lanedir_consec_max0.2375799978131203
driven_lanedir_consec_mean0.1871224013646781
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.2375799978131203
driven_lanedir_mean0.1871224013646781
driven_lanedir_median0.1871224013646781
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.5499999999999936
in-drivable-lane_mean2.324999999999993
in-drivable-lane_min2.099999999999993
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4813712171148974, "survival_time": 3.949999999999994, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4813616860528333, "deviation-center-line": 0.10783809919009804, "driven_lanedir_consec": 0.13666480491623578}, "loop2-000-ego1": {"driven_any": 0.48137121711489694, "survival_time": 3.949999999999994, "driven_lanedir": 0.2375799978131203, "in-drivable-lane": 2.099999999999993, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.4813616860528347, "deviation-center-line": 0.20320919013322583, "driven_lanedir_consec": 0.2375799978131203}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
4225497Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnonogpu-staging-spot-0-050:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
4053317Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4successnonogpu-staging-spot-0-050:30:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.8249999999998965
driven_lanedir_consec_median2.089362646121109
deviation-center-line_median5.160696904244562


other stats
deviation-center-line_max5.884537088976701
deviation-center-line_mean4.608902728622453
deviation-center-line_min2.229680017023988
deviation-heading_max33.00132974561592
deviation-heading_mean11.086939889451044
deviation-heading_median5.315632499039603
deviation-heading_min0.7151648141090521
distance-from-start_max2.4007738045922906
distance-from-start_mean1.8550334398943655
distance-from-start_median1.8031549983915711
distance-from-start_min1.4130499582020293
driven_any_max3.5300951074200406
driven_any_mean2.5187726211552337
driven_any_median2.531092735855504
driven_any_min1.4828099054898876
driven_lanedir_consec_max3.437555654852413
driven_lanedir_consec_mean2.243867367124486
driven_lanedir_consec_min1.3591885214033157
driven_lanedir_max3.437555654852413
driven_lanedir_mean2.430771337654316
driven_lanedir_median2.4562457120319716
driven_lanedir_min1.3730382717009086
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4124999999999552
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5425992768884045, "survival_time": 59.99999999999873, "driven_lanedir": 1.537863345389593, "in-drivable-lane": 0.0, "deviation-heading": 0.7151648141090521, "distance-from-start": 1.5381664294601065, "deviation-center-line": 2.229680017023988, "driven_lanedir_consec": 1.537863345389593}, "loop-000-ego1": {"driven_any": 3.519586194822603, "survival_time": 59.99999999999873, "driven_lanedir": 3.3746280786743506, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.288395459035003, "distance-from-start": 2.0681435673230366, "deviation-center-line": 5.233752335699744, "driven_lanedir_consec": 2.6408619468526253}, "loop-000-ego2": {"driven_any": 3.5300951074200406, "survival_time": 59.99999999999873, "driven_lanedir": 3.437555654852413, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342869539044204, "distance-from-start": 2.4007738045922906, "deviation-center-line": 5.884537088976701, "driven_lanedir_consec": 3.437555654852413}, "loop-000-ego3": {"driven_any": 1.4828099054898876, "survival_time": 59.99999999999873, "driven_lanedir": 1.3730382717009086, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 33.00132974561592, "distance-from-start": 1.4130499582020293, "deviation-center-line": 5.087641472789379, "driven_lanedir_consec": 1.3591885214033157}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
4035322Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:33:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4026317Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:30:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4017319Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-1of4successnonogpu-staging-spot-0-050:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873308651520088
deviation-center-line_median5.442861880459055


other stats
deviation-center-line_max5.442861880459055
deviation-center-line_mean5.442861880459055
deviation-center-line_min5.442861880459055
deviation-heading_max11.057314601935024
deviation-heading_mean11.057314601935024
deviation-heading_median11.057314601935024
deviation-heading_min11.057314601935024
distance-from-start_max1.5192445510405312
distance-from-start_mean1.5192445510405312
distance-from-start_median1.5192445510405312
distance-from-start_min1.5192445510405312
driven_any_max3.452076592019545
driven_any_mean3.452076592019545
driven_any_median3.452076592019545
driven_any_min3.452076592019545
driven_lanedir_consec_max1.5873308651520088
driven_lanedir_consec_mean1.5873308651520088
driven_lanedir_consec_min1.5873308651520088
driven_lanedir_max3.163921596586153
driven_lanedir_mean3.163921596586153
driven_lanedir_median3.163921596586153
driven_lanedir_min3.163921596586153
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019545, "survival_time": 59.99999999999873, "driven_lanedir": 3.163921596586153, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935024, "distance-from-start": 1.5192445510405312, "deviation-center-line": 5.442861880459055, "driven_lanedir_consec": 1.5873308651520088}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3997324Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successnonogpu-staging-spot-0-050:30:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.9999999999999576
driven_lanedir_consec_median2.9816916359710164
deviation-center-line_median5.999212579807951


other stats
deviation-center-line_max6.279828591515408
deviation-center-line_mean5.898869531164895
deviation-center-line_min5.317224373528271
deviation-heading_max6.908636787901558
deviation-heading_mean5.005262125464508
deviation-heading_median5.305986868490894
deviation-heading_min2.5004379769746867
distance-from-start_max2.7163807174982693
distance-from-start_mean1.9474863408546057
distance-from-start_median2.133877458090523
distance-from-start_min0.8058097297391075
driven_any_max3.5795968906089635
driven_any_mean3.1367153053145196
driven_any_median3.497838330840228
driven_any_min1.97158766896866
driven_lanedir_consec_max3.554363389555086
driven_lanedir_consec_mean2.561281278590032
driven_lanedir_consec_min0.7273784528630087
driven_lanedir_max3.554363389555086
driven_lanedir_mean3.017264615398282
driven_lanedir_median3.3374889646993235
driven_lanedir_min1.8397171426393943
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean1.8624999999999492
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.97158766896866, "survival_time": 59.99999999999873, "driven_lanedir": 1.8397171426393943, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.390348197280298, "distance-from-start": 0.8058097297391075, "deviation-center-line": 5.7223527739429985, "driven_lanedir_consec": 0.7273784528630087}, "loop-000-ego1": {"driven_any": 3.5795968906089635, "survival_time": 59.99999999999873, "driven_lanedir": 3.554363389555086, "in-drivable-lane": 0.0, "deviation-heading": 2.5004379769746867, "distance-from-start": 2.7163807174982693, "deviation-center-line": 6.279828591515408, "driven_lanedir_consec": 3.554363389555086}, "loop-000-ego2": {"driven_any": 3.4760913988196283, "survival_time": 59.99999999999873, "driven_lanedir": 3.3074406527439937, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.221625539701491, "distance-from-start": 2.187655374279134, "deviation-center-line": 6.276072385672903, "driven_lanedir_consec": 3.3074406527439937}, "loop-000-ego3": {"driven_any": 3.519585262860827, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675372766546534, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908636787901558, "distance-from-start": 2.080099541901913, "deviation-center-line": 5.317224373528271, "driven_lanedir_consec": 2.655942619198039}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3989328Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-1of4successnonogpu-staging-spot-0-050:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.65000000000013
in-drivable-lane_median17.20000000000013
driven_lanedir_consec_median0.13979970825413446
deviation-center-line_median0.09390672675333606


other stats
deviation-center-line_max0.09390672675333606
deviation-center-line_mean0.09390672675333606
deviation-center-line_min0.09390672675333606
deviation-heading_max0.9654180772015548
deviation-heading_mean0.9654180772015548
deviation-heading_median0.9654180772015548
deviation-heading_min0.9654180772015548
distance-from-start_max2.912547675729677
distance-from-start_mean2.912547675729677
distance-from-start_median2.912547675729677
distance-from-start_min2.912547675729677
driven_any_max2.9132594175988857
driven_any_mean2.9132594175988857
driven_any_median2.9132594175988857
driven_any_min2.9132594175988857
driven_lanedir_consec_max0.13979970825413446
driven_lanedir_consec_mean0.13979970825413446
driven_lanedir_consec_min0.13979970825413446
driven_lanedir_max0.13979970825413446
driven_lanedir_mean0.13979970825413446
driven_lanedir_median0.13979970825413446
driven_lanedir_min0.13979970825413446
in-drivable-lane_max17.20000000000013
in-drivable-lane_mean17.20000000000013
in-drivable-lane_min17.20000000000013
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.9132594175988857, "survival_time": 18.65000000000013, "driven_lanedir": 0.13979970825413446, "in-drivable-lane": 17.20000000000013, "deviation-heading": 0.9654180772015548, "distance-from-start": 2.912547675729677, "deviation-center-line": 0.09390672675333606, "driven_lanedir_consec": 0.13979970825413446}}
simulation-passed1
survival_time_max18.65000000000013
survival_time_mean18.65000000000013
survival_time_min18.65000000000013
No reset possible
3982330Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4successnonogpu-staging-spot-0-050:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median0.0
driven_lanedir_consec_median0.1855313235047669
deviation-center-line_median0.23128930214039897


other stats
deviation-center-line_max0.23128930214039897
deviation-center-line_mean0.23128930214039897
deviation-center-line_min0.23128930214039897
deviation-heading_max1.2772144939748085
deviation-heading_mean1.2772144939748085
deviation-heading_median1.2772144939748085
deviation-heading_min1.2772144939748085
distance-from-start_max0.2167455424653452
distance-from-start_mean0.2167455424653452
distance-from-start_median0.2167455424653452
distance-from-start_min0.2167455424653452
driven_any_max0.2167486400801532
driven_any_mean0.2167486400801532
driven_any_median0.2167486400801532
driven_any_min0.2167486400801532
driven_lanedir_consec_max0.1855313235047669
driven_lanedir_consec_mean0.1855313235047669
driven_lanedir_consec_min0.1855313235047669
driven_lanedir_max0.1855313235047669
driven_lanedir_mean0.1855313235047669
driven_lanedir_median0.1855313235047669
driven_lanedir_min0.1855313235047669
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.2167486400801532, "survival_time": 2.3499999999999996, "driven_lanedir": 0.1855313235047669, "in-drivable-lane": 0.0, "deviation-heading": 1.2772144939748085, "distance-from-start": 0.2167455424653452, "deviation-center-line": 0.23128930214039897, "driven_lanedir_consec": 0.1855313235047669}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
3976331Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4successnonogpu-staging-spot-0-050:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
3971332Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19694617160956465
survival_time_median6.199999999999986
deviation-center-line_median0.12539055697768176
in-drivable-lane_median4.449999999999985


other stats
deviation-center-line_max0.12539055697768176
deviation-center-line_mean0.12539055697768176
deviation-center-line_min0.12539055697768176
deviation-heading_max0.9520924629376074
deviation-heading_mean0.9520924629376074
deviation-heading_median0.9520924629376074
deviation-heading_min0.9520924629376074
distance-from-start_max0.8501561575907637
distance-from-start_mean0.8501561575907637
distance-from-start_median0.8501561575907637
distance-from-start_min0.8501561575907637
driven_any_max0.8502902342720419
driven_any_mean0.8502902342720419
driven_any_median0.8502902342720419
driven_any_min0.8502902342720419
driven_lanedir_consec_max0.19694617160956465
driven_lanedir_consec_mean0.19694617160956465
driven_lanedir_consec_min0.19694617160956465
driven_lanedir_max0.19694617160956465
driven_lanedir_mean0.19694617160956465
driven_lanedir_median0.19694617160956465
driven_lanedir_min0.19694617160956465
in-drivable-lane_max4.449999999999985
in-drivable-lane_mean4.449999999999985
in-drivable-lane_min4.449999999999985
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8502902342720419, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376074, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
3966334Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-0of4successnonogpu-staging-spot-0-050:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.324999999999993
driven_lanedir_consec_median0.1871224013646781
deviation-center-line_median0.15552364466166196


other stats
deviation-center-line_max0.20320919013322583
deviation-center-line_mean0.15552364466166196
deviation-center-line_min0.10783809919009804
deviation-heading_max0.9508048428349386
deviation-heading_mean0.7622210804954066
deviation-heading_median0.7622210804954066
deviation-heading_min0.5736373181558745
distance-from-start_max0.4813616860528347
distance-from-start_mean0.481361686052834
distance-from-start_median0.481361686052834
distance-from-start_min0.4813616860528333
driven_any_max0.4813712171148966
driven_any_mean0.48137121711489617
driven_any_median0.48137121711489617
driven_any_min0.4813712171148958
driven_lanedir_consec_max0.2375799978131203
driven_lanedir_consec_mean0.1871224013646781
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.2375799978131203
driven_lanedir_mean0.1871224013646781
driven_lanedir_median0.1871224013646781
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.5499999999999936
in-drivable-lane_mean2.324999999999993
in-drivable-lane_min2.099999999999993
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4813712171148958, "survival_time": 3.949999999999994, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4813616860528333, "deviation-center-line": 0.10783809919009804, "driven_lanedir_consec": 0.13666480491623578}, "loop2-000-ego1": {"driven_any": 0.4813712171148966, "survival_time": 3.949999999999994, "driven_lanedir": 0.2375799978131203, "in-drivable-lane": 2.099999999999993, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.4813616860528347, "deviation-center-line": 0.20320919013322583, "driven_lanedir_consec": 0.2375799978131203}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
3962335Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-3of4successnonogpu-staging-spot-0-050:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.80000000000006
in-drivable-lane_median10.700000000000069
driven_lanedir_consec_median0.3090243649917519
deviation-center-line_median0.2686153603671883


other stats
deviation-center-line_max0.2686153603671883
deviation-center-line_mean0.2686153603671883
deviation-center-line_min0.2686153603671883
deviation-heading_max2.4995337560174913
deviation-heading_mean2.4995337560174913
deviation-heading_median2.4995337560174913
deviation-heading_min2.4995337560174913
distance-from-start_max2.107081087129657
distance-from-start_mean2.107081087129657
distance-from-start_median2.107081087129657
distance-from-start_min2.107081087129657
driven_any_max2.1073264492289434
driven_any_mean2.1073264492289434
driven_any_median2.1073264492289434
driven_any_min2.1073264492289434
driven_lanedir_consec_max0.3090243649917519
driven_lanedir_consec_mean0.3090243649917519
driven_lanedir_consec_min0.3090243649917519
driven_lanedir_max0.3090243649917519
driven_lanedir_mean0.3090243649917519
driven_lanedir_median0.3090243649917519
driven_lanedir_min0.3090243649917519
in-drivable-lane_max10.700000000000069
in-drivable-lane_mean10.700000000000069
in-drivable-lane_min10.700000000000069
per-episodes
details{"loop-000-ego0": {"driven_any": 2.1073264492289434, "survival_time": 13.80000000000006, "driven_lanedir": 0.3090243649917519, "in-drivable-lane": 10.700000000000069, "deviation-heading": 2.4995337560174913, "distance-from-start": 2.107081087129657, "deviation-center-line": 0.2686153603671883, "driven_lanedir_consec": 0.3090243649917519}}
simulation-passed1
survival_time_max13.80000000000006
survival_time_mean13.80000000000006
survival_time_min13.80000000000006
No reset possible
3957336Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4successnonogpu-staging-spot-0-050:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666265914899656
deviation-center-line_median0.10783813033632964


other stats
deviation-center-line_max0.10783813033632964
deviation-center-line_mean0.10783813033632964
deviation-center-line_min0.10783813033632964
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575148
distance-from-start_mean1.6182798682575148
distance-from-start_median1.6182798682575148
distance-from-start_min1.6182798682575148
driven_any_max1.6183892771013793
driven_any_mean1.6183892771013793
driven_any_median1.6183892771013793
driven_any_min1.6183892771013793
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.6183892771013793, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
3952337Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4successnonogpu-staging-spot-0-050:03:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.749999999999988
in-drivable-lane_median4.349999999999987
driven_lanedir_consec_median0.13666599700910398
deviation-center-line_median0.10783823581413723


other stats
deviation-center-line_max0.10783823581413723
deviation-center-line_mean0.10783823581413723
deviation-center-line_min0.10783823581413723
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.7799926905395436
distance-from-start_mean0.7799926905395436
distance-from-start_median0.7799926905395436
distance-from-start_min0.7799926905395436
driven_any_max0.7800067434780132
driven_any_mean0.7800067434780132
driven_any_median0.7800067434780132
driven_any_min0.7800067434780132
driven_lanedir_consec_max0.13666599700910398
driven_lanedir_consec_mean0.13666599700910398
driven_lanedir_consec_min0.13666599700910398
driven_lanedir_max0.13666599700910398
driven_lanedir_mean0.13666599700910398
driven_lanedir_median0.13666599700910398
driven_lanedir_min0.13666599700910398
in-drivable-lane_max4.349999999999987
in-drivable-lane_mean4.349999999999987
in-drivable-lane_min4.349999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7800067434780132, "survival_time": 5.749999999999988, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 4.349999999999987, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7799926905395436, "deviation-center-line": 0.10783823581413723, "driven_lanedir_consec": 0.13666599700910398}}
simulation-passed1
survival_time_max5.749999999999988
survival_time_mean5.749999999999988
survival_time_min5.749999999999988
No reset possible
3949338Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnonogpu-staging-spot-0-050:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
3941340Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successnonogpu-staging-spot-0-050:07:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median8.475000000000021
driven_lanedir_consec_median0.2593084475741141
deviation-center-line_median0.24034409785662963


other stats
deviation-center-line_max1.082984557473667
deviation-center-line_mean0.41787777662949666
deviation-center-line_min0.1078383533310603
deviation-heading_max2.339188809527298
deviation-heading_mean1.212353106209787
deviation-heading_median0.968293148577988
deviation-heading_min0.5736373181558745
distance-from-start_max1.6182798682575184
distance-from-start_mean1.2278394198954643
distance-from-start_median1.2281617924849129
distance-from-start_min0.8367542263545129
driven_any_max1.618389277101384
driven_any_mean1.2279094330504043
driven_any_median1.2282388605737438
driven_any_min0.8367707339527459
driven_lanedir_consec_max0.6611857977727704
driven_lanedir_consec_mean0.32911687445930876
driven_lanedir_consec_min0.13666480491623645
driven_lanedir_max0.9897803868677432
driven_lanedir_mean0.411265521733052
driven_lanedir_median0.2593084475741141
driven_lanedir_min0.13666480491623645
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean6.600000000000016
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.618389277101384, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}, "udem-000-ego1": {"driven_any": 0.8367707339527459, "survival_time": 10.85000000000002, "driven_lanedir": 0.2375805938595854, "in-drivable-lane": 9.000000000000018, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.8367542263545129, "deviation-center-line": 0.203209370672121, "driven_lanedir_consec": 0.2375805938595854}, "udem-000-ego2": {"driven_any": 0.9932647664055628, "survival_time": 10.85000000000002, "driven_lanedir": 0.9897803868677432, "in-drivable-lane": 0.0, "deviation-heading": 0.9857814543210373, "distance-from-start": 0.9932177858395714, "deviation-center-line": 1.082984557473667, "driven_lanedir_consec": 0.6611857977727704}, "udem-000-ego3": {"driven_any": 1.4632129547419246, "survival_time": 10.85000000000002, "driven_lanedir": 0.28103630128864276, "in-drivable-lane": 7.950000000000025, "deviation-heading": 2.339188809527298, "distance-from-start": 1.463105799130254, "deviation-center-line": 0.2774788250411383, "driven_lanedir_consec": 0.28103630128864276}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
3931326Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-0of4successnonogpu-staging-spot-0-050:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.09163409663777
deviation-center-line_median5.917240924506971


other stats
deviation-center-line_max5.917240924506971
deviation-center-line_mean5.917240924506971
deviation-center-line_min5.917240924506971
deviation-heading_max8.389433016031823
deviation-heading_mean8.389433016031823
deviation-heading_median8.389433016031823
deviation-heading_min8.389433016031823
distance-from-start_max1.030783103523257
distance-from-start_mean1.030783103523257
distance-from-start_median1.030783103523257
distance-from-start_min1.030783103523257
driven_any_max3.4490819837243887
driven_any_mean3.4490819837243887
driven_any_median3.4490819837243887
driven_any_min3.4490819837243887
driven_lanedir_consec_max2.09163409663777
driven_lanedir_consec_mean2.09163409663777
driven_lanedir_consec_min2.09163409663777
driven_lanedir_max3.2040229365911816
driven_lanedir_mean3.2040229365911816
driven_lanedir_median3.2040229365911816
driven_lanedir_min3.2040229365911816
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243887, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040229365911816, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433016031823, "distance-from-start": 1.030783103523257, "deviation-center-line": 5.917240924506971, "driven_lanedir_consec": 2.09163409663777}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3924273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4successnonogpu-staging-spot-0-050:24:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-8.005812679456881e-07
deviation-center-line_median1.5844989127493232


other stats
deviation-center-line_max3.4683931889545456
deviation-center-line_mean1.7151217085698838
deviation-center-line_min0.22309581982634333
deviation-heading_max40.967332753486254
deviation-heading_mean25.43795482877342
deviation-heading_median28.066168080220784
deviation-heading_min4.652150401165858
distance-from-start_max1.4217791915866692e-15
distance-from-start_mean5.774894028216986e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min0.0
driven_any_max1.7061350299040477e-12
driven_any_mean6.929872833860494e-13
driven_any_median5.329070518200751e-13
driven_any_min0.0
driven_lanedir_consec_max1.6144274717078133e-05
driven_lanedir_consec_mean-6.788979568517206e-05
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max1.6144274717078133e-05
driven_lanedir_mean-6.788979568517206e-05
driven_lanedir_median-8.005812679456881e-07
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 1.6144274717078133e-05, "in-drivable-lane": 0.0, "deviation-heading": 18.30940375485005, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.4683931889545456, "driven_lanedir_consec": 1.6144274717078133e-05}, "zigzag-000-ego2": {"driven_any": 1.7061350299040477e-12, "survival_time": 59.99999999999873, "driven_lanedir": -1.601162535891376e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.652150401165858, "distance-from-start": 1.4217791915866692e-15, "deviation-center-line": 0.22309581982634333, "driven_lanedir_consec": -1.601162535891376e-06}, "zigzag-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.7624735124852213, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3920269Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4successnonogpu-staging-spot-0-050:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
3916271Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-1of4successnonogpu-staging-spot-0-050:08:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6017417553703126e-06
survival_time_median59.99999999999873
deviation-center-line_median0.8949077950231444
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949077950231444
deviation-center-line_mean0.8949077950231444
deviation-center-line_min0.8949077950231444
deviation-heading_max32.24912799874442
deviation-heading_mean32.24912799874442
deviation-heading_median32.24912799874442
deviation-heading_min32.24912799874442
distance-from-start_max8.881784197001252e-16
distance-from-start_mean8.881784197001252e-16
distance-from-start_median8.881784197001252e-16
distance-from-start_min8.881784197001252e-16
driven_any_max1.0658141036401505e-12
driven_any_mean1.0658141036401505e-12
driven_any_median1.0658141036401505e-12
driven_any_min1.0658141036401505e-12
driven_lanedir_consec_max2.6017417553703126e-06
driven_lanedir_consec_mean2.6017417553703126e-06
driven_lanedir_consec_min2.6017417553703126e-06
driven_lanedir_max2.6017417553703126e-06
driven_lanedir_mean2.6017417553703126e-06
driven_lanedir_median2.6017417553703126e-06
driven_lanedir_min2.6017417553703126e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0658141036401505e-12, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 8.881784197001252e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3891275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4successnonogpu-staging-spot-0-050:23:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134844


other stats
deviation-center-line_max0.4065243130134844
deviation-center-line_mean0.4065243130134844
deviation-center-line_min0.4065243130134844
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.4065243130134844, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
3865276Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:20:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFVI-sim-testing/submission276/sim-1of4-nogpu-staging-spot-0-05-job3865-a-wd/challenge-evaluation-output/episodes/udem-000/ui_image.mp4.firstpass.mp4'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3854277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4successnonogpu-staging-spot-0-050:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
3823312Liam Paulltemplate-rosaido-LF-sim-validationsim-1of4successnonogpu-staging-spot-0-050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14659463146275886
survival_time_median3.949999999999994
deviation-center-line_median0.06031518138130165
in-drivable-lane_median2.999999999999994


other stats
deviation-center-line_max0.06031518138130165
deviation-center-line_mean0.06031518138130165
deviation-center-line_min0.06031518138130165
deviation-heading_max0.6236808047352844
deviation-heading_mean0.6236808047352844
deviation-heading_median0.6236808047352844
deviation-heading_min0.6236808047352844
distance-from-start_max0.8536083215650702
distance-from-start_mean0.8536083215650702
distance-from-start_median0.8536083215650702
distance-from-start_min0.8536083215650702
driven_any_max0.8590211398178577
driven_any_mean0.8590211398178577
driven_any_median0.8590211398178577
driven_any_min0.8590211398178577
driven_lanedir_consec_max0.14659463146275886
driven_lanedir_consec_mean0.14659463146275886
driven_lanedir_consec_min0.14659463146275886
driven_lanedir_max0.14659463146275886
driven_lanedir_mean0.14659463146275886
driven_lanedir_median0.14659463146275886
driven_lanedir_min0.14659463146275886
in-drivable-lane_max2.999999999999994
in-drivable-lane_mean2.999999999999994
in-drivable-lane_min2.999999999999994
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.8590211398178577, "survival_time": 3.949999999999994, "driven_lanedir": 0.14659463146275886, "in-drivable-lane": 2.999999999999994, "deviation-heading": 0.6236808047352844, "distance-from-start": 0.8536083215650702, "deviation-center-line": 0.06031518138130165, "driven_lanedir_consec": 0.14659463146275886}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
3815172Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4successnonogpu-staging-spot-0-050:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19694617160956465
survival_time_median6.199999999999986
deviation-center-line_median0.12539055697768176
in-drivable-lane_median4.449999999999985


other stats
deviation-center-line_max0.12539055697768176
deviation-center-line_mean0.12539055697768176
deviation-center-line_min0.12539055697768176
deviation-heading_max0.9520924629376074
deviation-heading_mean0.9520924629376074
deviation-heading_median0.9520924629376074
deviation-heading_min0.9520924629376074
distance-from-start_max0.8501561575907637
distance-from-start_mean0.8501561575907637
distance-from-start_median0.8501561575907637
distance-from-start_min0.8501561575907637
driven_any_max0.8502902342720419
driven_any_mean0.8502902342720419
driven_any_median0.8502902342720419
driven_any_min0.8502902342720419
driven_lanedir_consec_max0.19694617160956465
driven_lanedir_consec_mean0.19694617160956465
driven_lanedir_consec_min0.19694617160956465
driven_lanedir_max0.19694617160956465
driven_lanedir_mean0.19694617160956465
driven_lanedir_median0.19694617160956465
driven_lanedir_min0.19694617160956465
in-drivable-lane_max4.449999999999985
in-drivable-lane_mean4.449999999999985
in-drivable-lane_min4.449999999999985
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8502902342720419, "survival_time": 6.199999999999986, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 4.449999999999985, "deviation-heading": 0.9520924629376074, "distance-from-start": 0.8501561575907637, "deviation-center-line": 0.12539055697768176, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
3039111Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:04:27
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3035111Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:02:29
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3028111Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:44
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3023112Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-0of4successnonogpu-staging-spot-0-050:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.949999999999983
in-drivable-lane_median4.449999999999985
driven_lanedir_consec_median0.4475128105949586
deviation-center-line_median0.2128373800737884


other stats
deviation-center-line_max0.2128373800737884
deviation-center-line_mean0.2128373800737884
deviation-center-line_min0.2128373800737884
deviation-heading_max1.603830063675076
deviation-heading_mean1.603830063675076
deviation-heading_median1.603830063675076
deviation-heading_min1.603830063675076
distance-from-start_max1.764913687779911
distance-from-start_mean1.764913687779911
distance-from-start_median1.764913687779911
distance-from-start_min1.764913687779911
driven_any_max1.7765974068809092
driven_any_mean1.7765974068809092
driven_any_median1.7765974068809092
driven_any_min1.7765974068809092
driven_lanedir_consec_max0.4475128105949586
driven_lanedir_consec_mean0.4475128105949586
driven_lanedir_consec_min0.4475128105949586
driven_lanedir_max0.4475128105949586
driven_lanedir_mean0.4475128105949586
driven_lanedir_median0.4475128105949586
driven_lanedir_min0.4475128105949586
in-drivable-lane_max4.449999999999985
in-drivable-lane_mean4.449999999999985
in-drivable-lane_min4.449999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.7765974068809092, "survival_time": 6.949999999999983, "driven_lanedir": 0.4475128105949586, "in-drivable-lane": 4.449999999999985, "deviation-heading": 1.603830063675076, "distance-from-start": 1.764913687779911, "deviation-center-line": 0.2128373800737884, "driven_lanedir_consec": 0.4475128105949586}}
simulation-passed1
survival_time_max6.949999999999983
survival_time_mean6.949999999999983
survival_time_min6.949999999999983
No reset possible
3019113Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-2of4successnonogpu-staging-spot-0-050:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.5999999999999988
in-drivable-lane_median1.2499999999999982
driven_lanedir_consec_median0.2601258103348165
deviation-center-line_median0.08919761906051873


other stats
deviation-center-line_max0.08919761906051873
deviation-center-line_mean0.08919761906051873
deviation-center-line_min0.08919761906051873
deviation-heading_max0.6100902125554847
deviation-heading_mean0.6100902125554847
deviation-heading_median0.6100902125554847
deviation-heading_min0.6100902125554847
distance-from-start_max0.46424488060552344
distance-from-start_mean0.46424488060552344
distance-from-start_median0.46424488060552344
distance-from-start_min0.46424488060552344
driven_any_max0.4676765319145154
driven_any_mean0.4676765319145154
driven_any_median0.4676765319145154
driven_any_min0.4676765319145154
driven_lanedir_consec_max0.2601258103348165
driven_lanedir_consec_mean0.2601258103348165
driven_lanedir_consec_min0.2601258103348165
driven_lanedir_max0.2601258103348165
driven_lanedir_mean0.2601258103348165
driven_lanedir_median0.2601258103348165
driven_lanedir_min0.2601258103348165
in-drivable-lane_max1.2499999999999982
in-drivable-lane_mean1.2499999999999982
in-drivable-lane_min1.2499999999999982
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4676765319145154, "survival_time": 2.5999999999999988, "driven_lanedir": 0.2601258103348165, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.6100902125554847, "distance-from-start": 0.46424488060552344, "deviation-center-line": 0.08919761906051873, "driven_lanedir_consec": 0.2601258103348165}}
simulation-passed1
survival_time_max2.5999999999999988
survival_time_mean2.5999999999999988
survival_time_min2.5999999999999988
No reset possible
3017114Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
3012115Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4successnonogpu-staging-spot-0-050:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.399999999999992
in-drivable-lane_median2.3499999999999943
driven_lanedir_consec_median0.4101453704548361
deviation-center-line_median0.1665612945101202


other stats
deviation-center-line_max0.1665612945101202
deviation-center-line_mean0.1665612945101202
deviation-center-line_min0.1665612945101202
deviation-heading_max1.3324383662116956
deviation-heading_mean1.3324383662116956
deviation-heading_median1.3324383662116956
deviation-heading_min1.3324383662116956
distance-from-start_max1.0940711950673705
distance-from-start_mean1.0940711950673705
distance-from-start_median1.0940711950673705
distance-from-start_min1.0940711950673705
driven_any_max1.0961715179261091
driven_any_mean1.0961715179261091
driven_any_median1.0961715179261091
driven_any_min1.0961715179261091
driven_lanedir_consec_max0.4101453704548361
driven_lanedir_consec_mean0.4101453704548361
driven_lanedir_consec_min0.4101453704548361
driven_lanedir_max0.4101453704548361
driven_lanedir_mean0.4101453704548361
driven_lanedir_median0.4101453704548361
driven_lanedir_min0.4101453704548361
in-drivable-lane_max2.3499999999999943
in-drivable-lane_mean2.3499999999999943
in-drivable-lane_min2.3499999999999943
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.0961715179261091, "survival_time": 4.399999999999992, "driven_lanedir": 0.4101453704548361, "in-drivable-lane": 2.3499999999999943, "deviation-heading": 1.3324383662116956, "distance-from-start": 1.0940711950673705, "deviation-center-line": 0.1665612945101202, "driven_lanedir_consec": 0.4101453704548361}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_min4.399999999999992
No reset possible
3004118Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-2of4successnonogpu-staging-spot-0-050:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.65000000000003
in-drivable-lane_median10.52500000000003
driven_lanedir_consec_median0.21506180698901867
deviation-center-line_median0.10967823584205684


other stats
deviation-center-line_max0.3742973283056312
deviation-center-line_mean0.16293538184557607
deviation-center-line_min0.05808772739255946
deviation-heading_max1.491506023507465
deviation-heading_mean0.7646413489093553
deviation-heading_median0.6006243965770725
deviation-heading_min0.3658105789758113
distance-from-start_max2.99559325401033
distance-from-start_mean1.301352760841175
distance-from-start_median0.9907902817827896
distance-from-start_min0.22823722578879013
driven_any_max3.1823421060704407
driven_any_mean1.36832271002256
driven_any_median1.031292129254593
driven_any_min0.22836447551061304
driven_lanedir_consec_max1.7699309601533475
driven_lanedir_consec_mean0.5778477364746453
driven_lanedir_consec_min0.11133637176719646
driven_lanedir_max1.7699309601533475
driven_lanedir_mean0.5778477364746453
driven_lanedir_median0.21506180698901867
driven_lanedir_min0.11133637176719646
in-drivable-lane_max10.75000000000003
in-drivable-lane_mean9.237500000000034
in-drivable-lane_min5.150000000000046
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.7600066497414949, "survival_time": 11.65000000000003, "driven_lanedir": 0.13927918700191588, "in-drivable-lane": 10.75000000000003, "deviation-heading": 0.6026973972604321, "distance-from-start": 0.7182020376696778, "deviation-center-line": 0.05808772739255946, "driven_lanedir_consec": 0.13927918700191588}, "autolab-000-ego1": {"driven_any": 1.302577608767691, "survival_time": 11.65000000000003, "driven_lanedir": 0.29084442697612145, "in-drivable-lane": 10.30000000000003, "deviation-heading": 0.3658105789758113, "distance-from-start": 1.2633785258959016, "deviation-center-line": 0.13709742558407031, "driven_lanedir_consec": 0.29084442697612145}, "autolab-000-ego2": {"driven_any": 3.1823421060704407, "survival_time": 11.65000000000003, "driven_lanedir": 1.7699309601533475, "in-drivable-lane": 5.150000000000046, "deviation-heading": 1.491506023507465, "distance-from-start": 2.99559325401033, "deviation-center-line": 0.3742973283056312, "driven_lanedir_consec": 1.7699309601533475}, "autolab-000-ego3": {"driven_any": 0.22836447551061304, "survival_time": 11.65000000000003, "driven_lanedir": 0.11133637176719646, "in-drivable-lane": 10.75000000000003, "deviation-heading": 0.5985513958937128, "distance-from-start": 0.22823722578879013, "deviation-center-line": 0.08225904610004332, "driven_lanedir_consec": 0.11133637176719646}}
simulation-passed1
survival_time_max11.65000000000003
survival_time_mean11.65000000000003
survival_time_min11.65000000000003
No reset possible
2999117Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnonogpu-staging-spot-0-050:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2997117Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnonogpu-staging-spot-0-050:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2995117Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2988121Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-1of4successnonogpu-staging-spot-0-050:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.000000000000009
in-drivable-lane_median8.15000000000001
driven_lanedir_consec_median0.2269615332099022
deviation-center-line_median0.14293272606509247


other stats
deviation-center-line_max0.14293272606509247
deviation-center-line_mean0.14293272606509247
deviation-center-line_min0.14293272606509247
deviation-heading_max1.7176014572399136
deviation-heading_mean1.7176014572399136
deviation-heading_median1.7176014572399136
deviation-heading_min1.7176014572399136
distance-from-start_max2.518587338186655
distance-from-start_mean2.518587338186655
distance-from-start_median2.518587338186655
distance-from-start_min2.518587338186655
driven_any_max2.69533960364352
driven_any_mean2.69533960364352
driven_any_median2.69533960364352
driven_any_min2.69533960364352
driven_lanedir_consec_max0.2269615332099022
driven_lanedir_consec_mean0.2269615332099022
driven_lanedir_consec_min0.2269615332099022
driven_lanedir_max0.2269615332099022
driven_lanedir_mean0.2269615332099022
driven_lanedir_median0.2269615332099022
driven_lanedir_min0.2269615332099022
in-drivable-lane_max8.15000000000001
in-drivable-lane_mean8.15000000000001
in-drivable-lane_min8.15000000000001
per-episodes
details{"udem-000-ego0": {"driven_any": 2.69533960364352, "survival_time": 10.000000000000009, "driven_lanedir": 0.2269615332099022, "in-drivable-lane": 8.15000000000001, "deviation-heading": 1.7176014572399136, "distance-from-start": 2.518587338186655, "deviation-center-line": 0.14293272606509247, "driven_lanedir_consec": 0.2269615332099022}}
simulation-passed1
survival_time_max10.000000000000009
survival_time_mean10.000000000000009
survival_time_min10.000000000000009
No reset possible
2986119Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-0of4successnonogpu-staging-spot-0-050:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.849999999999998
in-drivable-lane_median1.7999999999999976
driven_lanedir_consec_median0.16744027630955394
deviation-center-line_median0.07852711420208842


other stats
deviation-center-line_max0.07852711420208842
deviation-center-line_mean0.07852711420208842
deviation-center-line_min0.07852711420208842
deviation-heading_max0.6384730737864204
deviation-heading_mean0.6384730737864204
deviation-heading_median0.6384730737864204
deviation-heading_min0.6384730737864204
distance-from-start_max0.5156567553671942
distance-from-start_mean0.5156567553671942
distance-from-start_median0.5156567553671942
distance-from-start_min0.5156567553671942
driven_any_max0.5184785020866067
driven_any_mean0.5184785020866067
driven_any_median0.5184785020866067
driven_any_min0.5184785020866067
driven_lanedir_consec_max0.16744027630955394
driven_lanedir_consec_mean0.16744027630955394
driven_lanedir_consec_min0.16744027630955394
driven_lanedir_max0.16744027630955394
driven_lanedir_mean0.16744027630955394
driven_lanedir_median0.16744027630955394
driven_lanedir_min0.16744027630955394
in-drivable-lane_max1.7999999999999976
in-drivable-lane_mean1.7999999999999976
in-drivable-lane_min1.7999999999999976
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.5184785020866067, "survival_time": 2.849999999999998, "driven_lanedir": 0.16744027630955394, "in-drivable-lane": 1.7999999999999976, "deviation-heading": 0.6384730737864204, "distance-from-start": 0.5156567553671942, "deviation-center-line": 0.07852711420208842, "driven_lanedir_consec": 0.16744027630955394}}
simulation-passed1
survival_time_max2.849999999999998
survival_time_mean2.849999999999998
survival_time_min2.849999999999998
No reset possible
2980125Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:04:14
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2973125Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:03:39
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2964125Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:07:35
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2956126Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-1of4successnonogpu-staging-spot-0-050:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median28.100000000000264
in-drivable-lane_median11.100000000000122
driven_lanedir_consec_median2.011717842473157
deviation-center-line_median1.2849060067466311


other stats
deviation-center-line_max1.2849060067466311
deviation-center-line_mean1.2849060067466311
deviation-center-line_min1.2849060067466311
deviation-heading_max5.209410161114413
deviation-heading_mean5.209410161114413
deviation-heading_median5.209410161114413
deviation-heading_min5.209410161114413
distance-from-start_max2.0185004162398683
distance-from-start_mean2.0185004162398683
distance-from-start_median2.0185004162398683
distance-from-start_min2.0185004162398683
driven_any_max3.5792433029946493
driven_any_mean3.5792433029946493
driven_any_median3.5792433029946493
driven_any_min3.5792433029946493
driven_lanedir_consec_max2.011717842473157
driven_lanedir_consec_mean2.011717842473157
driven_lanedir_consec_min2.011717842473157
driven_lanedir_max2.011717842473157
driven_lanedir_mean2.011717842473157
driven_lanedir_median2.011717842473157
driven_lanedir_min2.011717842473157
in-drivable-lane_max11.100000000000122
in-drivable-lane_mean11.100000000000122
in-drivable-lane_min11.100000000000122
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.5792433029946493, "survival_time": 28.100000000000264, "driven_lanedir": 2.011717842473157, "in-drivable-lane": 11.100000000000122, "deviation-heading": 5.209410161114413, "distance-from-start": 2.0185004162398683, "deviation-center-line": 1.2849060067466311, "driven_lanedir_consec": 2.011717842473157}}
simulation-passed1
survival_time_max28.100000000000264
survival_time_mean28.100000000000264
survival_time_min28.100000000000264
No reset possible
2943127Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:08:19
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2934128Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2932125Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4timeoutnonogpu-staging-spot-0-050:03:07
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2923125Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:04:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2915127Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:08:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFV-sim-validation/submission127/sim-3of4-nogpu-staging-spot-0-05-job2915-a-wd/challenge-evaluation-output/episodes/loop-000/ui_image.mp4.palette.tmp.png'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2911131Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2910127Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:04:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2906126Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4successnonogpu-staging-spot-0-050:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.250000000000153
in-drivable-lane_median16.850000000000154
driven_lanedir_consec_median0.20329347115185947
deviation-center-line_median0.24829467896015636


other stats
deviation-center-line_max0.24829467896015636
deviation-center-line_mean0.24829467896015636
deviation-center-line_min0.24829467896015636
deviation-heading_max3.1572234267684056
deviation-heading_mean3.1572234267684056
deviation-heading_median3.1572234267684056
deviation-heading_min3.1572234267684056
distance-from-start_max0.5563556220056072
distance-from-start_mean0.5563556220056072
distance-from-start_median0.5563556220056072
distance-from-start_min0.5563556220056072
driven_any_max2.5364335657331742
driven_any_mean2.5364335657331742
driven_any_median2.5364335657331742
driven_any_min2.5364335657331742
driven_lanedir_consec_max0.20329347115185947
driven_lanedir_consec_mean0.20329347115185947
driven_lanedir_consec_min0.20329347115185947
driven_lanedir_max0.20329347115185947
driven_lanedir_mean0.20329347115185947
driven_lanedir_median0.20329347115185947
driven_lanedir_min0.20329347115185947
in-drivable-lane_max16.850000000000154
in-drivable-lane_mean16.850000000000154
in-drivable-lane_min16.850000000000154
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.5364335657331742, "survival_time": 20.250000000000153, "driven_lanedir": 0.20329347115185947, "in-drivable-lane": 16.850000000000154, "deviation-heading": 3.1572234267684056, "distance-from-start": 0.5563556220056072, "deviation-center-line": 0.24829467896015636, "driven_lanedir_consec": 0.20329347115185947}}
simulation-passed1
survival_time_max20.250000000000153
survival_time_mean20.250000000000153
survival_time_min20.250000000000153
No reset possible
2901131Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:06:06
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2894132Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:09:00
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2881134Bea Baselines 🐤baseline-duckietownaido-LFV-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:08:57
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2876138Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:06:48
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2872138Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:08:31
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2866223Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:10:24
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2858223Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successnonogpu-staging-spot-0-050:15:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median15.50000000000015
driven_lanedir_consec_median0.25235024327809585
deviation-center-line_median0.42703183560672103


other stats
deviation-center-line_max2.4472420705619533
deviation-center-line_mean0.8344397440503571
deviation-center-line_min0.03645323442603296
deviation-heading_max5.758343124435709
deviation-heading_mean2.9647842264649222
deviation-heading_median2.495952396335645
deviation-heading_min1.1088889887526905
distance-from-start_max0.7357883576773793
distance-from-start_mean0.4455427430503651
distance-from-start_median0.39183673855001466
distance-from-start_min0.26270913742405194
driven_any_max5.001991003394682
driven_any_mean1.5256410869454455
driven_any_median0.4116848275607295
driven_any_min0.277203689265641
driven_lanedir_consec_max0.27378157451757623
driven_lanedir_consec_mean0.2126092671035225
driven_lanedir_consec_min0.0719550073403219
driven_lanedir_max0.25840198320624896
driven_lanedir_mean0.20810689611748895
driven_lanedir_median0.25103529696169247
driven_lanedir_min0.0719550073403219
in-drivable-lane_max19.05000000000016
in-drivable-lane_mean12.737500000000114
in-drivable-lane_min0.8999999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.001991003394682, "survival_time": 20.70000000000016, "driven_lanedir": 0.2557720905734422, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.758343124435709, "distance-from-start": 0.7357883576773793, "deviation-center-line": 0.7687325001714213, "driven_lanedir_consec": 0.27378157451757623}, "zigzag-000-ego1": {"driven_any": 0.27720368926577976, "survival_time": 20.70000000000016, "driven_lanedir": 0.24629850334994272, "in-drivable-lane": 18.85000000000016, "deviation-heading": 1.237970895306601, "distance-from-start": 0.26270913742405194, "deviation-center-line": 0.08533117104202081, "driven_lanedir_consec": 0.24629850334994272}, "zigzag-000-ego2": {"driven_any": 0.277203689265641, "survival_time": 20.70000000000016, "driven_lanedir": 0.25840198320624896, "in-drivable-lane": 0.8999999999999998, "deviation-heading": 3.7539338973646887, "distance-from-start": 0.26270913742405355, "deviation-center-line": 2.4472420705619533, "driven_lanedir_consec": 0.25840198320624896}, "zigzag-000-ego3": {"driven_any": 0.5461659658556793, "survival_time": 20.70000000000016, "driven_lanedir": 0.0719550073403219, "in-drivable-lane": 19.05000000000016, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759758, "deviation-center-line": 0.03645323442603296, "driven_lanedir_consec": 0.0719550073403219}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
2850223Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:06:01
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2849226Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:20
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2844223Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-0of4successnonogpu-staging-spot-0-050:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.000000000000277
in-drivable-lane_median20.025000000000247
driven_lanedir_consec_median0.2300486386994012
deviation-center-line_median0.7278799269429306


other stats
deviation-center-line_max0.8194317074657906
deviation-center-line_mean0.7278799269429306
deviation-center-line_min0.6363281464200704
deviation-heading_max6.73261632177244
deviation-heading_mean6.633830808409963
deviation-heading_median6.633830808409963
deviation-heading_min6.535045295047486
distance-from-start_max0.8626308120701062
distance-from-start_mean0.8293644349619178
distance-from-start_median0.8293644349619178
distance-from-start_min0.7960980578537296
driven_any_max7.22251940565216
driven_any_mean6.586737153678611
driven_any_median6.586737153678611
driven_any_min5.950954901705061
driven_lanedir_consec_max0.2657607447138941
driven_lanedir_consec_mean0.2300486386994012
driven_lanedir_consec_min0.19433653268490825
driven_lanedir_max0.24775126076977605
driven_lanedir_mean0.21437974622313805
driven_lanedir_median0.21437974622313805
driven_lanedir_min0.18100823167650004
in-drivable-lane_max20.30000000000025
in-drivable-lane_mean20.025000000000247
in-drivable-lane_min19.750000000000245
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.950954901705061, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977605, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537296, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.2657607447138941}, "loop2-000-ego1": {"driven_any": 7.22251940565216, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167650004, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701062, "deviation-center-line": 0.6363281464200704, "driven_lanedir_consec": 0.19433653268490825}}
simulation-passed1
survival_time_max29.000000000000277
survival_time_mean29.000000000000277
survival_time_min29.000000000000277
No reset possible
2829230Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:39:43
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2824228Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4successnonogpu-staging-spot-0-050:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.25776519662350195
survival_time_median31.100000000000307
deviation-center-line_median0.8659888526711652
in-drivable-lane_median21.150000000000265


other stats
deviation-center-line_max0.8659888526711652
deviation-center-line_mean0.8659888526711652
deviation-center-line_min0.8659888526711652
deviation-heading_max7.706889494947773
deviation-heading_mean7.706889494947773
deviation-heading_median7.706889494947773
deviation-heading_min7.706889494947773
distance-from-start_max0.8626308120701057
distance-from-start_mean0.8626308120701057
distance-from-start_median0.8626308120701057
distance-from-start_min0.8626308120701057
driven_any_max7.342290201920544
driven_any_mean7.342290201920544
driven_any_median7.342290201920544
driven_any_min7.342290201920544
driven_lanedir_consec_max0.25776519662350195
driven_lanedir_consec_mean0.25776519662350195
driven_lanedir_consec_min0.25776519662350195
driven_lanedir_max0.23974426858772935
driven_lanedir_mean0.23974426858772935
driven_lanedir_median0.23974426858772935
driven_lanedir_min0.23974426858772935
in-drivable-lane_max21.150000000000265
in-drivable-lane_mean21.150000000000265
in-drivable-lane_min21.150000000000265
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.342290201920544, "survival_time": 31.100000000000307, "driven_lanedir": 0.23974426858772935, "in-drivable-lane": 21.150000000000265, "deviation-heading": 7.706889494947773, "distance-from-start": 0.8626308120701057, "deviation-center-line": 0.8659888526711652, "driven_lanedir_consec": 0.25776519662350195}}
simulation-passed1
survival_time_max31.100000000000307
survival_time_mean31.100000000000307
survival_time_min31.100000000000307
No reset possible
2820230Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:14:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 772, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2818231Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnonogpu-staging-spot-0-050:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.70000000000028
in-drivable-lane_median26.450000000000227
driven_lanedir_consec_median0.012424731783599874
deviation-center-line_median0.5849696511111409


other stats
deviation-center-line_max0.5849696511111409
deviation-center-line_mean0.5849696511111409
deviation-center-line_min0.5849696511111409
deviation-heading_max4.775258874675082
deviation-heading_mean4.775258874675082
deviation-heading_median4.775258874675082
deviation-heading_min4.775258874675082
distance-from-start_max0.9340577697896076
distance-from-start_mean0.9340577697896076
distance-from-start_median0.9340577697896076
distance-from-start_min0.9340577697896076
driven_any_max8.108127605402778
driven_any_mean8.108127605402778
driven_any_median8.108127605402778
driven_any_min8.108127605402778
driven_lanedir_consec_max0.012424731783599874
driven_lanedir_consec_mean0.012424731783599874
driven_lanedir_consec_min0.012424731783599874
driven_lanedir_max0.01577107388223381
driven_lanedir_mean0.01577107388223381
driven_lanedir_median0.01577107388223381
driven_lanedir_min0.01577107388223381
in-drivable-lane_max26.450000000000227
in-drivable-lane_mean26.450000000000227
in-drivable-lane_min26.450000000000227
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.108127605402778, "survival_time": 32.70000000000028, "driven_lanedir": 0.01577107388223381, "in-drivable-lane": 26.450000000000227, "deviation-heading": 4.775258874675082, "distance-from-start": 0.9340577697896076, "deviation-center-line": 0.5849696511111409, "driven_lanedir_consec": 0.012424731783599874}}
simulation-passed1
survival_time_max32.70000000000028
survival_time_mean32.70000000000028
survival_time_min32.70000000000028
No reset possible
2816231Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnonogpu-staging-spot-0-050:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.022350044024311844
deviation-center-line_median0.02664350798512652


other stats
deviation-center-line_max0.02664350798512652
deviation-center-line_mean0.02664350798512652
deviation-center-line_min0.02664350798512652
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.4028556303039821
distance-from-start_mean0.4028556303039821
distance-from-start_median0.4028556303039821
distance-from-start_min0.4028556303039821
driven_any_max0.4240764502839683
driven_any_mean0.4240764502839683
driven_any_median0.4240764502839683
driven_any_min0.4240764502839683
driven_lanedir_consec_max0.022350044024311844
driven_lanedir_consec_mean0.022350044024311844
driven_lanedir_consec_min0.022350044024311844
driven_lanedir_max0.022350044024311844
driven_lanedir_mean0.022350044024311844
driven_lanedir_median0.022350044024311844
driven_lanedir_min0.022350044024311844
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4240764502839683, "survival_time": 3.7499999999999942, "driven_lanedir": 0.022350044024311844, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 1.126574172093021, "distance-from-start": 0.4028556303039821, "deviation-center-line": 0.02664350798512652, "driven_lanedir_consec": 0.022350044024311844}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
2809232Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-0of4successnonogpu-staging-spot-0-050:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.850000000000032
in-drivable-lane_median8.400000000000022
driven_lanedir_consec_median0.02606914644547076
deviation-center-line_median0.32675612925723413


other stats
deviation-center-line_max0.32675612925723413
deviation-center-line_mean0.32675612925723413
deviation-center-line_min0.32675612925723413
deviation-heading_max2.5569355297042424
deviation-heading_mean2.5569355297042424
deviation-heading_median2.5569355297042424
deviation-heading_min2.5569355297042424
distance-from-start_max0.6024060239354879
distance-from-start_mean0.6024060239354879
distance-from-start_median0.6024060239354879
distance-from-start_min0.6024060239354879
driven_any_max2.587018858615972
driven_any_mean2.587018858615972
driven_any_median2.587018858615972
driven_any_min2.587018858615972
driven_lanedir_consec_max0.02606914644547076
driven_lanedir_consec_mean0.02606914644547076
driven_lanedir_consec_min0.02606914644547076
driven_lanedir_max0.02941536933481914
driven_lanedir_mean0.02941536933481914
driven_lanedir_median0.02941536933481914
driven_lanedir_min0.02941536933481914
in-drivable-lane_max8.400000000000022
in-drivable-lane_mean8.400000000000022
in-drivable-lane_min8.400000000000022
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.587018858615972, "survival_time": 11.850000000000032, "driven_lanedir": 0.02941536933481914, "in-drivable-lane": 8.400000000000022, "deviation-heading": 2.5569355297042424, "distance-from-start": 0.6024060239354879, "deviation-center-line": 0.32675612925723413, "driven_lanedir_consec": 0.02606914644547076}}
simulation-passed1
survival_time_max11.850000000000032
survival_time_mean11.850000000000032
survival_time_min11.850000000000032
No reset possible
2778232Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:24:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2771232Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4successnonogpu-staging-spot-0-050:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.900000000000034
in-drivable-lane_median8.450000000000022
driven_lanedir_consec_median0.02606802234991923
deviation-center-line_median0.3267559166059044


other stats
deviation-center-line_max0.3267559166059044
deviation-center-line_mean0.3267559166059044
deviation-center-line_min0.3267559166059044
deviation-heading_max2.5569354443903323
deviation-heading_mean2.5569354443903323
deviation-heading_median2.5569354443903323
deviation-heading_min2.5569354443903323
distance-from-start_max0.6207818224254961
distance-from-start_mean0.6207818224254961
distance-from-start_median0.6207818224254961
distance-from-start_min0.6207818224254961
driven_any_max2.607887888367929
driven_any_mean2.607887888367929
driven_any_median2.607887888367929
driven_any_min2.607887888367929
driven_lanedir_consec_max0.02606802234991923
driven_lanedir_consec_mean0.02606802234991923
driven_lanedir_consec_min0.02606802234991923
driven_lanedir_max0.029415675750660508
driven_lanedir_mean0.029415675750660508
driven_lanedir_median0.029415675750660508
driven_lanedir_min0.029415675750660508
in-drivable-lane_max8.450000000000022
in-drivable-lane_mean8.450000000000022
in-drivable-lane_min8.450000000000022
per-episodes
details{"loop-000-ego0": {"driven_any": 2.607887888367929, "survival_time": 11.900000000000034, "driven_lanedir": 0.029415675750660508, "in-drivable-lane": 8.450000000000022, "deviation-heading": 2.5569354443903323, "distance-from-start": 0.6207818224254961, "deviation-center-line": 0.3267559166059044, "driven_lanedir_consec": 0.02606802234991923}}
simulation-passed1
survival_time_max11.900000000000034
survival_time_mean11.900000000000034
survival_time_min11.900000000000034
No reset possible
2765232Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:07:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/containers/8faf0f22a33836dc7a0c70c1a5caa49c8a61b6fe15ac042724fd52d34b60a476/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.41/containers/8faf0f22a33836dc7a0c70c1a5caa49c8a61b6fe15ac042724fd52d34b60a476/json: Not Found ("No such container: 8faf0f22a33836dc7a0c70c1a5caa49c8a61b6fe15ac042724fd52d34b60a476")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2747235Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4successnonogpu-staging-spot-0-050:09:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.012426269112548072
survival_time_median51.799999999999194
deviation-center-line_median0.5849700317973117
in-drivable-lane_median45.549999999999145


other stats
deviation-center-line_max0.5849700317973117
deviation-center-line_mean0.5849700317973117
deviation-center-line_min0.5849700317973117
deviation-heading_max4.775258870776365
deviation-heading_mean4.775258870776365
deviation-heading_median4.775258870776365
deviation-heading_min4.775258870776365
distance-from-start_max1.2120262829129234
distance-from-start_mean1.2120262829129234
distance-from-start_median1.2120262829129234
distance-from-start_min1.2120262829129234
driven_any_max12.878703808364234
driven_any_mean12.878703808364234
driven_any_median12.878703808364234
driven_any_min12.878703808364234
driven_lanedir_consec_max0.012426269112548072
driven_lanedir_consec_mean0.012426269112548072
driven_lanedir_consec_min0.012426269112548072
driven_lanedir_max0.015772611211182008
driven_lanedir_mean0.015772611211182008
driven_lanedir_median0.015772611211182008
driven_lanedir_min0.015772611211182008
in-drivable-lane_max45.549999999999145
in-drivable-lane_mean45.549999999999145
in-drivable-lane_min45.549999999999145
per-episodes
details{"loop2-000-ego0": {"driven_any": 12.878703808364234, "survival_time": 51.799999999999194, "driven_lanedir": 0.015772611211182008, "in-drivable-lane": 45.549999999999145, "deviation-heading": 4.775258870776365, "distance-from-start": 1.2120262829129234, "deviation-center-line": 0.5849700317973117, "driven_lanedir_consec": 0.012426269112548072}}
simulation-passed1
survival_time_max51.799999999999194
survival_time_mean51.799999999999194
survival_time_min51.799999999999194
No reset possible
2734235Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2730235Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2711235Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2702236Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2698236Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2688236Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2682236Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2671266Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2670266Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2656266Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2653266Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2635267Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:01:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2598266Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4successnonogpu-staging-spot-0-050:28:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-4.299721525491407e-05
deviation-center-line_median1.5117185500594212


other stats
deviation-center-line_max2.9467617678498437
deviation-center-line_mean1.5769838576829704
deviation-center-line_min0.3377365627631955
deviation-heading_max32.249113233675025
deviation-heading_mean22.839465954359294
deviation-heading_median22.5972389335139
deviation-heading_min13.91427271673436
distance-from-start_max9.155133597044477e-16
distance-from-start_mean3.4683953629253476e-16
distance-from-start_median2.3592239273284576e-16
distance-from-start_min0.0
driven_any_max1.0986160316453499e-12
driven_any_mean4.16207443551045e-13
driven_any_median2.831068712794149e-13
driven_any_min0.0
driven_lanedir_consec_max4.432337763482508e-06
driven_lanedir_consec_mean-9.191609691705516e-05
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max4.432337763482508e-06
driven_lanedir_mean-9.191609691705516e-05
driven_lanedir_median-4.299721525491407e-05
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": -8.599443050982813e-05, "in-drivable-lane": 0.0, "deviation-heading": 30.712913270859467, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.1284946700229823, "driven_lanedir_consec": -8.599443050982813e-05}, "zigzag-000-ego2": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 2.9467617678498437, "driven_lanedir_consec": -0.000286102294921875}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.432337763482508e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.3377365627631955, "driven_lanedir_consec": 4.432337763482508e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
2584267Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4timeoutnonogpu-staging-spot-0-051:09:42
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2576267Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successnonogpu-staging-spot-0-050:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948943425962775


other stats
deviation-center-line_max0.8948943425962775
deviation-center-line_mean0.8948943425962775
deviation-center-line_min0.8948943425962775
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.8948943425962775, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
2565267Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-2of4successnonogpu-staging-spot-0-050:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.000286102294921875
deviation-center-line_median0.8948943425962731


other stats
deviation-center-line_max0.8948943425962731
deviation-center-line_mean0.8948943425962731
deviation-center-line_min0.8948943425962731
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max-0.000286102294921875
driven_lanedir_consec_mean-0.000286102294921875
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max-0.000286102294921875
driven_lanedir_mean-0.000286102294921875
driven_lanedir_median-0.000286102294921875
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.8948943425962731, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
2557268Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:04:39
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2551268Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:05:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2547268Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:03:00
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2541268Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:04:07
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2533269Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-0of4abortednonogpu-staging-spot-0-050:07:56
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2527269Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-1of4abortednonogpu-staging-spot-0-050:02:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2517270Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:02:33
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2516269Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4abortednonogpu-staging-spot-0-050:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2513270Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4timeoutnonogpu-staging-spot-0-050:00:41
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2487270Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4timeoutnonogpu-staging-spot-0-050:14:16
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2473271Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-0of4abortednonogpu-staging-spot-0-050:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2452271Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-2of4abortednonogpu-staging-spot-0-050:00:40
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2443272Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2431272Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-0of4abortednonogpu-staging-spot-0-050:00:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2426273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2337273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:08:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 426, in main
    raise dc.InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: broken process pool
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2211273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:14:48
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2208273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2200273Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2187274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2180274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2174274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2166274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2156274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2151274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2143274Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2134275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2126275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2123275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2118275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2109275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2103275Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2093276Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2024276Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:05:52
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2011276Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2002277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1993276Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-testingsim-3of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1989277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-0of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1982277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1972277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1936277Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1905280Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:01:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1822279Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-0of4successnonogpu-staging-spot-0-050:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.4065102356188296
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.4065102356188296
deviation-center-line_mean0.4065102356188296
deviation-center-line_min0.4065102356188296
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max8.326672684688674e-17
distance-from-start_mean8.326672684688674e-17
distance-from-start_median8.326672684688674e-17
distance-from-start_min8.326672684688674e-17
driven_any_max9.992007221626409e-14
driven_any_mean9.992007221626409e-14
driven_any_median9.992007221626409e-14
driven_any_min9.992007221626409e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 9.992007221626409e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 8.326672684688674e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1813279Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-testingsim-3of4successnonogpu-staging-spot-0-050:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.40652749865251137
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.40652749865251137
deviation-center-line_mean0.40652749865251137
deviation-center-line_min0.40652749865251137
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.551115123125784e-16
distance-from-start_mean5.551115123125784e-16
distance-from-start_median5.551115123125784e-16
distance-from-start_min5.551115123125784e-16
driven_any_max6.661338147750939e-13
driven_any_mean6.661338147750939e-13
driven_any_median6.661338147750939e-13
driven_any_min6.661338147750939e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.661338147750939e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125784e-16, "deviation-center-line": 0.40652749865251137, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1810309Andrea Censiminimal-agentaido-LFV-sim-validationsim-1of4timeoutnonogpu-staging-spot-0-050:00:50
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1795280Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:08:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1788139Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:04:09
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1781141Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:04:13
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1771146Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:04:39
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1764144Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:08:53
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1760146Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:05:41
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1736150Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:26:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 426, in main
    raise dc.InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: broken process pool
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1733142Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-3of4successnonogpu-staging-spot-0-050:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
1728143Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:03:38
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1725144Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-2of4successnonogpu-staging-spot-0-050:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
1706149Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-1of4successnonogpu-staging-spot-0-050:13:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5152254385002415
deviation-center-line_median4.002587878600771


other stats
deviation-center-line_max4.002587878600771
deviation-center-line_mean4.002587878600771
deviation-center-line_min4.002587878600771
deviation-heading_max7.890763160965315
deviation-heading_mean7.890763160965315
deviation-heading_median7.890763160965315
deviation-heading_min7.890763160965315
distance-from-start_max2.12987115230656
distance-from-start_mean2.12987115230656
distance-from-start_median2.12987115230656
distance-from-start_min2.12987115230656
driven_any_max3.5795907883793245
driven_any_mean3.5795907883793245
driven_any_median3.5795907883793245
driven_any_min3.5795907883793245
driven_lanedir_consec_max3.5152254385002415
driven_lanedir_consec_mean3.5152254385002415
driven_lanedir_consec_min3.5152254385002415
driven_lanedir_max3.522144437985599
driven_lanedir_mean3.522144437985599
driven_lanedir_median3.522144437985599
driven_lanedir_min3.522144437985599
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.5795907883793245, "survival_time": 59.99999999999873, "driven_lanedir": 3.522144437985599, "in-drivable-lane": 0.0, "deviation-heading": 7.890763160965315, "distance-from-start": 2.12987115230656, "deviation-center-line": 4.002587878600771, "driven_lanedir_consec": 3.5152254385002415}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1702147Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:01:38
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1693148Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:04:10
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1678157Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation256host-errornonogpu-staging-spot-0-050:05:22
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1675154Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:03:56
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1663154Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:06:54
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1645157Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation259host-errornonogpu-staging-spot-0-050:13:21
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1637158Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:05:20
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1636295Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:02:59
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1626158Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successnonogpu-staging-spot-0-050:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7940788932080864
deviation-center-line_median0.09395078397363615


other stats
deviation-center-line_max0.09395078397363615
deviation-center-line_mean0.09395078397363615
deviation-center-line_min0.09395078397363615
deviation-heading_max0.9391470252254364
deviation-heading_mean0.9391470252254364
deviation-heading_median0.9391470252254364
deviation-heading_min0.9391470252254364
distance-from-start_max0.6761226695999434
distance-from-start_mean0.6761226695999434
distance-from-start_median0.6761226695999434
distance-from-start_min0.6761226695999434
driven_any_max0.801037708816156
driven_any_mean0.801037708816156
driven_any_median0.801037708816156
driven_any_min0.801037708816156
driven_lanedir_consec_max0.7940788932080864
driven_lanedir_consec_mean0.7940788932080864
driven_lanedir_consec_min0.7940788932080864
driven_lanedir_max0.7940788932080864
driven_lanedir_mean0.7940788932080864
driven_lanedir_median0.7940788932080864
driven_lanedir_min0.7940788932080864
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.801037708816156, "survival_time": 8.999999999999993, "driven_lanedir": 0.7940788932080864, "in-drivable-lane": 0.0, "deviation-heading": 0.9391470252254364, "distance-from-start": 0.6761226695999434, "deviation-center-line": 0.09395078397363615, "driven_lanedir_consec": 0.7940788932080864}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
1612297Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:07:18
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1594304Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:13:09
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1586301Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:09:11
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1565307Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:14:52
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1552306Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:09:42
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1542160Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:09:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFI-state-sim-testing/submission160/sim-0of4-nogpu-staging-spot-0-05-job1542-a-wd/challenge-evaluation-output/episodes/4way-000/ui_image.mp4.palette.tmp.png'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1535159Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:02:21
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1527162Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:04:49
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1520161Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:02:36
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1511163Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:05:29
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1507162Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:02:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1500162Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:03:37
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1490166Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:05:24
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1482166Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-2of4successnonogpu-staging-spot-0-050:05:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.40000000000017
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7870268420255404
deviation-center-line_median0.17881843701465228


other stats
deviation-center-line_max0.17881843701465228
deviation-center-line_mean0.17881843701465228
deviation-center-line_min0.17881843701465228
deviation-heading_max1.5183855866138245
deviation-heading_mean1.5183855866138245
deviation-heading_median1.5183855866138245
deviation-heading_min1.5183855866138245
distance-from-start_max1.424737442481418
distance-from-start_mean1.424737442481418
distance-from-start_median1.424737442481418
distance-from-start_min1.424737442481418
driven_any_max1.798416666507389
driven_any_mean1.798416666507389
driven_any_median1.798416666507389
driven_any_min1.798416666507389
driven_lanedir_consec_max1.7870268420255404
driven_lanedir_consec_mean1.7870268420255404
driven_lanedir_consec_min1.7870268420255404
driven_lanedir_max1.7870268420255404
driven_lanedir_mean1.7870268420255404
driven_lanedir_median1.7870268420255404
driven_lanedir_min1.7870268420255404
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.798416666507389, "survival_time": 21.40000000000017, "driven_lanedir": 1.7870268420255404, "in-drivable-lane": 0.0, "deviation-heading": 1.5183855866138245, "distance-from-start": 1.424737442481418, "deviation-center-line": 0.17881843701465228, "driven_lanedir_consec": 1.7870268420255404}}
simulation-passed1
survival_time_max21.40000000000017
survival_time_mean21.40000000000017
survival_time_min21.40000000000017
No reset possible
1475165Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:03:49
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1468182Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:03:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1459181Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:06:34
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1445184Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:08:08
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1438189Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:08:04
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1431185Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation257host-errornonogpu-staging-spot-0-050:02:17
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1423185Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation258host-errornonogpu-staging-spot-0-050:04:23
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/containers/92f3aa2c8d3e4f3f3a9fef6102cca888c4b99f90e95c6808407a6167bcde10c4/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.41/containers/92f3aa2c8d3e4f3f3a9fef6102cca888c4b99f90e95c6808407a6167bcde10c4/json: Not Found ("No such container: 92f3aa2c8d3e4f3f3a9fef6102cca888c4b99f90e95c6808407a6167bcde10c4")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1417185Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation256host-errornonogpu-staging-spot-0-050:01:35
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1414186Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:02:22
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1407186Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4successnonogpu-staging-spot-0-050:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.43685686215374986
deviation-center-line_median0.2706641555254041


other stats
deviation-center-line_max0.2706641555254041
deviation-center-line_mean0.2706641555254041
deviation-center-line_min0.2706641555254041
deviation-heading_max0.7151185427551815
deviation-heading_mean0.7151185427551815
deviation-heading_median0.7151185427551815
deviation-heading_min0.7151185427551815
distance-from-start_max0.43794917699306546
distance-from-start_mean0.43794917699306546
distance-from-start_median0.43794917699306546
distance-from-start_min0.43794917699306546
driven_any_max0.4415992768886806
driven_any_mean0.4415992768886806
driven_any_median0.4415992768886806
driven_any_min0.4415992768886806
driven_lanedir_consec_max0.43685686215374986
driven_lanedir_consec_mean0.43685686215374986
driven_lanedir_consec_min0.43685686215374986
driven_lanedir_max0.43685686215374986
driven_lanedir_mean0.43685686215374986
driven_lanedir_median0.43685686215374986
driven_lanedir_min0.43685686215374986
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.4415992768886806, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215374986, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551815, "distance-from-start": 0.43794917699306546, "deviation-center-line": 0.2706641555254041, "driven_lanedir_consec": 0.43685686215374986}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
1398187Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:04:49
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1390189Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:03:38
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1380190Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:04:29
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1374190Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1365190Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1353191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1336191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1328190Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1321191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1310191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1301191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1294191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1281192Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1276191Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1270192Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1257192Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1250192Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1246193Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1238193Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1228193Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1214194Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1208194Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1194193Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1188193Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1185194Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1131167Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnonogpu-staging-spot-0-050:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.699999999999989
in-drivable-lane_median5.124999999999994
driven_lanedir_consec_median0.35349804729115897
deviation-center-line_median0.31473998602704034


other stats
deviation-center-line_max1.1167880744707726
deviation-center-line_mean0.4679858397779617
deviation-center-line_min0.1256753125869936
deviation-heading_max2.483401077481458
deviation-heading_mean1.59686418028581
deviation-heading_median1.5781230863572224
deviation-heading_min0.7478094709473372
distance-from-start_max1.2661028531770582
distance-from-start_mean0.950058294450684
distance-from-start_median1.0055183306038735
distance-from-start_min0.5230936634179305
driven_any_max1.2661876874339502
driven_any_mean0.9501035001353172
driven_any_median1.0055609346511667
driven_any_min0.5231044438049847
driven_lanedir_consec_max0.7375228777305458
driven_lanedir_consec_mean0.4010538260367677
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.7375228777305458
driven_lanedir_mean0.4010538260367677
driven_lanedir_median0.35349804729115897
driven_lanedir_min0.15969633183420706
in-drivable-lane_max7.2499999999999885
in-drivable-lane_mean4.374999999999994
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.9347451682894392, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.9347143740566116, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955005044754337}, "loop-000-ego1": {"driven_any": 1.2661876874339502, "survival_time": 8.699999999999989, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473372, "distance-from-start": 1.2661028531770582, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969633183420706}, "loop-000-ego2": {"driven_any": 0.5231044438049847, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441347746, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077481458, "distance-from-start": 0.5230936634179305, "deviation-center-line": 1.1167880744707726, "driven_lanedir_consec": 0.5074460441347746}, "loop-000-ego3": {"driven_any": 1.076376701012894, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777305458, "in-drivable-lane": 3.3, "deviation-heading": 2.2074242171563987, "distance-from-start": 1.076322287151135, "deviation-center-line": 0.4938550612758116, "driven_lanedir_consec": 0.7375228777305458}}
simulation-passed1
survival_time_max8.699999999999989
survival_time_mean8.699999999999989
survival_time_min8.699999999999989
No reset possible
1121167Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1110167Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1101167Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1095167Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1088168Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1078168Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1061168Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1051168Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1045169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1036169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1022169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1021169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1011169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
999169Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
988170Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
986170Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
979170Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
971170Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
967170Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
960171Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
954171Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
941171Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
940171Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
934171Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
924172Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4abortednonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
920172Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-2of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
916172Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-1of4abortednonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
912172Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-0of4abortednonogpu-staging-spot-0-050:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
908173Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
906173Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
902173Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
901176Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
886176Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4successnonogpu-staging-spot-0-050:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999991
in-drivable-lane_median3.299999999999991
driven_lanedir_consec_median0.13666552017194578
deviation-center-line_median0.10783835333106152


other stats
deviation-center-line_max0.10783835333106152
deviation-center-line_mean0.10783835333106152
deviation-center-line_min0.10783835333106152
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max0.6067369732496857
distance-from-start_mean0.6067369732496857
distance-from-start_median0.6067369732496857
distance-from-start_min0.6067369732496857
driven_any_max0.6067485028472931
driven_any_mean0.6067485028472931
driven_any_median0.6067485028472931
driven_any_min0.6067485028472931
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max3.299999999999991
in-drivable-lane_mean3.299999999999991
in-drivable-lane_min3.299999999999991
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.6067485028472931, "survival_time": 4.699999999999991, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 3.299999999999991, "deviation-heading": 0.9508048428349394, "distance-from-start": 0.6067369732496857, "deviation-center-line": 0.10783835333106152, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_min4.699999999999991
No reset possible
878176Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
871176Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
864177Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
856177Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
848177Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
840177Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
834177Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
821178Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
813178Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
807178Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
802178Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
792178Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
786179Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
779179Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
769179Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
761179Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
756180Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
751180Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
742180Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4host-errornonogpu-staging-spot-0-050:00:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
741180Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4host-errornonogpu-staging-spot-0-050:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
685152Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-3of4successnonogpu-staging-spot-0-050:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6903637727595648
deviation-center-line_median5.303135750931059


other stats
deviation-center-line_max5.303135750931059
deviation-center-line_mean5.303135750931059
deviation-center-line_min5.303135750931059
deviation-heading_max5.395040966687188
deviation-heading_mean5.395040966687188
deviation-heading_median5.395040966687188
deviation-heading_min5.395040966687188
distance-from-start_max1.390965525210542
distance-from-start_mean1.390965525210542
distance-from-start_median1.390965525210542
distance-from-start_min1.390965525210542
driven_any_max3.519587646027781
driven_any_mean3.519587646027781
driven_any_median3.519587646027781
driven_any_min3.519587646027781
driven_lanedir_consec_max1.6903637727595648
driven_lanedir_consec_mean1.6903637727595648
driven_lanedir_consec_min1.6903637727595648
driven_lanedir_max3.387502194996571
driven_lanedir_mean3.387502194996571
driven_lanedir_median3.387502194996571
driven_lanedir_min3.387502194996571
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 3.519587646027781, "survival_time": 59.99999999999873, "driven_lanedir": 3.387502194996571, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395040966687188, "distance-from-start": 1.390965525210542, "deviation-center-line": 5.303135750931059, "driven_lanedir_consec": 1.6903637727595648}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
64343Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-1of4abortednonogpu-staging-spot-0-050:20:48
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62540Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnonogpu-staging-spot-0-050:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.899999999999892
driven_lanedir_consec_median3.40640170732006
deviation-center-line_median5.159547195129483


other stats
deviation-center-line_max5.159547195129483
deviation-center-line_mean5.159547195129483
deviation-center-line_min5.159547195129483
deviation-heading_max7.059107454008588
deviation-heading_mean7.059107454008588
deviation-heading_median7.059107454008588
deviation-heading_min7.059107454008588
distance-from-start_max2.2176127613608925
distance-from-start_mean2.2176127613608925
distance-from-start_median2.2176127613608925
distance-from-start_min2.2176127613608925
driven_any_max3.532579606984142
driven_any_mean3.532579606984142
driven_any_median3.532579606984142
driven_any_min3.532579606984142
driven_lanedir_consec_max3.40640170732006
driven_lanedir_consec_mean3.40640170732006
driven_lanedir_consec_min3.40640170732006
driven_lanedir_max3.40640170732006
driven_lanedir_mean3.40640170732006
driven_lanedir_median3.40640170732006
driven_lanedir_min3.40640170732006
in-drivable-lane_max1.899999999999892
in-drivable-lane_mean1.899999999999892
in-drivable-lane_min1.899999999999892
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.532579606984142, "survival_time": 59.99999999999873, "driven_lanedir": 3.40640170732006, "in-drivable-lane": 1.899999999999892, "deviation-heading": 7.059107454008588, "distance-from-start": 2.2176127613608925, "deviation-center-line": 5.159547195129483, "driven_lanedir_consec": 3.40640170732006}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
58843Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4successnonogpu-staging-spot-0-050:13:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.7249999999999304
driven_lanedir_consec_median1.7824508236693029
deviation-center-line_median5.752006035796589


other stats
deviation-center-line_max5.917240924506971
deviation-center-line_mean5.752006035796589
deviation-center-line_min5.586771147086208
deviation-heading_max8.389433016031823
deviation-heading_mean8.327307078445351
deviation-heading_median8.327307078445351
deviation-heading_min8.265181140858878
distance-from-start_max1.2351380366112434
distance-from-start_mean1.1329605700672505
distance-from-start_median1.1329605700672505
distance-from-start_min1.030783103523257
driven_any_max3.4865836159248462
driven_any_mean3.4678327998246177
driven_any_median3.4678327998246177
driven_any_min3.4490819837243887
driven_lanedir_consec_max2.09163409663777
driven_lanedir_consec_mean1.7824508236693029
driven_lanedir_consec_min1.473267550700836
driven_lanedir_max3.288010499121376
driven_lanedir_mean3.246016717856279
driven_lanedir_median3.246016717856279
driven_lanedir_min3.2040229365911816
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean3.7249999999999304
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243887, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040229365911816, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433016031823, "distance-from-start": 1.030783103523257, "deviation-center-line": 5.917240924506971, "driven_lanedir_consec": 2.09163409663777}, "loop2-000-ego1": {"driven_any": 3.4865836159248462, "survival_time": 59.99999999999873, "driven_lanedir": 3.288010499121376, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181140858878, "distance-from-start": 1.2351380366112434, "deviation-center-line": 5.586771147086208, "driven_lanedir_consec": 1.473267550700836}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible