Evaluator 2

sim-1of4

success

2021-10-18 23:39:26+00:00

2021-10-18 23:43:05+00:00

0:03:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.099999999999986
in-drivable-lane_median	4.724999999999985
driven_lanedir_consec_median	0.31065815778611217
deviation-center-line_median	0.09125540082813652

other stats

deviation-center-line_max	0.1305878243691196
deviation-center-line_mean	0.0965204284356148
deviation-center-line_min	0.07298308771706652
deviation-heading_max	0.7107099106020507
deviation-heading_mean	0.5973010913936304
deviation-heading_median	0.5658644893569691
deviation-heading_min	0.5467654762585327
distance-from-start_max	1.4969635177188356
distance-from-start_mean	0.9095758789063574
distance-from-start_median	0.7809425566575108
distance-from-start_min	0.579454884591572
driven_any_max	1.508616354453376
driven_any_mean	0.9188307139511556
driven_any_median	0.7898741122917017
driven_any_min	0.5869582767678433
driven_lanedir_consec_max	0.5628648390263598
driven_lanedir_consec_mean	0.3363298727290034
driven_lanedir_consec_min	0.1611383363174295
driven_lanedir_max	0.5628648390263598
driven_lanedir_mean	0.3363298727290034
driven_lanedir_median	0.31065815778611217
driven_lanedir_min	0.1611383363174295
in-drivable-lane_max	4.999999999999986
in-drivable-lane_mean	4.587499999999986
in-drivable-lane_min	3.899999999999986
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.6750497753629152, "survival_time": 6.099999999999986, "driven_lanedir": 0.27006631724645414, "in-drivable-lane": 4.899999999999986, "deviation-heading": 0.5467654762585327, "distance-from-start": 0.6714773203562255, "deviation-center-line": 0.08901074249809124, "driven_lanedir_consec": 0.27006631724645414}, "zigzag-000-ego1": {"driven_any": 1.508616354453376, "survival_time": 6.099999999999986, "driven_lanedir": 0.5628648390263598, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.7107099106020507, "distance-from-start": 1.4969635177188356, "deviation-center-line": 0.1305878243691196, "driven_lanedir_consec": 0.5628648390263598}, "zigzag-000-ego2": {"driven_any": 0.9046984492204884, "survival_time": 6.099999999999986, "driven_lanedir": 0.3512499983257702, "in-drivable-lane": 4.549999999999986, "deviation-heading": 0.5571234461823318, "distance-from-start": 0.8904077929587961, "deviation-center-line": 0.0935000591581818, "driven_lanedir_consec": 0.3512499983257702}, "zigzag-000-ego3": {"driven_any": 0.5869582767678433, "survival_time": 6.099999999999986, "driven_lanedir": 0.1611383363174295, "in-drivable-lane": 4.999999999999986, "deviation-heading": 0.5746055325316065, "distance-from-start": 0.579454884591572, "deviation-center-line": 0.07298308771706652, "driven_lanedir_consec": 0.1611383363174295}}
simulation-passed	1
survival_time_max	6.099999999999986
survival_time_mean	6.099999999999986
survival_time_min	6.099999999999986

No reset possible

507

74

Bea Baselines 🐤

template-ros

sim-0of4

host-error

2021-10-18 23:33:53+00:00

2021-10-18 23:38:51+00:00

0:04:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido-LFVI_multi-sim-validation/submission74/sim-0of4-nogpu-staging-spot-0-03-job507-a-wd/challenge-evaluation-output/episodes/4way-000/ego1/camera.mp4-active.avi'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

498

73

Bea Baselines 🐤

template-ros

sim-0of4

host-error

2021-10-18 23:31:23+00:00

2021-10-18 23:33:47+00:00

0:02:24

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

493

74

Bea Baselines 🐤

template-ros

sim-3of4

success

2021-10-18 23:28:46+00:00

2021-10-18 23:30:56+00:00

0:02:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

485

76

Bea Baselines 🐤

template-ros

aido-LFP-sim-testing

sim-2of4

success

2021-10-18 23:27:00+00:00

2021-10-18 23:28:33+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.3499999999999996
in-drivable-lane_median	1.4999999999999996
driven_lanedir_consec_median	0.13700380461951256
deviation-center-line_median	0.052037644789986424

other stats

deviation-center-line_max	0.052037644789986424
deviation-center-line_mean	0.052037644789986424
deviation-center-line_min	0.052037644789986424
deviation-heading_max	0.565419636240663
deviation-heading_mean	0.565419636240663
deviation-heading_median	0.565419636240663
deviation-heading_min	0.565419636240663
distance-from-start_max	0.43091219170792056
distance-from-start_mean	0.43091219170792056
distance-from-start_median	0.43091219170792056
distance-from-start_min	0.43091219170792056
driven_any_max	0.4317049909430252
driven_any_mean	0.4317049909430252
driven_any_median	0.4317049909430252
driven_any_min	0.4317049909430252
driven_lanedir_consec_max	0.13700380461951256
driven_lanedir_consec_mean	0.13700380461951256
driven_lanedir_consec_min	0.13700380461951256
driven_lanedir_max	0.13700380461951256
driven_lanedir_mean	0.13700380461951256
driven_lanedir_median	0.13700380461951256
driven_lanedir_min	0.13700380461951256
in-drivable-lane_max	1.4999999999999996
in-drivable-lane_mean	1.4999999999999996
in-drivable-lane_min	1.4999999999999996
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.4317049909430252, "survival_time": 2.3499999999999996, "driven_lanedir": 0.13700380461951256, "in-drivable-lane": 1.4999999999999996, "deviation-heading": 0.565419636240663, "distance-from-start": 0.43091219170792056, "deviation-center-line": 0.052037644789986424, "driven_lanedir_consec": 0.13700380461951256}}
simulation-passed	1
survival_time_max	2.3499999999999996
survival_time_mean	2.3499999999999996
survival_time_min	2.3499999999999996

No reset possible

469

82

Bea Baselines 🐤

baseline-duckietown

sim-2of4

host-error

2021-10-18 23:21:12+00:00

2021-10-18 23:26:35+00:00

0:05:23

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

456

82

Bea Baselines 🐤

baseline-duckietown

sim-2of4

host-error

2021-10-18 23:14:40+00:00

2021-10-18 23:21:05+00:00

0:06:25

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

453

81

Bea Baselines 🐤

template-ros

sim-3of4

success

2021-10-18 23:12:56+00:00

2021-10-18 23:14:26+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

445

83

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

2021-10-18 23:08:10+00:00

2021-10-18 23:12:38+00:00

0:04:28

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

435

83

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

aido-LFVI-sim-validation

2021-10-18 23:02:19+00:00

2021-10-18 23:08:04+00:00

0:05:45

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

429

85

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2021-10-18 23:00:23+00:00

2021-10-18 23:01:56+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

425

88

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

2021-10-18 22:58:34+00:00

2021-10-18 23:00:04+00:00

0:01:30

Error while running [...]

Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, nogpu-staging-spot-0-03-job425-715662, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'nogpu-staging-spot-0-03-job425-715662', 'up', '-d']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

411

87

Bea Baselines 🐤

baseline-duckietown

sim-2of4

host-error

aido-LFV_multi-sim-testing

2021-10-18 22:49:08+00:00

2021-10-18 22:58:12+00:00

0:09:04

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

398

89

Bea Baselines 🐤

baseline-duckietown

sim-2of4

host-error

2021-10-18 22:42:21+00:00

2021-10-18 22:49:00+00:00

0:06:39

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

391

91

Bea Baselines 🐤

baseline-duckietown

aido-LFV-sim-testing

sim-2of4

host-error

2021-10-18 22:35:48+00:00

2021-10-18 22:41:56+00:00

0:06:08

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

382

93

Bea Baselines 🐤

baseline-duckietown

aido-LFI-sim-testing

sim-1of4

success

2021-10-18 22:28:47+00:00

2021-10-18 22:35:23+00:00

0:06:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	20.500000000000156
in-drivable-lane_median	2.2000000000000313
driven_lanedir_consec_median	2.0897684386160416
deviation-center-line_median	1.3047274998686136

other stats

deviation-center-line_max	1.3047274998686136
deviation-center-line_mean	1.3047274998686136
deviation-center-line_min	1.3047274998686136
deviation-heading_max	6.104537401306838
deviation-heading_mean	6.104537401306838
deviation-heading_median	6.104537401306838
deviation-heading_min	6.104537401306838
distance-from-start_max	1.8981578850510965
distance-from-start_mean	1.8981578850510965
distance-from-start_median	1.8981578850510965
distance-from-start_min	1.8981578850510965
driven_any_max	2.570274757812155
driven_any_mean	2.570274757812155
driven_any_median	2.570274757812155
driven_any_min	2.570274757812155
driven_lanedir_consec_max	2.0897684386160416
driven_lanedir_consec_mean	2.0897684386160416
driven_lanedir_consec_min	2.0897684386160416
driven_lanedir_max	2.089846793946503
driven_lanedir_mean	2.089846793946503
driven_lanedir_median	2.089846793946503
driven_lanedir_min	2.089846793946503
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	2.2000000000000313
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"udem1-000-ego0": {"driven_any": 2.570274757812155, "survival_time": 20.500000000000156, "driven_lanedir": 2.089846793946503, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 6.104537401306838, "distance-from-start": 1.8981578850510965, "deviation-center-line": 1.3047274998686136, "driven_lanedir_consec": 2.0897684386160416}}
simulation-passed	1
survival_time_max	20.500000000000156
survival_time_mean	20.500000000000156
survival_time_min	20.500000000000156

No reset possible

368

94

Bea Baselines 🐤

baseline-duckietown

aido-LF-sim-testing

sim-0of4

host-error

2021-10-18 22:18:10+00:00

2021-10-18 22:28:40+00:00

0:10:30

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

360

96

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

host-error

2021-10-18 22:13:54+00:00

2021-10-18 22:17:59+00:00

0:04:05

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

354

96

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

host-error

2021-10-18 22:09:22+00:00

2021-10-18 22:13:47+00:00

0:04:25

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

348

97

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

host-error

aido-LFV-sim-validation

2021-10-18 22:06:31+00:00

2021-10-18 22:08:56+00:00

0:02:25

Error while running [...]

Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, nogpu-staging-spot-0-03-job348-711535, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'nogpu-staging-spot-0-03-job348-711535', 'up', '-d']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

343

98

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

host-error

2021-10-18 21:58:38+00:00

2021-10-18 22:06:25+00:00

0:07:47

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

333

102

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

host-error

2021-10-18 21:51:52+00:00

2021-10-18 21:58:18+00:00

0:06:26

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

321

102

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

host-error

aido-LFV_multi-sim-testing

2021-10-18 21:46:47+00:00

2021-10-18 21:51:34+00:00

0:04:47

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

308

103

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

host-error

2021-10-18 21:37:17+00:00

2021-10-18 21:46:39+00:00

0:09:22

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

282

110

Bea Baselines 🐤

baseline-duckietown-ml

sim-0of4

aborted

2021-10-18 21:14:34+00:00

2021-10-18 21:36:58+00:00

0:22:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 391, in main
    stats = future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 426, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

272

110

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

host-error

aido-LFV_multi-full-sim-validation

2021-10-18 21:01:47+00:00

2021-10-18 21:14:27+00:00

0:12:40

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

247

36

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFV_multi-full-sim-validation

2021-10-18 20:32:45+00:00

2021-10-18 21:01:35+00:00

0:28:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.4749999999999552
driven_lanedir_consec_median	3.400282227461908
deviation-center-line_median	5.992377953630342

other stats

deviation-center-line_max	7.516029088900669
deviation-center-line_mean	6.078065419930993
deviation-center-line_min	4.811476683562619
deviation-heading_max	12.168685201255956
deviation-heading_mean	6.880886778230808
deviation-heading_median	6.217393990233782
deviation-heading_min	2.920073931199713
distance-from-start_max	3.0901348304289247
distance-from-start_mean	2.5082472338122037
distance-from-start_median	2.7478842626588915
distance-from-start_min	1.447085579502107
driven_any_max	3.5495824572427344
driven_any_mean	3.5349643358858884
driven_any_median	3.53534561744178
driven_any_min	3.5195836514172605
driven_lanedir_consec_max	3.485653904322924
driven_lanedir_consec_mean	3.092322036266292
driven_lanedir_consec_min	2.083069785818427
driven_lanedir_max	3.485653904322924
driven_lanedir_mean	3.4096808029121046
driven_lanedir_median	3.400282227461908
driven_lanedir_min	3.3525048524016774
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	1.4874999999999703
in-drivable-lane_min	0.9999999999999432
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.5465963269625824, "survival_time": 59.99999999999873, "driven_lanedir": 3.485653904322924, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.920073931199713, "distance-from-start": 2.876631299535302, "deviation-center-line": 7.516029088900669, "driven_lanedir_consec": 3.485653904322924}, "autolab-000-ego1": {"driven_any": 3.5240949079209773, "survival_time": 59.99999999999873, "driven_lanedir": 3.4260604158492907, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.516330158155915, "distance-from-start": 2.619137225782481, "deviation-center-line": 6.510873598064545, "driven_lanedir_consec": 3.4260604158492907}, "autolab-000-ego2": {"driven_any": 3.5495824572427344, "survival_time": 59.99999999999873, "driven_lanedir": 3.374504039074526, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 12.168685201255956, "distance-from-start": 3.0901348304289247, "deviation-center-line": 4.811476683562619, "driven_lanedir_consec": 3.374504039074526}, "autolab-000-ego3": {"driven_any": 3.5195836514172605, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524016774, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311648, "distance-from-start": 1.447085579502107, "deviation-center-line": 5.4738823091961395, "driven_lanedir_consec": 2.083069785818427}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

245

36

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

aido-LFVI_multi-state-sim-testing

2021-10-18 20:15:40+00:00

2021-10-18 20:32:12+00:00

0:16:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.1249999999999662
driven_lanedir_consec_median	1.445650352045355
deviation-center-line_median	5.216571406037255

other stats

deviation-center-line_max	5.528679809125455
deviation-center-line_mean	5.216571406037255
deviation-center-line_min	4.904463002949055
deviation-heading_max	8.487354063916149
deviation-heading_mean	8.116239531135022
deviation-heading_median	8.116239531135022
deviation-heading_min	7.745124998353894
distance-from-start_max	1.242743835742773
distance-from-start_mean	1.2243627584318866
distance-from-start_median	1.2243627584318866
distance-from-start_min	1.2059816811210002
driven_any_max	3.4865832572710853
driven_any_mean	3.485833636753865
driven_any_median	3.485833636753865
driven_any_min	3.4850840162366454
driven_lanedir_consec_max	1.4708900970780947
driven_lanedir_consec_mean	1.445650352045355
driven_lanedir_consec_min	1.4204106070126152
driven_lanedir_max	3.2904966312136006
driven_lanedir_mean	3.2881487036156885
driven_lanedir_median	3.2881487036156885
driven_lanedir_min	3.2858007760177763
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1249999999999662
in-drivable-lane_min	3.099999999999966
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4850840162366454, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904966312136006, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124998353894, "distance-from-start": 1.2059816811210002, "deviation-center-line": 4.904463002949055, "driven_lanedir_consec": 1.4204106070126152}, "loop2-000-ego1": {"driven_any": 3.4865832572710853, "survival_time": 59.99999999999873, "driven_lanedir": 3.2858007760177763, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.487354063916149, "distance-from-start": 1.242743835742773, "deviation-center-line": 5.528679809125455, "driven_lanedir_consec": 1.4708900970780947}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

243

37

Bea Baselines 🐤

minimal-agent-state

sim-2of4

failed

aido-LFVI_multi-full-sim-validation

2021-10-18 20:14:00+00:00

2021-10-18 20:15:14+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

240

38

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LFV_multi-state-sim-testing

2021-10-18 20:12:19+00:00

2021-10-18 20:13:35+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

236

39

Bea Baselines 🐤

minimal-agent-state

sim-2of4

failed

aido-LF-full-sim-validation

2021-10-18 20:10:28+00:00

2021-10-18 20:11:46+00:00

0:01:18

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

224

40

Bea Baselines 🐤

minimal-agent-full

sim-1of4

success

aido-LFP-state-sim-testing

2021-10-18 20:00:04+00:00

2021-10-18 20:10:09+00:00

0:10:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.249999999999972
driven_lanedir_consec_median	1.5873308651520088
deviation-center-line_median	5.442861880459055

other stats

deviation-center-line_max	5.442861880459055
deviation-center-line_mean	5.442861880459055
deviation-center-line_min	5.442861880459055
deviation-heading_max	11.057314601935024
deviation-heading_mean	11.057314601935024
deviation-heading_median	11.057314601935024
deviation-heading_min	11.057314601935024
distance-from-start_max	1.5192445510405312
distance-from-start_mean	1.5192445510405312
distance-from-start_median	1.5192445510405312
distance-from-start_min	1.5192445510405312
driven_any_max	3.452076592019545
driven_any_mean	3.452076592019545
driven_any_median	3.452076592019545
driven_any_min	3.452076592019545
driven_lanedir_consec_max	1.5873308651520088
driven_lanedir_consec_mean	1.5873308651520088
driven_lanedir_consec_min	1.5873308651520088
driven_lanedir_max	3.163921596586153
driven_lanedir_mean	3.163921596586153
driven_lanedir_median	3.163921596586153
driven_lanedir_min	3.163921596586153
in-drivable-lane_max	4.249999999999972
in-drivable-lane_mean	4.249999999999972
in-drivable-lane_min	4.249999999999972
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.452076592019545, "survival_time": 59.99999999999873, "driven_lanedir": 3.163921596586153, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935024, "distance-from-start": 1.5192445510405312, "deviation-center-line": 5.442861880459055, "driven_lanedir_consec": 1.5873308651520088}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

222

41

Bea Baselines 🐤

minimal-agent-state

sim-0of4

failed

aido-LFP-state-sim-testing

2021-10-18 19:58:44+00:00

2021-10-18 19:59:51+00:00

0:01:07

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

220

41

Bea Baselines 🐤

minimal-agent-state

sim-3of4

failed

aido-LFVI_multi-full-sim-testing

2021-10-18 19:57:29+00:00

2021-10-18 19:58:37+00:00

0:01:08

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

215

44

Bea Baselines 🐤

minimal-agent-full

sim-1of4

aborted

aido-LFVI_multi-full-sim-testing

2021-10-18 19:17:29+00:00

2021-10-18 19:57:04+00:00

0:39:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.1334721667639585
deviation-center-line_median	3.569274924533687

other stats

deviation-center-line_max	5.185171597412875
deviation-center-line_mean	3.7385983911606098
deviation-center-line_min	2.6306721181621873
deviation-heading_max	8.123909110819053
deviation-heading_mean	4.904445209077836
deviation-heading_median	3.9916054097825047
deviation-heading_min	3.510660905927283
distance-from-start_max	2.230934169509707
distance-from-start_mean	1.8422550062159049
distance-from-start_median	1.8376278078831336
distance-from-start_min	1.4628302395876456
driven_any_max	3.579587679138321
driven_any_mean	3.4082112386525103
driven_any_median	3.559331275339624
driven_any_min	2.934594724792472
driven_lanedir_consec_max	3.428808564589757
driven_lanedir_consec_mean	2.8688896273436635
driven_lanedir_consec_min	1.7798056112569802
driven_lanedir_max	3.561567679231309
driven_lanedir_mean	3.3515792832444156
driven_lanedir_median	3.4674200528695724
driven_lanedir_min	2.909909348007206
in-drivable-lane_max	1.3499999999999446
in-drivable-lane_mean	0.33749999999998614
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 2.934594724792472, "survival_time": 59.99999999999873, "driven_lanedir": 2.909909348007206, "in-drivable-lane": 0.0, "deviation-heading": 4.334701504286535, "distance-from-start": 1.573887683474244, "deviation-center-line": 5.185171597412875, "driven_lanedir_consec": 2.9029908891361216}, "udem-000-ego1": {"driven_any": 3.5390793760821095, "survival_time": 59.99999999999873, "driven_lanedir": 3.377246789156549, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 8.123909110819053, "distance-from-start": 1.4628302395876456, "deviation-center-line": 4.149660505041332, "driven_lanedir_consec": 1.7798056112569802}, "udem-000-ego2": {"driven_any": 3.579587679138321, "survival_time": 59.99999999999873, "driven_lanedir": 3.561567679231309, "in-drivable-lane": 0.0, "deviation-heading": 3.510660905927283, "distance-from-start": 2.230934169509707, "deviation-center-line": 2.6306721181621873, "driven_lanedir_consec": 3.428808564589757}, "udem-000-ego3": {"driven_any": 3.5795831745971385, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575933165825964, "in-drivable-lane": 0.0, "deviation-heading": 3.6485093152784738, "distance-from-start": 2.1013679322920233, "deviation-center-line": 2.988889344026042, "driven_lanedir_consec": 3.363953444391796}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

203

44

Bea Baselines 🐤

minimal-agent-full

sim-0of4

aborted

aido-LFVI_multi-state-sim-validation

2021-10-18 18:42:30+00:00

2021-10-18 19:17:22+00:00

0:34:52

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

195

47

Bea Baselines 🐤

baseline-simple-yield

sim-3of4

success

aido-LFVI_multi-state-sim-validation

2021-10-18 18:17:25+00:00

2021-10-18 18:41:53+00:00

0:24:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.539086702597831
deviation-center-line_median	0.3170392178109599

other stats

deviation-center-line_max	0.3899117485217711
deviation-center-line_mean	0.29740424453053
deviation-center-line_min	0.16562679397842903
deviation-heading_max	9.11325909487286
deviation-heading_mean	4.411246447400228
deviation-heading_median	3.5034740473105317
deviation-heading_min	1.5247786001069907
distance-from-start_max	3.2933823005468854
distance-from-start_mean	2.6710410334097863
distance-from-start_median	2.7757414307963546
distance-from-start_min	1.83929897149955
driven_any_max	5.6996262006241185
driven_any_mean	4.508918806888538
driven_any_median	4.897238892219033
driven_any_min	2.5415712424919663
driven_lanedir_consec_max	5.691228830865954
driven_lanedir_consec_mean	4.326845583475548
driven_lanedir_consec_min	2.537980097840577
driven_lanedir_max	5.691228830865954
driven_lanedir_mean	4.501451970861119
driven_lanedir_median	4.888299477368972
driven_lanedir_min	2.537980097840577
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 5.478961981453553, "survival_time": 59.99999999999873, "driven_lanedir": 5.4712852794124185, "in-drivable-lane": 0.0, "deviation-heading": 1.5247786001069907, "distance-from-start": 3.2933823005468854, "deviation-center-line": 0.16562679397842903, "driven_lanedir_consec": 5.178377659735297}, "udem-000-ego1": {"driven_any": 4.315515802984512, "survival_time": 59.99999999999873, "driven_lanedir": 4.305313675325525, "in-drivable-lane": 0.0, "deviation-heading": 4.753058465917148, "distance-from-start": 3.1123243861256507, "deviation-center-line": 0.3899117485217711, "driven_lanedir_consec": 3.8997957454603647}, "udem-000-ego2": {"driven_any": 5.6996262006241185, "survival_time": 59.99999999999873, "driven_lanedir": 5.691228830865954, "in-drivable-lane": 0.0, "deviation-heading": 2.2538896287039156, "distance-from-start": 2.4391584754670586, "deviation-center-line": 0.2578364154958317, "driven_lanedir_consec": 5.691228830865954}, "udem-000-ego3": {"driven_any": 2.5415712424919663, "survival_time": 59.99999999999873, "driven_lanedir": 2.537980097840577, "in-drivable-lane": 0.0, "deviation-heading": 9.11325909487286, "distance-from-start": 1.83929897149955, "deviation-center-line": 0.3762420201260881, "driven_lanedir_consec": 2.537980097840577}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

189

47

Bea Baselines 🐤

baseline-simple-yield

sim-2of4

success

aido-LFP-state-sim-validation

2021-10-18 17:52:50+00:00

2021-10-18 18:16:59+00:00

0:24:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.22252310221451532
deviation-center-line_median	1.3983085657418166

other stats

deviation-center-line_max	3.450684914636027
deviation-center-line_mean	1.5800993018674458
deviation-center-line_min	0.0730951613501236
deviation-heading_max	26.9052448670844
deviation-heading_mean	14.17749073368442
deviation-heading_median	14.37526621418224
deviation-heading_min	1.0541856392887945
distance-from-start_max	1.5511179555303405
distance-from-start_mean	0.49905934166065113
distance-from-start_median	0.22255970555613208
distance-from-start_min	3.4694469519536136e-17
driven_any_max	3.436990780968862
driven_any_mean	0.9713227955479988
driven_any_median	0.22415020061154617
driven_any_min	4.1633363423443377e-14
driven_lanedir_consec_max	2.724100559317032
driven_lanedir_consec_mean	0.7922866909365157
driven_lanedir_consec_min	0.0
driven_lanedir_max	3.43445877795716
driven_lanedir_mean	0.9698762455965476
driven_lanedir_median	0.22252310221451532
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 3.436990780968862, "survival_time": 59.99999999999873, "driven_lanedir": 3.43445877795716, "in-drivable-lane": 0.0, "deviation-heading": 1.0541856392887945, "distance-from-start": 1.5511179555303405, "deviation-center-line": 0.11393481028888136, "driven_lanedir_consec": 2.724100559317032}, "udem-001-ego1": {"driven_any": 0.44830040122255527, "survival_time": 59.99999999999873, "driven_lanedir": 0.44504620442903065, "in-drivable-lane": 0.0, "deviation-heading": 1.908090576843721, "distance-from-start": 0.4451194111122637, "deviation-center-line": 0.0730951613501236, "driven_lanedir_consec": 0.44504620442903065}, "udem-001-ego2": {"driven_any": 4.1633363423443377e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.842441851520757, "distance-from-start": 3.4694469519536136e-17, "deviation-center-line": 2.682682321194752, "driven_lanedir_consec": 0.0}, "udem-001-ego3": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 3.450684914636027, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

180

49

Bea Baselines 🐤

baseline-simple-yield

sim-2of4

success

aido-LF-state-sim-testing

2021-10-18 17:48:15+00:00

2021-10-18 17:52:06+00:00

0:03:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	16.200000000000095
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.5452151798918583
deviation-center-line_median	0.1733700898404126

other stats

deviation-center-line_max	0.1733700898404126
deviation-center-line_mean	0.1733700898404126
deviation-center-line_min	0.1733700898404126
deviation-heading_max	1.4757207002415371
deviation-heading_mean	1.4757207002415371
deviation-heading_median	1.4757207002415371
deviation-heading_min	1.4757207002415371
distance-from-start_max	1.0690652544139576
distance-from-start_mean	1.0690652544139576
distance-from-start_median	1.0690652544139576
distance-from-start_min	1.0690652544139576
driven_any_max	1.5557696325100094
driven_any_mean	1.5557696325100094
driven_any_median	1.5557696325100094
driven_any_min	1.5557696325100094
driven_lanedir_consec_max	1.5452151798918583
driven_lanedir_consec_mean	1.5452151798918583
driven_lanedir_consec_min	1.5452151798918583
driven_lanedir_max	1.5452151798918583
driven_lanedir_mean	1.5452151798918583
driven_lanedir_median	1.5452151798918583
driven_lanedir_min	1.5452151798918583
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.5557696325100094, "survival_time": 16.200000000000095, "driven_lanedir": 1.5452151798918583, "in-drivable-lane": 0.0, "deviation-heading": 1.4757207002415371, "distance-from-start": 1.0690652544139576, "deviation-center-line": 0.1733700898404126, "driven_lanedir_consec": 1.5452151798918583}}
simulation-passed	1
survival_time_max	16.200000000000095
survival_time_mean	16.200000000000095
survival_time_min	16.200000000000095

No reset possible

176

50

Bea Baselines 🐤

baseline-simple-yield

sim-0of4

success

2021-10-18 17:39:34+00:00

2021-10-18 17:47:43+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065102356188296

other stats

deviation-center-line_max	0.4065102356188296
deviation-center-line_mean	0.4065102356188296
deviation-center-line_min	0.4065102356188296
deviation-heading_max	40.967332753486225
deviation-heading_mean	40.967332753486225
deviation-heading_median	40.967332753486225
deviation-heading_min	40.967332753486225
distance-from-start_max	8.326672684688674e-17
distance-from-start_mean	8.326672684688674e-17
distance-from-start_median	8.326672684688674e-17
distance-from-start_min	8.326672684688674e-17
driven_any_max	9.992007221626409e-14
driven_any_mean	9.992007221626409e-14
driven_any_median	9.992007221626409e-14
driven_any_min	9.992007221626409e-14
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 9.992007221626409e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 8.326672684688674e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

162

22

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2021-10-18 17:32:59+00:00

2021-10-18 17:39:08+00:00

0:06:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	12.850000000000048
in-drivable-lane_median	9.600000000000051
driven_lanedir_consec_median	0.395970381094496
deviation-center-line_median	0.2727382860816282

other stats

deviation-center-line_max	0.3711793675074801
deviation-center-line_mean	0.2630700617569692
deviation-center-line_min	0.13562430735714032
deviation-heading_max	2.53835057480462
deviation-heading_mean	1.5839275146723817
deviation-heading_median	1.5305477977075066
deviation-heading_min	0.7362638884698938
distance-from-start_max	1.9486947141078033
distance-from-start_mean	1.6104892935754336
distance-from-start_median	1.6878960391209077
distance-from-start_min	1.117470381952116
driven_any_max	1.9488515657780825
driven_any_mean	1.6105973523255648
driven_any_median	1.688005904379683
driven_any_min	1.117526034764811
driven_lanedir_consec_max	0.6388965134503053
driven_lanedir_consec_mean	0.3976334018683761
driven_lanedir_consec_min	0.15969633183420706
driven_lanedir_max	0.6388965134503053
driven_lanedir_mean	0.3976334018683761
driven_lanedir_median	0.395970381094496
driven_lanedir_min	0.15969633183420706
in-drivable-lane_max	11.400000000000048
in-drivable-lane_mean	9.612500000000054
in-drivable-lane_min	7.850000000000057
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.9488515657780825, "survival_time": 12.850000000000048, "driven_lanedir": 0.3312247708304017, "in-drivable-lane": 9.550000000000052, "deviation-heading": 2.53835057480462, "distance-from-start": 1.9486947141078033, "deviation-center-line": 0.26973515872126524, "driven_lanedir_consec": 0.3312247708304017}, "autolab-000-ego1": {"driven_any": 1.117526034764811, "survival_time": 12.850000000000048, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 11.400000000000048, "deviation-heading": 0.7478094709473371, "distance-from-start": 1.117470381952116, "deviation-center-line": 0.13562430735714032, "driven_lanedir_consec": 0.15969633183420706}, "autolab-000-ego2": {"driven_any": 1.69215427635685, "survival_time": 12.850000000000048, "driven_lanedir": 0.6388965134503053, "in-drivable-lane": 7.850000000000057, "deviation-heading": 2.313286124467676, "distance-from-start": 1.6920444051025798, "deviation-center-line": 0.3711793675074801, "driven_lanedir_consec": 0.6388965134503053}, "autolab-000-ego3": {"driven_any": 1.6838575324025156, "survival_time": 12.850000000000048, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 9.650000000000052, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed	1
survival_time_max	12.850000000000048
survival_time_mean	12.850000000000048
survival_time_min	12.850000000000048

No reset possible

155

23

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2021-10-18 17:31:00+00:00

2021-10-18 17:32:47+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.449999999999985
in-drivable-lane_median	4.699999999999984
driven_lanedir_consec_median	0.19954528207596137
deviation-center-line_median	0.1256753841612151

other stats

deviation-center-line_max	0.1256753841612151
deviation-center-line_mean	0.1256753841612151
deviation-center-line_min	0.1256753841612151
deviation-heading_max	0.9488219555580462
deviation-heading_mean	0.9488219555580462
deviation-heading_median	0.9488219555580462
deviation-heading_min	0.9488219555580462
distance-from-start_max	0.8933842387456832
distance-from-start_mean	0.8933842387456832
distance-from-start_median	0.8933842387456832
distance-from-start_min	0.8933842387456832
driven_any_max	0.8934060045503949
driven_any_mean	0.8934060045503949
driven_any_median	0.8934060045503949
driven_any_min	0.8934060045503949
driven_lanedir_consec_max	0.19954528207596137
driven_lanedir_consec_mean	0.19954528207596137
driven_lanedir_consec_min	0.19954528207596137
driven_lanedir_max	0.19954528207596137
driven_lanedir_mean	0.19954528207596137
driven_lanedir_median	0.19954528207596137
driven_lanedir_min	0.19954528207596137
in-drivable-lane_max	4.699999999999984
in-drivable-lane_mean	4.699999999999984
in-drivable-lane_min	4.699999999999984
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.8934060045503949, "survival_time": 6.449999999999985, "driven_lanedir": 0.19954528207596137, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.8933842387456832, "deviation-center-line": 0.1256753841612151, "driven_lanedir_consec": 0.19954528207596137}}
simulation-passed	1
survival_time_max	6.449999999999985
survival_time_mean	6.449999999999985
survival_time_min	6.449999999999985

No reset possible

136

29

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2021-10-18 17:24:23+00:00

2021-10-18 17:30:29+00:00

0:06:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.85000000000002
in-drivable-lane_median	8.475000000000021
driven_lanedir_consec_median	0.2593084475741141
deviation-center-line_median	0.24034409785662963

other stats

deviation-center-line_max	1.082984557473667
deviation-center-line_mean	0.41787777662949666
deviation-center-line_min	0.1078383533310603
deviation-heading_max	2.339188809527298
deviation-heading_mean	1.212353106209787
deviation-heading_median	0.968293148577988
deviation-heading_min	0.5736373181558745
distance-from-start_max	1.6182798682575184
distance-from-start_mean	1.2278394198954643
distance-from-start_median	1.2281617924849129
distance-from-start_min	0.8367542263545129
driven_any_max	1.618389277101384
driven_any_mean	1.2279094330504043
driven_any_median	1.2282388605737438
driven_any_min	0.8367707339527459
driven_lanedir_consec_max	0.6611857977727704
driven_lanedir_consec_mean	0.32911687445930876
driven_lanedir_consec_min	0.13666480491623645
driven_lanedir_max	0.9897803868677432
driven_lanedir_mean	0.411265521733052
driven_lanedir_median	0.2593084475741141
driven_lanedir_min	0.13666480491623645
in-drivable-lane_max	9.45000000000002
in-drivable-lane_mean	6.600000000000016
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.618389277101384, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}, "udem-000-ego1": {"driven_any": 0.8367707339527459, "survival_time": 10.85000000000002, "driven_lanedir": 0.2375805938595854, "in-drivable-lane": 9.000000000000018, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.8367542263545129, "deviation-center-line": 0.203209370672121, "driven_lanedir_consec": 0.2375805938595854}, "udem-000-ego2": {"driven_any": 0.9932647664055628, "survival_time": 10.85000000000002, "driven_lanedir": 0.9897803868677432, "in-drivable-lane": 0.0, "deviation-heading": 0.9857814543210373, "distance-from-start": 0.9932177858395714, "deviation-center-line": 1.082984557473667, "driven_lanedir_consec": 0.6611857977727704}, "udem-000-ego3": {"driven_any": 1.4632129547419246, "survival_time": 10.85000000000002, "driven_lanedir": 0.28103630128864276, "in-drivable-lane": 7.950000000000025, "deviation-heading": 2.339188809527298, "distance-from-start": 1.463105799130254, "deviation-center-line": 0.2774788250411383, "driven_lanedir_consec": 0.28103630128864276}}
simulation-passed	1
survival_time_max	10.85000000000002
survival_time_mean	10.85000000000002
survival_time_min	10.85000000000002

No reset possible

50

1

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:55:20+00:00

2021-10-17 16:55:24+00:00

0:00:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49

1

Bea Baselines 🐤

template-random

sim-2of4

host-error

2021-10-17 16:54:39+00:00

2021-10-17 16:55:06+00:00

0:00:27

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48

2

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:54:24+00:00

2021-10-17 16:54:27+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47

2

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:54:07+00:00

2021-10-17 16:54:10+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

46

2

Bea Baselines 🐤

template-random

sim-3of4

host-error

2021-10-17 16:53:51+00:00

2021-10-17 16:53:53+00:00

0:00:02

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

45

2

Bea Baselines 🐤

template-random

sim-2of4

host-error

2021-10-17 16:53:29+00:00

2021-10-17 16:53:32+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44

2

Bea Baselines 🐤

template-random

sim-1of4

host-error

2021-10-17 16:53:14+00:00

2021-10-17 16:53:17+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43

3

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:52:16+00:00

2021-10-17 16:53:01+00:00

0:00:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5

4

Bea Baselines 🐤

template-random

sim-3of4

success