Evaluator 4

2021-10-18 23:36:10+00:00

2021-10-18 23:41:01+00:00

0:04:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	6.8999999999999835
in-drivable-lane_median	5.599999999999983
driven_lanedir_consec_median	0.2310079446878663
deviation-center-line_median	0.08630516837985633

other stats

deviation-center-line_max	0.08630516837985633
deviation-center-line_mean	0.08630516837985633
deviation-center-line_min	0.08630516837985633
deviation-heading_max	0.6566177141968366
deviation-heading_mean	0.6566177141968366
deviation-heading_median	0.6566177141968366
deviation-heading_min	0.6566177141968366
distance-from-start_max	1.6635399318115662
distance-from-start_mean	1.6635399318115662
distance-from-start_median	1.6635399318115662
distance-from-start_min	1.6635399318115662
driven_any_max	1.8232529558354793
driven_any_mean	1.8232529558354793
driven_any_median	1.8232529558354793
driven_any_min	1.8232529558354793
driven_lanedir_consec_max	0.2310079446878663
driven_lanedir_consec_mean	0.2310079446878663
driven_lanedir_consec_min	0.2310079446878663
driven_lanedir_max	0.2310079446878663
driven_lanedir_mean	0.2310079446878663
driven_lanedir_median	0.2310079446878663
driven_lanedir_min	0.2310079446878663
in-drivable-lane_max	5.599999999999983
in-drivable-lane_mean	5.599999999999983
in-drivable-lane_min	5.599999999999983
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.8232529558354793, "survival_time": 6.8999999999999835, "driven_lanedir": 0.2310079446878663, "in-drivable-lane": 5.599999999999983, "deviation-heading": 0.6566177141968366, "distance-from-start": 1.6635399318115662, "deviation-center-line": 0.08630516837985633, "driven_lanedir_consec": 0.2310079446878663}}
simulation-passed	1
survival_time_max	6.8999999999999835
survival_time_mean	6.8999999999999835
survival_time_min	6.8999999999999835

No reset possible

509

73

Bea Baselines 🐤

template-ros

sim-2of4

success

aido-LFV_multi-sim-validation

2021-10-18 23:33:54+00:00

2021-10-18 23:36:03+00:00

0:02:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.21181296542506933
survival_time_median	5.949999999999987
deviation-center-line_median	0.09570964900654218
in-drivable-lane_median	4.649999999999986

other stats

deviation-center-line_max	0.09570964900654218
deviation-center-line_mean	0.09570964900654218
deviation-center-line_min	0.09570964900654218
deviation-heading_max	0.68970816534482
deviation-heading_mean	0.68970816534482
deviation-heading_median	0.68970816534482
deviation-heading_min	0.68970816534482
distance-from-start_max	1.3189727582689852
distance-from-start_mean	1.3189727582689852
distance-from-start_median	1.3189727582689852
distance-from-start_min	1.3189727582689852
driven_any_max	1.385412721586725
driven_any_mean	1.385412721586725
driven_any_median	1.385412721586725
driven_any_min	1.385412721586725
driven_lanedir_consec_max	0.21181296542506933
driven_lanedir_consec_mean	0.21181296542506933
driven_lanedir_consec_min	0.21181296542506933
driven_lanedir_max	0.21181296542506933
driven_lanedir_mean	0.21181296542506933
driven_lanedir_median	0.21181296542506933
driven_lanedir_min	0.21181296542506933
in-drivable-lane_max	4.649999999999986
in-drivable-lane_mean	4.649999999999986
in-drivable-lane_min	4.649999999999986
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.385412721586725, "survival_time": 5.949999999999987, "driven_lanedir": 0.21181296542506933, "in-drivable-lane": 4.649999999999986, "deviation-heading": 0.68970816534482, "distance-from-start": 1.3189727582689852, "deviation-center-line": 0.09570964900654218, "driven_lanedir_consec": 0.21181296542506933}}
simulation-passed	1
survival_time_max	5.949999999999987
survival_time_mean	5.949999999999987
survival_time_min	5.949999999999987

No reset possible

487

82

Bea Baselines 🐤

baseline-duckietown

sim-2of4

host-error

2021-10-18 23:27:30+00:00

2021-10-18 23:33:47+00:00

0:06:17

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

475

80

Bea Baselines 🐤

template-ros

sim-2of4

success

2021-10-18 23:22:57+00:00

2021-10-18 23:27:16+00:00

0:04:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.26847966922516475
survival_time_median	14.700000000000074
deviation-center-line_median	0.15038903249614052
in-drivable-lane_median	12.850000000000058

other stats

deviation-center-line_max	0.15038903249614052
deviation-center-line_mean	0.15038903249614052
deviation-center-line_min	0.15038903249614052
deviation-heading_max	1.5976603238596176
deviation-heading_mean	1.5976603238596176
deviation-heading_median	1.5976603238596176
deviation-heading_min	1.5976603238596176
distance-from-start_max	4.049251574832633
distance-from-start_mean	4.049251574832633
distance-from-start_median	4.049251574832633
distance-from-start_min	4.049251574832633
driven_any_max	4.1459302089427625
driven_any_mean	4.1459302089427625
driven_any_median	4.1459302089427625
driven_any_min	4.1459302089427625
driven_lanedir_consec_max	0.26847966922516475
driven_lanedir_consec_mean	0.26847966922516475
driven_lanedir_consec_min	0.26847966922516475
driven_lanedir_max	0.26847966922516475
driven_lanedir_mean	0.26847966922516475
driven_lanedir_median	0.26847966922516475
driven_lanedir_min	0.26847966922516475
in-drivable-lane_max	12.850000000000058
in-drivable-lane_mean	12.850000000000058
in-drivable-lane_min	12.850000000000058
per-episodes	details {"autolab-000-ego0": {"driven_any": 4.1459302089427625, "survival_time": 14.700000000000074, "driven_lanedir": 0.26847966922516475, "in-drivable-lane": 12.850000000000058, "deviation-heading": 1.5976603238596176, "distance-from-start": 4.049251574832633, "deviation-center-line": 0.15038903249614052, "driven_lanedir_consec": 0.26847966922516475}}
simulation-passed	1
survival_time_max	14.700000000000074
survival_time_mean	14.700000000000074
survival_time_min	14.700000000000074

No reset possible

466

79

Bea Baselines 🐤

template-ros

sim-1of4

success

2021-10-18 23:19:31+00:00

2021-10-18 23:22:44+00:00

0:03:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	2.549999999999999
in-drivable-lane_median	1.6999999999999988
driven_lanedir_consec_median	0.12253814810230113
deviation-center-line_median	0.053494469225655254

other stats

deviation-center-line_max	0.053494469225655254
deviation-center-line_mean	0.053494469225655254
deviation-center-line_min	0.053494469225655254
deviation-heading_max	0.6050156834777366
deviation-heading_mean	0.6050156834777366
deviation-heading_median	0.6050156834777366
deviation-heading_min	0.6050156834777366
distance-from-start_max	0.4916086861525985
distance-from-start_mean	0.4916086861525985
distance-from-start_median	0.4916086861525985
distance-from-start_min	0.4916086861525985
driven_any_max	0.49356816650015056
driven_any_mean	0.49356816650015056
driven_any_median	0.49356816650015056
driven_any_min	0.49356816650015056
driven_lanedir_consec_max	0.12253814810230113
driven_lanedir_consec_mean	0.12253814810230113
driven_lanedir_consec_min	0.12253814810230113
driven_lanedir_max	0.12253814810230113
driven_lanedir_mean	0.12253814810230113
driven_lanedir_median	0.12253814810230113
driven_lanedir_min	0.12253814810230113
in-drivable-lane_max	1.6999999999999988
in-drivable-lane_mean	1.6999999999999988
in-drivable-lane_min	1.6999999999999988
per-episodes	details {"udem1-000-ego0": {"driven_any": 0.49356816650015056, "survival_time": 2.549999999999999, "driven_lanedir": 0.12253814810230113, "in-drivable-lane": 1.6999999999999988, "deviation-heading": 0.6050156834777366, "distance-from-start": 0.4916086861525985, "deviation-center-line": 0.053494469225655254, "driven_lanedir_consec": 0.12253814810230113}}
simulation-passed	1
survival_time_max	2.549999999999999
survival_time_mean	2.549999999999999
survival_time_min	2.549999999999999

No reset possible

460

80

Bea Baselines 🐤

template-ros

sim-0of4

success

aido-LFV_multi-sim-validation

2021-10-18 23:16:56+00:00

2021-10-18 23:19:01+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1808289087796493
survival_time_median	6.649999999999984
deviation-center-line_median	0.07375407293357045
in-drivable-lane_median	5.649999999999984

other stats

deviation-center-line_max	0.07375407293357045
deviation-center-line_mean	0.07375407293357045
deviation-center-line_min	0.07375407293357045
deviation-heading_max	0.5818746068781857
deviation-heading_mean	0.5818746068781857
deviation-heading_median	0.5818746068781857
deviation-heading_min	0.5818746068781857
distance-from-start_max	1.7019503079024314
distance-from-start_mean	1.7019503079024314
distance-from-start_median	1.7019503079024314
distance-from-start_min	1.7019503079024314
driven_any_max	1.7417787674521708
driven_any_mean	1.7417787674521708
driven_any_median	1.7417787674521708
driven_any_min	1.7417787674521708
driven_lanedir_consec_max	0.1808289087796493
driven_lanedir_consec_mean	0.1808289087796493
driven_lanedir_consec_min	0.1808289087796493
driven_lanedir_max	0.1808289087796493
driven_lanedir_mean	0.1808289087796493
driven_lanedir_median	0.1808289087796493
driven_lanedir_min	0.1808289087796493
in-drivable-lane_max	5.649999999999984
in-drivable-lane_mean	5.649999999999984
in-drivable-lane_min	5.649999999999984
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.7417787674521708, "survival_time": 6.649999999999984, "driven_lanedir": 0.1808289087796493, "in-drivable-lane": 5.649999999999984, "deviation-heading": 0.5818746068781857, "distance-from-start": 1.7019503079024314, "deviation-center-line": 0.07375407293357045, "driven_lanedir_consec": 0.1808289087796493}}
simulation-passed	1
survival_time_max	6.649999999999984
survival_time_mean	6.649999999999984
survival_time_min	6.649999999999984

No reset possible

446

82

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

2021-10-18 23:08:12+00:00

2021-10-18 23:16:38+00:00

0:08:26

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

428

88

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

aido-LFVI-sim-validation

2021-10-18 23:00:23+00:00

2021-10-18 23:08:05+00:00

0:07:42

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

427

85

Bea Baselines 🐤

baseline-duckietown

sim-1of4

host-error

2021-10-18 22:59:45+00:00

2021-10-18 23:00:13+00:00

0:00:28

Error while running [...]

Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

408

87

Bea Baselines 🐤

baseline-duckietown

sim-0of4

success

aido-LFV_multi-sim-testing

2021-10-18 22:47:10+00:00

2021-10-18 22:59:18+00:00

0:12:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.723411334798816
survival_time_median	59.99999999999873
deviation-center-line_median	5.520070814994054
in-drivable-lane_median	6.499999999999902

other stats

deviation-center-line_max	5.520070814994054
deviation-center-line_mean	5.520070814994054
deviation-center-line_min	5.520070814994054
deviation-heading_max	10.921669952917258
deviation-heading_mean	10.921669952917258
deviation-heading_median	10.921669952917258
deviation-heading_min	10.921669952917258
distance-from-start_max	1.0665793496436284
distance-from-start_mean	1.0665793496436284
distance-from-start_median	1.0665793496436284
distance-from-start_min	1.0665793496436284
driven_any_max	7.907559075251183
driven_any_mean	7.907559075251183
driven_any_median	7.907559075251183
driven_any_min	7.907559075251183
driven_lanedir_consec_max	6.723411334798816
driven_lanedir_consec_mean	6.723411334798816
driven_lanedir_consec_min	6.723411334798816
driven_lanedir_max	6.723411334798816
driven_lanedir_mean	6.723411334798816
driven_lanedir_median	6.723411334798816
driven_lanedir_min	6.723411334798816
in-drivable-lane_max	6.499999999999902
in-drivable-lane_mean	6.499999999999902
in-drivable-lane_min	6.499999999999902
per-episodes	details {"loop2-000-ego0": {"driven_any": 7.907559075251183, "survival_time": 59.99999999999873, "driven_lanedir": 6.723411334798816, "in-drivable-lane": 6.499999999999902, "deviation-heading": 10.921669952917258, "distance-from-start": 1.0665793496436284, "deviation-center-line": 5.520070814994054, "driven_lanedir_consec": 6.723411334798816}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

396

89

Bea Baselines 🐤

baseline-duckietown

sim-3of4

host-error

2021-10-18 22:40:23+00:00

2021-10-18 22:46:58+00:00

0:06:35

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

388

91

Bea Baselines 🐤

baseline-duckietown

aido-LFV-sim-testing

sim-0of4

host-error

2021-10-18 22:30:59+00:00

2021-10-18 22:40:01+00:00

0:09:02

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

380

92

Bea Baselines 🐤

baseline-duckietown

aido-LFVI-sim-testing

sim-2of4

success

2021-10-18 22:28:40+00:00

2021-10-18 22:30:27+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

375

93

Bea Baselines 🐤

baseline-duckietown

sim-3of4

host-error

2021-10-18 22:25:26+00:00

2021-10-18 22:28:28+00:00

0:03:02

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

372

93

Bea Baselines 🐤

baseline-duckietown

sim-2of4

success

2021-10-18 22:23:23+00:00

2021-10-18 22:24:59+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

357

97

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2021-10-18 22:13:38+00:00

2021-10-18 22:22:49+00:00

0:09:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.8948988630736971

other stats

deviation-center-line_max	0.8948988630736971
deviation-center-line_mean	0.8948988630736971
deviation-center-line_min	0.8948988630736971
deviation-heading_max	32.249113233675025
deviation-heading_mean	32.249113233675025
deviation-heading_median	32.249113233675025
deviation-heading_min	32.249113233675025
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

356

97

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

timeout

aido-LFV_multi-sim-testing

2021-10-18 22:09:29+00:00

2021-10-18 22:13:32+00:00

0:04:03

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

319

103

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

host-error

2021-10-18 21:46:28+00:00

2021-10-18 22:09:16+00:00

0:22:48

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

315

102

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

host-error

2021-10-18 21:44:10+00:00

2021-10-18 21:46:22+00:00

0:02:12

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

306

104

Bea Baselines 🐤

baseline-duckietown-ml

aido-LFP-sim-testing

sim-0of4

success

2021-10-18 21:36:02+00:00

2021-10-18 21:43:55+00:00

0:07:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065274986524565

other stats

deviation-center-line_max	0.4065274986524565
deviation-center-line_mean	0.4065274986524565
deviation-center-line_min	0.4065274986524565
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

295

107

Bea Baselines 🐤

baseline-duckietown-ml

sim-1of4

success

2021-10-18 21:26:36+00:00

2021-10-18 21:35:42+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	0.4065243130134252

other stats

deviation-center-line_max	0.4065243130134252
deviation-center-line_mean	0.4065243130134252
deviation-center-line_min	0.4065243130134252
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	0.0
distance-from-start_mean	0.0
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	0.0
driven_any_mean	0.0
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

291

107

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

2021-10-18 21:24:31+00:00

2021-10-18 21:26:15+00:00

0:01:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

284

109

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

2021-10-18 21:15:43+00:00

2021-10-18 21:24:18+00:00

0:08:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	0.40652749865251137
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.40652749865251137
deviation-center-line_mean	0.40652749865251137
deviation-center-line_min	0.40652749865251137
deviation-heading_max	40.967332753486254
deviation-heading_mean	40.967332753486254
deviation-heading_median	40.967332753486254
deviation-heading_min	40.967332753486254
distance-from-start_max	5.551115123125784e-16
distance-from-start_mean	5.551115123125784e-16
distance-from-start_median	5.551115123125784e-16
distance-from-start_min	5.551115123125784e-16
driven_any_max	6.661338147750939e-13
driven_any_mean	6.661338147750939e-13
driven_any_median	6.661338147750939e-13
driven_any_min	6.661338147750939e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 6.661338147750939e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125784e-16, "deviation-center-line": 0.40652749865251137, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

278

109

Bea Baselines 🐤

baseline-duckietown-ml

sim-2of4

success

aido-LFVI_multi-sim-testing

2021-10-18 21:06:17+00:00

2021-10-18 21:15:21+00:00

0:09:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	0.40651342125783446
in-drivable-lane_median	0.0

other stats

deviation-center-line_max	0.40651342125783446
deviation-center-line_mean	0.40651342125783446
deviation-center-line_min	0.40651342125783446
deviation-heading_max	40.967332753486225
deviation-heading_mean	40.967332753486225
deviation-heading_median	40.967332753486225
deviation-heading_min	40.967332753486225
distance-from-start_max	8.881784197001252e-16
distance-from-start_mean	8.881784197001252e-16
distance-from-start_median	8.881784197001252e-16
distance-from-start_min	8.881784197001252e-16
driven_any_max	1.0658141036401505e-12
driven_any_mean	1.0658141036401505e-12
driven_any_median	1.0658141036401505e-12
driven_any_min	1.0658141036401505e-12
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.0658141036401505e-12, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 8.881784197001252e-16, "deviation-center-line": 0.40651342125783446, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

273

110

Bea Baselines 🐤

baseline-duckietown-ml

sim-3of4

success

aido-LF-state-sim-validation

2021-10-18 21:01:47+00:00

2021-10-18 21:06:10+00:00

0:04:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

269

30

Bea Baselines 🐤

minimal-agent-state

sim-1of4

failed

aido-LFP-full-sim-validation

2021-10-18 21:00:38+00:00

2021-10-18 21:01:41+00:00

0:01:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

255

34

Bea Baselines 🐤

minimal-agent-full

sim-1of4

success

aido-LFP-full-sim-validation

2021-10-18 20:48:42+00:00

2021-10-18 21:00:07+00:00

0:11:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.249999999999972
driven_lanedir_consec_median	1.5873308651520088
deviation-center-line_median	5.442861880459055

other stats

deviation-center-line_max	5.442861880459055
deviation-center-line_mean	5.442861880459055
deviation-center-line_min	5.442861880459055
deviation-heading_max	11.057314601935024
deviation-heading_mean	11.057314601935024
deviation-heading_median	11.057314601935024
deviation-heading_min	11.057314601935024
distance-from-start_max	1.5192445510405312
distance-from-start_mean	1.5192445510405312
distance-from-start_median	1.5192445510405312
distance-from-start_min	1.5192445510405312
driven_any_max	3.452076592019545
driven_any_mean	3.452076592019545
driven_any_median	3.452076592019545
driven_any_min	3.452076592019545
driven_lanedir_consec_max	1.5873308651520088
driven_lanedir_consec_mean	1.5873308651520088
driven_lanedir_consec_min	1.5873308651520088
driven_lanedir_max	3.163921596586153
driven_lanedir_mean	3.163921596586153
driven_lanedir_median	3.163921596586153
driven_lanedir_min	3.163921596586153
in-drivable-lane_max	4.249999999999972
in-drivable-lane_mean	4.249999999999972
in-drivable-lane_min	4.249999999999972
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.452076592019545, "survival_time": 59.99999999999873, "driven_lanedir": 3.163921596586153, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314601935024, "distance-from-start": 1.5192445510405312, "deviation-center-line": 5.442861880459055, "driven_lanedir_consec": 1.5873308651520088}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

252

34

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LF-state-sim-testing

2021-10-18 20:43:52+00:00

2021-10-18 20:47:16+00:00

0:03:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.200000000000053
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.7222898911877365
deviation-center-line_median	0.6263425139703792

other stats

deviation-center-line_max	0.6263425139703792
deviation-center-line_mean	0.6263425139703792
deviation-center-line_min	0.6263425139703792
deviation-heading_max	1.4170853186472243
deviation-heading_mean	1.4170853186472243
deviation-heading_median	1.4170853186472243
deviation-heading_min	1.4170853186472243
distance-from-start_max	0.7201981002422111
distance-from-start_mean	0.7201981002422111
distance-from-start_median	0.7201981002422111
distance-from-start_min	0.7201981002422111
driven_any_max	0.7295990048299275
driven_any_mean	0.7295990048299275
driven_any_median	0.7295990048299275
driven_any_min	0.7295990048299275
driven_lanedir_consec_max	0.7222898911877365
driven_lanedir_consec_mean	0.7222898911877365
driven_lanedir_consec_min	0.7222898911877365
driven_lanedir_max	0.7222898911877365
driven_lanedir_mean	0.7222898911877365
driven_lanedir_median	0.7222898911877365
driven_lanedir_min	0.7222898911877365
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.7295990048299275, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877365, "in-drivable-lane": 0.0, "deviation-heading": 1.4170853186472243, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703792, "driven_lanedir_consec": 0.7222898911877365}}
simulation-passed	1
survival_time_max	13.200000000000053
survival_time_mean	13.200000000000053
survival_time_min	13.200000000000053

No reset possible

251

35

Bea Baselines 🐤

minimal-agent-state

sim-0of4

failed

aido-LF-state-sim-testing

2021-10-18 20:42:08+00:00

2021-10-18 20:43:18+00:00

0:01:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

249

35

Bea Baselines 🐤

minimal-agent-state

sim-2of4

failed

aido-LF-state-sim-testing

2021-10-18 20:40:33+00:00

2021-10-18 20:41:44+00:00

0:01:11

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

248

35

Bea Baselines 🐤

minimal-agent-state

sim-1of4

failed

aido-LFVI_multi-full-sim-validation

2021-10-18 20:37:32+00:00

2021-10-18 20:38:46+00:00

0:01:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│         k: observations
│        v1: DB20ObservationsPlusState
│        v2: DB20ObservationsOnlyState
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "camera"
│            │ |  of type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│            │ |  but <class 'aido_schemas.schemas.DB20ObservationsOnlyState'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│ p2_inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    aci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 129, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {seed: int, get_commands: GetCommands, observations: DB20ObservationsPlusState, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs: {observations: DB20ObservationsOnlyState, seed: int, get_commands: GetCommands, episode_start: EpisodeStart}
│     │ outputs: {commands: Duckiebot1Commands}
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 689, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 254, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

238

38

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

aido-LF-full-sim-validation

2021-10-18 20:11:22+00:00

2021-10-18 20:34:12+00:00

0:22:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	39.3499999999999
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.5095534275440208
deviation-center-line_median	2.410297264878746

other stats

deviation-center-line_max	3.46912911268962
deviation-center-line_mean	2.3011280909281555
deviation-center-line_min	0.9147887212655106
deviation-heading_max	5.65520162643443
deviation-heading_mean	4.272633805081291
deviation-heading_median	4.60755455297762
deviation-heading_min	2.2202244879354964
distance-from-start_max	1.2248575527849863
distance-from-start_mean	1.0826855214682094
distance-from-start_median	1.1264107889656856
distance-from-start_min	0.8530629551564797
driven_any_max	2.298586662486186
driven_any_mean	1.8875908572890323
driven_any_median	1.8260916837184844
driven_any_min	1.599593399232974
driven_lanedir_consec_max	2.0653121593240966
driven_lanedir_consec_mean	1.4646616945191229
driven_lanedir_consec_min	0.7742277636643535
driven_lanedir_max	2.28606052808724
driven_lanedir_mean	1.8405617146534288
driven_lanedir_median	1.7564369644765665
driven_lanedir_min	1.563312401573341
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	0.5000000000000071
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 2.298586662486186, "survival_time": 39.3499999999999, "driven_lanedir": 2.28606052808724, "in-drivable-lane": 0.0, "deviation-heading": 2.2202244879354964, "distance-from-start": 1.0650525775420805, "deviation-center-line": 0.9147887212655106, "driven_lanedir_consec": 2.0653121593240966}, "4way-000-ego1": {"driven_any": 1.599595506211618, "survival_time": 39.3499999999999, "driven_lanedir": 1.563312401573341, "in-drivable-lane": 0.0, "deviation-heading": 5.615416992272732, "distance-from-start": 1.187769000389291, "deviation-center-line": 2.829676513086965, "driven_lanedir_consec": 1.562604084440543}, "4way-000-ego2": {"driven_any": 1.599593399232974, "survival_time": 39.3499999999999, "driven_lanedir": 1.5922313902297849, "in-drivable-lane": 0.0, "deviation-heading": 3.599692113682508, "distance-from-start": 1.2248575527849863, "deviation-center-line": 1.9909180166705267, "driven_lanedir_consec": 1.4565027706474982}, "4way-000-ego3": {"driven_any": 2.0525878612253505, "survival_time": 39.3499999999999, "driven_lanedir": 1.9206425387233483, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.65520162643443, "distance-from-start": 0.8530629551564797, "deviation-center-line": 3.46912911268962, "driven_lanedir_consec": 0.7742277636643535}}
simulation-passed	1
survival_time_max	39.3499999999999
survival_time_mean	39.3499999999999
survival_time_min	39.3499999999999

No reset possible

228

40

Bea Baselines 🐤

minimal-agent-full

sim-3of4

success

aido-LF-full-sim-validation

2021-10-18 20:02:34+00:00

2021-10-18 20:11:04+00:00

0:08:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.099999999999902
driven_lanedir_consec_median	2.814994221639415
deviation-center-line_median	4.094985086570109

other stats

deviation-center-line_max	4.094985086570109
deviation-center-line_mean	4.094985086570109
deviation-center-line_min	4.094985086570109
deviation-heading_max	9.10432529887803
deviation-heading_mean	9.10432529887803
deviation-heading_median	9.10432529887803
deviation-heading_min	9.10432529887803
distance-from-start_max	2.645340380806441
distance-from-start_mean	2.645340380806441
distance-from-start_median	2.645340380806441
distance-from-start_min	2.645340380806441
driven_any_max	3.486581977234639
driven_any_mean	3.486581977234639
driven_any_median	3.486581977234639
driven_any_min	3.486581977234639
driven_lanedir_consec_max	2.814994221639415
driven_lanedir_consec_mean	2.814994221639415
driven_lanedir_consec_min	2.814994221639415
driven_lanedir_max	3.274708987457034
driven_lanedir_mean	3.274708987457034
driven_lanedir_median	3.274708987457034
driven_lanedir_min	3.274708987457034
in-drivable-lane_max	3.099999999999902
in-drivable-lane_mean	3.099999999999902
in-drivable-lane_min	3.099999999999902
per-episodes	details {"loop-000-ego0": {"driven_any": 3.486581977234639, "survival_time": 59.99999999999873, "driven_lanedir": 3.274708987457034, "in-drivable-lane": 3.099999999999902, "deviation-heading": 9.10432529887803, "distance-from-start": 2.645340380806441, "deviation-center-line": 4.094985086570109, "driven_lanedir_consec": 2.814994221639415}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

227

40

Bea Baselines 🐤

minimal-agent-full

sim-2of4

host-error

aido-LFP-full-sim-testing

2021-10-18 20:02:11+00:00

2021-10-18 20:02:14+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("login attempt to https://registry-stage2.duckietown.org/v2/ failed with status: 502 Bad Gateway")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

219

42

Bea Baselines 🐤

minimal-agent-full

sim-0of4

success

aido-LFV_multi-full-sim-testing

2021-10-18 19:54:50+00:00

2021-10-18 20:01:51+00:00

0:07:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	51.949999999999186
in-drivable-lane_median	3.449999999999882
driven_lanedir_consec_median	2.7806693784918126
deviation-center-line_median	5.983237422521915

other stats

deviation-center-line_max	5.983237422521915
deviation-center-line_mean	5.983237422521915
deviation-center-line_min	5.983237422521915
deviation-heading_max	5.351741767067896
deviation-heading_mean	5.351741767067896
deviation-heading_median	5.351741767067896
deviation-heading_min	5.351741767067896
distance-from-start_max	1.6305272648718805
distance-from-start_mean	1.6305272648718805
distance-from-start_median	1.6305272648718805
distance-from-start_min	1.6305272648718805
driven_any_max	2.95109108951375
driven_any_mean	2.95109108951375
driven_any_median	2.95109108951375
driven_any_min	2.95109108951375
driven_lanedir_consec_max	2.7806693784918126
driven_lanedir_consec_mean	2.7806693784918126
driven_lanedir_consec_min	2.7806693784918126
driven_lanedir_max	2.7806693784918126
driven_lanedir_mean	2.7806693784918126
driven_lanedir_median	2.7806693784918126
driven_lanedir_min	2.7806693784918126
in-drivable-lane_max	3.449999999999882
in-drivable-lane_mean	3.449999999999882
in-drivable-lane_min	3.449999999999882
per-episodes	details {"loop2-000-ego0": {"driven_any": 2.95109108951375, "survival_time": 51.949999999999186, "driven_lanedir": 2.7806693784918126, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067896, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.983237422521915, "driven_lanedir_consec": 2.7806693784918126}}
simulation-passed	1
survival_time_max	51.949999999999186
survival_time_mean	51.949999999999186
survival_time_min	51.949999999999186

No reset possible

211

43

Bea Baselines 🐤

minimal-agent-full

sim-2of4

aborted

aido-LFV_multi-full-sim-testing

2021-10-18 19:16:31+00:00

2021-10-18 19:54:44+00:00

0:38:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.17499999999996
driven_lanedir_consec_median	1.8859779264809196
deviation-center-line_median	5.342044093996971

other stats

deviation-center-line_max	7.275924926311184
deviation-center-line_mean	5.706188811875608
deviation-center-line_min	4.864742133197307
deviation-heading_max	24.381184135059772
deviation-heading_mean	11.29955147726862
deviation-heading_median	7.478334156236409
deviation-heading_min	5.8603534615418775
distance-from-start_max	2.7566543136035913
distance-from-start_mean	1.9175184910013976
distance-from-start_median	1.732391267431496
distance-from-start_min	1.4486371155390072
driven_any_max	3.5195923437136294
driven_any_mean	2.7625082847873736
driven_any_median	2.762173878471443
driven_any_min	2.0060930384929785
driven_lanedir_consec_max	3.385387272061554
driven_lanedir_consec_mean	2.143156808218185
driven_lanedir_consec_min	1.4152841078493492
driven_lanedir_max	3.385387272061554
driven_lanedir_mean	2.634203315067613
driven_lanedir_median	2.633939470902031
driven_lanedir_min	1.8835470464048365
in-drivable-lane_max	2.400000000000034
in-drivable-lane_mean	2.18749999999996
in-drivable-lane_min	1.9999999999998863
per-episodes	details {"autolab-000-ego0": {"driven_any": 2.016760537304788, "survival_time": 59.99999999999873, "driven_lanedir": 1.904099016664519, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 24.381184135059772, "distance-from-start": 1.967934233485134, "deviation-center-line": 5.25275935214242, "driven_lanedir_consec": 1.8884088065570024}, "autolab-000-ego1": {"driven_any": 3.5195923437136294, "survival_time": 59.99999999999873, "driven_lanedir": 3.385387272061554, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066767019151307, "distance-from-start": 2.7566543136035913, "deviation-center-line": 5.431328835851521, "driven_lanedir_consec": 3.385387272061554}, "autolab-000-ego2": {"driven_any": 3.5075872196380975, "survival_time": 59.99999999999873, "driven_lanedir": 3.363779925139543, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.8603534615418775, "distance-from-start": 1.4486371155390072, "deviation-center-line": 4.864742133197307, "driven_lanedir_consec": 1.4152841078493492}, "autolab-000-ego3": {"driven_any": 2.0060930384929785, "survival_time": 59.99999999999873, "driven_lanedir": 1.8835470464048365, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 7.889901293321512, "distance-from-start": 1.4968483013778582, "deviation-center-line": 7.275924926311184, "driven_lanedir_consec": 1.8835470464048365}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

210

43

Bea Baselines 🐤

minimal-agent-full

sim-2of4

aborted

aido-LFV_multi-full-sim-testing

2021-10-18 19:00:53+00:00

2021-10-18 19:16:14+00:00

0:15:21

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1141, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

207

43

Bea Baselines 🐤

minimal-agent-full

sim-0of4

aborted

aido-LF-full-sim-testing

2021-10-18 18:44:56+00:00

2021-10-18 19:00:31+00:00

0:15:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.7249999999999304
driven_lanedir_consec_median	1.7824508236693029
deviation-center-line_median	5.752006035796589

other stats

deviation-center-line_max	5.917240924506971
deviation-center-line_mean	5.752006035796589
deviation-center-line_min	5.586771147086208
deviation-heading_max	8.389433016031823
deviation-heading_mean	8.327307078445351
deviation-heading_median	8.327307078445351
deviation-heading_min	8.265181140858878
distance-from-start_max	1.2351380366112434
distance-from-start_mean	1.1329605700672505
distance-from-start_median	1.1329605700672505
distance-from-start_min	1.030783103523257
driven_any_max	3.4865836159248462
driven_any_mean	3.4678327998246177
driven_any_median	3.4678327998246177
driven_any_min	3.4490819837243887
driven_lanedir_consec_max	2.09163409663777
driven_lanedir_consec_mean	1.7824508236693029
driven_lanedir_consec_min	1.473267550700836
driven_lanedir_max	3.288010499121376
driven_lanedir_mean	3.246016717856279
driven_lanedir_median	3.246016717856279
driven_lanedir_min	3.2040229365911816
in-drivable-lane_max	4.349999999999895
in-drivable-lane_mean	3.7249999999999304
in-drivable-lane_min	3.099999999999966
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4490819837243887, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040229365911816, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433016031823, "distance-from-start": 1.030783103523257, "deviation-center-line": 5.917240924506971, "driven_lanedir_consec": 2.09163409663777}, "loop2-000-ego1": {"driven_any": 3.4865836159248462, "survival_time": 59.99999999999873, "driven_lanedir": 3.288010499121376, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181140858878, "distance-from-start": 1.2351380366112434, "deviation-center-line": 5.586771147086208, "driven_lanedir_consec": 1.473267550700836}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

201

45

Bea Baselines 🐤

minimal-agent-full

sim-2of4

success

aido-LF-state-sim-validation

2021-10-18 18:33:33+00:00

2021-10-18 18:44:26+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.0000000000000284
driven_lanedir_consec_median	1.664889734748713
deviation-center-line_median	4.938816197948505

other stats

deviation-center-line_max	4.938816197948505
deviation-center-line_mean	4.938816197948505
deviation-center-line_min	4.938816197948505
deviation-heading_max	7.489030374236872
deviation-heading_mean	7.489030374236872
deviation-heading_median	7.489030374236872
deviation-heading_min	7.489030374236872
distance-from-start_max	1.3909655084060193
distance-from-start_mean	1.3909655084060193
distance-from-start_median	1.3909655084060193
distance-from-start_min	1.3909655084060193
driven_any_max	3.5195846188674142
driven_any_mean	3.5195846188674142
driven_any_median	3.5195846188674142
driven_any_min	3.5195846188674142
driven_lanedir_consec_max	1.664889734748713
driven_lanedir_consec_mean	1.664889734748713
driven_lanedir_consec_min	1.664889734748713
driven_lanedir_max	3.362091194105374
driven_lanedir_mean	3.362091194105374
driven_lanedir_median	3.362091194105374
driven_lanedir_min	3.362091194105374
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	2.0000000000000284
in-drivable-lane_min	2.0000000000000284
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.5195846188674142, "survival_time": 59.99999999999873, "driven_lanedir": 3.362091194105374, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 7.489030374236872, "distance-from-start": 1.3909655084060193, "deviation-center-line": 4.938816197948505, "driven_lanedir_consec": 1.664889734748713}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

197

46

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

aido-LFV_multi-state-sim-validation

2021-10-18 18:23:34+00:00

2021-10-18 18:33:12+00:00

0:09:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.660827015103613
deviation-center-line_median	0.34307231203711835

other stats

deviation-center-line_max	0.34307231203711835
deviation-center-line_mean	0.34307231203711835
deviation-center-line_min	0.34307231203711835
deviation-heading_max	3.0996504199313746
deviation-heading_mean	3.0996504199313746
deviation-heading_median	3.0996504199313746
deviation-heading_min	3.0996504199313746
distance-from-start_max	2.974970546350257
distance-from-start_mean	2.974970546350257
distance-from-start_median	2.974970546350257
distance-from-start_min	2.974970546350257
driven_any_max	5.676470660839513
driven_any_mean	5.676470660839513
driven_any_median	5.676470660839513
driven_any_min	5.676470660839513
driven_lanedir_consec_max	5.660827015103613
driven_lanedir_consec_mean	5.660827015103613
driven_lanedir_consec_min	5.660827015103613
driven_lanedir_max	5.660827015103613
driven_lanedir_mean	5.660827015103613
driven_lanedir_median	5.660827015103613
driven_lanedir_min	5.660827015103613
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 5.676470660839513, "survival_time": 59.99999999999873, "driven_lanedir": 5.660827015103613, "in-drivable-lane": 0.0, "deviation-heading": 3.0996504199313746, "distance-from-start": 2.974970546350257, "deviation-center-line": 0.34307231203711835, "driven_lanedir_consec": 5.660827015103613}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

192

48

Bea Baselines 🐤

baseline-simple-yield

success

aido-LFVI_multi-state-sim-testing

2021-10-18 18:03:18+00:00

2021-10-18 18:23:27+00:00

0:20:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	29.999999999999364
driven_lanedir_consec_median	2.597347553723017
deviation-center-line_median	0.09533378339608344

other stats

deviation-center-line_max	0.4135448534312566
deviation-center-line_mean	0.15105310505585587
deviation-center-line_min	0.0
deviation-heading_max	3.460742788441941
deviation-heading_mean	1.1328508119472795
deviation-heading_median	0.5353302296735888
deviation-heading_min	0.0
distance-from-start_max	2.7548358425520463
distance-from-start_mean	1.4424635534309402
distance-from-start_median	1.229577353818044
distance-from-start_min	0.5558636635356259
driven_any_max	5.821181545616975
driven_any_mean	5.446621127938215
driven_any_median	5.4801748851655585
driven_any_min	5.004953195804769
driven_lanedir_consec_max	5.521217320651045
driven_lanedir_consec_mean	2.6789781070242698
driven_lanedir_consec_min	0.0
driven_lanedir_max	5.817787656912104
driven_lanedir_mean	2.827845724055816
driven_lanedir_median	2.74679761965558
driven_lanedir_min	0.0
in-drivable-lane_max	59.99999999999873
in-drivable-lane_mean	29.999999999999364
in-drivable-lane_min	0.0
per-episodes	details {"udem2-ego0": {"driven_any": 5.004953195804769, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.619313626312017, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "udem2-ego1": {"driven_any": 5.549890270033774, "survival_time": 59.99999999999873, "driven_lanedir": 5.49359523931116, "in-drivable-lane": 0.0, "deviation-heading": 3.460742788441941, "distance-from-start": 1.839841081324071, "deviation-center-line": 0.4135448534312566, "driven_lanedir_consec": 5.194695107446034}, "udem2-ego2": {"driven_any": 5.410459500297342, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 0.5558636635356259, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}, "udem2-ego3": {"driven_any": 5.821181545616975, "survival_time": 59.99999999999873, "driven_lanedir": 5.817787656912104, "in-drivable-lane": 0.0, "deviation-heading": 1.0706604593471776, "distance-from-start": 2.7548358425520463, "deviation-center-line": 0.19066756679216687, "driven_lanedir_consec": 5.521217320651045}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

174

51

Bea Baselines 🐤

baseline-simple-yield

sim-1of4

success

aido-LFV_multi-sim-validation

2021-10-18 17:38:51+00:00

2021-10-18 18:02:31+00:00

0:23:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	2.500212792452454
deviation-center-line_median	0.2417764180156101

other stats

deviation-center-line_max	0.9361634607993364
deviation-center-line_mean	0.3857921899447251
deviation-center-line_min	0.12345246294834386
deviation-heading_max	7.546794145741603
deviation-heading_mean	3.813295637150747
deviation-heading_median	3.413552579730702
deviation-heading_min	0.8792832433999819
distance-from-start_max	3.0104534794677464
distance-from-start_mean	2.086588286945902
distance-from-start_median	1.9179628821707604
distance-from-start_min	1.4999739039743407
driven_any_max	4.053398179378087
driven_any_mean	2.7199654373941176
driven_any_median	2.5041844218188904
driven_any_min	1.818094726560603
driven_lanedir_consec_max	4.0495170156619515
driven_lanedir_consec_mean	2.716343344429449
driven_lanedir_consec_min	1.8154307771509368
driven_lanedir_max	4.049517156094364
driven_lanedir_mean	2.716343379537552
driven_lanedir_median	2.500212792452454
driven_lanedir_min	1.8154307771509368
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 4.053398179378087, "survival_time": 59.99999999999873, "driven_lanedir": 4.049517156094364, "in-drivable-lane": 0.0, "deviation-heading": 0.8792832433999819, "distance-from-start": 3.0104534794677464, "deviation-center-line": 0.12345246294834386, "driven_lanedir_consec": 4.0495170156619515}, "4way-001-ego1": {"driven_any": 1.818094726560603, "survival_time": 59.99999999999873, "driven_lanedir": 1.8154307771509368, "in-drivable-lane": 0.0, "deviation-heading": 7.546794145741603, "distance-from-start": 1.7917281207129614, "deviation-center-line": 0.9361634607993364, "driven_lanedir_consec": 1.8154307771509368}, "4way-001-ego2": {"driven_any": 2.52408966779893, "survival_time": 59.99999999999873, "driven_lanedir": 2.5202436434745765, "in-drivable-lane": 0.0, "deviation-heading": 4.889758619965982, "distance-from-start": 2.0441976436285594, "deviation-center-line": 0.1801621062215555, "driven_lanedir_consec": 2.5202436434745765}, "4way-001-ego3": {"driven_any": 2.484279175838851, "survival_time": 59.99999999999873, "driven_lanedir": 2.4801819414303328, "in-drivable-lane": 0.0, "deviation-heading": 1.9373465394954208, "distance-from-start": 1.4999739039743407, "deviation-center-line": 0.30339072980966464, "driven_lanedir_consec": 2.4801819414303328}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

161

22

Bea Baselines 🐤

minimal-agent

sim-1of4

success

2021-10-18 17:32:39+00:00

2021-10-18 17:37:59+00:00

0:05:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	10.20000000000001
in-drivable-lane_median	7.550000000000012
driven_lanedir_consec_median	0.3510078234673182
deviation-center-line_median	0.1875173231179

other stats

deviation-center-line_max	0.2707804718914694
deviation-center-line_mean	0.18444125730986227
deviation-center-line_min	0.0919499111121796
deviation-heading_max	1.191765179893031
deviation-heading_mean	0.9622869363024876
deviation-heading_median	0.9361472189771174
deviation-heading_min	0.7850881273626839
distance-from-start_max	1.5123565388898514
distance-from-start_mean	1.0659158945047955
distance-from-start_median	1.0223949566720527
distance-from-start_min	0.706517125785226
driven_any_max	1.5124649660017953
driven_any_mean	1.065965786863606
driven_any_median	1.0224346418929606
driven_any_min	0.7065288976667069
driven_lanedir_consec_max	0.5392423985110799
driven_lanedir_consec_mean	0.34683572422132686
driven_lanedir_consec_min	0.1460848514395911
driven_lanedir_max	0.5392423985110799
driven_lanedir_mean	0.34683572422132686
driven_lanedir_median	0.3510078234673182
driven_lanedir_min	0.1460848514395911
in-drivable-lane_max	8.75000000000001
in-drivable-lane_mean	7.587500000000013
in-drivable-lane_min	6.500000000000015
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.7065288976667069, "survival_time": 10.20000000000001, "driven_lanedir": 0.19955231542409413, "in-drivable-lane": 8.45000000000001, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.706517125785226, "deviation-center-line": 0.12567462277579125, "driven_lanedir_consec": 0.19955231542409413}, "zigzag-000-ego1": {"driven_any": 1.5124649660017953, "survival_time": 10.20000000000001, "driven_lanedir": 0.5024633315105422, "in-drivable-lane": 6.650000000000015, "deviation-heading": 1.191765179893031, "distance-from-start": 1.5123565388898514, "deviation-center-line": 0.24936002346000877, "driven_lanedir_consec": 0.5024633315105422}, "zigzag-000-ego2": {"driven_any": 0.8448328173529576, "survival_time": 10.20000000000001, "driven_lanedir": 0.5392423985110799, "in-drivable-lane": 6.500000000000015, "deviation-heading": 0.923472482396189, "distance-from-start": 0.8448159163231229, "deviation-center-line": 0.2707804718914694, "driven_lanedir_consec": 0.5392423985110799}, "zigzag-000-ego3": {"driven_any": 1.200036466432964, "survival_time": 10.20000000000001, "driven_lanedir": 0.1460848514395911, "in-drivable-lane": 8.75000000000001, "deviation-heading": 0.7850881273626839, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.1460848514395911}}
simulation-passed	1
survival_time_max	10.20000000000001
survival_time_mean	10.20000000000001
survival_time_min	10.20000000000001

No reset possible

153

24

Bea Baselines 🐤

minimal-agent

sim-0of4

success

2021-10-18 17:30:08+00:00

2021-10-18 17:32:20+00:00

0:02:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31872588830254256
survival_time_median	12.40000000000004
deviation-center-line_median	0.2634614200814007
in-drivable-lane_median	9.150000000000045

other stats

deviation-center-line_max	0.2634614200814007
deviation-center-line_mean	0.2634614200814007
deviation-center-line_min	0.2634614200814007
deviation-heading_max	2.5397416158346133
deviation-heading_mean	2.5397416158346133
deviation-heading_median	2.5397416158346133
deviation-heading_min	2.5397416158346133
distance-from-start_max	1.8751243016635983
distance-from-start_mean	1.8751243016635983
distance-from-start_median	1.8751243016635983
distance-from-start_min	1.8751243016635983
driven_any_max	1.8759780200120333
driven_any_mean	1.8759780200120333
driven_any_median	1.8759780200120333
driven_any_min	1.8759780200120333
driven_lanedir_consec_max	0.31872588830254256
driven_lanedir_consec_mean	0.31872588830254256
driven_lanedir_consec_min	0.31872588830254256
driven_lanedir_max	0.31872588830254256
driven_lanedir_mean	0.31872588830254256
driven_lanedir_median	0.31872588830254256
driven_lanedir_min	0.31872588830254256
in-drivable-lane_max	9.150000000000045
in-drivable-lane_mean	9.150000000000045
in-drivable-lane_min	9.150000000000045
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.8759780200120333, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872588830254256, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.5397416158346133, "distance-from-start": 1.8751243016635983, "deviation-center-line": 0.2634614200814007, "driven_lanedir_consec": 0.31872588830254256}}
simulation-passed	1
survival_time_max	12.40000000000004
survival_time_mean	12.40000000000004
survival_time_min	12.40000000000004

No reset possible

141

28

Bea Baselines 🐤

minimal-agent

sim-1of4

success

aido-LFVI_multi-sim-testing

2021-10-18 17:27:17+00:00

2021-10-18 17:29:53+00:00

0:02:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3104807293428191
survival_time_median	11.60000000000003
deviation-center-line_median	0.4653925586404345
in-drivable-lane_median	7.549999999999989

other stats

deviation-center-line_max	0.4653925586404345
deviation-center-line_mean	0.4653925586404345
deviation-center-line_min	0.4653925586404345
deviation-heading_max	2.661550166530274
deviation-heading_mean	2.661550166530274
deviation-heading_median	2.661550166530274
deviation-heading_min	2.661550166530274
distance-from-start_max	1.7416408001353558
distance-from-start_mean	1.7416408001353558
distance-from-start_median	1.7416408001353558
distance-from-start_min	1.7416408001353558
driven_any_max	1.7417506842617128
driven_any_mean	1.7417506842617128
driven_any_median	1.7417506842617128
driven_any_min	1.7417506842617128
driven_lanedir_consec_max	0.3104807293428191
driven_lanedir_consec_mean	0.3104807293428191
driven_lanedir_consec_min	0.3104807293428191
driven_lanedir_max	0.3104807293428191
driven_lanedir_mean	0.3104807293428191
driven_lanedir_median	0.3104807293428191
driven_lanedir_min	0.3104807293428191
in-drivable-lane_max	7.549999999999989
in-drivable-lane_mean	7.549999999999989
in-drivable-lane_min	7.549999999999989
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.7417506842617128, "survival_time": 11.60000000000003, "driven_lanedir": 0.3104807293428191, "in-drivable-lane": 7.549999999999989, "deviation-heading": 2.661550166530274, "distance-from-start": 1.7416408001353558, "deviation-center-line": 0.4653925586404345, "driven_lanedir_consec": 0.3104807293428191}}
simulation-passed	1
survival_time_max	11.60000000000003
survival_time_mean	11.60000000000003
survival_time_min	11.60000000000003

No reset possible

129

29

Bea Baselines 🐤

minimal-agent

sim-2of4

success

2021-10-18 17:24:13+00:00

2021-10-18 17:26:46+00:00

0:02:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

42

1

Bea Baselines 🐤

template-random

sim-3of4

success

2021-10-17 16:43:59+00:00

2021-10-17 16:50:02+00:00

0:06:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2718431750312411
survival_time_median	45.099999999999575
deviation-center-line_median	0.765552090953893
in-drivable-lane_median	36.54999999999956

other stats

deviation-center-line_max	0.765552090953893
deviation-center-line_mean	0.765552090953893
deviation-center-line_min	0.765552090953893
deviation-heading_max	5.708723015945327
deviation-heading_mean	5.708723015945327
deviation-heading_median	5.708723015945327
deviation-heading_min	5.708723015945327
distance-from-start_max	1.0442247976691916
distance-from-start_mean	1.0442247976691916
distance-from-start_median	1.0442247976691916
distance-from-start_min	1.0442247976691916
driven_any_max	11.376062002465076
driven_any_mean	11.376062002465076
driven_any_median	11.376062002465076
driven_any_min	11.376062002465076
driven_lanedir_consec_max	0.2718431750312411
driven_lanedir_consec_mean	0.2718431750312411
driven_lanedir_consec_min	0.2718431750312411
driven_lanedir_max	0.25383249899423177
driven_lanedir_mean	0.25383249899423177
driven_lanedir_median	0.25383249899423177
driven_lanedir_min	0.25383249899423177
in-drivable-lane_max	36.54999999999956
in-drivable-lane_mean	36.54999999999956
in-drivable-lane_min	36.54999999999956
per-episodes	details {"loop-000-ego0": {"driven_any": 11.376062002465076, "survival_time": 45.099999999999575, "driven_lanedir": 0.25383249899423177, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.0442247976691916, "deviation-center-line": 0.765552090953893, "driven_lanedir_consec": 0.2718431750312411}}
simulation-passed	1
survival_time_max	45.099999999999575
survival_time_mean	45.099999999999575
survival_time_min	45.099999999999575

No reset possible

41

1

Bea Baselines 🐤

template-random

sim-2of4

host-error

2021-10-17 16:43:31+00:00

2021-10-17 16:43:46+00:00

0:00:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39

1

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:43:14+00:00

2021-10-17 16:43:17+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38

2

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:42:57+00:00

2021-10-17 16:43:00+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

37

2

Bea Baselines 🐤

template-random

sim-3of4

host-error

2021-10-17 16:42:34+00:00

2021-10-17 16:42:37+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36

2

Bea Baselines 🐤

template-random

sim-2of4

host-error

2021-10-17 16:42:16+00:00

2021-10-17 16:42:19+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35

2

Bea Baselines 🐤

template-random

sim-2of4

host-error

2021-10-17 16:42:00+00:00

2021-10-17 16:42:03+00:00

0:00:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

33

2

Bea Baselines 🐤

template-random

sim-1of4

host-error

2021-10-17 16:41:38+00:00

2021-10-17 16:41:42+00:00

0:00:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32

3

Bea Baselines 🐤

template-random

sim-0of4

host-error

2021-10-17 16:41:23+00:00

2021-10-17 16:41:31+00:00

0:00:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http+docker://localhost/v1.41/auth

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 78, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 35, in docker_login
    res = client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 401 Client Error for http+docker://localhost/v1.41/auth: Unauthorized ("Get https://registry-stage2.duckietown.org/v2/: unauthorized: authentication required")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7

3

Bea Baselines 🐤

template-random

sim-1of4

success