Submission 146

Submission

146

Competing

user retired

Challenge

aido-LFVI-full-sim-testing

User

Bea Baselines 🐤

Date submitted

2021-10-19 09:50:46+00:00

Last status update

2021-10-19 15:32:42+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 1776 sim-1of4: 1783 sim-2of4: 1718 sim-3of4: 1717

User label

minimal-agent-full

Admin priority

Blessing

n/a

User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

1783

sim-1of4

success

2021-10-19 15:20:27+00:00

2021-10-19 15:32:35+00:00

0:12:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.237732648607257
deviation-center-line_median	3.445377915310228

other stats

deviation-center-line_max	3.445377915310228
deviation-center-line_mean	3.445377915310228
deviation-center-line_min	3.445377915310228
deviation-heading_max	3.901683446348004
deviation-heading_mean	3.901683446348004
deviation-heading_median	3.901683446348004
deviation-heading_min	3.901683446348004
distance-from-start_max	1.948445748776694
distance-from-start_mean	1.948445748776694
distance-from-start_median	1.948445748776694
distance-from-start_min	1.948445748776694
driven_any_max	3.5795828930138853
driven_any_mean	3.5795828930138853
driven_any_median	3.5795828930138853
driven_any_min	3.5795828930138853
driven_lanedir_consec_max	3.237732648607257
driven_lanedir_consec_mean	3.237732648607257
driven_lanedir_consec_min	3.237732648607257
driven_lanedir_max	3.554146020871638
driven_lanedir_mean	3.554146020871638
driven_lanedir_median	3.554146020871638
driven_lanedir_min	3.554146020871638
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.5795828930138853, "survival_time": 59.99999999999873, "driven_lanedir": 3.554146020871638, "in-drivable-lane": 0.0, "deviation-heading": 3.901683446348004, "distance-from-start": 1.948445748776694, "deviation-center-line": 3.445377915310228, "driven_lanedir_consec": 3.237732648607257}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

1776

sim-0of4

success

2021-10-19 15:15:20+00:00

2021-10-19 15:27:35+00:00

0:12:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	49.9499999999993
in-drivable-lane_median	0.0
driven_lanedir_consec_median	2.903013185974918
deviation-center-line_median	3.7894398733160073

other stats

deviation-center-line_max	3.7894398733160073
deviation-center-line_mean	3.7894398733160073
deviation-center-line_min	3.7894398733160073
deviation-heading_max	4.334690003953372
deviation-heading_mean	4.334690003953372
deviation-heading_median	4.334690003953372
deviation-heading_min	4.334690003953372
distance-from-start_max	1.5738876609453012
distance-from-start_mean	1.5738876609453012
distance-from-start_median	1.5738876609453012
distance-from-start_min	1.5738876609453012
driven_any_max	2.934594724791726
driven_any_mean	2.934594724791726
driven_any_median	2.934594724791726
driven_any_min	2.934594724791726
driven_lanedir_consec_max	2.903013185974918
driven_lanedir_consec_mean	2.903013185974918
driven_lanedir_consec_min	2.903013185974918
driven_lanedir_max	2.909932487673111
driven_lanedir_mean	2.909932487673111
driven_lanedir_median	2.909932487673111
driven_lanedir_min	2.909932487673111
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 2.934594724791726, "survival_time": 49.9499999999993, "driven_lanedir": 2.909932487673111, "in-drivable-lane": 0.0, "deviation-heading": 4.334690003953372, "distance-from-start": 1.5738876609453012, "deviation-center-line": 3.7894398733160073, "driven_lanedir_consec": 2.903013185974918}}
simulation-passed	1
survival_time_max	49.9499999999993
survival_time_mean	49.9499999999993
survival_time_min	49.9499999999993

No reset possible

1771

sim-1of4

host-error

2021-10-19 15:14:54+00:00

2021-10-19 15:19:33+00:00

0:04:39

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1763

sim-1of4

host-error

2021-10-19 15:02:56+00:00

2021-10-19 15:09:55+00:00

0:06:59

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1760

sim-0of4

host-error

2021-10-19 14:59:30+00:00

2021-10-19 15:05:11+00:00

0:05:41

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1753

sim-1of4

host-error

2021-10-19 14:48:33+00:00

2021-10-19 14:56:06+00:00

0:07:33

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1752

sim-0of4

host-error

2021-10-19 14:48:17+00:00

2021-10-19 14:53:51+00:00

0:05:34

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1745

sim-1of4

timeout

2021-10-19 14:44:24+00:00

No reset possible

1740

sim-0of4

host-error

2021-10-19 14:37:34+00:00

2021-10-19 14:47:00+00:00

0:09:26

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1739

sim-1of4

host-error

2021-10-19 14:37:26+00:00

2021-10-19 14:43:09+00:00

0:05:43

The container "simul [...]

The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1735

sim-0of4

host-error

2021-10-19 14:30:46+00:00

2021-10-19 14:36:59+00:00

0:06:13

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1719

sim-1of4

host-error

2021-10-19 14:22:17+00:00

2021-10-19 14:37:08+00:00

0:14:51

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

1718

sim-2of4

success

2021-10-19 14:21:24+00:00

2021-10-19 14:22:57+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

1717

sim-3of4

success

2021-10-19 14:20:35+00:00

2021-10-19 14:22:16+00:00

0:01:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

1716

sim-0of4

host-error

2021-10-19 14:17:30+00:00

2021-10-19 14:30:26+00:00

0:12:56

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible