Duckietown Challenges Home Challenges Submissions

Submission 184

Submission184
Competinguser retired
Challengeaido-LFVI-state-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1460 sim-1of4: 1449 sim-2of4: 1479 sim-3of4: 1441
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

1479

Click the images to see detailed statistics about the episode.

4way-000

1460

Click the images to see detailed statistics about the episode.

udem-001

1449

Click the images to see detailed statistics about the episode.

udem-000

1441

Click the images to see detailed statistics about the episode.

4way-001

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1479sim-2of4successno0:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.4352328242070893
deviation-center-line_median3.4976585833034135


other stats
deviation-center-line_max3.4976585833034135
deviation-center-line_mean3.4976585833034135
deviation-center-line_min3.4976585833034135
deviation-heading_max4.543459809815336
deviation-heading_mean4.543459809815336
deviation-heading_median4.543459809815336
deviation-heading_min4.543459809815336
distance-from-start_max2.277929298279452
distance-from-start_mean2.277929298279452
distance-from-start_median2.277929298279452
distance-from-start_min2.277929298279452
driven_any_max3.579588783619002
driven_any_mean3.579588783619002
driven_any_median3.579588783619002
driven_any_min3.579588783619002
driven_lanedir_consec_max3.4352328242070893
driven_lanedir_consec_mean3.4352328242070893
driven_lanedir_consec_min3.4352328242070893
driven_lanedir_max3.556070602440162
driven_lanedir_mean3.556070602440162
driven_lanedir_median3.556070602440162
driven_lanedir_min3.556070602440162
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.579588783619002, "survival_time": 59.99999999999873, "driven_lanedir": 3.556070602440162, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809815336, "distance-from-start": 2.277929298279452, "deviation-center-line": 3.4976585833034135, "driven_lanedir_consec": 3.4352328242070893}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1462sim-2of4host-errorno0:08:02
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1460sim-0of4successno0:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.30000000000031
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.7255277856012594
deviation-center-line_median2.855857091334


other stats
deviation-center-line_max2.855857091334
deviation-center-line_mean2.855857091334
deviation-center-line_min2.855857091334
deviation-heading_max2.4300668794999862
deviation-heading_mean2.4300668794999862
deviation-heading_median2.4300668794999862
deviation-heading_min2.4300668794999862
distance-from-start_max1.366301151018967
distance-from-start_mean1.366301151018967
distance-from-start_median1.366301151018967
distance-from-start_min1.366301151018967
driven_any_max1.782596914710312
driven_any_mean1.782596914710312
driven_any_median1.782596914710312
driven_any_min1.782596914710312
driven_lanedir_consec_max1.7255277856012594
driven_lanedir_consec_mean1.7255277856012594
driven_lanedir_consec_min1.7255277856012594
driven_lanedir_max1.7255277856012594
driven_lanedir_mean1.7255277856012594
driven_lanedir_median1.7255277856012594
driven_lanedir_min1.7255277856012594
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-001-ego0": {"driven_any": 1.782596914710312, "survival_time": 31.30000000000031, "driven_lanedir": 1.7255277856012594, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.4300668794999862, "distance-from-start": 1.366301151018967, "deviation-center-line": 2.855857091334, "driven_lanedir_consec": 1.7255277856012594}}
simulation-passed1
survival_time_max31.30000000000031
survival_time_mean31.30000000000031
survival_time_min31.30000000000031
No reset possible
1449sim-1of4successno0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.449999999999985
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4398565700031045
deviation-center-line_median0.2725613901951353


other stats
deviation-center-line_max0.2725613901951353
deviation-center-line_mean0.2725613901951353
deviation-center-line_min0.2725613901951353
deviation-heading_max0.7151184294493084
deviation-heading_mean0.7151184294493084
deviation-heading_median0.7151184294493084
deviation-heading_min0.7151184294493084
distance-from-start_max0.4409417364496094
distance-from-start_mean0.4409417364496094
distance-from-start_median0.4409417364496094
distance-from-start_min0.4409417364496094
driven_any_max0.44459927688868583
driven_any_mean0.44459927688868583
driven_any_median0.44459927688868583
driven_any_min0.44459927688868583
driven_lanedir_consec_max0.4398565700031045
driven_lanedir_consec_mean0.4398565700031045
driven_lanedir_consec_min0.4398565700031045
driven_lanedir_max0.4398565700031045
driven_lanedir_mean0.4398565700031045
driven_lanedir_median0.4398565700031045
driven_lanedir_min0.4398565700031045
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.44459927688868583, "survival_time": 8.449999999999985, "driven_lanedir": 0.4398565700031045, "in-drivable-lane": 0.0, "deviation-heading": 0.7151184294493084, "distance-from-start": 0.4409417364496094, "deviation-center-line": 0.2725613901951353, "driven_lanedir_consec": 0.4398565700031045}}
simulation-passed1
survival_time_max8.449999999999985
survival_time_mean8.449999999999985
survival_time_min8.449999999999985
No reset possible
1447sim-0of4host-errorno0:09:47
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1445sim-2of4host-errorno0:08:08
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1441sim-3of4successno0:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.2000000000000313
driven_lanedir_consec_median3.071963497906379
deviation-center-line_median2.5127522585495896


other stats
deviation-center-line_max2.5127522585495896
deviation-center-line_mean2.5127522585495896
deviation-center-line_min2.5127522585495896
deviation-heading_max5.806435105941533
deviation-heading_mean5.806435105941533
deviation-heading_median5.806435105941533
deviation-heading_min5.806435105941533
distance-from-start_max2.5580188444297236
distance-from-start_mean2.5580188444297236
distance-from-start_median2.5580188444297236
distance-from-start_min2.5580188444297236
driven_any_max3.513574191135252
driven_any_mean3.513574191135252
driven_any_median3.513574191135252
driven_any_min3.513574191135252
driven_lanedir_consec_max3.071963497906379
driven_lanedir_consec_mean3.071963497906379
driven_lanedir_consec_min3.071963497906379
driven_lanedir_max3.3771987735839333
driven_lanedir_mean3.3771987735839333
driven_lanedir_median3.3771987735839333
driven_lanedir_min3.3771987735839333
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean2.2000000000000313
in-drivable-lane_min2.2000000000000313
per-episodes
details{"4way-001-ego0": {"driven_any": 3.513574191135252, "survival_time": 59.99999999999873, "driven_lanedir": 3.3771987735839333, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.806435105941533, "distance-from-start": 2.5580188444297236, "deviation-center-line": 2.5127522585495896, "driven_lanedir_consec": 3.071963497906379}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1439sim-2of4host-errorno0:07:48
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1435sim-1of4host-errorno0:09:18
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1434sim-0of4host-errorno0:05:46
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1426sim-1of4host-errorno0:05:10
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible