Duckietown Challenges Home Challenges Submissions

Submission 186

Submission186
Competinguser retired
Challengeaido-LFP-state-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1406 sim-1of4: 1415 sim-2of4: 1432 sim-3of4: 1407
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

1432

Click the images to see detailed statistics about the episode.

loop-000

1415

Click the images to see detailed statistics about the episode.

autolab-000

1407

Click the images to see detailed statistics about the episode.

loop-000

1406

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1432sim-2of4successno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.43685686215374986
deviation-center-line_median0.2706641555254041


other stats
deviation-center-line_max0.2706641555254041
deviation-center-line_mean0.2706641555254041
deviation-center-line_min0.2706641555254041
deviation-heading_max0.7151185427551814
deviation-heading_mean0.7151185427551814
deviation-heading_median0.7151185427551814
deviation-heading_min0.7151185427551814
distance-from-start_max0.43794917699306546
distance-from-start_mean0.43794917699306546
distance-from-start_median0.43794917699306546
distance-from-start_min0.43794917699306546
driven_any_max0.44159927688868106
driven_any_mean0.44159927688868106
driven_any_median0.44159927688868106
driven_any_min0.44159927688868106
driven_lanedir_consec_max0.43685686215374986
driven_lanedir_consec_mean0.43685686215374986
driven_lanedir_consec_min0.43685686215374986
driven_lanedir_max0.43685686215374986
driven_lanedir_mean0.43685686215374986
driven_lanedir_median0.43685686215374986
driven_lanedir_min0.43685686215374986
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.44159927688868106, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215374986, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551814, "distance-from-start": 0.43794917699306546, "deviation-center-line": 0.2706641555254041, "driven_lanedir_consec": 0.43685686215374986}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
1419sim-2of4host-errorno0:05:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1415sim-1of4successno0:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.99999999999901
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204529797293048
deviation-center-line_median4.299642634855429


other stats
deviation-center-line_max4.299642634855429
deviation-center-line_mean4.299642634855429
deviation-center-line_min4.299642634855429
deviation-heading_max7.7378824423555965
deviation-heading_mean7.7378824423555965
deviation-heading_median7.7378824423555965
deviation-heading_min7.7378824423555965
distance-from-start_max1.2060007896591365
distance-from-start_mean1.2060007896591365
distance-from-start_median1.2060007896591365
distance-from-start_min1.2060007896591365
driven_any_max3.1430848844497925
driven_any_mean3.1430848844497925
driven_any_median3.1430848844497925
driven_any_min3.1430848844497925
driven_lanedir_consec_max1.4204529797293048
driven_lanedir_consec_mean1.4204529797293048
driven_lanedir_consec_min1.4204529797293048
driven_lanedir_max2.948696776147453
driven_lanedir_mean2.948696776147453
driven_lanedir_median2.948696776147453
driven_lanedir_min2.948696776147453
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.1430848844497925, "survival_time": 54.99999999999901, "driven_lanedir": 2.948696776147453, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7378824423555965, "distance-from-start": 1.2060007896591365, "deviation-center-line": 4.299642634855429, "driven_lanedir_consec": 1.4204529797293048}}
simulation-passed1
survival_time_max54.99999999999901
survival_time_mean54.99999999999901
survival_time_min54.99999999999901
No reset possible
1414sim-2of4host-errorno0:02:22
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1407sim-3of4successno0:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.43685686215374986
deviation-center-line_median0.2706641555254041


other stats
deviation-center-line_max0.2706641555254041
deviation-center-line_mean0.2706641555254041
deviation-center-line_min0.2706641555254041
deviation-heading_max0.7151185427551815
deviation-heading_mean0.7151185427551815
deviation-heading_median0.7151185427551815
deviation-heading_min0.7151185427551815
distance-from-start_max0.43794917699306546
distance-from-start_mean0.43794917699306546
distance-from-start_median0.43794917699306546
distance-from-start_min0.43794917699306546
driven_any_max0.4415992768886806
driven_any_mean0.4415992768886806
driven_any_median0.4415992768886806
driven_any_min0.4415992768886806
driven_lanedir_consec_max0.43685686215374986
driven_lanedir_consec_mean0.43685686215374986
driven_lanedir_consec_min0.43685686215374986
driven_lanedir_max0.43685686215374986
driven_lanedir_mean0.43685686215374986
driven_lanedir_median0.43685686215374986
driven_lanedir_min0.43685686215374986
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.4415992768886806, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215374986, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551815, "distance-from-start": 0.43794917699306546, "deviation-center-line": 0.2706641555254041, "driven_lanedir_consec": 0.43685686215374986}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
1406sim-0of4successno0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.4204195014292784
deviation-center-line_median4.9036007238733


other stats
deviation-center-line_max4.9036007238733
deviation-center-line_mean4.9036007238733
deviation-center-line_min4.9036007238733
deviation-heading_max7.744574643696205
deviation-heading_mean7.744574643696205
deviation-heading_median7.744574643696205
deviation-heading_min7.744574643696205
distance-from-start_max1.2060007972132514
distance-from-start_mean1.2060007972132514
distance-from-start_median1.2060007972132514
distance-from-start_min1.2060007972132514
driven_any_max3.4850840176965696
driven_any_mean3.4850840176965696
driven_any_median3.4850840176965696
driven_any_min3.4850840176965696
driven_lanedir_consec_max1.4204195014292784
driven_lanedir_consec_mean1.4204195014292784
driven_lanedir_consec_min1.4204195014292784
driven_lanedir_max3.2905070650128003
driven_lanedir_mean3.2905070650128003
driven_lanedir_median3.2905070650128003
driven_lanedir_min3.2905070650128003
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840176965696, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905070650128003, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574643696205, "distance-from-start": 1.2060007972132514, "deviation-center-line": 4.9036007238733, "driven_lanedir_consec": 1.4204195014292784}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible