Duckietown Challenges Home Challenges Submissions

Submission 149

Submission149
Competinguser retired
Challengeaido-LFI-full-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1687 sim-1of4: 1706 sim-2of4: 1681 sim-3of4: 1682
Next
User labelminimal-agent-full
Admin priority50
Blessingn/a
User priority50

1706

Click the images to see detailed statistics about the episode.

udem1-000

1687

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1706sim-1of4successno0:13:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5152254385002415
deviation-center-line_median4.002587878600771


other stats
deviation-center-line_max4.002587878600771
deviation-center-line_mean4.002587878600771
deviation-center-line_min4.002587878600771
deviation-heading_max7.890763160965315
deviation-heading_mean7.890763160965315
deviation-heading_median7.890763160965315
deviation-heading_min7.890763160965315
distance-from-start_max2.12987115230656
distance-from-start_mean2.12987115230656
distance-from-start_median2.12987115230656
distance-from-start_min2.12987115230656
driven_any_max3.5795907883793245
driven_any_mean3.5795907883793245
driven_any_median3.5795907883793245
driven_any_min3.5795907883793245
driven_lanedir_consec_max3.5152254385002415
driven_lanedir_consec_mean3.5152254385002415
driven_lanedir_consec_min3.5152254385002415
driven_lanedir_max3.522144437985599
driven_lanedir_mean3.522144437985599
driven_lanedir_median3.522144437985599
driven_lanedir_min3.522144437985599
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.5795907883793245, "survival_time": 59.99999999999873, "driven_lanedir": 3.522144437985599, "in-drivable-lane": 0.0, "deviation-heading": 7.890763160965315, "distance-from-start": 2.12987115230656, "deviation-center-line": 4.002587878600771, "driven_lanedir_consec": 3.5152254385002415}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1698sim-1of4host-errorno0:03:39
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1687sim-0of4successno0:06:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.5152252733816995
deviation-center-line_median4.0025878682920135


other stats
deviation-center-line_max4.0025878682920135
deviation-center-line_mean4.0025878682920135
deviation-center-line_min4.0025878682920135
deviation-heading_max7.890763160970441
deviation-heading_mean7.890763160970441
deviation-heading_median7.890763160970441
deviation-heading_min7.890763160970441
distance-from-start_max2.1298711512095228
distance-from-start_mean2.1298711512095228
distance-from-start_median2.1298711512095228
distance-from-start_min2.1298711512095228
driven_any_max3.579590788379324
driven_any_mean3.579590788379324
driven_any_median3.579590788379324
driven_any_min3.579590788379324
driven_lanedir_consec_max3.5152252733816995
driven_lanedir_consec_mean3.5152252733816995
driven_lanedir_consec_min3.5152252733816995
driven_lanedir_max3.522144272867058
driven_lanedir_mean3.522144272867058
driven_lanedir_median3.522144272867058
driven_lanedir_min3.522144272867058
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.579590788379324, "survival_time": 59.99999999999873, "driven_lanedir": 3.522144272867058, "in-drivable-lane": 0.0, "deviation-heading": 7.890763160970441, "distance-from-start": 2.1298711512095228, "deviation-center-line": 4.0025878682920135, "driven_lanedir_consec": 3.5152252733816995}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1686sim-1of4host-errorno0:02:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1682sim-3of4successno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
1681sim-2of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible