Duckietown Challenges Home Challenges Submissions

Submission 121

Submission121
Competinguser retired
Challengeaido-LFVI-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 2974 sim-1of4: 2988 sim-2of4: 2977 sim-3of4: 2976
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
2988sim-1of4successno0:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.000000000000009
in-drivable-lane_median8.15000000000001
driven_lanedir_consec_median0.2269615332099022
deviation-center-line_median0.14293272606509247


other stats
deviation-center-line_max0.14293272606509247
deviation-center-line_mean0.14293272606509247
deviation-center-line_min0.14293272606509247
deviation-heading_max1.7176014572399136
deviation-heading_mean1.7176014572399136
deviation-heading_median1.7176014572399136
deviation-heading_min1.7176014572399136
distance-from-start_max2.518587338186655
distance-from-start_mean2.518587338186655
distance-from-start_median2.518587338186655
distance-from-start_min2.518587338186655
driven_any_max2.69533960364352
driven_any_mean2.69533960364352
driven_any_median2.69533960364352
driven_any_min2.69533960364352
driven_lanedir_consec_max0.2269615332099022
driven_lanedir_consec_mean0.2269615332099022
driven_lanedir_consec_min0.2269615332099022
driven_lanedir_max0.2269615332099022
driven_lanedir_mean0.2269615332099022
driven_lanedir_median0.2269615332099022
driven_lanedir_min0.2269615332099022
in-drivable-lane_max8.15000000000001
in-drivable-lane_mean8.15000000000001
in-drivable-lane_min8.15000000000001
per-episodes
details{"udem-000-ego0": {"driven_any": 2.69533960364352, "survival_time": 10.000000000000009, "driven_lanedir": 0.2269615332099022, "in-drivable-lane": 8.15000000000001, "deviation-heading": 1.7176014572399136, "distance-from-start": 2.518587338186655, "deviation-center-line": 0.14293272606509247, "driven_lanedir_consec": 0.2269615332099022}}
simulation-passed1
survival_time_max10.000000000000009
survival_time_mean10.000000000000009
survival_time_min10.000000000000009
No reset possible
2978sim-1of4host-errorno0:05:16
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2977sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2976sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2974sim-0of4successno0:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median4.249999999999989
driven_lanedir_consec_median0.20327557127530185
deviation-center-line_median0.07653992088278146


other stats
deviation-center-line_max0.07653992088278146
deviation-center-line_mean0.07653992088278146
deviation-center-line_min0.07653992088278146
deviation-heading_max0.572422561966045
deviation-heading_mean0.572422561966045
deviation-heading_median0.572422561966045
deviation-heading_min0.572422561966045
distance-from-start_max1.184980170640146
distance-from-start_mean1.184980170640146
distance-from-start_median1.184980170640146
distance-from-start_min1.184980170640146
driven_any_max1.284110184605746
driven_any_mean1.284110184605746
driven_any_median1.284110184605746
driven_any_min1.284110184605746
driven_lanedir_consec_max0.20327557127530185
driven_lanedir_consec_mean0.20327557127530185
driven_lanedir_consec_min0.20327557127530185
driven_lanedir_max0.20327557127530185
driven_lanedir_mean0.20327557127530185
driven_lanedir_median0.20327557127530185
driven_lanedir_min0.20327557127530185
in-drivable-lane_max4.249999999999989
in-drivable-lane_mean4.249999999999989
in-drivable-lane_min4.249999999999989
per-episodes
details{"4way-000-ego0": {"driven_any": 1.284110184605746, "survival_time": 5.299999999999989, "driven_lanedir": 0.20327557127530185, "in-drivable-lane": 4.249999999999989, "deviation-heading": 0.572422561966045, "distance-from-start": 1.184980170640146, "deviation-center-line": 0.07653992088278146, "driven_lanedir_consec": 0.20327557127530185}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible