Duckietown Challenges Home Challenges Submissions

Submission 112

Submission112
Competinguser retired
Challengeaido-LFP-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 3023 sim-1of4: 3021 sim-2of4: 3025 sim-3of4: 3031
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

3031

Click the images to see detailed statistics about the episode.

loop-000

3025

Click the images to see detailed statistics about the episode.

autolab-000

3023

Click the images to see detailed statistics about the episode.

loop2-000

3021

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
3031sim-3of4successno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.950000000000001
in-drivable-lane_median0.8000000000000007
driven_lanedir_consec_median0.15196217841452953
deviation-center-line_median0.06820417782690844


other stats
deviation-center-line_max0.06820417782690844
deviation-center-line_mean0.06820417782690844
deviation-center-line_min0.06820417782690844
deviation-heading_max0.7206949433165789
deviation-heading_mean0.7206949433165789
deviation-heading_median0.7206949433165789
deviation-heading_min0.7206949433165789
distance-from-start_max0.22155518863887824
distance-from-start_mean0.22155518863887824
distance-from-start_median0.22155518863887824
distance-from-start_min0.22155518863887824
driven_any_max0.22315612607124924
driven_any_mean0.22315612607124924
driven_any_median0.22315612607124924
driven_any_min0.22315612607124924
driven_lanedir_consec_max0.15196217841452953
driven_lanedir_consec_mean0.15196217841452953
driven_lanedir_consec_min0.15196217841452953
driven_lanedir_max0.15196217841452953
driven_lanedir_mean0.15196217841452953
driven_lanedir_median0.15196217841452953
driven_lanedir_min0.15196217841452953
in-drivable-lane_max0.8000000000000007
in-drivable-lane_mean0.8000000000000007
in-drivable-lane_min0.8000000000000007
per-episodes
details{"loop-000-ego0": {"driven_any": 0.22315612607124924, "survival_time": 1.950000000000001, "driven_lanedir": 0.15196217841452953, "in-drivable-lane": 0.8000000000000007, "deviation-heading": 0.7206949433165789, "distance-from-start": 0.22155518863887824, "deviation-center-line": 0.06820417782690844, "driven_lanedir_consec": 0.15196217841452953}}
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.950000000000001
survival_time_min1.950000000000001
No reset possible
3029sim-3of4host-errorno0:03:38
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3025sim-2of4successno0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.099999999999993
in-drivable-lane_median2.8999999999999932
driven_lanedir_consec_median0.23085284392713357
deviation-center-line_median0.08903895096968942


other stats
deviation-center-line_max0.08903895096968942
deviation-center-line_mean0.08903895096968942
deviation-center-line_min0.08903895096968942
deviation-heading_max0.6003927528552271
deviation-heading_mean0.6003927528552271
deviation-heading_median0.6003927528552271
deviation-heading_min0.6003927528552271
distance-from-start_max0.9280212718612753
distance-from-start_mean0.9280212718612753
distance-from-start_median0.9280212718612753
distance-from-start_min0.9280212718612753
driven_any_max0.9491198682711116
driven_any_mean0.9491198682711116
driven_any_median0.9491198682711116
driven_any_min0.9491198682711116
driven_lanedir_consec_max0.23085284392713357
driven_lanedir_consec_mean0.23085284392713357
driven_lanedir_consec_min0.23085284392713357
driven_lanedir_max0.23085284392713357
driven_lanedir_mean0.23085284392713357
driven_lanedir_median0.23085284392713357
driven_lanedir_min0.23085284392713357
in-drivable-lane_max2.8999999999999932
in-drivable-lane_mean2.8999999999999932
in-drivable-lane_min2.8999999999999932
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.9491198682711116, "survival_time": 4.099999999999993, "driven_lanedir": 0.23085284392713357, "in-drivable-lane": 2.8999999999999932, "deviation-heading": 0.6003927528552271, "distance-from-start": 0.9280212718612753, "deviation-center-line": 0.08903895096968942, "driven_lanedir_consec": 0.23085284392713357}}
simulation-passed1
survival_time_max4.099999999999993
survival_time_mean4.099999999999993
survival_time_min4.099999999999993
No reset possible
3024sim-3of4successno0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3023sim-0of4successno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.949999999999983
in-drivable-lane_median4.449999999999985
driven_lanedir_consec_median0.4475128105949586
deviation-center-line_median0.2128373800737884


other stats
deviation-center-line_max0.2128373800737884
deviation-center-line_mean0.2128373800737884
deviation-center-line_min0.2128373800737884
deviation-heading_max1.603830063675076
deviation-heading_mean1.603830063675076
deviation-heading_median1.603830063675076
deviation-heading_min1.603830063675076
distance-from-start_max1.764913687779911
distance-from-start_mean1.764913687779911
distance-from-start_median1.764913687779911
distance-from-start_min1.764913687779911
driven_any_max1.7765974068809092
driven_any_mean1.7765974068809092
driven_any_median1.7765974068809092
driven_any_min1.7765974068809092
driven_lanedir_consec_max0.4475128105949586
driven_lanedir_consec_mean0.4475128105949586
driven_lanedir_consec_min0.4475128105949586
driven_lanedir_max0.4475128105949586
driven_lanedir_mean0.4475128105949586
driven_lanedir_median0.4475128105949586
driven_lanedir_min0.4475128105949586
in-drivable-lane_max4.449999999999985
in-drivable-lane_mean4.449999999999985
in-drivable-lane_min4.449999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.7765974068809092, "survival_time": 6.949999999999983, "driven_lanedir": 0.4475128105949586, "in-drivable-lane": 4.449999999999985, "deviation-heading": 1.603830063675076, "distance-from-start": 1.764913687779911, "deviation-center-line": 0.2128373800737884, "driven_lanedir_consec": 0.4475128105949586}}
simulation-passed1
survival_time_max6.949999999999983
survival_time_mean6.949999999999983
survival_time_min6.949999999999983
No reset possible
3021sim-1of4successno0:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.650000000000016
in-drivable-lane_median9.650000000000016
driven_lanedir_consec_median0.16277276642845084
deviation-center-line_median0.06194869969863484


other stats
deviation-center-line_max0.06194869969863484
deviation-center-line_mean0.06194869969863484
deviation-center-line_min0.06194869969863484
deviation-heading_max0.6051630068735905
deviation-heading_mean0.6051630068735905
deviation-heading_median0.6051630068735905
deviation-heading_min0.6051630068735905
distance-from-start_max2.823542972652465
distance-from-start_mean2.823542972652465
distance-from-start_median2.823542972652465
distance-from-start_min2.823542972652465
driven_any_max2.937661987261324
driven_any_mean2.937661987261324
driven_any_median2.937661987261324
driven_any_min2.937661987261324
driven_lanedir_consec_max0.16277276642845084
driven_lanedir_consec_mean0.16277276642845084
driven_lanedir_consec_min0.16277276642845084
driven_lanedir_max0.16277276642845084
driven_lanedir_mean0.16277276642845084
driven_lanedir_median0.16277276642845084
driven_lanedir_min0.16277276642845084
in-drivable-lane_max9.650000000000016
in-drivable-lane_mean9.650000000000016
in-drivable-lane_min9.650000000000016
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.937661987261324, "survival_time": 10.650000000000016, "driven_lanedir": 0.16277276642845084, "in-drivable-lane": 9.650000000000016, "deviation-heading": 0.6051630068735905, "distance-from-start": 2.823542972652465, "deviation-center-line": 0.06194869969863484, "driven_lanedir_consec": 0.16277276642845084}}
simulation-passed1
survival_time_max10.650000000000016
survival_time_mean10.650000000000016
survival_time_min10.650000000000016
No reset possible