Duckietown Challenges Home Challenges Submissions

Submission 124

Submission124
Competinguser retired
Challengeaido-LFVI_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 2958 sim-1of4: 2952 sim-2of4: 2954 sim-3of4: 2955
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
2958sim-0of4successno0:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median3.34999999999999
driven_lanedir_consec_median0.26519662416725864
deviation-center-line_median0.12634091828121083


other stats
deviation-center-line_max0.27186356727552663
deviation-center-line_mean0.1463794166165053
deviation-center-line_min0.060972262628072864
deviation-heading_max2.690984011863269
deviation-heading_mean0.9937154181449064
deviation-heading_median0.45156735160593914
deviation-heading_min0.38074295750447823
distance-from-start_max1.0748749042524717
distance-from-start_mean0.6361689509158333
distance-from-start_median0.552951716268475
distance-from-start_min0.36389746687391195
driven_any_max1.0962051858375628
driven_any_mean0.6455521597451076
driven_any_median0.560836599131207
driven_any_min0.36433025488045384
driven_lanedir_consec_max0.33955600310062994
driven_lanedir_consec_mean0.2422551770553763
driven_lanedir_consec_min0.09907145678635798
driven_lanedir_max0.33955600310062994
driven_lanedir_mean0.2422551770553763
driven_lanedir_median0.26519662416725864
driven_lanedir_min0.09907145678635798
in-drivable-lane_max4.149999999999991
in-drivable-lane_mean3.312499999999991
in-drivable-lane_min2.399999999999995
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0962051858375628, "survival_time": 4.899999999999991, "driven_lanedir": 0.21348498690931028, "in-drivable-lane": 2.399999999999995, "deviation-heading": 2.690984011863269, "distance-from-start": 1.0748749042524717, "deviation-center-line": 0.27186356727552663, "driven_lanedir_consec": 0.21348498690931028}, "4way-000-ego1": {"driven_any": 0.36433025488045384, "survival_time": 4.899999999999991, "driven_lanedir": 0.33955600310062994, "in-drivable-lane": 3.1999999999999895, "deviation-heading": 0.4018375149298848, "distance-from-start": 0.36389746687391195, "deviation-center-line": 0.1678383506580381, "driven_lanedir_consec": 0.33955600310062994}, "4way-000-ego2": {"driven_any": 0.38537018121812344, "survival_time": 4.899999999999991, "driven_lanedir": 0.316908261425207, "in-drivable-lane": 3.4999999999999902, "deviation-heading": 0.38074295750447823, "distance-from-start": 0.3832317474140655, "deviation-center-line": 0.08484348590438359, "driven_lanedir_consec": 0.316908261425207}, "4way-000-ego3": {"driven_any": 0.7363030170442905, "survival_time": 4.899999999999991, "driven_lanedir": 0.09907145678635798, "in-drivable-lane": 4.149999999999991, "deviation-heading": 0.5012971882819934, "distance-from-start": 0.7226716851228843, "deviation-center-line": 0.060972262628072864, "driven_lanedir_consec": 0.09907145678635798}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
2955sim-3of4successno0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2954sim-2of4successno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2952sim-1of4successno0:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999987
in-drivable-lane_median3.949999999999988
driven_lanedir_consec_median0.2800135560101482
deviation-center-line_median0.15407948951382164


other stats
deviation-center-line_max0.5527750956568663
deviation-center-line_mean0.2315507011098087
deviation-center-line_min0.06526872975472511
deviation-heading_max1.0621475139643064
deviation-heading_mean0.7353208279569268
deviation-heading_median0.6810764433205264
deviation-heading_min0.5169829112223479
distance-from-start_max1.3638162335999815
distance-from-start_mean0.8059946708964913
distance-from-start_median0.7488238692528748
distance-from-start_min0.3625147114802341
driven_any_max1.440782107961685
driven_any_mean0.8353876792117985
driven_any_median0.7689727730074976
driven_any_min0.36282306287051386
driven_lanedir_consec_max0.6415622537732046
driven_lanedir_consec_mean0.33898480637841377
driven_lanedir_consec_min0.15434985972015405
driven_lanedir_max0.6415622537732046
driven_lanedir_mean0.33898480637841377
driven_lanedir_median0.2800135560101482
driven_lanedir_min0.15434985972015405
in-drivable-lane_max4.849999999999987
in-drivable-lane_mean3.187499999999991
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.440782107961685, "survival_time": 5.799999999999987, "driven_lanedir": 0.15583329242553037, "in-drivable-lane": 4.849999999999987, "deviation-heading": 0.6045192034147711, "distance-from-start": 1.3638162335999815, "deviation-center-line": 0.06526872975472511, "driven_lanedir_consec": 0.15583329242553037}, "udem-000-ego1": {"driven_any": 1.1284398628504213, "survival_time": 5.799999999999987, "driven_lanedir": 0.6415622537732046, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.7576336832262818, "distance-from-start": 1.0882716235939474, "deviation-center-line": 0.2135151535410185, "driven_lanedir_consec": 0.6415622537732046}, "udem-000-ego2": {"driven_any": 0.4095056831645738, "survival_time": 5.799999999999987, "driven_lanedir": 0.4041938195947661, "in-drivable-lane": 0.0, "deviation-heading": 1.0621475139643064, "distance-from-start": 0.40937611491180215, "deviation-center-line": 0.5527750956568663, "driven_lanedir_consec": 0.4041938195947661}, "udem-000-ego3": {"driven_any": 0.36282306287051386, "survival_time": 5.799999999999987, "driven_lanedir": 0.15434985972015405, "in-drivable-lane": 4.849999999999987, "deviation-heading": 0.5169829112223479, "distance-from-start": 0.3625147114802341, "deviation-center-line": 0.0946438254866248, "driven_lanedir_consec": 0.15434985972015405}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
2950sim-1of4host-errorno0:00:25
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2931sim-1of4host-errorno0:03:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible