Duckietown Challenges Home Challenges Submissions

Submission 117

Submission117
Competinguser retired
Challengeaido-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 3014 sim-1of4: 3005 sim-2of4: 2999 sim-3of4: 2995
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

3014

Click the images to see detailed statistics about the episode.

4way-000

3005

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
3014sim-0of4successno0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.799999999999984
in-drivable-lane_median5.249999999999985
driven_lanedir_consec_median0.28767761822445365
deviation-center-line_median0.1145937481867311


other stats
deviation-center-line_max0.16558961354468332
deviation-center-line_mean0.11463710698876164
deviation-center-line_min0.06377131803690098
deviation-heading_max1.4792561779937492
deviation-heading_mean0.8528556211586686
deviation-heading_median0.7544966135727436
deviation-heading_min0.42317307949543814
distance-from-start_max1.6796019602593193
distance-from-start_mean1.020619325886392
distance-from-start_median0.9336899078386726
distance-from-start_min0.5354955276089036
driven_any_max1.8248410618090585
driven_any_mean1.0671548706875458
driven_any_median0.947540892798906
driven_any_min0.5486966353433125
driven_lanedir_consec_max0.6464886927315969
driven_lanedir_consec_mean0.33616116837189514
driven_lanedir_consec_min0.12280074430707644
driven_lanedir_max0.6464886927315969
driven_lanedir_mean0.33616116837189514
driven_lanedir_median0.28767761822445365
driven_lanedir_min0.12280074430707644
in-drivable-lane_max5.999999999999984
in-drivable-lane_mean5.149999999999984
in-drivable-lane_min4.099999999999985
per-episodes
details{"4way-000-ego0": {"driven_any": 1.8248410618090585, "survival_time": 6.799999999999984, "driven_lanedir": 0.340978135519559, "in-drivable-lane": 4.849999999999986, "deviation-heading": 1.4792561779937492, "distance-from-start": 1.6796019602593193, "deviation-center-line": 0.16558961354468332, "driven_lanedir_consec": 0.340978135519559}, "4way-000-ego1": {"driven_any": 0.7410379470568906, "survival_time": 6.799999999999984, "driven_lanedir": 0.12280074430707644, "in-drivable-lane": 5.999999999999984, "deviation-heading": 0.472733172313583, "distance-from-start": 0.7335073353335224, "deviation-center-line": 0.06377131803690098, "driven_lanedir_consec": 0.12280074430707644}, "4way-000-ego2": {"driven_any": 1.154043838540921, "survival_time": 6.799999999999984, "driven_lanedir": 0.6464886927315969, "in-drivable-lane": 4.099999999999985, "deviation-heading": 1.036260054831904, "distance-from-start": 1.1338724803438227, "deviation-center-line": 0.16173690515741, "driven_lanedir_consec": 0.6464886927315969}, "4way-000-ego3": {"driven_any": 0.5486966353433125, "survival_time": 6.799999999999984, "driven_lanedir": 0.23437710092934827, "in-drivable-lane": 5.6499999999999835, "deviation-heading": 0.42317307949543814, "distance-from-start": 0.5354955276089036, "deviation-center-line": 0.06745059121605222, "driven_lanedir_consec": 0.23437710092934827}}
simulation-passed1
survival_time_max6.799999999999984
survival_time_mean6.799999999999984
survival_time_min6.799999999999984
No reset possible
3006sim-0of4host-errorno0:05:30
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3005sim-1of4successno0:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.349999999999998
in-drivable-lane_median6.775
driven_lanedir_consec_median0.45308847438457234
deviation-center-line_median0.15936992539834413


other stats
deviation-center-line_max0.37874755832135415
deviation-center-line_mean0.1942027124259035
deviation-center-line_min0.07932344058557161
deviation-heading_max2.275239410536328
deviation-heading_mean1.1993079551749948
deviation-heading_median1.0317804971113833
deviation-heading_min0.4584314159408844
distance-from-start_max2.258659189235389
distance-from-start_mean0.9971850342062004
distance-from-start_median0.6789336563326802
distance-from-start_min0.3722136349240526
driven_any_max2.4126077185685877
driven_any_mean1.0412255841161195
driven_any_median0.6895420595191604
driven_any_min0.3732104988575698
driven_lanedir_consec_max0.9279724697035908
driven_lanedir_consec_mean0.5003040496228683
driven_lanedir_consec_min0.16706678001873798
driven_lanedir_max0.9279724697035908
driven_lanedir_mean0.5075718009560313
driven_lanedir_median0.4676239770508983
driven_lanedir_min0.16706678001873798
in-drivable-lane_max8.449999999999998
in-drivable-lane_mean6.887500000000001
in-drivable-lane_min5.550000000000006
per-episodes
details{"udem-000-ego0": {"driven_any": 2.4126077185685877, "survival_time": 9.349999999999998, "driven_lanedir": 0.9279724697035908, "in-drivable-lane": 5.550000000000006, "deviation-heading": 1.4847246034228705, "distance-from-start": 2.258659189235389, "deviation-center-line": 0.37874755832135415, "driven_lanedir_consec": 0.9279724697035908}, "udem-000-ego1": {"driven_any": 0.3732104988575698, "survival_time": 9.349999999999998, "driven_lanedir": 0.16706678001873798, "in-drivable-lane": 8.449999999999998, "deviation-heading": 0.4584314159408844, "distance-from-start": 0.3722136349240526, "deviation-center-line": 0.07932344058557161, "driven_lanedir_consec": 0.16706678001873798}, "udem-000-ego2": {"driven_any": 0.37946609178187185, "survival_time": 9.349999999999998, "driven_lanedir": 0.27588281384786795, "in-drivable-lane": 7.949999999999997, "deviation-heading": 0.5788363907998962, "distance-from-start": 0.37367421140426493, "deviation-center-line": 0.08212170903512288, "driven_lanedir_consec": 0.27588281384786795}, "udem-000-ego3": {"driven_any": 0.9996180272564488, "survival_time": 9.349999999999998, "driven_lanedir": 0.6593651402539287, "in-drivable-lane": 5.600000000000003, "deviation-heading": 2.275239410536328, "distance-from-start": 0.9841931012610956, "deviation-center-line": 0.2366181417615654, "driven_lanedir_consec": 0.6302941349212767}}
simulation-passed1
survival_time_max9.349999999999998
survival_time_mean9.349999999999998
survival_time_min9.349999999999998
No reset possible
2999sim-2of4successno0:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
2998sim-1of4host-errorno0:03:43
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2997sim-2of4successno0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2996sim-0of4host-errorno0:04:20
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2995sim-3of4successno0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible