Duckietown Challenges Home Challenges Submissions

Submission 182

Submission182
Competinguser retired
Challengeaido-LFI-state-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 1455 sim-1of4: 1487 sim-2of4: 1454 sim-3of4: 1452
Next
User labelminimal-agent-state
Admin priority50
Blessingn/a
User priority50

1487

Click the images to see detailed statistics about the episode.

4way-000

1455

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
1487sim-1of4successno0:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.422693327269467
deviation-center-line_median4.174748477641233


other stats
deviation-center-line_max4.174748477641233
deviation-center-line_mean4.174748477641233
deviation-center-line_min4.174748477641233
deviation-heading_max4.53375631696134
deviation-heading_mean4.53375631696134
deviation-heading_median4.53375631696134
deviation-heading_min4.53375631696134
distance-from-start_max2.2784552816176964
distance-from-start_mean2.2784552816176964
distance-from-start_median2.2784552816176964
distance-from-start_min2.2784552816176964
driven_any_max3.5795871541140043
driven_any_mean3.5795871541140043
driven_any_median3.5795871541140043
driven_any_min3.5795871541140043
driven_lanedir_consec_max3.422693327269467
driven_lanedir_consec_mean3.422693327269467
driven_lanedir_consec_min3.422693327269467
driven_lanedir_max3.5561080143932853
driven_lanedir_mean3.5561080143932853
driven_lanedir_median3.5561080143932853
driven_lanedir_min3.5561080143932853
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795871541140043, "survival_time": 59.99999999999873, "driven_lanedir": 3.5561080143932853, "in-drivable-lane": 0.0, "deviation-heading": 4.53375631696134, "distance-from-start": 2.2784552816176964, "deviation-center-line": 4.174748477641233, "driven_lanedir_consec": 3.422693327269467}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
1477sim-1of4host-errorno0:07:26
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1468sim-1of4host-errorno0:03:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1344, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1247, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 422, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1139, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 237, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 555, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1457sim-1of4host-errorno0:07:40
The container "simul [...]
The container "simulator" exited with code 137.


Error code 137 means an out-of-memory error. The container exceeded the memory available to it. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
1455sim-0of4successno0:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.8966134085487143
deviation-center-line_median3.8033318362841015


other stats
deviation-center-line_max3.8033318362841015
deviation-center-line_mean3.8033318362841015
deviation-center-line_min3.8033318362841015
deviation-heading_max4.074858735595131
deviation-heading_mean4.074858735595131
deviation-heading_median4.074858735595131
deviation-heading_min4.074858735595131
distance-from-start_max1.5745533995624932
distance-from-start_mean1.5745533995624932
distance-from-start_median1.5745533995624932
distance-from-start_min1.5745533995624932
driven_any_max2.9375948144939903
driven_any_mean2.9375948144939903
driven_any_median2.9375948144939903
driven_any_min2.9375948144939903
driven_lanedir_consec_max2.8966134085487143
driven_lanedir_consec_mean2.8966134085487143
driven_lanedir_consec_min2.8966134085487143
driven_lanedir_max2.916242176218587
driven_lanedir_mean2.916242176218587
driven_lanedir_median2.916242176218587
driven_lanedir_min2.916242176218587
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 2.9375948144939903, "survival_time": 49.9999999999993, "driven_lanedir": 2.916242176218587, "in-drivable-lane": 0.0, "deviation-heading": 4.074858735595131, "distance-from-start": 1.5745533995624932, "deviation-center-line": 3.8033318362841015, "driven_lanedir_consec": 2.8966134085487143}}
simulation-passed1
survival_time_max49.9999999999993
survival_time_mean49.9999999999993
survival_time_min49.9999999999993
No reset possible
1454sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
1452sim-3of4successno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible