Duckietown Challenges Home Challenges Submissions

Evaluator 93

ID93
evaluatordavinci-stage-03
owneruser1000001
machinedavinci-stage
processdavinci-stage-03
version6.2.45
first heard
last heard
statusinactive
# evaluating
# success12 8232
# timeout2 8930
# failed
# error
# aborted
# host-error11 8345
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors97%
RAM total (MB)251.6 GB
RAM free (MB)243.4 GB
Disk (MB)491.1 GB
Disk available (MB)181.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8967852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4timeoutnodavinci-stage-03----No reset possible
8963860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4host-errornodavinci-stage-030:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8942853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4host-errornodavinci-stage-030:01:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8930853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4timeoutnodavinci-stage-030:00:53
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8914852Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4host-errornodavinci-stage-030:00:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8824855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-0of4successnodavinci-stage-030:09:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.54999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2926691878522645
deviation-center-line_median3.961954170796273


other stats
deviation-center-line_max3.961954170796273
deviation-center-line_mean3.961954170796273
deviation-center-line_min3.961954170796273
deviation-heading_max3.0019673934722957
deviation-heading_mean3.0019673934722957
deviation-heading_median3.0019673934722957
deviation-heading_min3.0019673934722957
distance-from-start_max1.8411177593664525
distance-from-start_mean1.8411177593664525
distance-from-start_median1.8411177593664525
distance-from-start_min1.8411177593664525
driven_any_max2.310597586456975
driven_any_mean2.310597586456975
driven_any_median2.310597586456975
driven_any_min2.310597586456975
driven_lanedir_consec_max2.2926691878522645
driven_lanedir_consec_mean2.2926691878522645
driven_lanedir_consec_min2.2926691878522645
driven_lanedir_max2.2926691878522645
driven_lanedir_mean2.2926691878522645
driven_lanedir_median2.2926691878522645
driven_lanedir_min2.2926691878522645
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.310597586456975, "survival_time": 39.54999999999989, "driven_lanedir": 2.2926691878522645, "in-drivable-lane": 0.0, "deviation-heading": 3.0019673934722957, "distance-from-start": 1.8411177593664525, "deviation-center-line": 3.961954170796273, "driven_lanedir_consec": 2.2926691878522645}}
simulation-passed1
survival_time_max39.54999999999989
survival_time_mean39.54999999999989
survival_time_min39.54999999999989
No reset possible
8811854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4host-errornodavinci-stage-030:00:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8809854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4host-errornodavinci-stage-030:00:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8808854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4host-errornodavinci-stage-030:00:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8772855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-3of4successnodavinci-stage-030:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.849999999999876
driven_lanedir_consec_median2.2261398186252195
deviation-center-line_median6.026388852659691


other stats
deviation-center-line_max6.026388852659691
deviation-center-line_mean6.026388852659691
deviation-center-line_min6.026388852659691
deviation-heading_max10.12511562520589
deviation-heading_mean10.12511562520589
deviation-heading_median10.12511562520589
deviation-heading_min10.12511562520589
distance-from-start_max1.712119374671022
distance-from-start_mean1.712119374671022
distance-from-start_median1.712119374671022
distance-from-start_min1.712119374671022
driven_any_max3.434227933985191
driven_any_mean3.434227933985191
driven_any_median3.434227933985191
driven_any_min3.434227933985191
driven_lanedir_consec_max2.2261398186252195
driven_lanedir_consec_mean2.2261398186252195
driven_lanedir_consec_min2.2261398186252195
driven_lanedir_max3.1490843763375547
driven_lanedir_mean3.1490843763375547
driven_lanedir_median3.1490843763375547
driven_lanedir_min3.1490843763375547
in-drivable-lane_max4.849999999999876
in-drivable-lane_mean4.849999999999876
in-drivable-lane_min4.849999999999876
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.434227933985191, "survival_time": 59.99999999999873, "driven_lanedir": 3.1490843763375547, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.12511562520589, "distance-from-start": 1.712119374671022, "deviation-center-line": 6.026388852659691, "driven_lanedir_consec": 2.2261398186252195}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8734861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4successnodavinci-stage-030:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median1.6999999999999993
driven_lanedir_consec_median0.017998370632290372
deviation-center-line_median0.009977449447227685


other stats
deviation-center-line_max0.009977449447227685
deviation-center-line_mean0.009977449447227685
deviation-center-line_min0.009977449447227685
deviation-heading_max0.6251202104697304
deviation-heading_mean0.6251202104697304
deviation-heading_median0.6251202104697304
deviation-heading_min0.6251202104697304
distance-from-start_max0.10141421289289594
distance-from-start_mean0.10141421289289594
distance-from-start_median0.10141421289289594
distance-from-start_min0.10141421289289594
driven_any_max0.1623878249477941
driven_any_mean0.1623878249477941
driven_any_median0.1623878249477941
driven_any_min0.1623878249477941
driven_lanedir_consec_max0.017998370632290372
driven_lanedir_consec_mean0.017998370632290372
driven_lanedir_consec_min0.017998370632290372
driven_lanedir_max0.017998370632290372
driven_lanedir_mean0.017998370632290372
driven_lanedir_median0.017998370632290372
driven_lanedir_min0.017998370632290372
in-drivable-lane_max1.6999999999999993
in-drivable-lane_mean1.6999999999999993
in-drivable-lane_min1.6999999999999993
per-episodes
details{"udem-000-ego0": {"driven_any": 0.1623878249477941, "survival_time": 2.4499999999999993, "driven_lanedir": 0.017998370632290372, "in-drivable-lane": 1.6999999999999993, "deviation-heading": 0.6251202104697304, "distance-from-start": 0.10141421289289594, "deviation-center-line": 0.009977449447227685, "driven_lanedir_consec": 0.017998370632290372}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
8513864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4successnodavinci-stage-030:22:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median44.62499999999892
driven_lanedir_consec_median0.17950078954944182
deviation-center-line_median1.177216439825663


other stats
deviation-center-line_max9.860212962477547
deviation-center-line_mean3.0599684543856243
deviation-center-line_min0.025227975413623777
deviation-heading_max66.61996147903312
deviation-heading_mean23.12080005912356
deviation-heading_median12.55977395799906
deviation-heading_min0.7436908414630016
distance-from-start_max0.3566891451741072
distance-from-start_mean0.2461338264963797
distance-from-start_median0.24783411309291423
distance-from-start_min0.13217793462558297
driven_any_max6.215244159406516
driven_any_mean1.8614079892528672
driven_any_median0.5338814038863001
driven_any_min0.16262498983235335
driven_lanedir_consec_max1.784541920335276
driven_lanedir_consec_mean0.5454185317707815
driven_lanedir_consec_min0.03813062764896635
driven_lanedir_max1.784541920335276
driven_lanedir_mean0.5454185317707815
driven_lanedir_median0.17950078954944182
driven_lanedir_min0.03813062764896635
in-drivable-lane_max59.04999999999873
in-drivable-lane_mean37.94999999999914
in-drivable-lane_min3.4999999999999902
per-episodes
details{"4way-000-ego0": {"driven_any": 0.16262498983235335, "survival_time": 59.99999999999873, "driven_lanedir": 0.03813062764896635, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.8104952727782007, "distance-from-start": 0.13217793462558297, "deviation-center-line": 0.025227975413623777, "driven_lanedir_consec": 0.03813062764896635}, "4way-000-ego1": {"driven_any": 0.35772507279164445, "survival_time": 59.99999999999873, "driven_lanedir": 0.10185758692727752, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.7436908414630016, "distance-from-start": 0.25952755934678473, "deviation-center-line": 0.09543171525787858, "driven_lanedir_consec": 0.10185758692727752}, "4way-000-ego2": {"driven_any": 0.7100377349809558, "survival_time": 59.99999999999873, "driven_lanedir": 0.2571439921716061, "in-drivable-lane": 3.4999999999999902, "deviation-heading": 66.61996147903312, "distance-from-start": 0.23614066683904375, "deviation-center-line": 9.860212962477547, "driven_lanedir_consec": 0.2571439921716061}, "4way-000-ego3": {"driven_any": 6.215244159406516, "survival_time": 59.99999999999873, "driven_lanedir": 1.784541920335276, "in-drivable-lane": 30.349999999999117, "deviation-heading": 24.30905264321992, "distance-from-start": 0.3566891451741072, "deviation-center-line": 2.2590011643934473, "driven_lanedir_consec": 1.784541920335276}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8503861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-3of4host-errornodavinci-stage-030:00:57
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8492862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4host-errornodavinci-stage-030:00:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8478862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4host-errornodavinci-stage-030:01:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8449862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successnodavinci-stage-030:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8424862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-1of4successnodavinci-stage-030:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median1.2999999999999994
driven_lanedir_consec_median0.0992854162011758
deviation-center-line_median0.05681860676438433


other stats
deviation-center-line_max0.05681860676438433
deviation-center-line_mean0.05681860676438433
deviation-center-line_min0.05681860676438433
deviation-heading_max0.8059491902661039
deviation-heading_mean0.8059491902661039
deviation-heading_median0.8059491902661039
deviation-heading_min0.8059491902661039
distance-from-start_max0.27921792807782053
distance-from-start_mean0.27921792807782053
distance-from-start_median0.27921792807782053
distance-from-start_min0.27921792807782053
driven_any_max0.29174550446269315
driven_any_mean0.29174550446269315
driven_any_median0.29174550446269315
driven_any_min0.29174550446269315
driven_lanedir_consec_max0.0992854162011758
driven_lanedir_consec_mean0.0992854162011758
driven_lanedir_consec_min0.0992854162011758
driven_lanedir_max0.0992854162011758
driven_lanedir_mean0.0992854162011758
driven_lanedir_median0.0992854162011758
driven_lanedir_min0.0992854162011758
in-drivable-lane_max1.2999999999999994
in-drivable-lane_mean1.2999999999999994
in-drivable-lane_min1.2999999999999994
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.29174550446269315, "survival_time": 2.3499999999999996, "driven_lanedir": 0.0992854162011758, "in-drivable-lane": 1.2999999999999994, "deviation-heading": 0.8059491902661039, "distance-from-start": 0.27921792807782053, "deviation-center-line": 0.05681860676438433, "driven_lanedir_consec": 0.0992854162011758}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
8351863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successnodavinci-stage-030:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9695531787466467
survival_time_median59.99999999999873
deviation-center-line_median1.6971736359562966
in-drivable-lane_median32.69999999999929


other stats
deviation-center-line_max1.6971736359562966
deviation-center-line_mean1.6971736359562966
deviation-center-line_min1.6971736359562966
deviation-heading_max22.92513836647
deviation-heading_mean22.92513836647
deviation-heading_median22.92513836647
deviation-heading_min22.92513836647
distance-from-start_max0.2620450125392862
distance-from-start_mean0.2620450125392862
distance-from-start_median0.2620450125392862
distance-from-start_min0.2620450125392862
driven_any_max7.413059035729653
driven_any_mean7.413059035729653
driven_any_median7.413059035729653
driven_any_min7.413059035729653
driven_lanedir_consec_max1.9695531787466467
driven_lanedir_consec_mean1.9695531787466467
driven_lanedir_consec_min1.9695531787466467
driven_lanedir_max1.9695531787466467
driven_lanedir_mean1.9695531787466467
driven_lanedir_median1.9695531787466467
driven_lanedir_min1.9695531787466467
in-drivable-lane_max32.69999999999929
in-drivable-lane_mean32.69999999999929
in-drivable-lane_min32.69999999999929
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.413059035729653, "survival_time": 59.99999999999873, "driven_lanedir": 1.9695531787466467, "in-drivable-lane": 32.69999999999929, "deviation-heading": 22.92513836647, "distance-from-start": 0.2620450125392862, "deviation-center-line": 1.6971736359562966, "driven_lanedir_consec": 1.9695531787466467}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8348863Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4host-errornodavinci-stage-030:00:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8345864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornodavinci-stage-030:00:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8312865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-3of4successnodavinci-stage-030:17:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.950000000000095
in-drivable-lane_median25.82500000000007
driven_lanedir_consec_median1.059998506416722
deviation-center-line_median0.7676299742210693


other stats
deviation-center-line_max1.066203339278742
deviation-center-line_mean0.6597813086928304
deviation-center-line_min0.03766194705044126
deviation-heading_max8.965698980170801
deviation-heading_mean6.2233026250109695
deviation-heading_median7.491741010213317
deviation-heading_min0.9440294994464442
distance-from-start_max0.9392917647622416
distance-from-start_mean0.4883476782140382
distance-from-start_median0.3921841010047591
distance-from-start_min0.2297307460843928
driven_any_max7.842884876821172
driven_any_mean3.6383940205062615
driven_any_median3.200754778444729
driven_any_min0.30918164831441797
driven_lanedir_consec_max1.9690782221594083
driven_lanedir_consec_mean1.031159021808912
driven_lanedir_consec_min0.035560852242794594
driven_lanedir_max1.9690782221594083
driven_lanedir_mean1.031159021808912
driven_lanedir_median1.059998506416722
driven_lanedir_min0.035560852242794594
in-drivable-lane_max34.950000000000095
in-drivable-lane_mean24.325000000000088
in-drivable-lane_min10.700000000000111
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.30918164831441797, "survival_time": 35.950000000000095, "driven_lanedir": 0.035560852242794594, "in-drivable-lane": 34.950000000000095, "deviation-heading": 0.9440294994464442, "distance-from-start": 0.2297307460843928, "deviation-center-line": 0.03766194705044126, "driven_lanedir_consec": 0.035560852242794594}, "zigzag-000-ego1": {"driven_any": 4.656098221608442, "survival_time": 35.950000000000095, "driven_lanedir": 1.9690782221594083, "in-drivable-lane": 10.700000000000111, "deviation-heading": 8.965698980170801, "distance-from-start": 0.4298626695104294, "deviation-center-line": 0.956384635487038, "driven_lanedir_consec": 1.9690782221594083}, "zigzag-000-ego2": {"driven_any": 1.7454113352810154, "survival_time": 35.950000000000095, "driven_lanedir": 0.51124609097592, "in-drivable-lane": 27.15000000000005, "deviation-heading": 6.95029806566184, "distance-from-start": 0.3545055324990887, "deviation-center-line": 0.5788753129551004, "driven_lanedir_consec": 0.51124609097592}, "zigzag-000-ego3": {"driven_any": 7.842884876821172, "survival_time": 35.950000000000095, "driven_lanedir": 1.6087509218575244, "in-drivable-lane": 24.500000000000103, "deviation-heading": 8.033183954764795, "distance-from-start": 0.9392917647622416, "deviation-center-line": 1.066203339278742, "driven_lanedir_consec": 1.6087509218575244}}
simulation-passed1
survival_time_max35.950000000000095
survival_time_mean35.950000000000095
survival_time_min35.950000000000095
No reset possible
8258872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4successnodavinci-stage-030:15:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.299999999999432
driven_lanedir_consec_median2.2957354701278443
deviation-center-line_median1.4363129207272496


other stats
deviation-center-line_max1.4363129207272496
deviation-center-line_mean1.4363129207272496
deviation-center-line_min1.4363129207272496
deviation-heading_max24.670560319749463
deviation-heading_mean24.670560319749463
deviation-heading_median24.670560319749463
deviation-heading_min24.670560319749463
distance-from-start_max0.3486179691076407
distance-from-start_mean0.3486179691076407
distance-from-start_median0.3486179691076407
distance-from-start_min0.3486179691076407
driven_any_max6.654274719179294
driven_any_mean6.654274719179294
driven_any_median6.654274719179294
driven_any_min6.654274719179294
driven_lanedir_consec_max2.2957354701278443
driven_lanedir_consec_mean2.2957354701278443
driven_lanedir_consec_min2.2957354701278443
driven_lanedir_max2.2957354701278443
driven_lanedir_mean2.2957354701278443
driven_lanedir_median2.2957354701278443
driven_lanedir_min2.2957354701278443
in-drivable-lane_max28.299999999999432
in-drivable-lane_mean28.299999999999432
in-drivable-lane_min28.299999999999432
per-episodes
details{"loop-000-ego0": {"driven_any": 6.654274719179294, "survival_time": 59.99999999999873, "driven_lanedir": 2.2957354701278443, "in-drivable-lane": 28.299999999999432, "deviation-heading": 24.670560319749463, "distance-from-start": 0.3486179691076407, "deviation-center-line": 1.4363129207272496, "driven_lanedir_consec": 2.2957354701278443}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8242874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4successnodavinci-stage-030:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.699999999999995
in-drivable-lane_median1.7999999999999938
driven_lanedir_consec_median0.21903722866057465
deviation-center-line_median0.08667575220737096


other stats
deviation-center-line_max0.08667575220737096
deviation-center-line_mean0.08667575220737096
deviation-center-line_min0.08667575220737096
deviation-heading_max1.111763062990207
deviation-heading_mean1.111763062990207
deviation-heading_median1.111763062990207
deviation-heading_min1.111763062990207
distance-from-start_max0.22323685401652657
distance-from-start_mean0.22323685401652657
distance-from-start_median0.22323685401652657
distance-from-start_min0.22323685401652657
driven_any_max0.4697856705177879
driven_any_mean0.4697856705177879
driven_any_median0.4697856705177879
driven_any_min0.4697856705177879
driven_lanedir_consec_max0.21903722866057465
driven_lanedir_consec_mean0.21903722866057465
driven_lanedir_consec_min0.21903722866057465
driven_lanedir_max0.21903722866057465
driven_lanedir_mean0.21903722866057465
driven_lanedir_median0.21903722866057465
driven_lanedir_min0.21903722866057465
in-drivable-lane_max1.7999999999999938
in-drivable-lane_mean1.7999999999999938
in-drivable-lane_min1.7999999999999938
per-episodes
details{"4way-000-ego0": {"driven_any": 0.4697856705177879, "survival_time": 3.699999999999995, "driven_lanedir": 0.21903722866057465, "in-drivable-lane": 1.7999999999999938, "deviation-heading": 1.111763062990207, "distance-from-start": 0.22323685401652657, "deviation-center-line": 0.08667575220737096, "driven_lanedir_consec": 0.21903722866057465}}
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean3.699999999999995
survival_time_min3.699999999999995
No reset possible
8240874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4successnodavinci-stage-030:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.149999999999993
in-drivable-lane_median1.949999999999993
driven_lanedir_consec_median0.24383222534208393
deviation-center-line_median0.11192580537695464


other stats
deviation-center-line_max0.11192580537695464
deviation-center-line_mean0.11192580537695464
deviation-center-line_min0.11192580537695464
deviation-heading_max1.3152281146976446
deviation-heading_mean1.3152281146976446
deviation-heading_median1.3152281146976446
deviation-heading_min1.3152281146976446
distance-from-start_max0.2538657680090424
distance-from-start_mean0.2538657680090424
distance-from-start_median0.2538657680090424
distance-from-start_min0.2538657680090424
driven_any_max0.49830056190128624
driven_any_mean0.49830056190128624
driven_any_median0.49830056190128624
driven_any_min0.49830056190128624
driven_lanedir_consec_max0.24383222534208393
driven_lanedir_consec_mean0.24383222534208393
driven_lanedir_consec_min0.24383222534208393
driven_lanedir_max0.24383222534208393
driven_lanedir_mean0.24383222534208393
driven_lanedir_median0.24383222534208393
driven_lanedir_min0.24383222534208393
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean1.949999999999993
in-drivable-lane_min1.949999999999993
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.49830056190128624, "survival_time": 4.149999999999993, "driven_lanedir": 0.24383222534208393, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.3152281146976446, "distance-from-start": 0.2538657680090424, "deviation-center-line": 0.11192580537695464, "driven_lanedir_consec": 0.24383222534208393}}
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean4.149999999999993
survival_time_min4.149999999999993
No reset possible
8232874Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-2of4successnodavinci-stage-030:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible