Duckietown Challenges Home Challenges Submissions

Evaluator 92

ID92
evaluatordavinci-stage-05
owneruser1000001
machinedavinci-stage
processdavinci-stage-05
version6.2.45
first heard
last heard
statusinactive
# evaluating
# success17 8230
# timeout1 9023
# failed
# error
# aborted
# host-error7 8269
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors84%
RAM total (MB)251.6 GB
RAM free (MB)230.1 GB
Disk (MB)491.1 GB
Disk available (MB)175.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
9023853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4timeoutnodavinci-stage-05----No reset possible
9011854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4host-errornodavinci-stage-050:01:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8971854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-050:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.600000000000172
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median1.0990342557162571
deviation-center-line_median1.828958616792992


other stats
deviation-center-line_max1.828958616792992
deviation-center-line_mean1.828958616792992
deviation-center-line_min1.828958616792992
deviation-heading_max5.113647296201552
deviation-heading_mean5.113647296201552
deviation-heading_median5.113647296201552
deviation-heading_min5.113647296201552
distance-from-start_max1.0166726694408912
distance-from-start_mean1.0166726694408912
distance-from-start_median1.0166726694408912
distance-from-start_min1.0166726694408912
driven_any_max1.203590732794828
driven_any_mean1.203590732794828
driven_any_median1.203590732794828
driven_any_min1.203590732794828
driven_lanedir_consec_max1.0990342557162571
driven_lanedir_consec_mean1.0990342557162571
driven_lanedir_consec_min1.0990342557162571
driven_lanedir_max1.0990342557162571
driven_lanedir_mean1.0990342557162571
driven_lanedir_median1.0990342557162571
driven_lanedir_min1.0990342557162571
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean1.0000000000000142
in-drivable-lane_min1.0000000000000142
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.203590732794828, "survival_time": 21.600000000000172, "driven_lanedir": 1.0990342557162571, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296201552, "distance-from-start": 1.0166726694408912, "deviation-center-line": 1.828958616792992, "driven_lanedir_consec": 1.0990342557162571}}
simulation-passed1
survival_time_max21.600000000000172
survival_time_mean21.600000000000172
survival_time_min21.600000000000172
No reset possible
8948853Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-0of4host-errornodavinci-stage-050:02:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8885854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4successnodavinci-stage-050:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655265789104
deviation-center-line_median7.114511199103643


other stats
deviation-center-line_max7.114511199103643
deviation-center-line_mean7.114511199103643
deviation-center-line_min7.114511199103643
deviation-heading_max5.702635580930089
deviation-heading_mean5.702635580930089
deviation-heading_median5.702635580930089
deviation-heading_min5.702635580930089
distance-from-start_max1.6303678440695035
distance-from-start_mean1.6303678440695035
distance-from-start_median1.6303678440695035
distance-from-start_min1.6303678440695035
driven_any_max3.466336917289666
driven_any_mean3.466336917289666
driven_any_median3.466336917289666
driven_any_min3.466336917289666
driven_lanedir_consec_max3.2655265789104
driven_lanedir_consec_mean3.2655265789104
driven_lanedir_consec_min3.2655265789104
driven_lanedir_max3.2655265789104
driven_lanedir_mean3.2655265789104
driven_lanedir_median3.2655265789104
driven_lanedir_min3.2655265789104
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8835854Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4successnodavinci-stage-050:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.600000000000172
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median1.0990342557162571
deviation-center-line_median1.828958616792992


other stats
deviation-center-line_max1.828958616792992
deviation-center-line_mean1.828958616792992
deviation-center-line_min1.828958616792992
deviation-heading_max5.113647296201552
deviation-heading_mean5.113647296201552
deviation-heading_median5.113647296201552
deviation-heading_min5.113647296201552
distance-from-start_max1.0166726694408912
distance-from-start_mean1.0166726694408912
distance-from-start_median1.0166726694408912
distance-from-start_min1.0166726694408912
driven_any_max1.203590732794828
driven_any_mean1.203590732794828
driven_any_median1.203590732794828
driven_any_min1.203590732794828
driven_lanedir_consec_max1.0990342557162571
driven_lanedir_consec_mean1.0990342557162571
driven_lanedir_consec_min1.0990342557162571
driven_lanedir_max1.0990342557162571
driven_lanedir_mean1.0990342557162571
driven_lanedir_median1.0990342557162571
driven_lanedir_min1.0990342557162571
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean1.0000000000000142
in-drivable-lane_min1.0000000000000142
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.203590732794828, "survival_time": 21.600000000000172, "driven_lanedir": 1.0990342557162571, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296201552, "distance-from-start": 1.0166726694408912, "deviation-center-line": 1.828958616792992, "driven_lanedir_consec": 1.0990342557162571}}
simulation-passed1
survival_time_max21.600000000000172
survival_time_mean21.600000000000172
survival_time_min21.600000000000172
No reset possible
8791855Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-1of4successnodavinci-stage-050:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6903637368165474
deviation-center-line_median5.3052701976903025


other stats
deviation-center-line_max5.3052701976903025
deviation-center-line_mean5.3052701976903025
deviation-center-line_min5.3052701976903025
deviation-heading_max5.395915130465752
deviation-heading_mean5.395915130465752
deviation-heading_median5.395915130465752
deviation-heading_min5.395915130465752
distance-from-start_max1.3909655253694608
distance-from-start_mean1.3909655253694608
distance-from-start_median1.3909655253694608
distance-from-start_min1.3909655253694608
driven_any_max3.5195876463774605
driven_any_mean3.5195876463774605
driven_any_median3.5195876463774605
driven_any_min3.5195876463774605
driven_lanedir_consec_max1.6903637368165474
driven_lanedir_consec_mean1.6903637368165474
driven_lanedir_consec_min1.6903637368165474
driven_lanedir_max3.3875012546504166
driven_lanedir_mean3.3875012546504166
driven_lanedir_median3.3875012546504166
driven_lanedir_min3.3875012546504166
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5195876463774605, "survival_time": 59.99999999999873, "driven_lanedir": 3.3875012546504166, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395915130465752, "distance-from-start": 1.3909655253694608, "deviation-center-line": 5.3052701976903025, "driven_lanedir_consec": 1.6903637368165474}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8746857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4successnodavinci-stage-050:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
8712857Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-050:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
8678858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-1of4successnodavinci-stage-050:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
8650858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4successnodavinci-stage-050:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
8627858Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnodavinci-stage-050:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median2.0999999999999934
driven_lanedir_consec_median0.19955565328420843
deviation-center-line_median0.12567516126913225


other stats
deviation-center-line_max0.12567516126913225
deviation-center-line_mean0.12567516126913225
deviation-center-line_min0.12567516126913225
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.46487640009490927
distance-from-start_mean0.46487640009490927
distance-from-start_median0.46487640009490927
distance-from-start_min0.46487640009490927
driven_any_max0.46488519376666826
driven_any_mean0.46488519376666826
driven_any_median0.46488519376666826
driven_any_min0.46488519376666826
driven_lanedir_consec_max0.19955565328420843
driven_lanedir_consec_mean0.19955565328420843
driven_lanedir_consec_min0.19955565328420843
driven_lanedir_max0.19955565328420843
driven_lanedir_mean0.19955565328420843
driven_lanedir_median0.19955565328420843
driven_lanedir_min0.19955565328420843
in-drivable-lane_max2.0999999999999934
in-drivable-lane_mean2.0999999999999934
in-drivable-lane_min2.0999999999999934
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
8603861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4host-errornodavinci-stage-050:01:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8589860Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-3of4host-errornodavinci-stage-050:01:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8579861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4host-errornodavinci-stage-050:00:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8565861Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-3of4successnodavinci-stage-050:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8535862Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successnodavinci-stage-050:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3
in-drivable-lane_median1.2499999999999996
driven_lanedir_consec_median0.036833139850303453
deviation-center-line_median0.03081049814264641


other stats
deviation-center-line_max0.03081049814264641
deviation-center-line_mean0.03081049814264641
deviation-center-line_min0.03081049814264641
deviation-heading_max0.9373928630495696
deviation-heading_mean0.9373928630495696
deviation-heading_median0.9373928630495696
deviation-heading_min0.9373928630495696
distance-from-start_max0.14146434718730336
distance-from-start_mean0.14146434718730336
distance-from-start_median0.14146434718730336
distance-from-start_min0.14146434718730336
driven_any_max0.16700990114891456
driven_any_mean0.16700990114891456
driven_any_median0.16700990114891456
driven_any_min0.16700990114891456
driven_lanedir_consec_max0.036833139850303453
driven_lanedir_consec_mean0.036833139850303453
driven_lanedir_consec_min0.036833139850303453
driven_lanedir_max0.036833139850303453
driven_lanedir_mean0.036833139850303453
driven_lanedir_median0.036833139850303453
driven_lanedir_min0.036833139850303453
in-drivable-lane_max1.2499999999999996
in-drivable-lane_mean1.2499999999999996
in-drivable-lane_min1.2499999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 0.16700990114891456, "survival_time": 2.3, "driven_lanedir": 0.036833139850303453, "in-drivable-lane": 1.2499999999999996, "deviation-heading": 0.9373928630495696, "distance-from-start": 0.14146434718730336, "deviation-center-line": 0.03081049814264641, "driven_lanedir_consec": 0.036833139850303453}}
simulation-passed1
survival_time_max2.3
survival_time_mean2.3
survival_time_min2.3
No reset possible
8458864Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4successnodavinci-stage-050:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.800000000000018
in-drivable-lane_median8.000000000000014
driven_lanedir_consec_median0.41769143305015566
deviation-center-line_median0.1622870356560966


other stats
deviation-center-line_max0.3427270866371422
deviation-center-line_mean0.1764316165542622
deviation-center-line_min0.038425308267713426
deviation-heading_max2.7089153450850603
deviation-heading_mean1.4949675553716284
deviation-heading_median1.3563452514730852
deviation-heading_min0.5582643734552835
distance-from-start_max0.4602315640904363
distance-from-start_mean0.31178888958458517
distance-from-start_median0.35922948584402026
distance-from-start_min0.06846502255986382
driven_any_max1.929716550813953
driven_any_mean1.1114492492472452
driven_any_median1.211133296144454
driven_any_min0.09381385388611972
driven_lanedir_consec_max0.7505405892605297
driven_lanedir_consec_mean0.4035667252166292
driven_lanedir_consec_min0.02834344550567569
driven_lanedir_max0.7505405892605297
driven_lanedir_mean0.4035667252166292
driven_lanedir_median0.41769143305015566
driven_lanedir_min0.02834344550567569
in-drivable-lane_max10.10000000000002
in-drivable-lane_mean8.01250000000002
in-drivable-lane_min5.950000000000031
per-episodes
details{"udem-000-ego0": {"driven_any": 1.7424688280456848, "survival_time": 10.800000000000018, "driven_lanedir": 0.7505405892605297, "in-drivable-lane": 5.950000000000031, "deviation-heading": 2.7089153450850603, "distance-from-start": 0.396246887509234, "deviation-center-line": 0.3427270866371422, "driven_lanedir_consec": 0.7505405892605297}, "udem-000-ego1": {"driven_any": 0.09381385388611972, "survival_time": 10.800000000000018, "driven_lanedir": 0.02834344550567569, "in-drivable-lane": 10.10000000000002, "deviation-heading": 0.5582643734552835, "distance-from-start": 0.06846502255986382, "deviation-center-line": 0.038425308267713426, "driven_lanedir_consec": 0.02834344550567569}, "udem-000-ego2": {"driven_any": 1.929716550813953, "survival_time": 10.800000000000018, "driven_lanedir": 0.6116778216093319, "in-drivable-lane": 6.950000000000012, "deviation-heading": 1.8700218999165816, "distance-from-start": 0.4602315640904363, "deviation-center-line": 0.26307759343143616, "driven_lanedir_consec": 0.6116778216093319}, "udem-000-ego3": {"driven_any": 0.6797977642432231, "survival_time": 10.800000000000018, "driven_lanedir": 0.2237050444909794, "in-drivable-lane": 9.050000000000018, "deviation-heading": 0.842668603029589, "distance-from-start": 0.3222120841788065, "deviation-center-line": 0.06149647788075702, "driven_lanedir_consec": 0.2237050444909794}}
simulation-passed1
survival_time_max10.800000000000018
survival_time_mean10.800000000000018
survival_time_min10.800000000000018
No reset possible
8323865Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4successnodavinci-stage-050:30:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median45.27499999999889
driven_lanedir_consec_median0.8521119635377814
deviation-center-line_median1.5161665936464024


other stats
deviation-center-line_max1.6164057761836468
deviation-center-line_mean1.2107590682617286
deviation-center-line_min0.1942973095704633
deviation-heading_max14.885783695197537
deviation-heading_mean9.465524902120354
deviation-heading_median10.82382169799823
deviation-heading_min1.3286725172874163
distance-from-start_max0.8409037560922272
distance-from-start_mean0.48715100115071097
distance-from-start_median0.40331013843011143
distance-from-start_min0.3010799716503937
driven_any_max12.593043041673614
driven_any_mean6.415211056800219
driven_any_median5.279629290241148
driven_any_min2.508542605044965
driven_lanedir_consec_max1.6134739414804342
driven_lanedir_consec_mean0.8579398843943573
driven_lanedir_consec_min0.114061669021432
driven_lanedir_max2.2794629141208764
driven_lanedir_mean1.0467311647746107
driven_lanedir_median0.8967000379780672
driven_lanedir_min0.114061669021432
in-drivable-lane_max58.19999999999873
in-drivable-lane_mean47.29999999999893
in-drivable-lane_min40.44999999999918
per-episodes
details{"loop-000-ego0": {"driven_any": 12.593043041673614, "survival_time": 59.99999999999873, "driven_lanedir": 2.2794629141208764, "in-drivable-lane": 43.49999999999892, "deviation-heading": 13.747889146605887, "distance-from-start": 0.8409037560922272, "deviation-center-line": 1.561616623292852, "driven_lanedir_consec": 1.6134739414804342}, "loop-000-ego1": {"driven_any": 2.508542605044965, "survival_time": 59.99999999999873, "driven_lanedir": 0.114061669021432, "in-drivable-lane": 58.19999999999873, "deviation-heading": 1.3286725172874163, "distance-from-start": 0.3153738209398033, "deviation-center-line": 0.1942973095704633, "driven_lanedir_consec": 0.114061669021432}, "loop-000-ego2": {"driven_any": 3.7255771705561815, "survival_time": 59.99999999999873, "driven_lanedir": 0.7230749232216344, "in-drivable-lane": 40.44999999999918, "deviation-heading": 14.885783695197537, "distance-from-start": 0.4912464559204195, "deviation-center-line": 1.6164057761836468, "driven_lanedir_consec": 0.6338987743410628}, "loop-000-ego3": {"driven_any": 6.833681409926116, "survival_time": 59.99999999999873, "driven_lanedir": 1.0703251527345, "in-drivable-lane": 47.04999999999886, "deviation-heading": 7.899754249390573, "distance-from-start": 0.3010799716503937, "deviation-center-line": 1.4707165639999529, "driven_lanedir_consec": 1.0703251527345}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8278866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-3of4successnodavinci-stage-050:12:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median32.449999999999406
driven_lanedir_consec_median0.2374831194100175
deviation-center-line_median1.89572681152832


other stats
deviation-center-line_max1.89572681152832
deviation-center-line_mean1.89572681152832
deviation-center-line_min1.89572681152832
deviation-heading_max21.695181791581597
deviation-heading_mean21.695181791581597
deviation-heading_median21.695181791581597
deviation-heading_min21.695181791581597
distance-from-start_max0.34627101214097894
distance-from-start_mean0.34627101214097894
distance-from-start_median0.34627101214097894
distance-from-start_min0.34627101214097894
driven_any_max1.6393661473535202
driven_any_mean1.6393661473535202
driven_any_median1.6393661473535202
driven_any_min1.6393661473535202
driven_lanedir_consec_max0.2374831194100175
driven_lanedir_consec_mean0.2374831194100175
driven_lanedir_consec_min0.2374831194100175
driven_lanedir_max0.4484296494115805
driven_lanedir_mean0.4484296494115805
driven_lanedir_median0.4484296494115805
driven_lanedir_min0.4484296494115805
in-drivable-lane_max32.449999999999406
in-drivable-lane_mean32.449999999999406
in-drivable-lane_min32.449999999999406
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.6393661473535202, "survival_time": 59.99999999999873, "driven_lanedir": 0.4484296494115805, "in-drivable-lane": 32.449999999999406, "deviation-heading": 21.695181791581597, "distance-from-start": 0.34627101214097894, "deviation-center-line": 1.89572681152832, "driven_lanedir_consec": 0.2374831194100175}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8276866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4host-errornodavinci-stage-050:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8269866Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-1of4host-errornodavinci-stage-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8256872Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-2of4successnodavinci-stage-050:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.850000000000062
in-drivable-lane_median8.400000000000048
driven_lanedir_consec_median0.360628513353328
deviation-center-line_median0.4678808000013573


other stats
deviation-center-line_max0.4678808000013573
deviation-center-line_mean0.4678808000013573
deviation-center-line_min0.4678808000013573
deviation-heading_max3.940241959217459
deviation-heading_mean3.940241959217459
deviation-heading_median3.940241959217459
deviation-heading_min3.940241959217459
distance-from-start_max0.18522925979109447
distance-from-start_mean0.18522925979109447
distance-from-start_median0.18522925979109447
distance-from-start_min0.18522925979109447
driven_any_max1.3364488831900414
driven_any_mean1.3364488831900414
driven_any_median1.3364488831900414
driven_any_min1.3364488831900414
driven_lanedir_consec_max0.360628513353328
driven_lanedir_consec_mean0.360628513353328
driven_lanedir_consec_min0.360628513353328
driven_lanedir_max0.360628513353328
driven_lanedir_mean0.360628513353328
driven_lanedir_median0.360628513353328
driven_lanedir_min0.360628513353328
in-drivable-lane_max8.400000000000048
in-drivable-lane_mean8.400000000000048
in-drivable-lane_min8.400000000000048
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3364488831900414, "survival_time": 13.850000000000062, "driven_lanedir": 0.360628513353328, "in-drivable-lane": 8.400000000000048, "deviation-heading": 3.940241959217459, "distance-from-start": 0.18522925979109447, "deviation-center-line": 0.4678808000013573, "driven_lanedir_consec": 0.360628513353328}}
simulation-passed1
survival_time_max13.850000000000062
survival_time_mean13.850000000000062
survival_time_min13.850000000000062
No reset possible
8248873Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnodavinci-stage-050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
8230875Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4successnodavinci-stage-050:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0984299185682402
survival_time_median59.99999999999873
deviation-center-line_median0.5805014738589958
in-drivable-lane_median49.04999999999865


other stats
deviation-center-line_max0.5805014738589958
deviation-center-line_mean0.5805014738589958
deviation-center-line_min0.5805014738589958
deviation-heading_max7.839654237091522
deviation-heading_mean7.839654237091522
deviation-heading_median7.839654237091522
deviation-heading_min7.839654237091522
distance-from-start_max0.39134928077168585
distance-from-start_mean0.39134928077168585
distance-from-start_median0.39134928077168585
distance-from-start_min0.39134928077168585
driven_any_max8.61502070027225
driven_any_mean8.61502070027225
driven_any_median8.61502070027225
driven_any_min8.61502070027225
driven_lanedir_consec_max1.0984299185682402
driven_lanedir_consec_mean1.0984299185682402
driven_lanedir_consec_min1.0984299185682402
driven_lanedir_max1.0984299185682402
driven_lanedir_mean1.0984299185682402
driven_lanedir_median1.0984299185682402
driven_lanedir_min1.0984299185682402
in-drivable-lane_max49.04999999999865
in-drivable-lane_mean49.04999999999865
in-drivable-lane_min49.04999999999865
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.61502070027225, "survival_time": 59.99999999999873, "driven_lanedir": 1.0984299185682402, "in-drivable-lane": 49.04999999999865, "deviation-heading": 7.839654237091522, "distance-from-start": 0.39134928077168585, "deviation-center-line": 0.5805014738589958, "driven_lanedir_consec": 1.0984299185682402}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible