Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 8228876Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-1of4 timeout no davinci-stage-012022-11-16 18:31:34+00:00 - - - - No reset possible 8180877Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-1of4 success no davinci-stage-012022-11-16 18:01:36+00:00 2022-11-16 18:31:22+00:00 0:29:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.02499999999935 driven_lanedir_consec_median 0.7453003265804716 deviation-center-line_median 1.925971677371612
other stats deviation-center-line_max 2.7624626207296523 deviation-center-line_mean 2.0779171948473723 deviation-center-line_min 1.697262803916614 deviation-heading_max 37.82293240559152 deviation-heading_mean 21.685559081871837 deviation-heading_median 17.910409748712762 deviation-heading_min 13.09848442447029 distance-from-start_max 0.9243297061005324 distance-from-start_mean 0.4823567812285662 distance-from-start_median 0.5025487094068661 distance-from-start_min 2.482534153247273e-16 driven_any_max 11.669428452522917 driven_any_mean 6.139752421720696 driven_any_median 6.444790617179786 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 3.068518204668104 driven_lanedir_consec_mean 1.1397797144572617 driven_lanedir_consec_min 0.0 driven_lanedir_max 3.068518204668104 driven_lanedir_mean 1.5875532442725289 driven_lanedir_median 1.6408473862110058 driven_lanedir_min 0.0 in-drivable-lane_max 42.8499999999987 in-drivable-lane_mean 28.724999999999348 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 2.2341813735421843, "survival_time": 59.99999999999873, "driven_lanedir": 0.4418065517205605, "in-drivable-lane": 42.8499999999987, "deviation-heading": 13.09848442447029, "distance-from-start": 0.4971953679823901, "deviation-center-line": 1.697262803916614, "driven_lanedir_consec": 0.4418065517205605}, "loop-000-ego1": {"driven_any": 11.669428452522917, "survival_time": 59.99999999999873, "driven_lanedir": 2.839888220701451, "in-drivable-lane": 36.24999999999952, "deviation-heading": 18.873839859699245, "distance-from-start": 0.9243297061005324, "deviation-center-line": 1.9035810774573745, "driven_lanedir_consec": 1.0487941014403828}, "loop-000-ego2": {"driven_any": 10.655399860817386, "survival_time": 59.99999999999873, "driven_lanedir": 3.068518204668104, "in-drivable-lane": 35.79999999999918, "deviation-heading": 16.94697963772628, "distance-from-start": 0.5079020508313421, "deviation-center-line": 1.948362277285849, "driven_lanedir_consec": 3.068518204668104}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8169879Bea Baselines template-random aido-LFV-sim-validationsim-1of4 success no davinci-stage-012022-11-16 17:48:57+00:00 2022-11-16 18:00:14+00:00 0:11:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 8134879Bea Baselines template-random aido-LFV-sim-validationsim-1of4 success no davinci-stage-012022-11-16 17:38:22+00:00 2022-11-16 17:48:45+00:00 0:10:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 8118879Bea Baselines template-random aido-LFV-sim-validationsim-2of4 success no davinci-stage-012022-11-16 17:33:58+00:00 2022-11-16 17:38:04+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.65000000000003 in-drivable-lane_median 4.950000000000033 driven_lanedir_consec_median 0.26764605432234867 deviation-center-line_median 0.6035442792313549
other stats deviation-center-line_max 0.6035442792313549 deviation-center-line_mean 0.6035442792313549 deviation-center-line_min 0.6035442792313549 deviation-heading_max 4.043215735457215 deviation-heading_mean 4.043215735457215 deviation-heading_median 4.043215735457215 deviation-heading_min 4.043215735457215 distance-from-start_max 0.5461575079396498 distance-from-start_mean 0.5461575079396498 distance-from-start_median 0.5461575079396498 distance-from-start_min 0.5461575079396498 driven_any_max 2.4684338587867174 driven_any_mean 2.4684338587867174 driven_any_median 2.4684338587867174 driven_any_min 2.4684338587867174 driven_lanedir_consec_max 0.26764605432234867 driven_lanedir_consec_mean 0.26764605432234867 driven_lanedir_consec_min 0.26764605432234867 driven_lanedir_max 0.262846269745866 driven_lanedir_mean 0.262846269745866 driven_lanedir_median 0.262846269745866 driven_lanedir_min 0.262846269745866 in-drivable-lane_max 4.950000000000033 in-drivable-lane_mean 4.950000000000033 in-drivable-lane_min 4.950000000000033 per-episodes details {"loop2-000-ego0": {"driven_any": 2.4684338587867174, "survival_time": 11.65000000000003, "driven_lanedir": 0.262846269745866, "in-drivable-lane": 4.950000000000033, "deviation-heading": 4.043215735457215, "distance-from-start": 0.5461575079396498, "deviation-center-line": 0.6035442792313549, "driven_lanedir_consec": 0.26764605432234867}}simulation-passed 1 survival_time_max 11.65000000000003 survival_time_mean 11.65000000000003 survival_time_min 11.65000000000003
No reset possible 8097882Bea Baselines template-random aido-LFV-sim-validationsim-1of4 success no davinci-stage-012022-11-16 17:23:01+00:00 2022-11-16 17:33:49+00:00 0:10:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 8094880Bea Baselines template-ros aido-LF-sim-validationsim-2of4 host-error no davinci-stage-012022-11-16 17:22:29+00:00 2022-11-16 17:22:56+00:00 0:00:27 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 863, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1065, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Bea Baselines 🐤