Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 8225876Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-1of4 timeout no davinci-stage-052022-11-16 18:21:06+00:00 - - - - No reset possible 8171877Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-0of4 success no davinci-stage-052022-11-16 17:51:34+00:00 2022-11-16 18:20:33+00:00 0:28:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 43.249999999999176 driven_lanedir_consec_median 0.4329994666151524 deviation-center-line_median 1.6142403325007668
other stats deviation-center-line_max 3.3069532728538005 deviation-center-line_mean 1.6599185919515302 deviation-center-line_min 0.104240429950787 deviation-heading_max 39.12770071228571 deviation-heading_mean 16.93456846776604 deviation-heading_median 14.081051567167052 deviation-heading_min 0.4484700244443368 distance-from-start_max 0.6103269082339134 distance-from-start_mean 0.42364359223649206 distance-from-start_median 0.4071221459815506 distance-from-start_min 0.2700031687489534 driven_any_max 5.97961962377692 driven_any_mean 4.3363422189533605 driven_any_median 5.54345935746373 driven_any_min 0.2788305371090643 driven_lanedir_consec_max 2.2286084861836843 driven_lanedir_consec_mean 0.8124964725552104 driven_lanedir_consec_min 0.1553784708068524 driven_lanedir_max 2.2286084861836843 driven_lanedir_mean 0.8840891057474192 driven_lanedir_median 0.57618473299957 driven_lanedir_min 0.1553784708068524 in-drivable-lane_max 58.94999999999872 in-drivable-lane_mean 41.08749999999922 in-drivable-lane_min 18.899999999999785 per-episodes details {"autolab-000-ego0": {"driven_any": 5.154065130851192, "survival_time": 59.99999999999873, "driven_lanedir": 0.8683777612305166, "in-drivable-lane": 33.24999999999966, "deviation-heading": 23.21084287399253, "distance-from-start": 0.4395980620163517, "deviation-center-line": 3.3069532728538005, "driven_lanedir_consec": 0.5820072284616815}, "autolab-000-ego1": {"driven_any": 0.2788305371090643, "survival_time": 59.99999999999873, "driven_lanedir": 0.1553784708068524, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.4484700244443368, "distance-from-start": 0.2700031687489534, "deviation-center-line": 0.104240429950787, "driven_lanedir_consec": 0.1553784708068524}, "autolab-000-ego2": {"driven_any": 5.97961962377692, "survival_time": 59.99999999999873, "driven_lanedir": 0.28399170476862334, "in-drivable-lane": 53.24999999999869, "deviation-heading": 4.951260260341582, "distance-from-start": 0.6103269082339134, "deviation-center-line": 0.8033597346291389, "driven_lanedir_consec": 0.28399170476862334}, "autolab-000-ego3": {"driven_any": 5.932853584076267, "survival_time": 59.99999999999873, "driven_lanedir": 2.2286084861836843, "in-drivable-lane": 18.899999999999785, "deviation-heading": 39.12770071228571, "distance-from-start": 0.3746462299467496, "deviation-center-line": 2.425120930372395, "driven_lanedir_consec": 2.2286084861836843}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8168876Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-2of4 success no davinci-stage-052022-11-16 17:48:30+00:00 2022-11-16 17:51:09+00:00 0:02:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 8164877Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-1of4 host-error no davinci-stage-052022-11-16 17:47:20+00:00 2022-11-16 17:48:15+00:00 0:00:55 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 863, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1065, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8152877Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-2of4 success no davinci-stage-052022-11-16 17:43:54+00:00 2022-11-16 17:47:06+00:00 0:03:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.299999999999982 in-drivable-lane_median 5.149999999999984 driven_lanedir_consec_median 0.21300140813263468 deviation-center-line_median 0.14845206887417745
other stats deviation-center-line_max 0.2099809144943895 deviation-center-line_mean 0.14845206887417745 deviation-center-line_min 0.08692322325396538 deviation-heading_max 2.2958629349449104 deviation-heading_mean 1.43972857684747 deviation-heading_median 1.43972857684747 deviation-heading_min 0.5835942187500298 distance-from-start_max 0.2561480268195313 distance-from-start_mean 0.23284522098753413 distance-from-start_median 0.23284522098753413 distance-from-start_min 0.20954241515553695 driven_any_max 0.9788790008393824 driven_any_mean 0.6139246478726516 driven_any_median 0.6139246478726516 driven_any_min 0.2489702949059206 driven_lanedir_consec_max 0.3468885984557277 driven_lanedir_consec_mean 0.21300140813263468 driven_lanedir_consec_min 0.07911421780954164 driven_lanedir_max 0.3468885984557277 driven_lanedir_mean 0.21300140813263468 driven_lanedir_median 0.21300140813263468 driven_lanedir_min 0.07911421780954164 in-drivable-lane_max 6.399999999999982 in-drivable-lane_mean 5.149999999999984 in-drivable-lane_min 3.899999999999987 per-episodes details {"loop2-000-ego0": {"driven_any": 0.9788790008393824, "survival_time": 7.299999999999982, "driven_lanedir": 0.3468885984557277, "in-drivable-lane": 3.899999999999987, "deviation-heading": 2.2958629349449104, "distance-from-start": 0.2561480268195313, "deviation-center-line": 0.2099809144943895, "driven_lanedir_consec": 0.3468885984557277}, "loop2-000-ego1": {"driven_any": 0.2489702949059206, "survival_time": 7.299999999999982, "driven_lanedir": 0.07911421780954164, "in-drivable-lane": 6.399999999999982, "deviation-heading": 0.5835942187500298, "distance-from-start": 0.20954241515553695, "deviation-center-line": 0.08692322325396538, "driven_lanedir_consec": 0.07911421780954164}}simulation-passed 1 survival_time_max 7.299999999999982 survival_time_mean 7.299999999999982 survival_time_min 7.299999999999982
No reset possible 8112878Bea Baselines template-pytorch aido-LFP-sim-testingsim-0of4 success no davinci-stage-052022-11-16 17:29:52+00:00 2022-11-16 17:43:30+00:00 0:13:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 41.24999999999873 driven_lanedir_consec_median 1.3140445259266789 deviation-center-line_median 1.3522041837152106
other stats deviation-center-line_max 1.3522041837152106 deviation-center-line_mean 1.3522041837152106 deviation-center-line_min 1.3522041837152106 deviation-heading_max 15.783738061455646 deviation-heading_mean 15.783738061455646 deviation-heading_median 15.783738061455646 deviation-heading_min 15.783738061455646 distance-from-start_max 0.3917802717459998 distance-from-start_mean 0.3917802717459998 distance-from-start_median 0.3917802717459998 distance-from-start_min 0.3917802717459998 driven_any_max 8.05270823681518 driven_any_mean 8.05270823681518 driven_any_median 8.05270823681518 driven_any_min 8.05270823681518 driven_lanedir_consec_max 1.3140445259266789 driven_lanedir_consec_mean 1.3140445259266789 driven_lanedir_consec_min 1.3140445259266789 driven_lanedir_max 1.4383555151042302 driven_lanedir_mean 1.4383555151042302 driven_lanedir_median 1.4383555151042302 driven_lanedir_min 1.4383555151042302 in-drivable-lane_max 41.24999999999873 in-drivable-lane_mean 41.24999999999873 in-drivable-lane_min 41.24999999999873 per-episodes details {"autolab-000-ego0": {"driven_any": 8.05270823681518, "survival_time": 59.99999999999873, "driven_lanedir": 1.4383555151042302, "in-drivable-lane": 41.24999999999873, "deviation-heading": 15.783738061455646, "distance-from-start": 0.3917802717459998, "deviation-center-line": 1.3522041837152106, "driven_lanedir_consec": 1.3140445259266789}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8104880Bea Baselines template-ros aido-LF-sim-validationsim-2of4 success no davinci-stage-052022-11-16 17:27:39+00:00 2022-11-16 17:29:44+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.29401593171712537 survival_time_median 7.049999999999983 deviation-center-line_median 0.13223877756936514 in-drivable-lane_median 5.299999999999986
other stats deviation-center-line_max 0.13223877756936514 deviation-center-line_mean 0.13223877756936514 deviation-center-line_min 0.13223877756936514 deviation-heading_max 1.4361968994681829 deviation-heading_mean 1.4361968994681829 deviation-heading_median 1.4361968994681829 deviation-heading_min 1.4361968994681829 distance-from-start_max 1.694826428322143 distance-from-start_mean 1.694826428322143 distance-from-start_median 1.694826428322143 distance-from-start_min 1.694826428322143 driven_any_max 1.8387968013719145 driven_any_mean 1.8387968013719145 driven_any_median 1.8387968013719145 driven_any_min 1.8387968013719145 driven_lanedir_consec_max 0.29401593171712537 driven_lanedir_consec_mean 0.29401593171712537 driven_lanedir_consec_min 0.29401593171712537 driven_lanedir_max 0.29401593171712537 driven_lanedir_mean 0.29401593171712537 driven_lanedir_median 0.29401593171712537 driven_lanedir_min 0.29401593171712537 in-drivable-lane_max 5.299999999999986 in-drivable-lane_mean 5.299999999999986 in-drivable-lane_min 5.299999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8387968013719145, "survival_time": 7.049999999999983, "driven_lanedir": 0.29401593171712537, "in-drivable-lane": 5.299999999999986, "deviation-heading": 1.4361968994681829, "distance-from-start": 1.694826428322143, "deviation-center-line": 0.13223877756936514, "driven_lanedir_consec": 0.29401593171712537}}simulation-passed 1 survival_time_max 7.049999999999983 survival_time_mean 7.049999999999983 survival_time_min 7.049999999999983
No reset possible 8101881Bea Baselines template-tensorflow aido-LFV-sim-validationsim-2of4 failed no davinci-stage-052022-11-16 17:25:53+00:00 2022-11-16 17:27:32+00:00 0:01:39 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8095880Bea Baselines template-ros aido-LF-sim-validationsim-0of4 success no davinci-stage-052022-11-16 17:22:29+00:00 2022-11-16 17:25:22+00:00 0:02:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.137960400538224 survival_time_median 12.200000000000038 deviation-center-line_median 0.05056805766053324 in-drivable-lane_median 11.300000000000038
other stats deviation-center-line_max 0.05056805766053324 deviation-center-line_mean 0.05056805766053324 deviation-center-line_min 0.05056805766053324 deviation-heading_max 0.6026520339279079 deviation-heading_mean 0.6026520339279079 deviation-heading_median 0.6026520339279079 deviation-heading_min 0.6026520339279079 distance-from-start_max 2.5879714775176232 distance-from-start_mean 2.5879714775176232 distance-from-start_median 2.5879714775176232 distance-from-start_min 2.5879714775176232 driven_any_max 3.24113709751772 driven_any_mean 3.24113709751772 driven_any_median 3.24113709751772 driven_any_min 3.24113709751772 driven_lanedir_consec_max 0.137960400538224 driven_lanedir_consec_mean 0.137960400538224 driven_lanedir_consec_min 0.137960400538224 driven_lanedir_max 0.137960400538224 driven_lanedir_mean 0.137960400538224 driven_lanedir_median 0.137960400538224 driven_lanedir_min 0.137960400538224 in-drivable-lane_max 11.300000000000038 in-drivable-lane_mean 11.300000000000038 in-drivable-lane_min 11.300000000000038 per-episodes details {"autolab-000-ego0": {"driven_any": 3.24113709751772, "survival_time": 12.200000000000038, "driven_lanedir": 0.137960400538224, "in-drivable-lane": 11.300000000000038, "deviation-heading": 0.6026520339279079, "distance-from-start": 2.5879714775176232, "deviation-center-line": 0.05056805766053324, "driven_lanedir_consec": 0.137960400538224}}simulation-passed 1 survival_time_max 12.200000000000038 survival_time_mean 12.200000000000038 survival_time_min 12.200000000000038
No reset possible
Bea Baselines 🐤