Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 8969852Bea Baselines minimal-agent-state aido-LFVI-state-sim-testingsim-1of4 timeout no davinci-stage-022022-11-16 20:44:54+00:00 - - - - No reset possible 8944860Bea Baselines template-pytorch aido-LFV-sim-validationsim-3of4 host-error no davinci-stage-022022-11-16 20:42:35+00:00 2022-11-16 20:44:48+00:00 0:02:13 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 864, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1066, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 8890853Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-testingsim-2of4 success no davinci-stage-022022-11-16 20:37:03+00:00 2022-11-16 20:42:28+00:00 0:05:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.9499999999998447 driven_lanedir_consec_median 3.263240026998127 deviation-center-line_median 6.92092898374527
other stats deviation-center-line_max 7.278875768698185 deviation-center-line_mean 6.92092898374527 deviation-center-line_min 6.562982198792354 deviation-heading_max 6.398456444977544 deviation-heading_mean 6.382402306354827 deviation-heading_median 6.382402306354827 deviation-heading_min 6.36634816773211 distance-from-start_max 1.6564545383599565 distance-from-start_mean 1.643956757921588 distance-from-start_median 1.643956757921588 distance-from-start_min 1.63145897748322 driven_any_max 3.4717176906196623 driven_any_mean 3.4611535550941017 driven_any_median 3.4611535550941017 driven_any_min 3.450589419568541 driven_lanedir_consec_max 3.2881993578511035 driven_lanedir_consec_mean 3.263240026998127 driven_lanedir_consec_min 3.2382806961451513 driven_lanedir_max 3.2881993578511035 driven_lanedir_mean 3.263240026998127 driven_lanedir_median 3.263240026998127 driven_lanedir_min 3.2382806961451513 in-drivable-lane_max 4.299999999999894 in-drivable-lane_mean 3.9499999999998447 in-drivable-lane_min 3.5999999999997954 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4717176906196623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2881993578511035, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.36634816773211, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.562982198792354, "driven_lanedir_consec": 3.2881993578511035}, "loop2-000-ego1": {"driven_any": 3.450589419568541, "survival_time": 59.99999999999873, "driven_lanedir": 3.2382806961451513, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.398456444977544, "distance-from-start": 1.6564545383599565, "deviation-center-line": 7.278875768698185, "driven_lanedir_consec": 3.2382806961451513}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8815855Bea Baselines minimal-agent-state aido-LFV-state-sim-testingsim-2of4 success no davinci-stage-022022-11-16 20:29:23+00:00 2022-11-16 20:36:51+00:00 0:07:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091631317677411 deviation-center-line_median 5.914152927086772
other stats deviation-center-line_max 5.914152927086772 deviation-center-line_mean 5.914152927086772 deviation-center-line_min 5.914152927086772 deviation-heading_max 8.388766833741702 deviation-heading_mean 8.388766833741702 deviation-heading_median 8.388766833741702 deviation-heading_min 8.388766833741702 distance-from-start_max 1.0308142273247416 distance-from-start_mean 1.0308142273247416 distance-from-start_median 1.0308142273247416 distance-from-start_min 1.0308142273247416 driven_any_max 3.449081983452879 driven_any_mean 3.449081983452879 driven_any_median 3.449081983452879 driven_any_min 3.449081983452879 driven_lanedir_consec_max 2.091631317677411 driven_lanedir_consec_mean 2.091631317677411 driven_lanedir_consec_min 2.091631317677411 driven_lanedir_max 3.203997570451749 driven_lanedir_mean 3.203997570451749 driven_lanedir_median 3.203997570451749 driven_lanedir_min 3.203997570451749 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.449081983452879, "survival_time": 59.99999999999873, "driven_lanedir": 3.203997570451749, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.388766833741702, "distance-from-start": 1.0308142273247416, "deviation-center-line": 5.914152927086772, "driven_lanedir_consec": 2.091631317677411}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8776855Bea Baselines minimal-agent-state aido-LFV-state-sim-testingsim-0of4 success no davinci-stage-022022-11-16 20:19:49+00:00 2022-11-16 20:29:11+00:00 0:09:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 39.54999999999989 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.2926691878522645 deviation-center-line_median 3.961954170796273
other stats deviation-center-line_max 3.961954170796273 deviation-center-line_mean 3.961954170796273 deviation-center-line_min 3.961954170796273 deviation-heading_max 3.0019673934722957 deviation-heading_mean 3.0019673934722957 deviation-heading_median 3.0019673934722957 deviation-heading_min 3.0019673934722957 distance-from-start_max 1.8411177593664525 distance-from-start_mean 1.8411177593664525 distance-from-start_median 1.8411177593664525 distance-from-start_min 1.8411177593664525 driven_any_max 2.310597586456975 driven_any_mean 2.310597586456975 driven_any_median 2.310597586456975 driven_any_min 2.310597586456975 driven_lanedir_consec_max 2.2926691878522645 driven_lanedir_consec_mean 2.2926691878522645 driven_lanedir_consec_min 2.2926691878522645 driven_lanedir_max 2.2926691878522645 driven_lanedir_mean 2.2926691878522645 driven_lanedir_median 2.2926691878522645 driven_lanedir_min 2.2926691878522645 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 2.310597586456975, "survival_time": 39.54999999999989, "driven_lanedir": 2.2926691878522645, "in-drivable-lane": 0.0, "deviation-heading": 3.0019673934722957, "distance-from-start": 1.8411177593664525, "deviation-center-line": 3.961954170796273, "driven_lanedir_consec": 2.2926691878522645}}simulation-passed 1 survival_time_max 39.54999999999989 survival_time_mean 39.54999999999989 survival_time_min 39.54999999999989
No reset possible 8527865Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-0of4 success no davinci-stage-022022-11-16 19:54:22+00:00 2022-11-16 20:19:26+00:00 0:25:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 53.8999999999987 driven_lanedir_consec_median 0.7378388138439856 deviation-center-line_median 0.547771339324924
other stats deviation-center-line_max 1.113330356623358 deviation-center-line_mean 0.6164948663584056 deviation-center-line_min 0.25710643016041623 deviation-heading_max 10.762980813034138 deviation-heading_mean 5.503322121804538 deviation-heading_median 4.546652510934344 deviation-heading_min 2.1570026523153247 distance-from-start_max 0.7381058021396517 distance-from-start_mean 0.5641809382829039 distance-from-start_median 0.6080040749042859 distance-from-start_min 0.30260980118339237 driven_any_max 8.389181375833008 driven_any_mean 5.996067843400688 driven_any_median 6.58622979675756 driven_any_min 2.422630404254628 driven_lanedir_consec_max 0.8197123567990163 driven_lanedir_consec_mean 0.6399599646966645 driven_lanedir_consec_min 0.2644498742996706 driven_lanedir_max 0.8528120288609529 driven_lanedir_mean 0.7801209934132353 driven_lanedir_median 0.7858653441840355 driven_lanedir_min 0.6959412564239171 in-drivable-lane_max 55.549999999998725 in-drivable-lane_mean 52.96249999999881 in-drivable-lane_min 48.49999999999912 per-episodes details {"autolab-000-ego0": {"driven_any": 8.389181375833008, "survival_time": 59.99999999999873, "driven_lanedir": 0.7919943171040169, "in-drivable-lane": 48.49999999999912, "deviation-heading": 10.762980813034138, "distance-from-start": 0.30260980118339237, "deviation-center-line": 1.113330356623358, "driven_lanedir_consec": 0.2644498742996706}, "autolab-000-ego1": {"driven_any": 5.5735075406244015, "survival_time": 59.99999999999873, "driven_lanedir": 0.7797363712640542, "in-drivable-lane": 54.5999999999987, "deviation-heading": 3.254330878836965, "distance-from-start": 0.7381058021396517, "deviation-center-line": 0.5070351629103351, "driven_lanedir_consec": 0.7797363712640542}, "autolab-000-ego2": {"driven_any": 7.598952052890718, "survival_time": 59.99999999999873, "driven_lanedir": 0.8528120288609529, "in-drivable-lane": 53.19999999999869, "deviation-heading": 5.838974143031722, "distance-from-start": 0.5623666416126791, "deviation-center-line": 0.5885075157395129, "driven_lanedir_consec": 0.8197123567990163}, "autolab-000-ego3": {"driven_any": 2.422630404254628, "survival_time": 59.99999999999873, "driven_lanedir": 0.6959412564239171, "in-drivable-lane": 55.549999999998725, "deviation-heading": 2.1570026523153247, "distance-from-start": 0.6536415081958927, "deviation-center-line": 0.25710643016041623, "driven_lanedir_consec": 0.6959412564239171}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8334865Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-0of4 success no davinci-stage-022022-11-16 19:20:18+00:00 2022-11-16 19:54:15+00:00 0:33:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 48.94999999999889 driven_lanedir_consec_median 0.7574182948789925 deviation-center-line_median 1.1338119518874423
other stats deviation-center-line_max 2.226151088892253 deviation-center-line_mean 1.1415070328479715 deviation-center-line_min 0.0722531387247496 deviation-heading_max 16.352224872997663 deviation-heading_mean 9.031017891108252 deviation-heading_median 9.518997437854097 deviation-heading_min 0.7338518157271571 distance-from-start_max 0.8892593848570614 distance-from-start_mean 0.6744569112762858 distance-from-start_median 0.7039797108638377 distance-from-start_min 0.4006088385204066 driven_any_max 11.00888808295282 driven_any_mean 6.493541557154516 driven_any_median 7.070396858899331 driven_any_min 0.8244844278665826 driven_lanedir_consec_max 1.329546238277427 driven_lanedir_consec_mean 0.7284064731002355 driven_lanedir_consec_min 0.06924306436553018 driven_lanedir_max 1.8486713687407808 driven_lanedir_mean 0.8950702717392369 driven_lanedir_median 0.8311833269253184 driven_lanedir_min 0.06924306436553018 in-drivable-lane_max 59.04999999999873 in-drivable-lane_mean 49.27499999999896 in-drivable-lane_min 40.14999999999933 per-episodes details {"autolab-000-ego0": {"driven_any": 8.411465159633867, "survival_time": 59.99999999999873, "driven_lanedir": 0.482242234141764, "in-drivable-lane": 54.999999999998806, "deviation-heading": 3.4196965960718884, "distance-from-start": 0.8892593848570614, "deviation-center-line": 0.5371453087688912, "driven_lanedir_consec": 0.482242234141764}, "autolab-000-ego1": {"driven_any": 0.8244844278665826, "survival_time": 59.99999999999873, "driven_lanedir": 0.06924306436553018, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.7338518157271571, "distance-from-start": 0.5247889702526549, "deviation-center-line": 0.0722531387247496, "driven_lanedir_consec": 0.06924306436553018}, "autolab-000-ego2": {"driven_any": 11.00888808295282, "survival_time": 59.99999999999873, "driven_lanedir": 1.8486713687407808, "in-drivable-lane": 42.89999999999897, "deviation-heading": 15.618298279636305, "distance-from-start": 0.8831704514750205, "deviation-center-line": 1.7304785950059935, "driven_lanedir_consec": 1.329546238277427}, "autolab-000-ego3": {"driven_any": 5.729328558164794, "survival_time": 59.99999999999873, "driven_lanedir": 1.1801244197088727, "in-drivable-lane": 40.14999999999933, "deviation-heading": 16.352224872997663, "distance-from-start": 0.4006088385204066, "deviation-center-line": 2.226151088892253, "driven_lanedir_consec": 1.032594355616221}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8306866Bea Baselines template-pytorch aido-LFP-sim-validationsim-2of4 success no davinci-stage-022022-11-16 19:12:18+00:00 2022-11-16 19:20:05+00:00 0:07:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 49.14999999999864 driven_lanedir_consec_median 0.5527855581670524 deviation-center-line_median 0.9193779517537238
other stats deviation-center-line_max 0.9193779517537238 deviation-center-line_mean 0.9193779517537238 deviation-center-line_min 0.9193779517537238 deviation-heading_max 8.113488286200258 deviation-heading_mean 8.113488286200258 deviation-heading_median 8.113488286200258 deviation-heading_min 8.113488286200258 distance-from-start_max 0.32406942768219826 distance-from-start_mean 0.32406942768219826 distance-from-start_median 0.32406942768219826 distance-from-start_min 0.32406942768219826 driven_any_max 5.017480376275608 driven_any_mean 5.017480376275608 driven_any_median 5.017480376275608 driven_any_min 5.017480376275608 driven_lanedir_consec_max 0.5527855581670524 driven_lanedir_consec_mean 0.5527855581670524 driven_lanedir_consec_min 0.5527855581670524 driven_lanedir_max 0.5527855581670524 driven_lanedir_mean 0.5527855581670524 driven_lanedir_median 0.5527855581670524 driven_lanedir_min 0.5527855581670524 in-drivable-lane_max 49.14999999999864 in-drivable-lane_mean 49.14999999999864 in-drivable-lane_min 49.14999999999864 per-episodes details {"loop2-000-ego0": {"driven_any": 5.017480376275608, "survival_time": 59.99999999999873, "driven_lanedir": 0.5527855581670524, "in-drivable-lane": 49.14999999999864, "deviation-heading": 8.113488286200258, "distance-from-start": 0.32406942768219826, "deviation-center-line": 0.9193779517537238, "driven_lanedir_consec": 0.5527855581670524}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 8300866Bea Baselines template-pytorch aido-LFP-sim-validationsim-1of4 success no davinci-stage-022022-11-16 19:10:28+00:00 2022-11-16 19:11:56+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.1000000000000005 in-drivable-lane_median 0.9000000000000001 driven_lanedir_consec_median 0.1260088504899708 deviation-center-line_median 0.06933905154817696
other stats deviation-center-line_max 0.06933905154817696 deviation-center-line_mean 0.06933905154817696 deviation-center-line_min 0.06933905154817696 deviation-heading_max 0.8336361902879461 deviation-heading_mean 0.8336361902879461 deviation-heading_median 0.8336361902879461 deviation-heading_min 0.8336361902879461 distance-from-start_max 0.21979358255347847 distance-from-start_mean 0.21979358255347847 distance-from-start_median 0.21979358255347847 distance-from-start_min 0.21979358255347847 driven_any_max 0.22542801617034147 driven_any_mean 0.22542801617034147 driven_any_median 0.22542801617034147 driven_any_min 0.22542801617034147 driven_lanedir_consec_max 0.1260088504899708 driven_lanedir_consec_mean 0.1260088504899708 driven_lanedir_consec_min 0.1260088504899708 driven_lanedir_max 0.1260088504899708 driven_lanedir_mean 0.1260088504899708 driven_lanedir_median 0.1260088504899708 driven_lanedir_min 0.1260088504899708 in-drivable-lane_max 0.9000000000000001 in-drivable-lane_mean 0.9000000000000001 in-drivable-lane_min 0.9000000000000001 per-episodes details {"loop-000-ego0": {"driven_any": 0.22542801617034147, "survival_time": 2.1000000000000005, "driven_lanedir": 0.1260088504899708, "in-drivable-lane": 0.9000000000000001, "deviation-heading": 0.8336361902879461, "distance-from-start": 0.21979358255347847, "deviation-center-line": 0.06933905154817696, "driven_lanedir_consec": 0.1260088504899708}}simulation-passed 1 survival_time_max 2.1000000000000005 survival_time_mean 2.1000000000000005 survival_time_min 2.1000000000000005
No reset possible 8231876Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-1of4 success no davinci-stage-022022-11-16 18:49:18+00:00 2022-11-16 19:10:18+00:00 0:21:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 58.69999999999872 driven_lanedir_consec_median 0.0804595061379697 deviation-center-line_median 0.0767416535895386
other stats deviation-center-line_max 2.3158591059300737 deviation-center-line_mean 0.6271940187685546 deviation-center-line_min 0.0394336619650677 deviation-heading_max 21.70046070048974 deviation-heading_mean 6.055390814275523 deviation-heading_median 0.9326029959276988 deviation-heading_min 0.655896564756956 distance-from-start_max 0.4667709889509365 distance-from-start_mean 0.21666548218478004 distance-from-start_median 0.16490979385813131 distance-from-start_min 0.07007135207192104 driven_any_max 5.9849882706217725 driven_any_mean 1.6148767738457868 driven_any_median 0.19763035425662073 driven_any_min 0.0792581162481325 driven_lanedir_consec_max 0.25583478910327795 driven_lanedir_consec_mean 0.11135950311645376 driven_lanedir_consec_min 0.02868421108659769 driven_lanedir_max 1.7162997887391165 driven_lanedir_mean 0.4764757530254134 driven_lanedir_median 0.0804595061379697 driven_lanedir_min 0.02868421108659769 in-drivable-lane_max 59.09999999999873 in-drivable-lane_mean 52.224999999998886 in-drivable-lane_min 32.39999999999937 per-episodes details {"4way-000-ego0": {"driven_any": 0.15805873279809957, "survival_time": 59.99999999999873, "driven_lanedir": 0.1061790710995949, "in-drivable-lane": 58.39999999999873, "deviation-heading": 1.0149704627207854, "distance-from-start": 0.11843731728569512, "deviation-center-line": 0.0394336619650677, "driven_lanedir_consec": 0.1061790710995949}, "4way-000-ego1": {"driven_any": 0.0792581162481325, "survival_time": 59.99999999999873, "driven_lanedir": 0.02868421108659769, "in-drivable-lane": 59.09999999999873, "deviation-heading": 0.655896564756956, "distance-from-start": 0.07007135207192104, "deviation-center-line": 0.06873718734214493, "driven_lanedir_consec": 0.02868421108659769}, "4way-000-ego2": {"driven_any": 5.9849882706217725, "survival_time": 59.99999999999873, "driven_lanedir": 1.7162997887391165, "in-drivable-lane": 32.39999999999937, "deviation-heading": 21.70046070048974, "distance-from-start": 0.4667709889509365, "deviation-center-line": 2.3158591059300737, "driven_lanedir_consec": 0.25583478910327795}, "4way-000-ego3": {"driven_any": 0.2372019757151419, "survival_time": 59.99999999999873, "driven_lanedir": 0.05473994117634451, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.8502355291346122, "distance-from-start": 0.2113822704305675, "deviation-center-line": 0.0847461198369323, "driven_lanedir_consec": 0.05473994117634451}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible
Bea Baselines 🐤