Duckietown Challenges Home Challenges Submissions

Submission 536

Submission536
Competingyes
Challengeaido-LFP-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of4: 17077 sim-1of4: 17078 sim-2of4: 17080 sim-3of4: 17079
Next
User labelbaseline-dagger-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17080sim-2of4successyes0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.650000000000173
in-drivable-lane_median4.850000000000051
driven_lanedir_consec_median2.511192838979184
deviation-center-line_median1.0654749087928057


other stats
deviation-center-line_max1.0654749087928057
deviation-center-line_mean1.0654749087928057
deviation-center-line_min1.0654749087928057
deviation-heading_max5.857592443384156
deviation-heading_mean5.857592443384156
deviation-heading_median5.857592443384156
deviation-heading_min5.857592443384156
distance-from-start_max1.5731666237013733
distance-from-start_mean1.5731666237013733
distance-from-start_median1.5731666237013733
distance-from-start_min1.5731666237013733
driven_any_max3.713030606884853
driven_any_mean3.713030606884853
driven_any_median3.713030606884853
driven_any_min3.713030606884853
driven_lanedir_consec_max2.511192838979184
driven_lanedir_consec_mean2.511192838979184
driven_lanedir_consec_min2.511192838979184
driven_lanedir_max2.511192838979184
driven_lanedir_mean2.511192838979184
driven_lanedir_median2.511192838979184
driven_lanedir_min2.511192838979184
in-drivable-lane_max4.850000000000051
in-drivable-lane_mean4.850000000000051
in-drivable-lane_min4.850000000000051
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.713030606884853, "survival_time": 21.650000000000173, "driven_lanedir": 2.511192838979184, "in-drivable-lane": 4.850000000000051, "deviation-heading": 5.857592443384156, "distance-from-start": 1.5731666237013733, "deviation-center-line": 1.0654749087928057, "driven_lanedir_consec": 2.511192838979184}}
simulation-passed1
survival_time_max21.650000000000173
survival_time_mean21.650000000000173
survival_time_min21.650000000000173
No reset possible
17079sim-3of4failedyes0:01:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17078sim-1of4failedyes0:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17077sim-0of4successyes0:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.60000000000013
in-drivable-lane_median0.0
driven_lanedir_consec_median2.381076441760812
deviation-center-line_median0.904429580871188


other stats
deviation-center-line_max0.904429580871188
deviation-center-line_mean0.904429580871188
deviation-center-line_min0.904429580871188
deviation-heading_max4.509440534394529
deviation-heading_mean4.509440534394529
deviation-heading_median4.509440534394529
deviation-heading_min4.509440534394529
distance-from-start_max2.1137228662470338
distance-from-start_mean2.1137228662470338
distance-from-start_median2.1137228662470338
distance-from-start_min2.1137228662470338
driven_any_max2.472079660132866
driven_any_mean2.472079660132866
driven_any_median2.472079660132866
driven_any_min2.472079660132866
driven_lanedir_consec_max2.381076441760812
driven_lanedir_consec_mean2.381076441760812
driven_lanedir_consec_min2.381076441760812
driven_lanedir_max2.381076441760812
driven_lanedir_mean2.381076441760812
driven_lanedir_median2.381076441760812
driven_lanedir_min2.381076441760812
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.472079660132866, "survival_time": 18.60000000000013, "driven_lanedir": 2.381076441760812, "in-drivable-lane": 0.0, "deviation-heading": 4.509440534394529, "distance-from-start": 2.1137228662470338, "deviation-center-line": 0.904429580871188, "driven_lanedir_consec": 2.381076441760812}}
simulation-passed1
survival_time_max18.60000000000013
survival_time_mean18.60000000000013
survival_time_min18.60000000000013
No reset possible
15941sim-3of4successno0:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15940sim-2of4successno0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15939sim-0of4successno0:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15937sim-1of4successno0:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14867sim-1of4successno0:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14866sim-3of4successno0:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14863sim-0of4successno0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14862sim-2of4successno0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13732sim-1of4errorno0:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13731sim-2of4errorno0:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13727sim-0of4errorno0:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13726sim-3of4errorno0:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12380sim-0of4successno0:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12379sim-1of4successno0:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12375sim-2of4successno0:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12374sim-3of4successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12372sim-0of4host-errorno0:00:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
    client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
  File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
    return self.api.login(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
    return self._result(response, json=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e) from e
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 901, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1103, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    do_login_for_registry(client, credentials, br.registry)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
    docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
    raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7304sim-2of4successno0:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7298sim-3of4successno0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7297sim-1of4successno0:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7296sim-0of4successno0:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6102sim-3of4successno0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6099sim-1of4successno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6098sim-0of4successno0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6097sim-2of4successno0:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4495sim-3of4successno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4494sim-2of4successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4493sim-1of4successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4492sim-0of4successno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible