Duckietown Challenges Home Challenges Submissions

Submission 530

Submission530
Competingyes
Challengeaido-LFV-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of4: 17102 sim-1of4: 17103 sim-2of4: 17101 sim-3of4: 17104
Next
User labelbaseline-dagger-pytorch
Admin priority50
Blessingn/a
User priority50

17104

Click the images to see detailed statistics about the episode.

zigzag-000

17102

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17104sim-3of4successyes0:17:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.300000000000007
driven_lanedir_consec_median8.676170766478169
deviation-center-line_median3.1470927157463193


other stats
deviation-center-line_max3.1470927157463193
deviation-center-line_mean3.1470927157463193
deviation-center-line_min3.1470927157463193
deviation-heading_max16.12383122797764
deviation-heading_mean16.12383122797764
deviation-heading_median16.12383122797764
deviation-heading_min16.12383122797764
distance-from-start_max4.517163920744505
distance-from-start_mean4.517163920744505
distance-from-start_median4.517163920744505
distance-from-start_min4.517163920744505
driven_any_max9.548735910605613
driven_any_mean9.548735910605613
driven_any_median9.548735910605613
driven_any_min9.548735910605613
driven_lanedir_consec_max8.676170766478169
driven_lanedir_consec_mean8.676170766478169
driven_lanedir_consec_min8.676170766478169
driven_lanedir_max8.676170766478169
driven_lanedir_mean8.676170766478169
driven_lanedir_median8.676170766478169
driven_lanedir_min8.676170766478169
in-drivable-lane_max1.300000000000007
in-drivable-lane_mean1.300000000000007
in-drivable-lane_min1.300000000000007
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.548735910605613, "survival_time": 59.99999999999873, "driven_lanedir": 8.676170766478169, "in-drivable-lane": 1.300000000000007, "deviation-heading": 16.12383122797764, "distance-from-start": 4.517163920744505, "deviation-center-line": 3.1470927157463193, "driven_lanedir_consec": 8.676170766478169}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17103sim-1of4failedyes0:01:19
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17102sim-0of4successyes0:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.349999999999989
in-drivable-lane_median0.7499999999999973
driven_lanedir_consec_median0.7733648767077974
deviation-center-line_median0.1899345327269107


other stats
deviation-center-line_max0.1899345327269107
deviation-center-line_mean0.1899345327269107
deviation-center-line_min0.1899345327269107
deviation-heading_max1.2762283192199255
deviation-heading_mean1.2762283192199255
deviation-heading_median1.2762283192199255
deviation-heading_min1.2762283192199255
distance-from-start_max0.7690218536398835
distance-from-start_mean0.7690218536398835
distance-from-start_median0.7690218536398835
distance-from-start_min0.7690218536398835
driven_any_max0.822608897269373
driven_any_mean0.822608897269373
driven_any_median0.822608897269373
driven_any_min0.822608897269373
driven_lanedir_consec_max0.7733648767077974
driven_lanedir_consec_mean0.7733648767077974
driven_lanedir_consec_min0.7733648767077974
driven_lanedir_max0.7733648767077974
driven_lanedir_mean0.7733648767077974
driven_lanedir_median0.7733648767077974
driven_lanedir_min0.7733648767077974
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.7499999999999973
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.822608897269373, "survival_time": 5.349999999999989, "driven_lanedir": 0.7733648767077974, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 1.2762283192199255, "distance-from-start": 0.7690218536398835, "deviation-center-line": 0.1899345327269107, "driven_lanedir_consec": 0.7733648767077974}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
17101sim-2of4failedyes0:01:33
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15965sim-0of4successno0:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15964sim-3of4successno0:15:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15963sim-2of4successno0:07:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15962sim-1of4successno0:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14891sim-3of4successno0:16:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14890sim-0of4successno0:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14889sim-1of4successno0:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14888sim-2of4successno0:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13758sim-2of4errorno0:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13754sim-1of4errorno0:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13751sim-0of4errorno0:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13750sim-3of4errorno0:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12406sim-1of4successno0:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12405sim-2of4successno0:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12404sim-3of4successno0:16:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12403sim-0of4successno0:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7354sim-0of4successno0:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7353sim-1of4successno0:09:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7352sim-2of4successno0:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7351sim-3of4successno0:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6124sim-3of4successno0:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6123sim-0of4successno0:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6122sim-1of4successno0:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6121sim-2of4successno0:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4529sim-2of4successno0:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4528sim-3of4successno0:12:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4526sim-1of4successno0:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4525sim-0of4successno0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible