Duckietown Challenges Home Challenges Submissions

Submission 396

Submission396
Competingyes
Challengeaido-LFI-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17173 sim-1of4: 17170 sim-2of4: 17171 sim-3of4: 17172
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

17173

Click the images to see detailed statistics about the episode.

4way-000

17170

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17173sim-0of4successyes0:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.100000000000009
in-drivable-lane_median1.999999999999993
driven_lanedir_consec_median-0.3142632718276417
deviation-center-line_median0.3049079323989983


other stats
deviation-center-line_max0.3049079323989983
deviation-center-line_mean0.3049079323989983
deviation-center-line_min0.3049079323989983
deviation-heading_max6.451039479191902
deviation-heading_mean6.451039479191902
deviation-heading_median6.451039479191902
deviation-heading_min6.451039479191902
distance-from-start_max0.15674361669443038
distance-from-start_mean0.15674361669443038
distance-from-start_median0.15674361669443038
distance-from-start_min0.15674361669443038
driven_any_max1.648769475082401
driven_any_mean1.648769475082401
driven_any_median1.648769475082401
driven_any_min1.648769475082401
driven_lanedir_consec_max-0.3142632718276417
driven_lanedir_consec_mean-0.3142632718276417
driven_lanedir_consec_min-0.3142632718276417
driven_lanedir_max-0.3088662370340476
driven_lanedir_mean-0.3088662370340476
driven_lanedir_median-0.3088662370340476
driven_lanedir_min-0.3088662370340476
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.999999999999993
in-drivable-lane_min1.999999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 1.648769475082401, "survival_time": 10.100000000000009, "driven_lanedir": -0.3088662370340476, "in-drivable-lane": 1.999999999999993, "deviation-heading": 6.451039479191902, "distance-from-start": 0.15674361669443038, "deviation-center-line": 0.3049079323989983, "driven_lanedir_consec": -0.3142632718276417}}
simulation-passed1
survival_time_max10.100000000000009
survival_time_mean10.100000000000009
survival_time_min10.100000000000009
No reset possible
17172sim-3of4successyes0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17171sim-2of4successyes0:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17170sim-1of4successyes0:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.699999999999292
driven_lanedir_consec_median-3.1355637001281074
deviation-center-line_median2.934952938872135


other stats
deviation-center-line_max2.934952938872135
deviation-center-line_mean2.934952938872135
deviation-center-line_min2.934952938872135
deviation-heading_max25.552279669740106
deviation-heading_mean25.552279669740106
deviation-heading_median25.552279669740106
deviation-heading_min25.552279669740106
distance-from-start_max0.1627029550076341
distance-from-start_mean0.1627029550076341
distance-from-start_median0.1627029550076341
distance-from-start_min0.1627029550076341
driven_any_max11.605809475307318
driven_any_mean11.605809475307318
driven_any_median11.605809475307318
driven_any_min11.605809475307318
driven_lanedir_consec_max-3.1355637001281074
driven_lanedir_consec_mean-3.1355637001281074
driven_lanedir_consec_min-3.1355637001281074
driven_lanedir_max-3.1355637001281074
driven_lanedir_mean-3.1355637001281074
driven_lanedir_median-3.1355637001281074
driven_lanedir_min-3.1355637001281074
in-drivable-lane_max30.699999999999292
in-drivable-lane_mean30.699999999999292
in-drivable-lane_min30.699999999999292
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.605809475307318, "survival_time": 59.99999999999873, "driven_lanedir": -3.1355637001281074, "in-drivable-lane": 30.699999999999292, "deviation-heading": 25.552279669740106, "distance-from-start": 0.1627029550076341, "deviation-center-line": 2.934952938872135, "driven_lanedir_consec": -3.1355637001281074}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16033sim-1of4successno0:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16032sim-3of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16031sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16029sim-0of4successno0:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14960sim-0of4successno0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14959sim-3of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14958sim-1of4successno0:09:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14954sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13829sim-0of4errorno0:02:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13823sim-0of4host-errorno0:01:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13822sim-1of4errorno0:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13821sim-3of4successno0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13820sim-2of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12474sim-0of4successno0:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12473sim-3of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12472sim-1of4successno0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12471sim-2of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7418sim-0of4successno0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7417sim-1of4successno0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7416sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7413sim-2of4successno0:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6193sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6192sim-0of4successno0:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6191sim-1of4successno0:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6186sim-2of4successno0:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4920sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4919sim-2of4successno0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4913sim-1of4successno0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4911sim-0of4successno0:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible