Duckietown Challenges Home Challenges Submissions

Submission 395

Submission395
Competingyes
Challengeaido-LFVI-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17177 sim-1of4: 17187 sim-2of4: 17176 sim-3of4: 17175
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17187sim-1of4successyes0:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.750000000000103
in-drivable-lane_median7.600000000000048
driven_lanedir_consec_median-1.137979933194094
deviation-center-line_median0.35582658130770806


other stats
deviation-center-line_max0.35582658130770806
deviation-center-line_mean0.35582658130770806
deviation-center-line_min0.35582658130770806
deviation-heading_max7.382791271613367
deviation-heading_mean7.382791271613367
deviation-heading_median7.382791271613367
deviation-heading_min7.382791271613367
distance-from-start_max0.16375554270961637
distance-from-start_mean0.16375554270961637
distance-from-start_median0.16375554270961637
distance-from-start_min0.16375554270961637
driven_any_max3.6033348409621095
driven_any_mean3.6033348409621095
driven_any_median3.6033348409621095
driven_any_min3.6033348409621095
driven_lanedir_consec_max-1.137979933194094
driven_lanedir_consec_mean-1.137979933194094
driven_lanedir_consec_min-1.137979933194094
driven_lanedir_max-1.1245351556262426
driven_lanedir_mean-1.1245351556262426
driven_lanedir_median-1.1245351556262426
driven_lanedir_min-1.1245351556262426
in-drivable-lane_max7.600000000000048
in-drivable-lane_mean7.600000000000048
in-drivable-lane_min7.600000000000048
per-episodes
details{"4way-000-ego0": {"driven_any": 3.6033348409621095, "survival_time": 16.750000000000103, "driven_lanedir": -1.1245351556262426, "in-drivable-lane": 7.600000000000048, "deviation-heading": 7.382791271613367, "distance-from-start": 0.16375554270961637, "deviation-center-line": 0.35582658130770806, "driven_lanedir_consec": -1.137979933194094}}
simulation-passed1
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_min16.750000000000103
No reset possible
17178sim-1of4host-erroryes0:03:55
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-stage-05-6.2.53-job17178-978303, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.53-job17178-978303', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17177sim-0of4successyes0:17:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.849999999999195
driven_lanedir_consec_median-2.757255501829291
deviation-center-line_median2.9451204666257524


other stats
deviation-center-line_max2.9451204666257524
deviation-center-line_mean2.9451204666257524
deviation-center-line_min2.9451204666257524
deviation-heading_max27.46675692774402
deviation-heading_mean27.46675692774402
deviation-heading_median27.46675692774402
deviation-heading_min27.46675692774402
distance-from-start_max0.14150413430657544
distance-from-start_mean0.14150413430657544
distance-from-start_median0.14150413430657544
distance-from-start_min0.14150413430657544
driven_any_max12.177141344233844
driven_any_mean12.177141344233844
driven_any_median12.177141344233844
driven_any_min12.177141344233844
driven_lanedir_consec_max-2.757255501829291
driven_lanedir_consec_mean-2.757255501829291
driven_lanedir_consec_min-2.757255501829291
driven_lanedir_max-2.757255501829291
driven_lanedir_mean-2.757255501829291
driven_lanedir_median-2.757255501829291
driven_lanedir_min-2.757255501829291
in-drivable-lane_max28.849999999999195
in-drivable-lane_mean28.849999999999195
in-drivable-lane_min28.849999999999195
per-episodes
details{"udem-000-ego0": {"driven_any": 12.177141344233844, "survival_time": 59.99999999999873, "driven_lanedir": -2.757255501829291, "in-drivable-lane": 28.849999999999195, "deviation-heading": 27.46675692774402, "distance-from-start": 0.14150413430657544, "deviation-center-line": 2.9451204666257524, "driven_lanedir_consec": -2.757255501829291}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17176sim-2of4successyes0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17175sim-3of4successyes0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
16037sim-1of4successno0:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16036sim-2of4successno0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16035sim-0of4successno0:16:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16034sim-3of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14965sim-2of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14963sim-1of4successno0:05:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14962sim-0of4successno0:17:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14961sim-3of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13827sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13826sim-1of4errorno0:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13825sim-2of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13824sim-0of4errorno0:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12478sim-3of4successno0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12477sim-0of4successno0:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12476sim-1of4successno0:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12475sim-2of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7422sim-3of4successno0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7421sim-1of4successno0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7420sim-0of4successno0:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7419sim-2of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6197sim-2of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6196sim-1of4successno0:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6195sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6194sim-0of4successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4924sim-3of4successno0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4923sim-2of4successno0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4922sim-0of4successno0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4921sim-1of4successno0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible