Duckietown Challenges Home Challenges Submissions

Submission 394

Submission394
Competingyes
Challengeaido-LFV-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17181 sim-1of4: 17180 sim-2of4: 17179 sim-3of4: 17182
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17182sim-3of4successyes0:22:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.39999999999902
driven_lanedir_consec_median-1.550144461122788
deviation-center-line_median2.463367203716699


other stats
deviation-center-line_max2.463367203716699
deviation-center-line_mean2.463367203716699
deviation-center-line_min2.463367203716699
deviation-heading_max20.05757283402047
deviation-heading_mean20.05757283402047
deviation-heading_median20.05757283402047
deviation-heading_min20.05757283402047
distance-from-start_max0.2202657828431243
distance-from-start_mean0.2202657828431243
distance-from-start_median0.2202657828431243
distance-from-start_min0.2202657828431243
driven_any_max10.7594709865027
driven_any_mean10.7594709865027
driven_any_median10.7594709865027
driven_any_min10.7594709865027
driven_lanedir_consec_max-1.550144461122788
driven_lanedir_consec_mean-1.550144461122788
driven_lanedir_consec_min-1.550144461122788
driven_lanedir_max-1.550144461122788
driven_lanedir_mean-1.550144461122788
driven_lanedir_median-1.550144461122788
driven_lanedir_min-1.550144461122788
in-drivable-lane_max37.39999999999902
in-drivable-lane_mean37.39999999999902
in-drivable-lane_min37.39999999999902
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.7594709865027, "survival_time": 59.99999999999873, "driven_lanedir": -1.550144461122788, "in-drivable-lane": 37.39999999999902, "deviation-heading": 20.05757283402047, "distance-from-start": 0.2202657828431243, "deviation-center-line": 2.463367203716699, "driven_lanedir_consec": -1.550144461122788}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17181sim-0of4successyes0:19:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median36.84999999999903
driven_lanedir_consec_median-2.596168725794497
deviation-center-line_median1.8625509644343072


other stats
deviation-center-line_max1.8625509644343072
deviation-center-line_mean1.8625509644343072
deviation-center-line_min1.8625509644343072
deviation-heading_max22.502560604009208
deviation-heading_mean22.502560604009208
deviation-heading_median22.502560604009208
deviation-heading_min22.502560604009208
distance-from-start_max0.172915698927857
distance-from-start_mean0.172915698927857
distance-from-start_median0.172915698927857
distance-from-start_min0.172915698927857
driven_any_max10.99858085341895
driven_any_mean10.99858085341895
driven_any_median10.99858085341895
driven_any_min10.99858085341895
driven_lanedir_consec_max-2.596168725794497
driven_lanedir_consec_mean-2.596168725794497
driven_lanedir_consec_min-2.596168725794497
driven_lanedir_max-2.596168725794497
driven_lanedir_mean-2.596168725794497
driven_lanedir_median-2.596168725794497
driven_lanedir_min-2.596168725794497
in-drivable-lane_max36.84999999999903
in-drivable-lane_mean36.84999999999903
in-drivable-lane_min36.84999999999903
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.99858085341895, "survival_time": 59.99999999999873, "driven_lanedir": -2.596168725794497, "in-drivable-lane": 36.84999999999903, "deviation-heading": 22.502560604009208, "distance-from-start": 0.172915698927857, "deviation-center-line": 1.8625509644343072, "driven_lanedir_consec": -2.596168725794497}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17180sim-1of4successyes0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.09999999999998
in-drivable-lane_median2.8999999999999906
driven_lanedir_consec_median-0.43937585828224446
deviation-center-line_median0.17413298320792647


other stats
deviation-center-line_max0.17413298320792647
deviation-center-line_mean0.17413298320792647
deviation-center-line_min0.17413298320792647
deviation-heading_max4.8204626876476135
deviation-heading_mean4.8204626876476135
deviation-heading_median4.8204626876476135
deviation-heading_min4.8204626876476135
distance-from-start_max0.15665584372659958
distance-from-start_mean0.15665584372659958
distance-from-start_median0.15665584372659958
distance-from-start_min0.15665584372659958
driven_any_max1.360736121976895
driven_any_mean1.360736121976895
driven_any_median1.360736121976895
driven_any_min1.360736121976895
driven_lanedir_consec_max-0.43937585828224446
driven_lanedir_consec_mean-0.43937585828224446
driven_lanedir_consec_min-0.43937585828224446
driven_lanedir_max-0.43937585828224446
driven_lanedir_mean-0.43937585828224446
driven_lanedir_median-0.43937585828224446
driven_lanedir_min-0.43937585828224446
in-drivable-lane_max2.8999999999999906
in-drivable-lane_mean2.8999999999999906
in-drivable-lane_min2.8999999999999906
per-episodes
details{"loop-000-ego0": {"driven_any": 1.360736121976895, "survival_time": 8.09999999999998, "driven_lanedir": -0.43937585828224446, "in-drivable-lane": 2.8999999999999906, "deviation-heading": 4.8204626876476135, "distance-from-start": 0.15665584372659958, "deviation-center-line": 0.17413298320792647, "driven_lanedir_consec": -0.43937585828224446}}
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean8.09999999999998
survival_time_min8.09999999999998
No reset possible
17179sim-2of4successyes0:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.399999999999142
driven_lanedir_consec_median-1.8115207049710225
deviation-center-line_median3.619278325570927


other stats
deviation-center-line_max3.619278325570927
deviation-center-line_mean3.619278325570927
deviation-center-line_min3.619278325570927
deviation-heading_max25.651175977169135
deviation-heading_mean25.651175977169135
deviation-heading_median25.651175977169135
deviation-heading_min25.651175977169135
distance-from-start_max0.152755833793969
distance-from-start_mean0.152755833793969
distance-from-start_median0.152755833793969
distance-from-start_min0.152755833793969
driven_any_max10.210169126488724
driven_any_mean10.210169126488724
driven_any_median10.210169126488724
driven_any_min10.210169126488724
driven_lanedir_consec_max-1.8115207049710225
driven_lanedir_consec_mean-1.8115207049710225
driven_lanedir_consec_min-1.8115207049710225
driven_lanedir_max-1.8115207049710225
driven_lanedir_mean-1.8115207049710225
driven_lanedir_median-1.8115207049710225
driven_lanedir_min-1.8115207049710225
in-drivable-lane_max26.399999999999142
in-drivable-lane_mean26.399999999999142
in-drivable-lane_min26.399999999999142
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.210169126488724, "survival_time": 59.99999999999873, "driven_lanedir": -1.8115207049710225, "in-drivable-lane": 26.399999999999142, "deviation-heading": 25.651175977169135, "distance-from-start": 0.152755833793969, "deviation-center-line": 3.619278325570927, "driven_lanedir_consec": -1.8115207049710225}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
16041sim-0of4successno0:18:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16040sim-3of4successno0:20:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16039sim-2of4successno0:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16038sim-1of4successno0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14968sim-2of4successno0:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14967sim-0of4successno0:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14966sim-3of4successno0:19:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14964sim-1of4successno0:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13832sim-3of4errorno0:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13831sim-0of4errorno0:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13830sim-1of4errorno0:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13828sim-2of4errorno0:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12482sim-2of4successno0:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12481sim-0of4successno0:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12480sim-1of4successno0:14:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12479sim-3of4successno0:20:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6201sim-0of4successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6200sim-2of4successno0:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6199sim-1of4successno0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6198sim-3of4successno0:14:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4929sim-3of4successno0:14:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4928sim-1of4successno0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4927sim-2of4successno0:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4926sim-0of4successno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible