Duckietown Challenges Home Challenges Submissions

Submission 533

Submission533
Competingyes
Challengeaido-LF-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of4: 17090 sim-1of4: 17089 sim-2of4: 17091 sim-3of4: 17094
Next
User labelbaseline-dagger-pytorch
Admin priority50
Blessingn/a
User priority50

17090

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17094sim-3of4failedyes0:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17091sim-2of4failedyes0:01:07
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17090sim-0of4successyes0:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.585360000111613
survival_time_median59.99999999999873
deviation-center-line_median3.1114891567015768
in-drivable-lane_median0.0


other stats
deviation-center-line_max3.1114891567015768
deviation-center-line_mean3.1114891567015768
deviation-center-line_min3.1114891567015768
deviation-heading_max14.309183839924325
deviation-heading_mean14.309183839924325
deviation-heading_median14.309183839924325
deviation-heading_min14.309183839924325
distance-from-start_max4.0428461897156875
distance-from-start_mean4.0428461897156875
distance-from-start_median4.0428461897156875
distance-from-start_min4.0428461897156875
driven_any_max9.040295289747556
driven_any_mean9.040295289747556
driven_any_median9.040295289747556
driven_any_min9.040295289747556
driven_lanedir_consec_max8.585360000111613
driven_lanedir_consec_mean8.585360000111613
driven_lanedir_consec_min8.585360000111613
driven_lanedir_max8.585360000111613
driven_lanedir_mean8.585360000111613
driven_lanedir_median8.585360000111613
driven_lanedir_min8.585360000111613
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.040295289747556, "survival_time": 59.99999999999873, "driven_lanedir": 8.585360000111613, "in-drivable-lane": 0.0, "deviation-heading": 14.309183839924325, "distance-from-start": 4.0428461897156875, "deviation-center-line": 3.1114891567015768, "driven_lanedir_consec": 8.585360000111613}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17089sim-1of4failedyes0:01:09
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15953sim-0of4successno0:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15952sim-2of4successno0:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15951sim-1of4successno0:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
15950sim-3of4successno0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14879sim-2of4successno0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14878sim-3of4successno0:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14877sim-1of4successno0:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14876sim-0of4successno0:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13743sim-0of4errorno0:00:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13742sim-3of4errorno0:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13741sim-2of4errorno0:00:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13739sim-1of4errorno0:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12394sim-0of4successno0:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12393sim-2of4successno0:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12391sim-1of4successno0:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12390sim-3of4failedno0:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7331sim-1of4successno0:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7322sim-3of4successno0:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7321sim-0of4successno0:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7319sim-2of4successno0:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6112sim-0of4successno0:06:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6111sim-2of4successno0:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6110sim-1of4successno0:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6109sim-3of4failedno0:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5115sim-3of4successno0:12:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4514sim-3of4abortedno0:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4512sim-2of4failedno0:01:05
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4511sim-1of4failedno0:01:06
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4508sim-0of4failedno0:01:06
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible