Duckietown Challenges Home Challenges Submissions

Submission 389

Submission389
Competingyes
Challengeaido-LFI-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17219 sim-1of4: 17227 sim-2of4: 17207 sim-3of4: 17221
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

17227

Click the images to see detailed statistics about the episode.

udem1-000

17219

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17227sim-1of4successyes0:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.099999999999397
driven_lanedir_consec_median-3.3646725705377123
deviation-center-line_median2.1540021563112215


other stats
deviation-center-line_max2.1540021563112215
deviation-center-line_mean2.1540021563112215
deviation-center-line_min2.1540021563112215
deviation-heading_max30.15163124748327
deviation-heading_mean30.15163124748327
deviation-heading_median30.15163124748327
deviation-heading_min30.15163124748327
distance-from-start_max0.215125044786342
distance-from-start_mean0.215125044786342
distance-from-start_median0.215125044786342
distance-from-start_min0.215125044786342
driven_any_max11.827858593103288
driven_any_mean11.827858593103288
driven_any_median11.827858593103288
driven_any_min11.827858593103288
driven_lanedir_consec_max-3.3646725705377123
driven_lanedir_consec_mean-3.3646725705377123
driven_lanedir_consec_min-3.3646725705377123
driven_lanedir_max-3.434592148991556
driven_lanedir_mean-3.434592148991556
driven_lanedir_median-3.434592148991556
driven_lanedir_min-3.434592148991556
in-drivable-lane_max24.099999999999397
in-drivable-lane_mean24.099999999999397
in-drivable-lane_min24.099999999999397
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.827858593103288, "survival_time": 59.99999999999873, "driven_lanedir": -3.434592148991556, "in-drivable-lane": 24.099999999999397, "deviation-heading": 30.15163124748327, "distance-from-start": 0.215125044786342, "deviation-center-line": 2.1540021563112215, "driven_lanedir_consec": -3.3646725705377123}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17221sim-3of4successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17219sim-0of4successyes0:10:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median55.299999999998995
in-drivable-lane_median23.44999999999956
driven_lanedir_consec_median-3.400332046754454
deviation-center-line_median1.999362585995937


other stats
deviation-center-line_max1.999362585995937
deviation-center-line_mean1.999362585995937
deviation-center-line_min1.999362585995937
deviation-heading_max24.0776055155273
deviation-heading_mean24.0776055155273
deviation-heading_median24.0776055155273
deviation-heading_min24.0776055155273
distance-from-start_max0.19816985400807985
distance-from-start_mean0.19816985400807985
distance-from-start_median0.19816985400807985
distance-from-start_min0.19816985400807985
driven_any_max11.31960802972671
driven_any_mean11.31960802972671
driven_any_median11.31960802972671
driven_any_min11.31960802972671
driven_lanedir_consec_max-3.400332046754454
driven_lanedir_consec_mean-3.400332046754454
driven_lanedir_consec_min-3.400332046754454
driven_lanedir_max-4.066140236815472
driven_lanedir_mean-4.066140236815472
driven_lanedir_median-4.066140236815472
driven_lanedir_min-4.066140236815472
in-drivable-lane_max23.44999999999956
in-drivable-lane_mean23.44999999999956
in-drivable-lane_min23.44999999999956
per-episodes
details{"4way-000-ego0": {"driven_any": 11.31960802972671, "survival_time": 55.299999999998995, "driven_lanedir": -4.066140236815472, "in-drivable-lane": 23.44999999999956, "deviation-heading": 24.0776055155273, "distance-from-start": 0.19816985400807985, "deviation-center-line": 1.999362585995937, "driven_lanedir_consec": -3.400332046754454}}
simulation-passed1
survival_time_max55.299999999998995
survival_time_mean55.299999999998995
survival_time_min55.299999999998995
No reset possible
17207sim-2of4successyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
17206sim-0of4host-erroryes0:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16062sim-2of4successno0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16061sim-0of4successno0:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16060sim-1of4successno0:09:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16058sim-3of4successno0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14991sim-1of4successno0:10:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14987sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14986sim-0of4successno0:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14984sim-3of4successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13871sim-1of4errorno0:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13863sim-1of4host-errorno0:01:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13858sim-0of4errorno0:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13856sim-1of4host-errorno0:01:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13852sim-0of4host-errorno0:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13851sim-2of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13849sim-1of4host-errorno0:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13848sim-3of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12512sim-3of4successno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12511sim-2of4successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12510sim-1of4successno0:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12507sim-0of4successno0:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7446sim-3of4successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7445sim-0of4successno0:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7444sim-1of4successno0:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7442sim-2of4successno0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6225sim-0of4successno0:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6224sim-1of4successno0:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6223sim-2of4successno0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6222sim-3of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4978sim-3of4successno0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4977sim-1of4successno0:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4976sim-2of4successno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4968sim-0of4successno0:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible