Duckietown Challenges Home Challenges Submissions

Submission 385

Submission385
Competingyes
Challengeaido-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 17262 sim-1of4: 17256 sim-2of4: 17260 sim-3of4: 17257
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

17262

Click the images to see detailed statistics about the episode.

autolab-000

17260

Click the images to see detailed statistics about the episode.

loop2-000

17257

Click the images to see detailed statistics about the episode.

zigzag-000

17256

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
17262sim-0of4successyes0:34:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median26.44999999999924
driven_lanedir_consec_median-3.576666427132401
deviation-center-line_median3.0396797173543817


other stats
deviation-center-line_max5.982733608672978
deviation-center-line_mean3.5347511101910296
deviation-center-line_min2.0769113973823763
deviation-heading_max34.9355347845064
deviation-heading_mean28.72191461198261
deviation-heading_median26.886829654388116
deviation-heading_min26.178464354647797
distance-from-start_max0.2104927044806729
distance-from-start_mean0.17964939838231045
distance-from-start_median0.17180588555637674
distance-from-start_min0.16449311793581547
driven_any_max15.309248407252754
driven_any_mean12.827489447243918
driven_any_median12.154134068074107
driven_any_min11.69244124557471
driven_lanedir_consec_max-2.7560325521222153
driven_lanedir_consec_mean-3.613698447929501
driven_lanedir_consec_min-4.545428385330986
driven_lanedir_max-2.7560325521222153
driven_lanedir_mean-4.959966006208434
driven_lanedir_median-3.947189314040648
driven_lanedir_min-9.189452844630225
in-drivable-lane_max28.499999999999435
in-drivable-lane_mean22.512499999999427
in-drivable-lane_min8.649999999999796
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.807705953415256, "survival_time": 59.99999999999873, "driven_lanedir": -3.871624026115776, "in-drivable-lane": 26.24999999999926, "deviation-heading": 26.19658439492024, "distance-from-start": 0.16923200605128152, "deviation-center-line": 2.8287238647216766, "driven_lanedir_consec": -3.3736494928998955}, "autolab-000-ego1": {"driven_any": 11.69244124557471, "survival_time": 59.99999999999873, "driven_lanedir": -2.7560325521222153, "in-drivable-lane": 26.649999999999217, "deviation-heading": 27.57707491385599, "distance-from-start": 0.17437976506147196, "deviation-center-line": 3.2506355699870872, "driven_lanedir_consec": -2.7560325521222153}, "autolab-000-ego2": {"driven_any": 15.309248407252754, "survival_time": 59.99999999999873, "driven_lanedir": -9.189452844630225, "in-drivable-lane": 8.649999999999796, "deviation-heading": 34.9355347845064, "distance-from-start": 0.2104927044806729, "deviation-center-line": 5.982733608672978, "driven_lanedir_consec": -4.545428385330986}, "autolab-000-ego3": {"driven_any": 12.500562182732956, "survival_time": 59.99999999999873, "driven_lanedir": -4.02275460196552, "in-drivable-lane": 28.499999999999435, "deviation-heading": 26.178464354647797, "distance-from-start": 0.16449311793581547, "deviation-center-line": 2.0769113973823763, "driven_lanedir_consec": -3.779683361364906}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17261sim-0of4host-erroryes0:01:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17260sim-2of4successyes0:12:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.57499999999915
driven_lanedir_consec_median-2.84891178816083
deviation-center-line_median2.549828697487662


other stats
deviation-center-line_max2.621005791917744
deviation-center-line_mean2.549828697487662
deviation-center-line_min2.4786516030575796
deviation-heading_max26.030180440662253
deviation-heading_mean25.60222181841532
deviation-heading_median25.60222181841532
deviation-heading_min25.174263196168383
distance-from-start_max0.16304304911899392
distance-from-start_mean0.1609398389939206
distance-from-start_median0.1609398389939206
distance-from-start_min0.15883662886884725
driven_any_max11.333816833275366
driven_any_mean11.206687885601074
driven_any_median11.206687885601074
driven_any_min11.079558937926784
driven_lanedir_consec_max-2.7014777118262785
driven_lanedir_consec_mean-2.84891178816083
driven_lanedir_consec_min-2.996345864495382
driven_lanedir_max-2.7014777118262785
driven_lanedir_mean-2.9421073057481406
driven_lanedir_median-2.9421073057481406
driven_lanedir_min-3.182736899670003
in-drivable-lane_max32.299999999999116
in-drivable-lane_mean30.57499999999915
in-drivable-lane_min28.849999999999184
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.079558937926784, "survival_time": 59.99999999999873, "driven_lanedir": -3.182736899670003, "in-drivable-lane": 28.849999999999184, "deviation-heading": 26.030180440662253, "distance-from-start": 0.16304304911899392, "deviation-center-line": 2.621005791917744, "driven_lanedir_consec": -2.996345864495382}, "loop2-000-ego1": {"driven_any": 11.333816833275366, "survival_time": 59.99999999999873, "driven_lanedir": -2.7014777118262785, "in-drivable-lane": 32.299999999999116, "deviation-heading": 25.174263196168383, "distance-from-start": 0.15883662886884725, "deviation-center-line": 2.4786516030575796, "driven_lanedir_consec": -2.7014777118262785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17259sim-0of4host-erroryes0:01:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17258sim-2of4host-erroryes0:01:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17257sim-3of4successyes0:38:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.024999999999437
driven_lanedir_consec_median-3.7426185467315367
deviation-center-line_median3.286949084352202


other stats
deviation-center-line_max4.457617988376784
deviation-center-line_mean3.132681468654183
deviation-center-line_min1.4992097175355437
deviation-heading_max27.321568176507515
deviation-heading_mean24.111756013141218
deviation-heading_median26.127484091217433
deviation-heading_min16.87048769362248
distance-from-start_max0.1679623245018981
distance-from-start_mean0.16651336424207155
distance-from-start_median0.16721445973350796
distance-from-start_min0.16366221299937225
driven_any_max16.074827316880494
driven_any_mean14.054214352236633
driven_any_median14.282983277065687
driven_any_min11.576063537934663
driven_lanedir_consec_max-2.2533347949621847
driven_lanedir_consec_mean-3.476487611460497
driven_lanedir_consec_min-4.16737855741673
driven_lanedir_max-2.2533347949621847
driven_lanedir_mean-5.552203870603558
driven_lanedir_median-5.952715432800382
driven_lanedir_min-8.050049821851282
in-drivable-lane_max39.89999999999906
in-drivable-lane_mean26.14999999999937
in-drivable-lane_min16.649999999999523
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.735363188663882, "survival_time": 59.99999999999873, "driven_lanedir": -4.474975924624375, "in-drivable-lane": 27.59999999999936, "deviation-heading": 27.321568176507515, "distance-from-start": 0.16657286629549042, "deviation-center-line": 2.9938513741659, "driven_lanedir_consec": -4.16737855741673}, "zigzag-000-ego1": {"driven_any": 11.576063537934663, "survival_time": 59.99999999999873, "driven_lanedir": -2.2533347949621847, "in-drivable-lane": 39.89999999999906, "deviation-heading": 16.87048769362248, "distance-from-start": 0.16366221299937225, "deviation-center-line": 1.4992097175355437, "driven_lanedir_consec": -2.2533347949621847}, "zigzag-000-ego2": {"driven_any": 15.830603365467493, "survival_time": 59.99999999999873, "driven_lanedir": -8.050049821851282, "in-drivable-lane": 16.649999999999523, "deviation-heading": 27.194051122382533, "distance-from-start": 0.1678560531715255, "deviation-center-line": 4.457617988376784, "driven_lanedir_consec": -3.7515583881154506}, "zigzag-000-ego3": {"driven_any": 16.074827316880494, "survival_time": 59.99999999999873, "driven_lanedir": -7.430454940976389, "in-drivable-lane": 20.449999999999513, "deviation-heading": 25.06091706005233, "distance-from-start": 0.1679623245018981, "deviation-center-line": 3.580046794538504, "driven_lanedir_consec": -3.733678705347623}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17256sim-1of4successyes0:32:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.92499999999935
driven_lanedir_consec_median-3.298094482444622
deviation-center-line_median2.7912619943184147


other stats
deviation-center-line_max3.823201113640619
deviation-center-line_mean2.9622853444611916
deviation-center-line_min2.4434162755673188
deviation-heading_max28.298074421329396
deviation-heading_mean27.46276446465614
deviation-heading_median27.276120827193587
deviation-heading_min27.00074178290798
distance-from-start_max0.2090723460249335
distance-from-start_mean0.18144222837136464
distance-from-start_median0.17506839134744184
distance-from-start_min0.1665597847656414
driven_any_max12.720994578764708
driven_any_mean11.631238230910906
driven_any_median11.614589058249722
driven_any_min10.574780228379463
driven_lanedir_consec_max-2.26406537282643
driven_lanedir_consec_mean-3.1720459909712355
driven_lanedir_consec_min-3.827929626169269
driven_lanedir_max-2.6753052128097488
driven_lanedir_mean-3.322239967957433
driven_lanedir_median-3.3928625164253576
driven_lanedir_min-3.827929626169269
in-drivable-lane_max28.79999999999938
in-drivable-lane_mean25.424999999999343
in-drivable-lane_min23.049999999999287
per-episodes
details{"loop-000-ego0": {"driven_any": 11.505804176448471, "survival_time": 59.99999999999873, "driven_lanedir": -3.1687616965369703, "in-drivable-lane": 23.84999999999939, "deviation-heading": 27.198194583486337, "distance-from-start": 0.1834517764238565, "deviation-center-line": 2.672829503619949, "driven_lanedir_consec": -3.1687616965369703}, "loop-000-ego1": {"driven_any": 12.720994578764708, "survival_time": 59.99999999999873, "driven_lanedir": -3.827929626169269, "in-drivable-lane": 28.79999999999938, "deviation-heading": 27.00074178290798, "distance-from-start": 0.2090723460249335, "deviation-center-line": 2.4434162755673188, "driven_lanedir_consec": -3.827929626169269}, "loop-000-ego2": {"driven_any": 10.574780228379463, "survival_time": 59.99999999999873, "driven_lanedir": -2.6753052128097488, "in-drivable-lane": 23.049999999999287, "deviation-heading": 28.298074421329396, "distance-from-start": 0.1665597847656414, "deviation-center-line": 3.823201113640619, "driven_lanedir_consec": -2.26406537282643}, "loop-000-ego3": {"driven_any": 11.723373940050973, "survival_time": 59.99999999999873, "driven_lanedir": -3.616963336313745, "in-drivable-lane": 25.99999999999931, "deviation-heading": 27.354047070900837, "distance-from-start": 0.16668500627102725, "deviation-center-line": 2.909694485016881, "driven_lanedir_consec": -3.4274272683522735}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
17253sim-3of4host-erroryes0:01:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17251sim-0of4host-erroryes0:01:23
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible