Duckietown Challenges Home Challenges Submissions

Evaluator 22

ID22
evaluatorgpu-staging-spot-0-02
owneruser1000001
machinegpu-staging-spot-0
processgpu-staging-spot-0-02
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success202 5226
# timeout4 6303
# failed61 5190
# error
# aborted
# host-error7 6812
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)246.2 GB
Disk (MB)969.3 GB
Disk available (MB)892.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7477800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-020:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7474801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-020:06:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7463385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4host-errornogpu-staging-spot-0-020:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7454387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-020:12:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.14999999999917
driven_lanedir_consec_median-3.039876866872404
deviation-center-line_median2.5975705613544187


other stats
deviation-center-line_max2.5975705613544187
deviation-center-line_mean2.5975705613544187
deviation-center-line_min2.5975705613544187
deviation-heading_max23.86740376671509
deviation-heading_mean23.86740376671509
deviation-heading_median23.86740376671509
deviation-heading_min23.86740376671509
distance-from-start_max0.16610539930854903
distance-from-start_mean0.16610539930854903
distance-from-start_median0.16610539930854903
distance-from-start_min0.16610539930854903
driven_any_max12.237918547828071
driven_any_mean12.237918547828071
driven_any_median12.237918547828071
driven_any_min12.237918547828071
driven_lanedir_consec_max-3.039876866872404
driven_lanedir_consec_mean-3.039876866872404
driven_lanedir_consec_min-3.039876866872404
driven_lanedir_max-3.241540781645438
driven_lanedir_mean-3.241540781645438
driven_lanedir_median-3.241540781645438
driven_lanedir_min-3.241540781645438
in-drivable-lane_max34.14999999999917
in-drivable-lane_mean34.14999999999917
in-drivable-lane_min34.14999999999917
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.237918547828071, "survival_time": 59.99999999999873, "driven_lanedir": -3.241540781645438, "in-drivable-lane": 34.14999999999917, "deviation-heading": 23.86740376671509, "distance-from-start": 0.16610539930854903, "deviation-center-line": 2.5975705613544187, "driven_lanedir_consec": -3.039876866872404}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7453387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-020:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.60000000000013
in-drivable-lane_median7.000000000000055
driven_lanedir_consec_median-1.12077612180664
deviation-center-line_median0.7849166889234834


other stats
deviation-center-line_max0.7849166889234834
deviation-center-line_mean0.7849166889234834
deviation-center-line_min0.7849166889234834
deviation-heading_max7.3997269104308865
deviation-heading_mean7.3997269104308865
deviation-heading_median7.3997269104308865
deviation-heading_min7.3997269104308865
distance-from-start_max0.17525969575729872
distance-from-start_mean0.17525969575729872
distance-from-start_median0.17525969575729872
distance-from-start_min0.17525969575729872
driven_any_max3.5726327251064913
driven_any_mean3.5726327251064913
driven_any_median3.5726327251064913
driven_any_min3.5726327251064913
driven_lanedir_consec_max-1.12077612180664
driven_lanedir_consec_mean-1.12077612180664
driven_lanedir_consec_min-1.12077612180664
driven_lanedir_max-1.6945230714543575
driven_lanedir_mean-1.6945230714543575
driven_lanedir_median-1.6945230714543575
driven_lanedir_min-1.6945230714543575
in-drivable-lane_max7.000000000000055
in-drivable-lane_mean7.000000000000055
in-drivable-lane_min7.000000000000055
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.5726327251064913, "survival_time": 18.60000000000013, "driven_lanedir": -1.6945230714543575, "in-drivable-lane": 7.000000000000055, "deviation-heading": 7.3997269104308865, "distance-from-start": 0.17525969575729872, "deviation-center-line": 0.7849166889234834, "driven_lanedir_consec": -1.12077612180664}}
simulation-passed1
survival_time_max18.60000000000013
survival_time_mean18.60000000000013
survival_time_min18.60000000000013
No reset possible
7448388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-020:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.6
in-drivable-lane_median1.4500000000000046
driven_lanedir_consec_median-0.08724280888355729
deviation-center-line_median0.3229371867520373


other stats
deviation-center-line_max0.3229371867520373
deviation-center-line_mean0.3229371867520373
deviation-center-line_min0.3229371867520373
deviation-heading_max5.650541839903048
deviation-heading_mean5.650541839903048
deviation-heading_median5.650541839903048
deviation-heading_min5.650541839903048
distance-from-start_max0.14402215537159938
distance-from-start_mean0.14402215537159938
distance-from-start_median0.14402215537159938
distance-from-start_min0.14402215537159938
driven_any_max1.4073087758775042
driven_any_mean1.4073087758775042
driven_any_median1.4073087758775042
driven_any_min1.4073087758775042
driven_lanedir_consec_max-0.08724280888355729
driven_lanedir_consec_mean-0.08724280888355729
driven_lanedir_consec_min-0.08724280888355729
driven_lanedir_max-0.08724280888355729
driven_lanedir_mean-0.08724280888355729
driven_lanedir_median-0.08724280888355729
driven_lanedir_min-0.08724280888355729
in-drivable-lane_max1.4500000000000046
in-drivable-lane_mean1.4500000000000046
in-drivable-lane_min1.4500000000000046
per-episodes
details{"4way-000-ego0": {"driven_any": 1.4073087758775042, "survival_time": 9.6, "driven_lanedir": -0.08724280888355729, "in-drivable-lane": 1.4500000000000046, "deviation-heading": 5.650541839903048, "distance-from-start": 0.14402215537159938, "deviation-center-line": 0.3229371867520373, "driven_lanedir_consec": -0.08724280888355729}}
simulation-passed1
survival_time_max9.6
survival_time_mean9.6
survival_time_min9.6
No reset possible
7443390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-020:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.8587311199723393
survival_time_median59.99999999999873
deviation-center-line_median2.8934156500181176
in-drivable-lane_median28.59999999999925


other stats
deviation-center-line_max2.8934156500181176
deviation-center-line_mean2.8934156500181176
deviation-center-line_min2.8934156500181176
deviation-heading_max26.583890052686577
deviation-heading_mean26.583890052686577
deviation-heading_median26.583890052686577
deviation-heading_min26.583890052686577
distance-from-start_max0.16406917609319258
distance-from-start_mean0.16406917609319258
distance-from-start_median0.16406917609319258
distance-from-start_min0.16406917609319258
driven_any_max11.19874637104679
driven_any_mean11.19874637104679
driven_any_median11.19874637104679
driven_any_min11.19874637104679
driven_lanedir_consec_max-2.8587311199723393
driven_lanedir_consec_mean-2.8587311199723393
driven_lanedir_consec_min-2.8587311199723393
driven_lanedir_max-3.104383032484938
driven_lanedir_mean-3.104383032484938
driven_lanedir_median-3.104383032484938
driven_lanedir_min-3.104383032484938
in-drivable-lane_max28.59999999999925
in-drivable-lane_mean28.59999999999925
in-drivable-lane_min28.59999999999925
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.19874637104679, "survival_time": 59.99999999999873, "driven_lanedir": -3.104383032484938, "in-drivable-lane": 28.59999999999925, "deviation-heading": 26.583890052686577, "distance-from-start": 0.16406917609319258, "deviation-center-line": 2.8934156500181176, "driven_lanedir_consec": -2.8587311199723393}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7439390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-020:06:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.4886206325357887
survival_time_median59.99999999999873
deviation-center-line_median3.0054492787494635
in-drivable-lane_median28.74999999999895


other stats
deviation-center-line_max3.0054492787494635
deviation-center-line_mean3.0054492787494635
deviation-center-line_min3.0054492787494635
deviation-heading_max25.241816775092857
deviation-heading_mean25.241816775092857
deviation-heading_median25.241816775092857
deviation-heading_min25.241816775092857
distance-from-start_max0.22135590217663956
distance-from-start_mean0.22135590217663956
distance-from-start_median0.22135590217663956
distance-from-start_min0.22135590217663956
driven_any_max11.37597631697899
driven_any_mean11.37597631697899
driven_any_median11.37597631697899
driven_any_min11.37597631697899
driven_lanedir_consec_max-2.4886206325357887
driven_lanedir_consec_mean-2.4886206325357887
driven_lanedir_consec_min-2.4886206325357887
driven_lanedir_max-3.039052638846052
driven_lanedir_mean-3.039052638846052
driven_lanedir_median-3.039052638846052
driven_lanedir_min-3.039052638846052
in-drivable-lane_max28.74999999999895
in-drivable-lane_mean28.74999999999895
in-drivable-lane_min28.74999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.37597631697899, "survival_time": 59.99999999999873, "driven_lanedir": -3.039052638846052, "in-drivable-lane": 28.74999999999895, "deviation-heading": 25.241816775092857, "distance-from-start": 0.22135590217663956, "deviation-center-line": 3.0054492787494635, "driven_lanedir_consec": -2.4886206325357887}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7438391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornogpu-staging-spot-0-020:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7437391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornogpu-staging-spot-0-020:01:31
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7430392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.17499999999932
driven_lanedir_consec_median-2.7761683057812125
deviation-center-line_median2.832891898546749


other stats
deviation-center-line_max2.934509246326963
deviation-center-line_mean2.832891898546749
deviation-center-line_min2.731274550766535
deviation-heading_max28.788631685843736
deviation-heading_mean26.345560208748584
deviation-heading_median26.345560208748584
deviation-heading_min23.90248873165343
distance-from-start_max0.13824101154248358
distance-from-start_mean0.1338497609230912
distance-from-start_median0.1338497609230912
distance-from-start_min0.1294585103036988
driven_any_max11.237976286793437
driven_any_mean11.11958761777694
driven_any_median11.11958761777694
driven_any_min11.001198948760448
driven_lanedir_consec_max-2.6223844096469633
driven_lanedir_consec_mean-2.7761683057812125
driven_lanedir_consec_min-2.929952201915462
driven_lanedir_max-2.6223844096469633
driven_lanedir_mean-2.7761683057812125
driven_lanedir_median-2.7761683057812125
driven_lanedir_min-2.929952201915462
in-drivable-lane_max32.64999999999911
in-drivable-lane_mean27.17499999999932
in-drivable-lane_min21.69999999999953
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.001198948760448, "survival_time": 59.99999999999873, "driven_lanedir": -2.929952201915462, "in-drivable-lane": 21.69999999999953, "deviation-heading": 28.788631685843736, "distance-from-start": 0.13824101154248358, "deviation-center-line": 2.731274550766535, "driven_lanedir_consec": -2.929952201915462}, "loop2-000-ego1": {"driven_any": 11.237976286793437, "survival_time": 59.99999999999873, "driven_lanedir": -2.6223844096469633, "in-drivable-lane": 32.64999999999911, "deviation-heading": 23.90248873165343, "distance-from-start": 0.1294585103036988, "deviation-center-line": 2.934509246326963, "driven_lanedir_consec": -2.6223844096469633}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7412398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-020:20:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.07499999999943
driven_lanedir_consec_median-2.86339837864713
deviation-center-line_median2.530185691897131


other stats
deviation-center-line_max5.162691027539735
deviation-center-line_mean3.0997180319351916
deviation-center-line_min2.17580971640677
deviation-heading_max28.781593491225458
deviation-heading_mean23.5693087698143
deviation-heading_median22.25879807202283
deviation-heading_min20.97804544398607
distance-from-start_max0.3138165238941789
distance-from-start_mean0.19486560631639704
distance-from-start_median0.16077237249547374
distance-from-start_min0.14410115638046178
driven_any_max13.297542406788564
driven_any_mean9.208123102249662
driven_any_median10.881031503312837
driven_any_min1.772886995584412
driven_lanedir_consec_max-0.4091997301790926
driven_lanedir_consec_mean-2.5934879995013875
driven_lanedir_consec_min-4.237955510532197
driven_lanedir_max-0.4091997301790926
driven_lanedir_mean-2.73528862122562
driven_lanedir_median-2.86339837864713
driven_lanedir_min-4.805157997429127
in-drivable-lane_max34.39999999999891
in-drivable-lane_mean22.962499999999448
in-drivable-lane_min3.3000000000000096
per-episodes
details{"4way-000-ego0": {"driven_any": 8.98489777346327, "survival_time": 59.99999999999873, "driven_lanedir": -2.190075851368732, "in-drivable-lane": 34.39999999999891, "deviation-heading": 20.97804544398607, "distance-from-start": 0.14410115638046178, "deviation-center-line": 2.5596381939795227, "driven_lanedir_consec": -2.190075851368732}, "4way-000-ego1": {"driven_any": 1.772886995584412, "survival_time": 59.99999999999873, "driven_lanedir": -0.4091997301790926, "in-drivable-lane": 3.3000000000000096, "deviation-heading": 21.60533283004389, "distance-from-start": 0.1553454833007404, "deviation-center-line": 5.162691027539735, "driven_lanedir_consec": -0.4091997301790926}, "4way-000-ego2": {"driven_any": 13.297542406788564, "survival_time": 59.99999999999873, "driven_lanedir": -4.805157997429127, "in-drivable-lane": 31.0499999999993, "deviation-heading": 22.912263314001777, "distance-from-start": 0.16619926169020707, "deviation-center-line": 2.17580971640677, "driven_lanedir_consec": -4.237955510532197}, "4way-000-ego3": {"driven_any": 12.7771652331624, "survival_time": 59.99999999999873, "driven_lanedir": -3.536720905925528, "in-drivable-lane": 23.099999999999568, "deviation-heading": 28.781593491225458, "distance-from-start": 0.3138165238941789, "deviation-center-line": 2.500733189814739, "driven_lanedir_consec": -3.536720905925528}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7406514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7402516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7397517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7392518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7388519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-020:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7384520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7380521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7375522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7373524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7371524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7369525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7367525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7365527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7362527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7361528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:14
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7353530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-020:09:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median46.59999999999949
in-drivable-lane_median0.0
driven_lanedir_consec_median6.488276592390252
deviation-center-line_median2.2744205143225775


other stats
deviation-center-line_max2.2744205143225775
deviation-center-line_mean2.2744205143225775
deviation-center-line_min2.2744205143225775
deviation-heading_max10.039420717742797
deviation-heading_mean10.039420717742797
deviation-heading_median10.039420717742797
deviation-heading_min10.039420717742797
distance-from-start_max2.70471649258437
distance-from-start_mean2.70471649258437
distance-from-start_median2.70471649258437
distance-from-start_min2.70471649258437
driven_any_max6.714125030048258
driven_any_mean6.714125030048258
driven_any_median6.714125030048258
driven_any_min6.714125030048258
driven_lanedir_consec_max6.488276592390252
driven_lanedir_consec_mean6.488276592390252
driven_lanedir_consec_min6.488276592390252
driven_lanedir_max6.488276592390252
driven_lanedir_mean6.488276592390252
driven_lanedir_median6.488276592390252
driven_lanedir_min6.488276592390252
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.714125030048258, "survival_time": 46.59999999999949, "driven_lanedir": 6.488276592390252, "in-drivable-lane": 0.0, "deviation-heading": 10.039420717742797, "distance-from-start": 2.70471649258437, "deviation-center-line": 2.2744205143225775, "driven_lanedir_consec": 6.488276592390252}}
simulation-passed1
survival_time_max46.59999999999949
survival_time_mean46.59999999999949
survival_time_min46.59999999999949
No reset possible
7333532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-020:07:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.350000000000005
driven_lanedir_consec_median9.329605022945412
deviation-center-line_median3.5119821105079185


other stats
deviation-center-line_max3.5119821105079185
deviation-center-line_mean3.5119821105079185
deviation-center-line_min3.5119821105079185
deviation-heading_max18.15780339579305
deviation-heading_mean18.15780339579305
deviation-heading_median18.15780339579305
deviation-heading_min18.15780339579305
distance-from-start_max1.0440260639538697
distance-from-start_mean1.0440260639538697
distance-from-start_median1.0440260639538697
distance-from-start_min1.0440260639538697
driven_any_max9.952051193870304
driven_any_mean9.952051193870304
driven_any_median9.952051193870304
driven_any_min9.952051193870304
driven_lanedir_consec_max9.329605022945412
driven_lanedir_consec_mean9.329605022945412
driven_lanedir_consec_min9.329605022945412
driven_lanedir_max9.332515677151507
driven_lanedir_mean9.332515677151507
driven_lanedir_median9.332515677151507
driven_lanedir_min9.332515677151507
in-drivable-lane_max0.350000000000005
in-drivable-lane_mean0.350000000000005
in-drivable-lane_min0.350000000000005
per-episodes
details{"4way-000-ego0": {"driven_any": 9.952051193870304, "survival_time": 59.99999999999873, "driven_lanedir": 9.332515677151507, "in-drivable-lane": 0.350000000000005, "deviation-heading": 18.15780339579305, "distance-from-start": 1.0440260639538697, "deviation-center-line": 3.5119821105079185, "driven_lanedir_consec": 9.329605022945412}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7321533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-020:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.945005652888067
survival_time_median59.99999999999873
deviation-center-line_median2.530057085785024
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.530057085785024
deviation-center-line_mean2.530057085785024
deviation-center-line_min2.530057085785024
deviation-heading_max10.910581313190823
deviation-heading_mean10.910581313190823
deviation-heading_median10.910581313190823
deviation-heading_min10.910581313190823
distance-from-start_max1.0654085657466963
distance-from-start_mean1.0654085657466963
distance-from-start_median1.0654085657466963
distance-from-start_min1.0654085657466963
driven_any_max10.201344757975235
driven_any_mean10.201344757975235
driven_any_median10.201344757975235
driven_any_min10.201344757975235
driven_lanedir_consec_max9.945005652888067
driven_lanedir_consec_mean9.945005652888067
driven_lanedir_consec_min9.945005652888067
driven_lanedir_max9.945005652888067
driven_lanedir_mean9.945005652888067
driven_lanedir_median9.945005652888067
driven_lanedir_min9.945005652888067
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.201344757975235, "survival_time": 59.99999999999873, "driven_lanedir": 9.945005652888067, "in-drivable-lane": 0.0, "deviation-heading": 10.910581313190823, "distance-from-start": 1.0654085657466963, "deviation-center-line": 2.530057085785024, "driven_lanedir_consec": 9.945005652888067}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7316534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7314534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-3of4failednogpu-staging-spot-0-020:01:03
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7310535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:04
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7297536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-020:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.699999999999655
in-drivable-lane_median2.450000000000035
driven_lanedir_consec_median6.857569331007754
deviation-center-line_median2.1914737205617465


other stats
deviation-center-line_max2.1914737205617465
deviation-center-line_mean2.1914737205617465
deviation-center-line_min2.1914737205617465
deviation-heading_max10.050210631657915
deviation-heading_mean10.050210631657915
deviation-heading_median10.050210631657915
deviation-heading_min10.050210631657915
distance-from-start_max3.666282414836105
distance-from-start_mean3.666282414836105
distance-from-start_median3.666282414836105
distance-from-start_min3.666282414836105
driven_any_max7.6799241319996625
driven_any_mean7.6799241319996625
driven_any_median7.6799241319996625
driven_any_min7.6799241319996625
driven_lanedir_consec_max6.857569331007754
driven_lanedir_consec_mean6.857569331007754
driven_lanedir_consec_min6.857569331007754
driven_lanedir_max6.857569331007754
driven_lanedir_mean6.857569331007754
driven_lanedir_median6.857569331007754
driven_lanedir_min6.857569331007754
in-drivable-lane_max2.450000000000035
in-drivable-lane_mean2.450000000000035
in-drivable-lane_min2.450000000000035
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.6799241319996625, "survival_time": 43.699999999999655, "driven_lanedir": 6.857569331007754, "in-drivable-lane": 2.450000000000035, "deviation-heading": 10.050210631657915, "distance-from-start": 3.666282414836105, "deviation-center-line": 2.1914737205617465, "driven_lanedir_consec": 6.857569331007754}}
simulation-passed1
survival_time_max43.699999999999655
survival_time_mean43.699999999999655
survival_time_min43.699999999999655
No reset possible
7292538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7286539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7274541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-020:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.833961771773286
survival_time_median59.99999999999873
deviation-center-line_median2.788813454534672
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.788813454534672
deviation-center-line_mean2.788813454534672
deviation-center-line_min2.788813454534672
deviation-heading_max12.82149824386417
deviation-heading_mean12.82149824386417
deviation-heading_median12.82149824386417
deviation-heading_min12.82149824386417
distance-from-start_max1.0826294018864289
distance-from-start_mean1.0826294018864289
distance-from-start_median1.0826294018864289
distance-from-start_min1.0826294018864289
driven_any_max10.162893689028042
driven_any_mean10.162893689028042
driven_any_median10.162893689028042
driven_any_min10.162893689028042
driven_lanedir_consec_max9.833961771773286
driven_lanedir_consec_mean9.833961771773286
driven_lanedir_consec_min9.833961771773286
driven_lanedir_max9.833961771773286
driven_lanedir_mean9.833961771773286
driven_lanedir_median9.833961771773286
driven_lanedir_min9.833961771773286
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.162893689028042, "survival_time": 59.99999999999873, "driven_lanedir": 9.833961771773286, "in-drivable-lane": 0.0, "deviation-heading": 12.82149824386417, "distance-from-start": 1.0826294018864289, "deviation-center-line": 2.788813454534672, "driven_lanedir_consec": 9.833961771773286}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7253541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-020:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.672765641297659
survival_time_median59.99999999999873
deviation-center-line_median3.63676119771028
in-drivable-lane_median0.9499999999999966


other stats
deviation-center-line_max3.63676119771028
deviation-center-line_mean3.63676119771028
deviation-center-line_min3.63676119771028
deviation-heading_max18.08929529536663
deviation-heading_mean18.08929529536663
deviation-heading_median18.08929529536663
deviation-heading_min18.08929529536663
distance-from-start_max3.311673137354021
distance-from-start_mean3.311673137354021
distance-from-start_median3.311673137354021
distance-from-start_min3.311673137354021
driven_any_max9.49580859188717
driven_any_mean9.49580859188717
driven_any_median9.49580859188717
driven_any_min9.49580859188717
driven_lanedir_consec_max8.672765641297659
driven_lanedir_consec_mean8.672765641297659
driven_lanedir_consec_min8.672765641297659
driven_lanedir_max8.672765641297659
driven_lanedir_mean8.672765641297659
driven_lanedir_median8.672765641297659
driven_lanedir_min8.672765641297659
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.9499999999999966
in-drivable-lane_min0.9499999999999966
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.49580859188717, "survival_time": 59.99999999999873, "driven_lanedir": 8.672765641297659, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 18.08929529536663, "distance-from-start": 3.311673137354021, "deviation-center-line": 3.63676119771028, "driven_lanedir_consec": 8.672765641297659}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7248542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7239542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7235600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:17
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7219600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-020:03:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7202603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.349999999999984
in-drivable-lane_median6.574999999999985
driven_lanedir_consec_median0.303375127744802
deviation-center-line_median0.12329693144645508


other stats
deviation-center-line_max0.16745604571618836
deviation-center-line_mean0.1238733055765581
deviation-center-line_min0.08144331369713395
deviation-heading_max1.410139130686416
deviation-heading_mean0.9070609503678482
deviation-heading_median0.8616449022665793
deviation-heading_min0.4948148662518185
distance-from-start_max2.05787517577923
distance-from-start_mean1.7236301848886495
distance-from-start_median1.7113625042088807
distance-from-start_min1.4139205553576075
driven_any_max2.119270731146091
driven_any_mean1.7757998918473683
driven_any_median1.7624743272371917
driven_any_min1.4589801817689985
driven_lanedir_consec_max0.699839809784355
driven_lanedir_consec_mean0.3650020930759559
driven_lanedir_consec_min0.15341830702986448
driven_lanedir_max0.699839809784355
driven_lanedir_mean0.3650020930759559
driven_lanedir_median0.303375127744802
driven_lanedir_min0.15341830702986448
in-drivable-lane_max7.449999999999983
in-drivable-lane_mean6.562499999999984
in-drivable-lane_min5.649999999999985
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4589801817689985, "survival_time": 8.349999999999984, "driven_lanedir": 0.19768306439202443, "in-drivable-lane": 6.949999999999984, "deviation-heading": 1.0791129879546604, "distance-from-start": 1.4139205553576075, "deviation-center-line": 0.10460666589972216, "driven_lanedir_consec": 0.19768306439202443}, "autolab-000-ego1": {"driven_any": 2.119270731146091, "survival_time": 8.349999999999984, "driven_lanedir": 0.15341830702986448, "in-drivable-lane": 7.449999999999983, "deviation-heading": 0.4948148662518185, "distance-from-start": 2.05787517577923, "deviation-center-line": 0.08144331369713395, "driven_lanedir_consec": 0.15341830702986448}, "autolab-000-ego2": {"driven_any": 1.7477084830604488, "survival_time": 8.349999999999984, "driven_lanedir": 0.4090671910975796, "in-drivable-lane": 6.199999999999986, "deviation-heading": 1.410139130686416, "distance-from-start": 1.6986776638345489, "deviation-center-line": 0.16745604571618836, "driven_lanedir_consec": 0.4090671910975796}, "autolab-000-ego3": {"driven_any": 1.7772401714139348, "survival_time": 8.349999999999984, "driven_lanedir": 0.699839809784355, "in-drivable-lane": 5.649999999999985, "deviation-heading": 0.6441768165784982, "distance-from-start": 1.7240473445832123, "deviation-center-line": 0.141987196993188, "driven_lanedir_consec": 0.699839809784355}}
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_min8.349999999999984
No reset possible
7191605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-020:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999991
in-drivable-lane_median3.79999999999999
driven_lanedir_consec_median0.21179787583295395
deviation-center-line_median0.07697010326128317


other stats
deviation-center-line_max0.07697010326128317
deviation-center-line_mean0.07697010326128317
deviation-center-line_min0.07697010326128317
deviation-heading_max0.5865283995754912
deviation-heading_mean0.5865283995754912
deviation-heading_median0.5865283995754912
deviation-heading_min0.5865283995754912
distance-from-start_max1.187406525511749
distance-from-start_mean1.187406525511749
distance-from-start_median1.187406525511749
distance-from-start_min1.187406525511749
driven_any_max1.2030228200181334
driven_any_mean1.2030228200181334
driven_any_median1.2030228200181334
driven_any_min1.2030228200181334
driven_lanedir_consec_max0.21179787583295395
driven_lanedir_consec_mean0.21179787583295395
driven_lanedir_consec_min0.21179787583295395
driven_lanedir_max0.21179787583295395
driven_lanedir_mean0.21179787583295395
driven_lanedir_median0.21179787583295395
driven_lanedir_min0.21179787583295395
in-drivable-lane_max3.79999999999999
in-drivable-lane_mean3.79999999999999
in-drivable-lane_min3.79999999999999
per-episodes
details{"loop-000-ego0": {"driven_any": 1.2030228200181334, "survival_time": 4.899999999999991, "driven_lanedir": 0.21179787583295395, "in-drivable-lane": 3.79999999999999, "deviation-heading": 0.5865283995754912, "distance-from-start": 1.187406525511749, "deviation-center-line": 0.07697010326128317, "driven_lanedir_consec": 0.21179787583295395}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_min4.899999999999991
No reset possible
7179607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-020:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.2
in-drivable-lane_median1.1
driven_lanedir_consec_median0.2072276244911706
deviation-center-line_median0.07172678334457587


other stats
deviation-center-line_max0.07172678334457587
deviation-center-line_mean0.07172678334457587
deviation-center-line_min0.07172678334457587
deviation-heading_max0.5947503758242577
deviation-heading_mean0.5947503758242577
deviation-heading_median0.5947503758242577
deviation-heading_min0.5947503758242577
distance-from-start_max0.3751806033443627
distance-from-start_mean0.3751806033443627
distance-from-start_median0.3751806033443627
distance-from-start_min0.3751806033443627
driven_any_max0.37583261442035615
driven_any_mean0.37583261442035615
driven_any_median0.37583261442035615
driven_any_min0.37583261442035615
driven_lanedir_consec_max0.2072276244911706
driven_lanedir_consec_mean0.2072276244911706
driven_lanedir_consec_min0.2072276244911706
driven_lanedir_max0.2072276244911706
driven_lanedir_mean0.2072276244911706
driven_lanedir_median0.2072276244911706
driven_lanedir_min0.2072276244911706
in-drivable-lane_max1.1
in-drivable-lane_mean1.1
in-drivable-lane_min1.1
per-episodes
details{"4way-000-ego0": {"driven_any": 0.37583261442035615, "survival_time": 2.2, "driven_lanedir": 0.2072276244911706, "in-drivable-lane": 1.1, "deviation-heading": 0.5947503758242577, "distance-from-start": 0.3751806033443627, "deviation-center-line": 0.07172678334457587, "driven_lanedir_consec": 0.2072276244911706}}
simulation-passed1
survival_time_max2.2
survival_time_mean2.2
survival_time_min2.2
No reset possible
7165610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-1of4successnogpu-staging-spot-0-020:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.450000000000127
in-drivable-lane_median17.400000000000126
driven_lanedir_consec_median0.1804969065713906
deviation-center-line_median0.09262730172926376


other stats
deviation-center-line_max0.23728642962958135
deviation-center-line_mean0.12165508333859736
deviation-center-line_min0.06407930026628056
deviation-heading_max1.2249713650103058
deviation-heading_mean0.695753506939395
deviation-heading_median0.5898782923451695
deviation-heading_min0.3782860780569349
distance-from-start_max3.2449378636065314
distance-from-start_mean1.6342847612665774
distance-from-start_median1.5388694862102916
distance-from-start_min0.21446220903919544
driven_any_max5.116988028036569
driven_any_mean2.1672891041118394
driven_any_median1.6687359233317838
driven_any_min0.21469654174722105
driven_lanedir_consec_max0.8987822825538521
driven_lanedir_consec_mean0.3382011110100979
driven_lanedir_consec_min0.0930283483437584
driven_lanedir_max0.8987822825538521
driven_lanedir_mean0.3382011110100979
driven_lanedir_median0.1804969065713906
driven_lanedir_min0.0930283483437584
in-drivable-lane_max17.700000000000127
in-drivable-lane_mean16.812500000000128
in-drivable-lane_min14.750000000000131
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.238071211364442, "survival_time": 18.450000000000127, "driven_lanedir": 0.1321998683181853, "in-drivable-lane": 17.500000000000128, "deviation-heading": 0.6435049607342495, "distance-from-start": 1.22510839268255, "deviation-center-line": 0.06407930026628056, "driven_lanedir_consec": 0.1321998683181853}, "autolab-000-ego1": {"driven_any": 5.116988028036569, "survival_time": 18.450000000000127, "driven_lanedir": 0.22879394482459592, "in-drivable-lane": 17.300000000000125, "deviation-heading": 0.3782860780569349, "distance-from-start": 3.2449378636065314, "deviation-center-line": 0.11868014119841427, "driven_lanedir_consec": 0.22879394482459592}, "autolab-000-ego2": {"driven_any": 2.099400635299126, "survival_time": 18.450000000000127, "driven_lanedir": 0.8987822825538521, "in-drivable-lane": 14.750000000000131, "deviation-heading": 1.2249713650103058, "distance-from-start": 1.8526305797380336, "deviation-center-line": 0.23728642962958135, "driven_lanedir_consec": 0.8987822825538521}, "autolab-000-ego3": {"driven_any": 0.21469654174722105, "survival_time": 18.450000000000127, "driven_lanedir": 0.0930283483437584, "in-drivable-lane": 17.700000000000127, "deviation-heading": 0.5362516239560896, "distance-from-start": 0.21446220903919544, "deviation-center-line": 0.06657446226011321, "driven_lanedir_consec": 0.0930283483437584}}
simulation-passed1
survival_time_max18.450000000000127
survival_time_mean18.450000000000127
survival_time_min18.450000000000127
No reset possible
7156613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7150611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-020:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6999999999999984
in-drivable-lane_median1.7499999999999982
driven_lanedir_consec_median0.1145513348777214
deviation-center-line_median0.05438158025871128


other stats
deviation-center-line_max0.05438158025871128
deviation-center-line_mean0.05438158025871128
deviation-center-line_min0.05438158025871128
deviation-heading_max0.694764097691242
deviation-heading_mean0.694764097691242
deviation-heading_median0.694764097691242
deviation-heading_min0.694764097691242
distance-from-start_max0.4315614779691158
distance-from-start_mean0.4315614779691158
distance-from-start_median0.4315614779691158
distance-from-start_min0.4315614779691158
driven_any_max0.4318417945871395
driven_any_mean0.4318417945871395
driven_any_median0.4318417945871395
driven_any_min0.4318417945871395
driven_lanedir_consec_max0.1145513348777214
driven_lanedir_consec_mean0.1145513348777214
driven_lanedir_consec_min0.1145513348777214
driven_lanedir_max0.1145513348777214
driven_lanedir_mean0.1145513348777214
driven_lanedir_median0.1145513348777214
driven_lanedir_min0.1145513348777214
in-drivable-lane_max1.7499999999999982
in-drivable-lane_mean1.7499999999999982
in-drivable-lane_min1.7499999999999982
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4318417945871395, "survival_time": 2.6999999999999984, "driven_lanedir": 0.1145513348777214, "in-drivable-lane": 1.7499999999999982, "deviation-heading": 0.694764097691242, "distance-from-start": 0.4315614779691158, "deviation-center-line": 0.05438158025871128, "driven_lanedir_consec": 0.1145513348777214}}
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.6999999999999984
survival_time_min2.6999999999999984
No reset possible
7142614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-020:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6999999999999984
in-drivable-lane_median1.7999999999999985
driven_lanedir_consec_median0.12340168903045969
deviation-center-line_median0.053277023574846566


other stats
deviation-center-line_max0.053277023574846566
deviation-center-line_mean0.053277023574846566
deviation-center-line_min0.053277023574846566
deviation-heading_max0.6286487771972079
deviation-heading_mean0.6286487771972079
deviation-heading_median0.6286487771972079
deviation-heading_min0.6286487771972079
distance-from-start_max0.4815200957329684
distance-from-start_mean0.4815200957329684
distance-from-start_median0.4815200957329684
distance-from-start_min0.4815200957329684
driven_any_max0.484937142232884
driven_any_mean0.484937142232884
driven_any_median0.484937142232884
driven_any_min0.484937142232884
driven_lanedir_consec_max0.12340168903045969
driven_lanedir_consec_mean0.12340168903045969
driven_lanedir_consec_min0.12340168903045969
driven_lanedir_max0.12340168903045969
driven_lanedir_mean0.12340168903045969
driven_lanedir_median0.12340168903045969
driven_lanedir_min0.12340168903045969
in-drivable-lane_max1.7999999999999985
in-drivable-lane_mean1.7999999999999985
in-drivable-lane_min1.7999999999999985
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.484937142232884, "survival_time": 2.6999999999999984, "driven_lanedir": 0.12340168903045969, "in-drivable-lane": 1.7999999999999985, "deviation-heading": 0.6286487771972079, "distance-from-start": 0.4815200957329684, "deviation-center-line": 0.053277023574846566, "driven_lanedir_consec": 0.12340168903045969}}
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.6999999999999984
survival_time_min2.6999999999999984
No reset possible
7136615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47570940073678813
survival_time_median9.249999999999996
deviation-center-line_median0.19717200674279983
in-drivable-lane_median6.850000000000001


other stats
deviation-center-line_max0.19717200674279983
deviation-center-line_mean0.19717200674279983
deviation-center-line_min0.19717200674279983
deviation-heading_max1.4906293709433531
deviation-heading_mean1.4906293709433531
deviation-heading_median1.4906293709433531
deviation-heading_min1.4906293709433531
distance-from-start_max2.3582245401258555
distance-from-start_mean2.3582245401258555
distance-from-start_median2.3582245401258555
distance-from-start_min2.3582245401258555
driven_any_max2.393581064439152
driven_any_mean2.393581064439152
driven_any_median2.393581064439152
driven_any_min2.393581064439152
driven_lanedir_consec_max0.47570940073678813
driven_lanedir_consec_mean0.47570940073678813
driven_lanedir_consec_min0.47570940073678813
driven_lanedir_max0.47570940073678813
driven_lanedir_mean0.47570940073678813
driven_lanedir_median0.47570940073678813
driven_lanedir_min0.47570940073678813
in-drivable-lane_max6.850000000000001
in-drivable-lane_mean6.850000000000001
in-drivable-lane_min6.850000000000001
per-episodes
details{"loop-000-ego0": {"driven_any": 2.393581064439152, "survival_time": 9.249999999999996, "driven_lanedir": 0.47570940073678813, "in-drivable-lane": 6.850000000000001, "deviation-heading": 1.4906293709433531, "distance-from-start": 2.3582245401258555, "deviation-center-line": 0.19717200674279983, "driven_lanedir_consec": 0.47570940073678813}}
simulation-passed1
survival_time_max9.249999999999996
survival_time_mean9.249999999999996
survival_time_min9.249999999999996
No reset possible
7126618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-0of4successnogpu-staging-spot-0-020:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.60000000000023
in-drivable-lane_median19.400000000000148
driven_lanedir_consec_median1.1535186161549045
deviation-center-line_median1.0810709132246223


other stats
deviation-center-line_max1.8553628278500955
deviation-center-line_mean1.0810709132246223
deviation-center-line_min0.3067789985991491
deviation-heading_max6.5044681671372695
deviation-heading_mean4.04465598658352
deviation-heading_median4.04465598658352
deviation-heading_min1.5848438060297714
distance-from-start_max1.461438907507684
distance-from-start_mean1.1002190222947776
distance-from-start_median1.1002190222947776
distance-from-start_min0.7389991370818714
driven_any_max4.309726798395601
driven_any_mean2.779539710820756
driven_any_median2.779539710820756
driven_any_min1.249352623245911
driven_lanedir_consec_max1.504678956063087
driven_lanedir_consec_mean1.1535186161549045
driven_lanedir_consec_min0.8023582762467215
driven_lanedir_max2.5405884899978224
driven_lanedir_mean1.671473383122272
driven_lanedir_median1.671473383122272
driven_lanedir_min0.8023582762467215
in-drivable-lane_max26.80000000000025
in-drivable-lane_mean19.400000000000148
in-drivable-lane_min12.00000000000005
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.249352623245911, "survival_time": 33.60000000000023, "driven_lanedir": 0.8023582762467215, "in-drivable-lane": 26.80000000000025, "deviation-heading": 1.5848438060297714, "distance-from-start": 0.7389991370818714, "deviation-center-line": 0.3067789985991491, "driven_lanedir_consec": 0.8023582762467215}, "loop2-000-ego1": {"driven_any": 4.309726798395601, "survival_time": 33.60000000000023, "driven_lanedir": 2.5405884899978224, "in-drivable-lane": 12.00000000000005, "deviation-heading": 6.5044681671372695, "distance-from-start": 1.461438907507684, "deviation-center-line": 1.8553628278500955, "driven_lanedir_consec": 1.504678956063087}}
simulation-passed1
survival_time_max33.60000000000023
survival_time_mean33.60000000000023
survival_time_min33.60000000000023
No reset possible
7120623Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-020:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12258147220094172
survival_time_median8.899999999999991
deviation-center-line_median0.11239582250127804
in-drivable-lane_median7.149999999999991


other stats
deviation-center-line_max0.11239582250127804
deviation-center-line_mean0.11239582250127804
deviation-center-line_min0.11239582250127804
deviation-heading_max1.2560468941444791
deviation-heading_mean1.2560468941444791
deviation-heading_median1.2560468941444791
deviation-heading_min1.2560468941444791
distance-from-start_max0.8586338626663717
distance-from-start_mean0.8586338626663717
distance-from-start_median0.8586338626663717
distance-from-start_min0.8586338626663717
driven_any_max1.0302956272153423
driven_any_mean1.0302956272153423
driven_any_median1.0302956272153423
driven_any_min1.0302956272153423
driven_lanedir_consec_max0.12258147220094172
driven_lanedir_consec_mean0.12258147220094172
driven_lanedir_consec_min0.12258147220094172
driven_lanedir_max0.12258147220094172
driven_lanedir_mean0.12258147220094172
driven_lanedir_median0.12258147220094172
driven_lanedir_min0.12258147220094172
in-drivable-lane_max7.149999999999991
in-drivable-lane_mean7.149999999999991
in-drivable-lane_min7.149999999999991
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.0302956272153423, "survival_time": 8.899999999999991, "driven_lanedir": 0.12258147220094172, "in-drivable-lane": 7.149999999999991, "deviation-heading": 1.2560468941444791, "distance-from-start": 0.8586338626663717, "deviation-center-line": 0.11239582250127804, "driven_lanedir_consec": 0.12258147220094172}}
simulation-passed1
survival_time_max8.899999999999991
survival_time_mean8.899999999999991
survival_time_min8.899999999999991
No reset possible
7116619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-0of4successnogpu-staging-spot-0-020:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.600000000000058
in-drivable-lane_median3.4500000000000126
driven_lanedir_consec_median1.1259009185919249
deviation-center-line_median0.5843643240880099


other stats
deviation-center-line_max0.5843643240880099
deviation-center-line_mean0.5843643240880099
deviation-center-line_min0.5843643240880099
deviation-heading_max4.223557593407394
deviation-heading_mean4.223557593407394
deviation-heading_median4.223557593407394
deviation-heading_min4.223557593407394
distance-from-start_max0.9943892826901954
distance-from-start_mean0.9943892826901954
distance-from-start_median0.9943892826901954
distance-from-start_min0.9943892826901954
driven_any_max1.6541874040504343
driven_any_mean1.6541874040504343
driven_any_median1.6541874040504343
driven_any_min1.6541874040504343
driven_lanedir_consec_max1.1259009185919249
driven_lanedir_consec_mean1.1259009185919249
driven_lanedir_consec_min1.1259009185919249
driven_lanedir_max1.1259009185919249
driven_lanedir_mean1.1259009185919249
driven_lanedir_median1.1259009185919249
driven_lanedir_min1.1259009185919249
in-drivable-lane_max3.4500000000000126
in-drivable-lane_mean3.4500000000000126
in-drivable-lane_min3.4500000000000126
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6541874040504343, "survival_time": 13.600000000000058, "driven_lanedir": 1.1259009185919249, "in-drivable-lane": 3.4500000000000126, "deviation-heading": 4.223557593407394, "distance-from-start": 0.9943892826901954, "deviation-center-line": 0.5843643240880099, "driven_lanedir_consec": 1.1259009185919249}}
simulation-passed1
survival_time_max13.600000000000058
survival_time_mean13.600000000000058
survival_time_min13.600000000000058
No reset possible
7107620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-020:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.55000000000029
in-drivable-lane_median1.3500000000000192
driven_lanedir_consec_median3.702335332598601
deviation-center-line_median1.293174210649059


other stats
deviation-center-line_max1.293174210649059
deviation-center-line_mean1.293174210649059
deviation-center-line_min1.293174210649059
deviation-heading_max4.9872245313861345
deviation-heading_mean4.9872245313861345
deviation-heading_median4.9872245313861345
deviation-heading_min4.9872245313861345
distance-from-start_max2.806330204176493
distance-from-start_mean2.806330204176493
distance-from-start_median2.806330204176493
distance-from-start_min2.806330204176493
driven_any_max4.1769095576673525
driven_any_mean4.1769095576673525
driven_any_median4.1769095576673525
driven_any_min4.1769095576673525
driven_lanedir_consec_max3.702335332598601
driven_lanedir_consec_mean3.702335332598601
driven_lanedir_consec_min3.702335332598601
driven_lanedir_max3.8348269857556776
driven_lanedir_mean3.8348269857556776
driven_lanedir_median3.8348269857556776
driven_lanedir_min3.8348269857556776
in-drivable-lane_max1.3500000000000192
in-drivable-lane_mean1.3500000000000192
in-drivable-lane_min1.3500000000000192
per-episodes
details{"loop-000-ego0": {"driven_any": 4.1769095576673525, "survival_time": 32.55000000000029, "driven_lanedir": 3.8348269857556776, "in-drivable-lane": 1.3500000000000192, "deviation-heading": 4.9872245313861345, "distance-from-start": 2.806330204176493, "deviation-center-line": 1.293174210649059, "driven_lanedir_consec": 3.702335332598601}}
simulation-passed1
survival_time_max32.55000000000029
survival_time_mean32.55000000000029
survival_time_min32.55000000000029
No reset possible
7103621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7090625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:11:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.4750000000000067
driven_lanedir_consec_median3.7459667512307626
deviation-center-line_median3.042684811058596


other stats
deviation-center-line_max4.7468427621897495
deviation-center-line_mean3.3986687512591485
deviation-center-line_min2.7624626207296523
deviation-heading_max37.82293240559152
deviation-heading_mean15.442257741877947
deviation-heading_median8.079105250854463
deviation-heading_min7.78788806021135
distance-from-start_max2.524327470001551
distance-from-start_mean1.4915909482758138
distance-from-start_median1.7210181615508515
distance-from-start_min2.482534153247273e-16
driven_any_max7.914549774688358
driven_any_mean4.413999359342215
driven_any_median4.8707238313401024
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max6.83297820879579
driven_lanedir_consec_mean3.5812279278143286
driven_lanedir_consec_min0.0
driven_lanedir_max7.591168545600732
driven_lanedir_mean4.057318206444445
driven_lanedir_median4.319052140088525
driven_lanedir_min0.0
in-drivable-lane_max6.799999999999656
in-drivable-lane_mean1.9374999999999176
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.914503492229634, "survival_time": 59.99999999999873, "driven_lanedir": 7.591168545600732, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 8.08229360763536, "distance-from-start": 2.05563515755506, "deviation-center-line": 3.075105080216741, "driven_lanedir_consec": 5.6868074310802665}, "loop-000-ego1": {"driven_any": 7.914549774688358, "survival_time": 59.99999999999873, "driven_lanedir": 6.83297820879579, "in-drivable-lane": 6.799999999999656, "deviation-heading": 8.075916894073565, "distance-from-start": 2.524327470001551, "deviation-center-line": 4.7468427621897495, "driven_lanedir_consec": 6.83297820879579}, "loop-000-ego2": {"driven_any": 1.826944170450572, "survival_time": 59.99999999999873, "driven_lanedir": 1.8051260713812587, "in-drivable-lane": 0.0, "deviation-heading": 7.78788806021135, "distance-from-start": 1.3864011655466435, "deviation-center-line": 3.010264541900451, "driven_lanedir_consec": 1.8051260713812587}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7074646Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-0of4successnogpu-staging-spot-0-020:08:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median41.34999999999903
driven_lanedir_consec_median0.6905742568536808
deviation-center-line_median1.6087749336957904


other stats
deviation-center-line_max2.102582839572185
deviation-center-line_mean1.6087749336957904
deviation-center-line_min1.1149670278193955
deviation-heading_max21.715482706550468
deviation-heading_mean14.703891637338856
deviation-heading_median14.703891637338856
deviation-heading_min7.692300568127245
distance-from-start_max1.0524108886536057
distance-from-start_mean0.7590442248412048
distance-from-start_median0.7590442248412048
distance-from-start_min0.46567756102880387
driven_any_max7.364970157495937
driven_any_mean6.271401932146857
driven_any_median6.271401932146857
driven_any_min5.1778337067977755
driven_lanedir_consec_max0.7883092382576249
driven_lanedir_consec_mean0.6905742568536808
driven_lanedir_consec_min0.5928392754497367
driven_lanedir_max1.3952891092704407
driven_lanedir_mean1.091799173764033
driven_lanedir_median1.091799173764033
driven_lanedir_min0.7883092382576249
in-drivable-lane_max49.59999999999864
in-drivable-lane_mean41.34999999999903
in-drivable-lane_min33.09999999999941
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.1778337067977755, "survival_time": 59.99999999999873, "driven_lanedir": 1.3952891092704407, "in-drivable-lane": 33.09999999999941, "deviation-heading": 21.715482706550468, "distance-from-start": 0.46567756102880387, "deviation-center-line": 2.102582839572185, "driven_lanedir_consec": 0.5928392754497367}, "loop2-000-ego1": {"driven_any": 7.364970157495937, "survival_time": 59.99999999999873, "driven_lanedir": 0.7883092382576249, "in-drivable-lane": 49.59999999999864, "deviation-heading": 7.692300568127245, "distance-from-start": 1.0524108886536057, "deviation-center-line": 1.1149670278193955, "driven_lanedir_consec": 0.7883092382576249}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7055648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-020:12:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.349999999999568
driven_lanedir_consec_median3.3391664451301835
deviation-center-line_median2.149686002081851


other stats
deviation-center-line_max2.149686002081851
deviation-center-line_mean2.149686002081851
deviation-center-line_min2.149686002081851
deviation-heading_max22.722050867622915
deviation-heading_mean22.722050867622915
deviation-heading_median22.722050867622915
deviation-heading_min22.722050867622915
distance-from-start_max0.39989204006126655
distance-from-start_mean0.39989204006126655
distance-from-start_median0.39989204006126655
distance-from-start_min0.39989204006126655
driven_any_max9.006720354617194
driven_any_mean9.006720354617194
driven_any_median9.006720354617194
driven_any_min9.006720354617194
driven_lanedir_consec_max3.3391664451301835
driven_lanedir_consec_mean3.3391664451301835
driven_lanedir_consec_min3.3391664451301835
driven_lanedir_max3.3391664451301835
driven_lanedir_mean3.3391664451301835
driven_lanedir_median3.3391664451301835
driven_lanedir_min3.3391664451301835
in-drivable-lane_max28.349999999999568
in-drivable-lane_mean28.349999999999568
in-drivable-lane_min28.349999999999568
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.006720354617194, "survival_time": 59.99999999999873, "driven_lanedir": 3.3391664451301835, "in-drivable-lane": 28.349999999999568, "deviation-heading": 22.722050867622915, "distance-from-start": 0.39989204006126655, "deviation-center-line": 2.149686002081851, "driven_lanedir_consec": 3.3391664451301835}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7050649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-020:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median1.4999999999999996
driven_lanedir_consec_median0.01880680934943646
deviation-center-line_median0.013571754428896224


other stats
deviation-center-line_max0.013571754428896224
deviation-center-line_mean0.013571754428896224
deviation-center-line_min0.013571754428896224
deviation-heading_max0.7355892915848862
deviation-heading_mean0.7355892915848862
deviation-heading_median0.7355892915848862
deviation-heading_min0.7355892915848862
distance-from-start_max0.06950177779494354
distance-from-start_mean0.06950177779494354
distance-from-start_median0.06950177779494354
distance-from-start_min0.06950177779494354
driven_any_max0.10499160004412111
driven_any_mean0.10499160004412111
driven_any_median0.10499160004412111
driven_any_min0.10499160004412111
driven_lanedir_consec_max0.01880680934943646
driven_lanedir_consec_mean0.01880680934943646
driven_lanedir_consec_min0.01880680934943646
driven_lanedir_max0.01880680934943646
driven_lanedir_mean0.01880680934943646
driven_lanedir_median0.01880680934943646
driven_lanedir_min0.01880680934943646
in-drivable-lane_max1.4999999999999996
in-drivable-lane_mean1.4999999999999996
in-drivable-lane_min1.4999999999999996
per-episodes
details{"4way-000-ego0": {"driven_any": 0.10499160004412111, "survival_time": 2.3499999999999996, "driven_lanedir": 0.01880680934943646, "in-drivable-lane": 1.4999999999999996, "deviation-heading": 0.7355892915848862, "distance-from-start": 0.06950177779494354, "deviation-center-line": 0.013571754428896224, "driven_lanedir_consec": 0.01880680934943646}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
7046649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7045650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4host-errornogpu-staging-spot-0-020:00:47
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7035651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-020:06:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35497086278139744
survival_time_median59.99999999999873
deviation-center-line_median2.120058199610348
in-drivable-lane_median39.29999999999936


other stats
deviation-center-line_max2.120058199610348
deviation-center-line_mean2.120058199610348
deviation-center-line_min2.120058199610348
deviation-heading_max17.871522678949095
deviation-heading_mean17.871522678949095
deviation-heading_median17.871522678949095
deviation-heading_min17.871522678949095
distance-from-start_max0.4300307348324317
distance-from-start_mean0.4300307348324317
distance-from-start_median0.4300307348324317
distance-from-start_min0.4300307348324317
driven_any_max7.933036106574263
driven_any_mean7.933036106574263
driven_any_median7.933036106574263
driven_any_min7.933036106574263
driven_lanedir_consec_max0.35497086278139744
driven_lanedir_consec_mean0.35497086278139744
driven_lanedir_consec_min0.35497086278139744
driven_lanedir_max1.6077813671376269
driven_lanedir_mean1.6077813671376269
driven_lanedir_median1.6077813671376269
driven_lanedir_min1.6077813671376269
in-drivable-lane_max39.29999999999936
in-drivable-lane_mean39.29999999999936
in-drivable-lane_min39.29999999999936
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.933036106574263, "survival_time": 59.99999999999873, "driven_lanedir": 1.6077813671376269, "in-drivable-lane": 39.29999999999936, "deviation-heading": 17.871522678949095, "distance-from-start": 0.4300307348324317, "deviation-center-line": 2.120058199610348, "driven_lanedir_consec": 0.35497086278139744}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7033651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1044013392587284
survival_time_median2.0500000000000007
deviation-center-line_median0.0700743800878847
in-drivable-lane_median0.9500000000000004


other stats
deviation-center-line_max0.0700743800878847
deviation-center-line_mean0.0700743800878847
deviation-center-line_min0.0700743800878847
deviation-heading_max0.8651880257108374
deviation-heading_mean0.8651880257108374
deviation-heading_median0.8651880257108374
deviation-heading_min0.8651880257108374
distance-from-start_max0.199157362066454
distance-from-start_mean0.199157362066454
distance-from-start_median0.199157362066454
distance-from-start_min0.199157362066454
driven_any_max0.21151423976181755
driven_any_mean0.21151423976181755
driven_any_median0.21151423976181755
driven_any_min0.21151423976181755
driven_lanedir_consec_max0.1044013392587284
driven_lanedir_consec_mean0.1044013392587284
driven_lanedir_consec_min0.1044013392587284
driven_lanedir_max0.1044013392587284
driven_lanedir_mean0.1044013392587284
driven_lanedir_median0.1044013392587284
driven_lanedir_min0.1044013392587284
in-drivable-lane_max0.9500000000000004
in-drivable-lane_mean0.9500000000000004
in-drivable-lane_min0.9500000000000004
per-episodes
details{"loop-000-ego0": {"driven_any": 0.21151423976181755, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1044013392587284, "in-drivable-lane": 0.9500000000000004, "deviation-heading": 0.8651880257108374, "distance-from-start": 0.199157362066454, "deviation-center-line": 0.0700743800878847, "driven_lanedir_consec": 0.1044013392587284}}
simulation-passed1
survival_time_max2.0500000000000007
survival_time_mean2.0500000000000007
survival_time_min2.0500000000000007
No reset possible
7031652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornogpu-staging-spot-0-020:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7027652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornogpu-staging-spot-0-020:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7025652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7015653Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median41.47499999999907
driven_lanedir_consec_median0.6096658685296583
deviation-center-line_median1.637452477800299


other stats
deviation-center-line_max2.5102206972214915
deviation-center-line_mean1.637452477800299
deviation-center-line_min0.7646842583791063
deviation-heading_max23.234511362567687
deviation-heading_mean14.843200545005883
deviation-heading_median14.843200545005883
deviation-heading_min6.451889727444081
distance-from-start_max0.4542581766893348
distance-from-start_mean0.2724154036692217
distance-from-start_median0.2724154036692217
distance-from-start_min0.0905726306491086
driven_any_max8.528355263985214
driven_any_mean5.4405921653289475
driven_any_median5.4405921653289475
driven_any_min2.352829066672682
driven_lanedir_consec_max0.7360148645233897
driven_lanedir_consec_mean0.6096658685296583
driven_lanedir_consec_min0.4833168725359269
driven_lanedir_max0.7360148645233897
driven_lanedir_mean0.6312823881038094
driven_lanedir_median0.6312823881038094
driven_lanedir_min0.5265499116842292
in-drivable-lane_max53.04999999999879
in-drivable-lane_mean41.47499999999907
in-drivable-lane_min29.899999999999352
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.352829066672682, "survival_time": 59.99999999999873, "driven_lanedir": 0.7360148645233897, "in-drivable-lane": 29.899999999999352, "deviation-heading": 23.234511362567687, "distance-from-start": 0.0905726306491086, "deviation-center-line": 2.5102206972214915, "driven_lanedir_consec": 0.7360148645233897}, "loop2-000-ego1": {"driven_any": 8.528355263985214, "survival_time": 59.99999999999873, "driven_lanedir": 0.5265499116842292, "in-drivable-lane": 53.04999999999879, "deviation-heading": 6.451889727444081, "distance-from-start": 0.4542581766893348, "deviation-center-line": 0.7646842583791063, "driven_lanedir_consec": 0.4833168725359269}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7007654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-020:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.800000000000104
in-drivable-lane_median22.250000000000007
driven_lanedir_consec_median1.152078975801573
deviation-center-line_median0.8123745807231144


other stats
deviation-center-line_max0.8123745807231144
deviation-center-line_mean0.8123745807231144
deviation-center-line_min0.8123745807231144
deviation-heading_max10.297084171122563
deviation-heading_mean10.297084171122563
deviation-heading_median10.297084171122563
deviation-heading_min10.297084171122563
distance-from-start_max0.72571236237623
distance-from-start_mean0.72571236237623
distance-from-start_median0.72571236237623
distance-from-start_min0.72571236237623
driven_any_max5.243203480871588
driven_any_mean5.243203480871588
driven_any_median5.243203480871588
driven_any_min5.243203480871588
driven_lanedir_consec_max1.152078975801573
driven_lanedir_consec_mean1.152078975801573
driven_lanedir_consec_min1.152078975801573
driven_lanedir_max1.152078975801573
driven_lanedir_mean1.152078975801573
driven_lanedir_median1.152078975801573
driven_lanedir_min1.152078975801573
in-drivable-lane_max22.250000000000007
in-drivable-lane_mean22.250000000000007
in-drivable-lane_min22.250000000000007
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.243203480871588, "survival_time": 35.800000000000104, "driven_lanedir": 1.152078975801573, "in-drivable-lane": 22.250000000000007, "deviation-heading": 10.297084171122563, "distance-from-start": 0.72571236237623, "deviation-center-line": 0.8123745807231144, "driven_lanedir_consec": 1.152078975801573}}
simulation-passed1
survival_time_max35.800000000000104
survival_time_mean35.800000000000104
survival_time_min35.800000000000104
No reset possible
7001656Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6997656Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6990659Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.9249999999999936
driven_lanedir_consec_median0.08837267787988146
deviation-center-line_median0.06794365808346838


other stats
deviation-center-line_max0.0751208135344895
deviation-center-line_mean0.06836335132509852
deviation-center-line_min0.062445275598967814
deviation-heading_max1.1652621216719916
deviation-heading_mean0.7941898311002247
deviation-heading_median0.730222675080932
deviation-heading_min0.5510518525670429
distance-from-start_max0.27196874536549825
distance-from-start_mean0.18740223157566327
distance-from-start_median0.19003539998257044
distance-from-start_min0.09756938097201394
driven_any_max0.5053193769560801
driven_any_mean0.30098341463970485
driven_any_median0.2979202736925174
driven_any_min0.10277373421770472
driven_lanedir_consec_max0.18562025052090503
driven_lanedir_consec_mean0.09794075471004536
driven_lanedir_consec_min0.02939741255951356
driven_lanedir_max0.18562025052090503
driven_lanedir_mean0.09794075471004536
driven_lanedir_median0.08837267787988146
driven_lanedir_min0.02939741255951356
in-drivable-lane_max3.099999999999994
in-drivable-lane_mean2.7624999999999935
in-drivable-lane_min2.099999999999993
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5053193769560801, "survival_time": 3.949999999999994, "driven_lanedir": 0.18562025052090503, "in-drivable-lane": 2.099999999999993, "deviation-heading": 1.1652621216719916, "distance-from-start": 0.22666576720829795, "deviation-center-line": 0.0751208135344895, "driven_lanedir_consec": 0.18562025052090503}, "udem-000-ego1": {"driven_any": 0.3162054748181015, "survival_time": 3.949999999999994, "driven_lanedir": 0.030569793513038235, "in-drivable-lane": 3.099999999999994, "deviation-heading": 0.6389713030353473, "distance-from-start": 0.15340503275684292, "deviation-center-line": 0.0684315112871312, "driven_lanedir_consec": 0.030569793513038235}, "udem-000-ego2": {"driven_any": 0.27963507256693326, "survival_time": 3.949999999999994, "driven_lanedir": 0.14617556224672468, "in-drivable-lane": 2.749999999999994, "deviation-heading": 0.5510518525670429, "distance-from-start": 0.27196874536549825, "deviation-center-line": 0.062445275598967814, "driven_lanedir_consec": 0.14617556224672468}, "udem-000-ego3": {"driven_any": 0.10277373421770472, "survival_time": 3.949999999999994, "driven_lanedir": 0.02939741255951356, "in-drivable-lane": 3.099999999999994, "deviation-heading": 0.8214740471265167, "distance-from-start": 0.09756938097201394, "deviation-center-line": 0.06745580487980556, "driven_lanedir_consec": 0.02939741255951356}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
6983659Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6979660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-3of4failednogpu-staging-spot-0-020:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6973662Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6970662Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6962663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6920710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:13:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median46.824999999998994
driven_lanedir_consec_median0.19888958841261967
deviation-center-line_median1.2302307544380242


other stats
deviation-center-line_max2.7624626207296523
deviation-center-line_mean1.4614842694980663
deviation-center-line_min0.6230129483865658
deviation-heading_max37.82293240559152
deviation-heading_mean14.895649917871705
deviation-heading_median8.929445635074492
deviation-heading_min3.900775995746316
distance-from-start_max1.4108418329399008
distance-from-start_mean0.7424833694964633
distance-from-start_median0.7795458225229759
distance-from-start_min2.482534153247273e-16
driven_any_max15.326310847370593
driven_any_mean6.8063963066798205
driven_any_median5.949637189674196
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.29723254612384026
driven_lanedir_consec_mean0.17375293073726988
driven_lanedir_consec_min0.0
driven_lanedir_max0.2967938965440506
driven_lanedir_mean0.16460716406936743
driven_lanedir_median0.1808173798667096
driven_lanedir_min0.0
in-drivable-lane_max53.199999999998695
in-drivable-lane_mean36.71249999999917
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.2967938965440506, "in-drivable-lane": 41.699999999999264, "deviation-heading": 13.4239573807347, "distance-from-start": 1.4108418329399008, "deviation-center-line": 1.7741548227320476, "driven_lanedir_consec": 0.29723254612384026}, "loop-000-ego1": {"driven_any": 6.69482709059637, "survival_time": 59.99999999999873, "driven_lanedir": 0.2307195600231423, "in-drivable-lane": 51.94999999999872, "deviation-heading": 4.434933889414283, "distance-from-start": 0.82330328736858, "deviation-center-line": 0.6230129483865658, "driven_lanedir_consec": 0.24485358668177015}, "loop-000-ego2": {"driven_any": 5.204447288752023, "survival_time": 59.99999999999873, "driven_lanedir": 0.13091519971027687, "in-drivable-lane": 53.199999999998695, "deviation-heading": 3.900775995746316, "distance-from-start": 0.7357883576773718, "deviation-center-line": 0.6863066861440009, "driven_lanedir_consec": 0.15292559014346918}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6914671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6898703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:08:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.750000000000316
in-drivable-lane_median25.175000000000296
driven_lanedir_consec_median0.18552469171877983
deviation-center-line_median0.49966350574004126


other stats
deviation-center-line_max0.7555299219673969
deviation-center-line_mean0.5108643440264811
deviation-center-line_min0.2886004426584447
deviation-heading_max5.677922521471409
deviation-heading_mean4.088893264090181
deviation-heading_median4.163773732737991
deviation-heading_min2.3501030694133327
distance-from-start_max0.8824046752191012
distance-from-start_mean0.7245653197432453
distance-from-start_median0.7348495479071131
distance-from-start_min0.5461575079396542
driven_any_max7.70048061152867
driven_any_mean5.0586670251615145
driven_any_median5.018099001021708
driven_any_min2.497989487073972
driven_lanedir_consec_max0.26764923329146384
driven_lanedir_consec_mean0.1856362610589692
driven_lanedir_consec_min0.10384642750685336
driven_lanedir_max0.2496385572544461
driven_lanedir_mean0.17341917865234155
driven_lanedir_median0.17223668708559425
driven_lanedir_min0.09956478318373164
in-drivable-lane_max28.300000000000303
in-drivable-lane_mean25.4625000000003
in-drivable-lane_min23.200000000000298
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.70048061152867, "survival_time": 31.750000000000316, "driven_lanedir": 0.2496385572544461, "in-drivable-lane": 23.200000000000298, "deviation-heading": 5.523299075233993, "distance-from-start": 0.8824046752191012, "deviation-center-line": 0.7555299219673969, "driven_lanedir_consec": 0.26764923329146384}, "autolab-000-ego1": {"driven_any": 6.066664798227061, "survival_time": 31.750000000000316, "driven_lanedir": 0.19493515195653055, "in-drivable-lane": 23.700000000000298, "deviation-heading": 5.677922521471409, "distance-from-start": 0.7960980578537342, "deviation-center-line": 0.5957741014324853, "driven_lanedir_consec": 0.20826345296493876}, "autolab-000-ego2": {"driven_any": 3.969533203816355, "survival_time": 31.750000000000316, "driven_lanedir": 0.14953822221465796, "in-drivable-lane": 26.650000000000297, "deviation-heading": 2.8042483902419892, "distance-from-start": 0.6736010379604919, "deviation-center-line": 0.40355291004759714, "driven_lanedir_consec": 0.1627859304726209}, "autolab-000-ego3": {"driven_any": 2.497989487073972, "survival_time": 31.750000000000316, "driven_lanedir": 0.09956478318373164, "in-drivable-lane": 28.300000000000303, "deviation-heading": 2.3501030694133327, "distance-from-start": 0.5461575079396542, "deviation-center-line": 0.2886004426584447, "driven_lanedir_consec": 0.10384642750685336}}
simulation-passed1
survival_time_max31.750000000000316
survival_time_mean31.750000000000316
survival_time_min31.750000000000316
No reset possible
6890705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-020:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.400000000000126
in-drivable-lane_median9.6500000000001
driven_lanedir_consec_median0.2737818968396458
deviation-center-line_median0.799573856657706


other stats
deviation-center-line_max0.799573856657706
deviation-center-line_mean0.799573856657706
deviation-center-line_min0.799573856657706
deviation-heading_max6.366511388189685
deviation-heading_mean6.366511388189685
deviation-heading_median6.366511388189685
deviation-heading_min6.366511388189685
distance-from-start_max0.6736010379604951
distance-from-start_mean0.6736010379604951
distance-from-start_median0.6736010379604951
distance-from-start_min0.6736010379604951
driven_any_max4.170232497072811
driven_any_mean4.170232497072811
driven_any_median4.170232497072811
driven_any_min4.170232497072811
driven_lanedir_consec_max0.2737818968396458
driven_lanedir_consec_mean0.2737818968396458
driven_lanedir_consec_min0.2737818968396458
driven_lanedir_max0.2565970421753513
driven_lanedir_mean0.2565970421753513
driven_lanedir_median0.2565970421753513
driven_lanedir_min0.2565970421753513
in-drivable-lane_max9.6500000000001
in-drivable-lane_mean9.6500000000001
in-drivable-lane_min9.6500000000001
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.170232497072811, "survival_time": 18.400000000000126, "driven_lanedir": 0.2565970421753513, "in-drivable-lane": 9.6500000000001, "deviation-heading": 6.366511388189685, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.799573856657706, "driven_lanedir_consec": 0.2737818968396458}}
simulation-passed1
survival_time_max18.400000000000126
survival_time_mean18.400000000000126
survival_time_min18.400000000000126
No reset possible
6886705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-020:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.65000000000003
in-drivable-lane_median4.950000000000033
driven_lanedir_consec_median0.26764605432234867
deviation-center-line_median0.6035442792313549


other stats
deviation-center-line_max0.6035442792313549
deviation-center-line_mean0.6035442792313549
deviation-center-line_min0.6035442792313549
deviation-heading_max4.043215735457215
deviation-heading_mean4.043215735457215
deviation-heading_median4.043215735457215
deviation-heading_min4.043215735457215
distance-from-start_max0.5461575079396498
distance-from-start_mean0.5461575079396498
distance-from-start_median0.5461575079396498
distance-from-start_min0.5461575079396498
driven_any_max2.4684338587867174
driven_any_mean2.4684338587867174
driven_any_median2.4684338587867174
driven_any_min2.4684338587867174
driven_lanedir_consec_max0.26764605432234867
driven_lanedir_consec_mean0.26764605432234867
driven_lanedir_consec_min0.26764605432234867
driven_lanedir_max0.262846269745866
driven_lanedir_mean0.262846269745866
driven_lanedir_median0.262846269745866
driven_lanedir_min0.262846269745866
in-drivable-lane_max4.950000000000033
in-drivable-lane_mean4.950000000000033
in-drivable-lane_min4.950000000000033
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.4684338587867174, "survival_time": 11.65000000000003, "driven_lanedir": 0.262846269745866, "in-drivable-lane": 4.950000000000033, "deviation-heading": 4.043215735457215, "distance-from-start": 0.5461575079396498, "deviation-center-line": 0.6035442792313549, "driven_lanedir_consec": 0.26764605432234867}}
simulation-passed1
survival_time_max11.65000000000003
survival_time_mean11.65000000000003
survival_time_min11.65000000000003
No reset possible
6878707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-020:05:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.26764888474322424
deviation-center-line_median0.7555295615924859


other stats
deviation-center-line_max0.7555295615924859
deviation-center-line_mean0.7555295615924859
deviation-center-line_min0.7555295615924859
deviation-heading_max5.523298977694424
deviation-heading_mean5.523298977694424
deviation-heading_median5.523298977694424
deviation-heading_min5.523298977694424
distance-from-start_max1.0442247976692045
distance-from-start_mean1.0442247976692045
distance-from-start_median1.0442247976692045
distance-from-start_min1.0442247976692045
driven_any_max11.376062002465131
driven_any_mean11.376062002465131
driven_any_median11.376062002465131
driven_any_min11.376062002465131
driven_lanedir_consec_max0.26764888474322424
driven_lanedir_consec_mean0.26764888474322424
driven_lanedir_consec_min0.26764888474322424
driven_lanedir_max0.2496386855430165
driven_lanedir_mean0.2496386855430165
driven_lanedir_median0.2496386855430165
driven_lanedir_min0.2496386855430165
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.376062002465131, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496386855430165, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523298977694424, "distance-from-start": 1.0442247976692045, "deviation-center-line": 0.7555295615924859, "driven_lanedir_consec": 0.26764888474322424}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
6860710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-1of4successnogpu-staging-spot-0-020:14:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.799999999999194
in-drivable-lane_median44.52499999999915
driven_lanedir_consec_median0.17645690696034633
deviation-center-line_median0.6288359436091835


other stats
deviation-center-line_max0.6863070684206949
deviation-center-line_mean0.6132347216191781
deviation-center-line_min0.5089599308376506
deviation-heading_max5.904235246936352
deviation-heading_mean4.779753520384025
deviation-heading_median4.657001419426715
deviation-heading_min3.900775995746317
distance-from-start_max1.2120262829129491
distance-from-start_mean1.0474942275906278
distance-from-start_median1.090926284797921
distance-from-start_min0.79609805785372
driven_any_max12.87870380836423
driven_any_mean10.630699349059253
driven_any_median11.702531035811734
driven_any_min6.239031516249309
driven_lanedir_consec_max0.24485749504972
driven_lanedir_consec_mean0.16302815368948875
driven_lanedir_consec_min0.05434130578754237
driven_lanedir_max0.23072215708841037
driven_lanedir_mean0.15210419461121738
driven_lanedir_median0.16000521526986278
driven_lanedir_min0.057684190816733594
in-drivable-lane_max44.99999999999916
in-drivable-lane_mean44.44999999999917
in-drivable-lane_min43.74999999999919
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.87870380836423, "survival_time": 51.799999999999194, "driven_lanedir": 0.057684190816733594, "in-drivable-lane": 44.24999999999912, "deviation-heading": 5.904235246936352, "distance-from-start": 1.2120262829129491, "deviation-center-line": 0.6346589459314982, "driven_lanedir_consec": 0.05434130578754237}, "autolab-000-ego1": {"driven_any": 6.239031516249309, "survival_time": 51.799999999999194, "driven_lanedir": 0.23072215708841037, "in-drivable-lane": 43.74999999999919, "deviation-heading": 4.4349341204672275, "distance-from-start": 0.79609805785372, "deviation-center-line": 0.6230129412868688, "driven_lanedir_consec": 0.24485749504972}, "autolab-000-ego2": {"driven_any": 11.02110496898548, "survival_time": 51.799999999999194, "driven_lanedir": 0.13091436524500333, "in-drivable-lane": 44.99999999999916, "deviation-heading": 3.900775995746317, "distance-from-start": 1.044224797669194, "deviation-center-line": 0.6863070684206949, "driven_lanedir_consec": 0.15293166981715745}, "autolab-000-ego3": {"driven_any": 12.383957102637988, "survival_time": 51.799999999999194, "driven_lanedir": 0.18909606529472223, "in-drivable-lane": 44.79999999999918, "deviation-heading": 4.879068718386203, "distance-from-start": 1.137627771926648, "deviation-center-line": 0.5089599308376506, "driven_lanedir_consec": 0.1999821441035352}}
simulation-passed1
survival_time_max51.799999999999194
survival_time_mean51.799999999999194
survival_time_min51.799999999999194
No reset possible
6856711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-020:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.022350044024311844
deviation-center-line_median0.02664350798512652


other stats
deviation-center-line_max0.02664350798512652
deviation-center-line_mean0.02664350798512652
deviation-center-line_min0.02664350798512652
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.4028556303039825
distance-from-start_mean0.4028556303039825
distance-from-start_median0.4028556303039825
distance-from-start_min0.4028556303039825
driven_any_max0.4240764502839735
driven_any_mean0.4240764502839735
driven_any_median0.4240764502839735
driven_any_min0.4240764502839735
driven_lanedir_consec_max0.022350044024311844
driven_lanedir_consec_mean0.022350044024311844
driven_lanedir_consec_min0.022350044024311844
driven_lanedir_max0.022350044024311844
driven_lanedir_mean0.022350044024311844
driven_lanedir_median0.022350044024311844
driven_lanedir_min0.022350044024311844
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4240764502839735, "survival_time": 3.7499999999999942, "driven_lanedir": 0.022350044024311844, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 1.126574172093021, "distance-from-start": 0.4028556303039825, "deviation-center-line": 0.02664350798512652, "driven_lanedir_consec": 0.022350044024311844}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
6852713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6847714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6829732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:10:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5116951606795332


other stats
deviation-center-line_max2.946768139128097
deviation-center-line_mean1.576975791536685
deviation-center-line_min0.3377447056595774
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.59726568012299
deviation-heading_min13.914341154718024
distance-from-start_max3.1401849173675503e-16
distance-from-start_mean1.3401577416544655e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min0.0
driven_any_max3.7682219008410875e-13
driven_any_mean1.608189289985366e-13
driven_any_median1.3322676295501878e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.894912424505976, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.12847789685309, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946768139128097, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6816734Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-020:08:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949084199908675


other stats
deviation-center-line_max0.8949084199908675
deviation-center-line_mean0.8949084199908675
deviation-center-line_min0.8949084199908675
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6812735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-2of4host-errornogpu-staging-spot-0-020:01:17
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/14676f222054c74e2df2a3a86b90de1d22e91800e83767ad9286b56d029aed91/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/14676f222054c74e2df2a3a86b90de1d22e91800e83767ad9286b56d029aed91/json: Not Found ("No such container: 14676f222054c74e2df2a3a86b90de1d22e91800e83767ad9286b56d029aed91")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6811735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6790769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:15:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.54999999999903
driven_lanedir_consec_median2.2592496148013375
deviation-center-line_median2.358243311523334


other stats
deviation-center-line_max4.275604723746355
deviation-center-line_mean2.5026088766325647
deviation-center-line_min1.0183441597372351
deviation-heading_max19.65641232871804
deviation-heading_mean13.804985795266523
deviation-heading_median13.799126661580267
deviation-heading_min7.9652775291875155
distance-from-start_max2.936263400894436
distance-from-start_mean1.4840019409480705
distance-from-start_median1.177032059449863
distance-from-start_min0.6456802439981182
driven_any_max7.906643040323935
driven_any_mean6.183812129683934
driven_any_median6.220297470806086
driven_any_min4.388010536799632
driven_lanedir_consec_max3.408303568008701
driven_lanedir_consec_mean2.3094651102492607
driven_lanedir_consec_min1.3110576433856662
driven_lanedir_max4.796409806534173
driven_lanedir_mean3.127351967388951
driven_lanedir_median3.028504998656299
driven_lanedir_min1.6559880657090351
in-drivable-lane_max43.94999999999862
in-drivable-lane_mean30.874999999999055
in-drivable-lane_min16.449999999999548
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.906643040323935, "survival_time": 59.99999999999873, "driven_lanedir": 4.796409806534173, "in-drivable-lane": 16.449999999999548, "deviation-heading": 19.65641232871804, "distance-from-start": 1.3525911261568275, "deviation-center-line": 4.275604723746355, "driven_lanedir_consec": 3.408303568008701}, "autolab-000-ego1": {"driven_any": 7.906322411310005, "survival_time": 59.99999999999873, "driven_lanedir": 4.215603950479394, "in-drivable-lane": 21.8499999999995, "deviation-heading": 16.456292653296718, "distance-from-start": 2.936263400894436, "deviation-center-line": 2.9652607871554664, "driven_lanedir_consec": 3.040375020312119}, "autolab-000-ego2": {"driven_any": 4.534272530302166, "survival_time": 59.99999999999873, "driven_lanedir": 1.841406046833204, "in-drivable-lane": 41.249999999998565, "deviation-heading": 11.14196066986382, "distance-from-start": 0.6456802439981182, "deviation-center-line": 1.7512258358912014, "driven_lanedir_consec": 1.3110576433856662}, "autolab-000-ego3": {"driven_any": 4.388010536799632, "survival_time": 59.99999999999873, "driven_lanedir": 1.6559880657090351, "in-drivable-lane": 43.94999999999862, "deviation-heading": 7.9652775291875155, "distance-from-start": 1.001472992742899, "deviation-center-line": 1.0183441597372351, "driven_lanedir_consec": 1.4781242092905555}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6774636Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4successnogpu-staging-spot-0-020:13:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.8249999999998965
driven_lanedir_consec_median2.089362646121113
deviation-center-line_median5.1606969042445545


other stats
deviation-center-line_max5.884537088976699
deviation-center-line_mean4.608902728622449
deviation-center-line_min2.229680017023988
deviation-heading_max33.00132974561592
deviation-heading_mean11.086939889451044
deviation-heading_median5.3156324990396016
deviation-heading_min0.7151648141090522
distance-from-start_max2.400773804592291
distance-from-start_mean1.855033439894366
distance-from-start_median1.8031549983915716
distance-from-start_min1.4130499582020293
driven_any_max3.5300951074200313
driven_any_mean2.5187726211552675
driven_any_median2.5310927358554984
driven_any_min1.4828099054900417
driven_lanedir_consec_max3.4375556548524067
driven_lanedir_consec_mean2.243867367124486
driven_lanedir_consec_min1.359188521403314
driven_lanedir_max3.4375556548524067
driven_lanedir_mean2.430771337654275
driven_lanedir_median2.4562457120319685
driven_lanedir_min1.373038271700757
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4124999999999552
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5425992768883967, "survival_time": 59.99999999999873, "driven_lanedir": 1.537863345389593, "in-drivable-lane": 0.0, "deviation-heading": 0.7151648141090522, "distance-from-start": 1.538166429460106, "deviation-center-line": 2.229680017023988, "driven_lanedir_consec": 1.537863345389593}, "loop-000-ego1": {"driven_any": 3.5195861948226006, "survival_time": 59.99999999999873, "driven_lanedir": 3.3746280786743443, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.2883954590350015, "distance-from-start": 2.068143567323037, "deviation-center-line": 5.233752335699729, "driven_lanedir_consec": 2.640861946852633}, "loop-000-ego2": {"driven_any": 3.5300951074200313, "survival_time": 59.99999999999873, "driven_lanedir": 3.4375556548524067, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342869539044202, "distance-from-start": 2.400773804592291, "deviation-center-line": 5.884537088976699, "driven_lanedir_consec": 3.4375556548524067}, "loop-000-ego3": {"driven_any": 1.4828099054900417, "survival_time": 59.99999999999873, "driven_lanedir": 1.373038271700757, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 33.00132974561592, "distance-from-start": 1.4130499582020293, "deviation-center-line": 5.08764147278938, "driven_lanedir_consec": 1.359188521403314}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6767772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6758774Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-020:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5150352351631085
survival_time_median48.29999999999939
deviation-center-line_median1.8218201375909215
in-drivable-lane_median25.449999999999292


other stats
deviation-center-line_max1.8218201375909215
deviation-center-line_mean1.8218201375909215
deviation-center-line_min1.8218201375909215
deviation-heading_max7.952135679948819
deviation-heading_mean7.952135679948819
deviation-heading_median7.952135679948819
deviation-heading_min7.952135679948819
distance-from-start_max1.1201986740984338
distance-from-start_mean1.1201986740984338
distance-from-start_median1.1201986740984338
distance-from-start_min1.1201986740984338
driven_any_max6.254638051150181
driven_any_mean6.254638051150181
driven_any_median6.254638051150181
driven_any_min6.254638051150181
driven_lanedir_consec_max1.5150352351631085
driven_lanedir_consec_mean1.5150352351631085
driven_lanedir_consec_min1.5150352351631085
driven_lanedir_max2.63041176048391
driven_lanedir_mean2.63041176048391
driven_lanedir_median2.63041176048391
driven_lanedir_min2.63041176048391
in-drivable-lane_max25.449999999999292
in-drivable-lane_mean25.449999999999292
in-drivable-lane_min25.449999999999292
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.254638051150181, "survival_time": 48.29999999999939, "driven_lanedir": 2.63041176048391, "in-drivable-lane": 25.449999999999292, "deviation-heading": 7.952135679948819, "distance-from-start": 1.1201986740984338, "deviation-center-line": 1.8218201375909215, "driven_lanedir_consec": 1.5150352351631085}}
simulation-passed1
survival_time_max48.29999999999939
survival_time_mean48.29999999999939
survival_time_min48.29999999999939
No reset possible
6753774Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-020:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.823357216009359
survival_time_median59.99999999999873
deviation-center-line_median4.281945399170489
in-drivable-lane_median12.349999999999602


other stats
deviation-center-line_max4.281945399170489
deviation-center-line_mean4.281945399170489
deviation-center-line_min4.281945399170489
deviation-heading_max12.930773105747294
deviation-heading_mean12.930773105747294
deviation-heading_median12.930773105747294
deviation-heading_min12.930773105747294
distance-from-start_max4.318077023216782
distance-from-start_mean4.318077023216782
distance-from-start_median4.318077023216782
distance-from-start_min4.318077023216782
driven_any_max7.901091734536729
driven_any_mean7.901091734536729
driven_any_median7.901091734536729
driven_any_min7.901091734536729
driven_lanedir_consec_max5.823357216009359
driven_lanedir_consec_mean5.823357216009359
driven_lanedir_consec_min5.823357216009359
driven_lanedir_max5.823357216009359
driven_lanedir_mean5.823357216009359
driven_lanedir_median5.823357216009359
driven_lanedir_min5.823357216009359
in-drivable-lane_max12.349999999999602
in-drivable-lane_mean12.349999999999602
in-drivable-lane_min12.349999999999602
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.901091734536729, "survival_time": 59.99999999999873, "driven_lanedir": 5.823357216009359, "in-drivable-lane": 12.349999999999602, "deviation-heading": 12.930773105747294, "distance-from-start": 4.318077023216782, "deviation-center-line": 4.281945399170489, "driven_lanedir_consec": 5.823357216009359}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6738776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:14:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.20000000000000284
driven_lanedir_consec_median4.747766277375855
deviation-center-line_median3.1989133930850864


other stats
deviation-center-line_max3.71637556904856
deviation-center-line_mean2.8231652707006636
deviation-center-line_min1.1784587275839218
deviation-heading_max37.82293240559152
deviation-heading_mean13.836387249457838
deviation-heading_median7.23869289283896
deviation-heading_min3.045230806561908
distance-from-start_max2.6884795637798513
distance-from-start_mean1.66281397338498
distance-from-start_median1.9813881648800344
distance-from-start_min2.482534153247273e-16
driven_any_max7.914583881341192
driven_any_mean4.423988832973163
driven_any_median4.890685725275581
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max7.759438795744844
driven_lanedir_consec_mean4.3137428376241385
driven_lanedir_consec_min0.0
driven_lanedir_max7.759438795744844
driven_lanedir_mean4.3137428376241385
driven_lanedir_median4.747766277375855
driven_lanedir_min0.0
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean0.3750000000000054
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 7.914583047741832, "survival_time": 59.99999999999873, "driven_lanedir": 7.636875080605553, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.458730919054324, "distance-from-start": 2.6884795637798513, "deviation-center-line": 3.71637556904856, "driven_lanedir_consec": 7.636875080605553}, "loop-000-ego1": {"driven_any": 7.914583881341192, "survival_time": 59.99999999999873, "driven_lanedir": 7.759438795744844, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 7.0186548666235975, "distance-from-start": 2.5375480406197797, "deviation-center-line": 3.635364165440521, "driven_lanedir_consec": 7.759438795744844}, "loop-000-ego2": {"driven_any": 1.8667884028093311, "survival_time": 59.99999999999873, "driven_lanedir": 1.8586574741461577, "in-drivable-lane": 0.0, "deviation-heading": 3.045230806561908, "distance-from-start": 1.4252282891402894, "deviation-center-line": 1.1784587275839218, "driven_lanedir_consec": 1.8586574741461577}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6679776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-1of4timeoutnogpu-staging-spot-0-02----No reset possible
6670777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-020:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.84999999999999
in-drivable-lane_median7.349999999999971
driven_lanedir_consec_median3.765235058680783
deviation-center-line_median2.7355013308720353


other stats
deviation-center-line_max2.7355013308720353
deviation-center-line_mean2.7355013308720353
deviation-center-line_min2.7355013308720353
deviation-heading_max5.602037776623628
deviation-heading_mean5.602037776623628
deviation-heading_median5.602037776623628
deviation-heading_min5.602037776623628
distance-from-start_max2.1296931520473685
distance-from-start_mean2.1296931520473685
distance-from-start_median2.1296931520473685
distance-from-start_min2.1296931520473685
driven_any_max4.867399190026676
driven_any_mean4.867399190026676
driven_any_median4.867399190026676
driven_any_min4.867399190026676
driven_lanedir_consec_max3.765235058680783
driven_lanedir_consec_mean3.765235058680783
driven_lanedir_consec_min3.765235058680783
driven_lanedir_max3.765235058680783
driven_lanedir_mean3.765235058680783
driven_lanedir_median3.765235058680783
driven_lanedir_min3.765235058680783
in-drivable-lane_max7.349999999999971
in-drivable-lane_mean7.349999999999971
in-drivable-lane_min7.349999999999971
per-episodes
details{"loop-000-ego0": {"driven_any": 4.867399190026676, "survival_time": 37.84999999999999, "driven_lanedir": 3.765235058680783, "in-drivable-lane": 7.349999999999971, "deviation-heading": 5.602037776623628, "distance-from-start": 2.1296931520473685, "deviation-center-line": 2.7355013308720353, "driven_lanedir_consec": 3.765235058680783}}
simulation-passed1
survival_time_max37.84999999999999
survival_time_mean37.84999999999999
survival_time_min37.84999999999999
No reset possible
6666777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-020:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.650000000000144
in-drivable-lane_median2.150000000000003
driven_lanedir_consec_median1.6267327343259668
deviation-center-line_median1.5649891464311698


other stats
deviation-center-line_max1.5649891464311698
deviation-center-line_mean1.5649891464311698
deviation-center-line_min1.5649891464311698
deviation-heading_max7.731952952700462
deviation-heading_mean7.731952952700462
deviation-heading_median7.731952952700462
deviation-heading_min7.731952952700462
distance-from-start_max1.7724485697553385
distance-from-start_mean1.7724485697553385
distance-from-start_median1.7724485697553385
distance-from-start_min1.7724485697553385
driven_any_max2.4508765476559105
driven_any_mean2.4508765476559105
driven_any_median2.4508765476559105
driven_any_min2.4508765476559105
driven_lanedir_consec_max1.6267327343259668
driven_lanedir_consec_mean1.6267327343259668
driven_lanedir_consec_min1.6267327343259668
driven_lanedir_max1.8449065387607049
driven_lanedir_mean1.8449065387607049
driven_lanedir_median1.8449065387607049
driven_lanedir_min1.8449065387607049
in-drivable-lane_max2.150000000000003
in-drivable-lane_mean2.150000000000003
in-drivable-lane_min2.150000000000003
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.4508765476559105, "survival_time": 19.650000000000144, "driven_lanedir": 1.8449065387607049, "in-drivable-lane": 2.150000000000003, "deviation-heading": 7.731952952700462, "distance-from-start": 1.7724485697553385, "deviation-center-line": 1.5649891464311698, "driven_lanedir_consec": 1.6267327343259668}}
simulation-passed1
survival_time_max19.650000000000144
survival_time_mean19.650000000000144
survival_time_min19.650000000000144
No reset possible
6660779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-020:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.40000000000007
in-drivable-lane_median2.100000000000019
driven_lanedir_consec_median0.8371709023066698
deviation-center-line_median0.893302000871411


other stats
deviation-center-line_max0.893302000871411
deviation-center-line_mean0.893302000871411
deviation-center-line_min0.893302000871411
deviation-heading_max3.775323225827779
deviation-heading_mean3.775323225827779
deviation-heading_median3.775323225827779
deviation-heading_min3.775323225827779
distance-from-start_max0.7592051921531449
distance-from-start_mean0.7592051921531449
distance-from-start_median0.7592051921531449
distance-from-start_min0.7592051921531449
driven_any_max1.767143286726505
driven_any_mean1.767143286726505
driven_any_median1.767143286726505
driven_any_min1.767143286726505
driven_lanedir_consec_max0.8371709023066698
driven_lanedir_consec_mean0.8371709023066698
driven_lanedir_consec_min0.8371709023066698
driven_lanedir_max1.3201708692669705
driven_lanedir_mean1.3201708692669705
driven_lanedir_median1.3201708692669705
driven_lanedir_min1.3201708692669705
in-drivable-lane_max2.100000000000019
in-drivable-lane_mean2.100000000000019
in-drivable-lane_min2.100000000000019
per-episodes
details{"udem-000-ego0": {"driven_any": 1.767143286726505, "survival_time": 14.40000000000007, "driven_lanedir": 1.3201708692669705, "in-drivable-lane": 2.100000000000019, "deviation-heading": 3.775323225827779, "distance-from-start": 0.7592051921531449, "deviation-center-line": 0.893302000871411, "driven_lanedir_consec": 0.8371709023066698}}
simulation-passed1
survival_time_max14.40000000000007
survival_time_mean14.40000000000007
survival_time_min14.40000000000007
No reset possible
6655779Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6649781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-020:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5633258408032447
survival_time_median59.99999999999873
deviation-center-line_median2.5331164133448807
in-drivable-lane_median28.949999999999047


other stats
deviation-center-line_max2.5331164133448807
deviation-center-line_mean2.5331164133448807
deviation-center-line_min2.5331164133448807
deviation-heading_max7.158073977823114
deviation-heading_mean7.158073977823114
deviation-heading_median7.158073977823114
deviation-heading_min7.158073977823114
distance-from-start_max3.797283949431529
distance-from-start_mean3.797283949431529
distance-from-start_median3.797283949431529
distance-from-start_min3.797283949431529
driven_any_max7.907668273598113
driven_any_mean7.907668273598113
driven_any_median7.907668273598113
driven_any_min7.907668273598113
driven_lanedir_consec_max3.5633258408032447
driven_lanedir_consec_mean3.5633258408032447
driven_lanedir_consec_min3.5633258408032447
driven_lanedir_max3.837649754231368
driven_lanedir_mean3.837649754231368
driven_lanedir_median3.837649754231368
driven_lanedir_min3.837649754231368
in-drivable-lane_max28.949999999999047
in-drivable-lane_mean28.949999999999047
in-drivable-lane_min28.949999999999047
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.907668273598113, "survival_time": 59.99999999999873, "driven_lanedir": 3.837649754231368, "in-drivable-lane": 28.949999999999047, "deviation-heading": 7.158073977823114, "distance-from-start": 3.797283949431529, "deviation-center-line": 2.5331164133448807, "driven_lanedir_consec": 3.5633258408032447}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6644781Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-020:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5503725488804361
survival_time_median32.4000000000003
deviation-center-line_median0.9488201861047248
in-drivable-lane_median23.85000000000029


other stats
deviation-center-line_max0.9488201861047248
deviation-center-line_mean0.9488201861047248
deviation-center-line_min0.9488201861047248
deviation-heading_max3.130305736920544
deviation-heading_mean3.130305736920544
deviation-heading_median3.130305736920544
deviation-heading_min3.130305736920544
distance-from-start_max0.9594302156210334
distance-from-start_mean0.9594302156210334
distance-from-start_median0.9594302156210334
distance-from-start_min0.9594302156210334
driven_any_max4.143356351803561
driven_any_mean4.143356351803561
driven_any_median4.143356351803561
driven_any_min4.143356351803561
driven_lanedir_consec_max0.5503725488804361
driven_lanedir_consec_mean0.5503725488804361
driven_lanedir_consec_min0.5503725488804361
driven_lanedir_max0.9713449833929186
driven_lanedir_mean0.9713449833929186
driven_lanedir_median0.9713449833929186
driven_lanedir_min0.9713449833929186
in-drivable-lane_max23.85000000000029
in-drivable-lane_mean23.85000000000029
in-drivable-lane_min23.85000000000029
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.143356351803561, "survival_time": 32.4000000000003, "driven_lanedir": 0.9713449833929186, "in-drivable-lane": 23.85000000000029, "deviation-heading": 3.130305736920544, "distance-from-start": 0.9594302156210334, "deviation-center-line": 0.9488201861047248, "driven_lanedir_consec": 0.5503725488804361}}
simulation-passed1
survival_time_max32.4000000000003
survival_time_mean32.4000000000003
survival_time_min32.4000000000003
No reset possible
6638782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6632792Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-020:05:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6567634Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-validationsim-1of4timeoutnogpu-staging-spot-0-02----No reset possible
6550640Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-1of4successnogpu-staging-spot-0-020:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median3.485872931964064
deviation-center-line_median4.220405873962668


other stats
deviation-center-line_max4.220405873962668
deviation-center-line_mean4.220405873962668
deviation-center-line_min4.220405873962668
deviation-heading_max2.9174896774298857
deviation-heading_mean2.9174896774298857
deviation-heading_median2.9174896774298857
deviation-heading_min2.9174896774298857
distance-from-start_max2.8928218615311083
distance-from-start_mean2.8928218615311083
distance-from-start_median2.8928218615311083
distance-from-start_min2.8928218615311083
driven_any_max3.5465963319759144
driven_any_mean3.5465963319759144
driven_any_median3.5465963319759144
driven_any_min3.5465963319759144
driven_lanedir_consec_max3.485872931964064
driven_lanedir_consec_mean3.485872931964064
driven_lanedir_consec_min3.485872931964064
driven_lanedir_max3.485872931964064
driven_lanedir_mean3.485872931964064
driven_lanedir_median3.485872931964064
driven_lanedir_min3.485872931964064
in-drivable-lane_max1.0999999999999377
in-drivable-lane_mean1.0999999999999377
in-drivable-lane_min1.0999999999999377
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963319759144, "survival_time": 59.99999999999873, "driven_lanedir": 3.485872931964064, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.9174896774298857, "distance-from-start": 2.8928218615311083, "deviation-center-line": 4.220405873962668, "driven_lanedir_consec": 3.485872931964064}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6532643Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4successnogpu-staging-spot-0-020:07:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.7249999999999304
driven_lanedir_consec_median1.782451327913266
deviation-center-line_median5.7520060807300135


other stats
deviation-center-line_max5.91724099846388
deviation-center-line_mean5.7520060807300135
deviation-center-line_min5.586771162996147
deviation-heading_max8.389432963329451
deviation-heading_mean8.327307052651967
deviation-heading_median8.327307052651967
deviation-heading_min8.265181141974484
distance-from-start_max1.2351380366112437
distance-from-start_mean1.1329605710789614
distance-from-start_median1.1329605710789614
distance-from-start_min1.0307831055466792
driven_any_max3.4865836159248382
driven_any_mean3.467832799824648
driven_any_median3.467832799824648
driven_any_min3.449081983724458
driven_lanedir_consec_max2.091635105125694
driven_lanedir_consec_mean1.782451327913266
driven_lanedir_consec_min1.473267550700838
driven_lanedir_max3.2880107027760648
driven_lanedir_mean3.2460173239276555
driven_lanedir_median3.2460173239276555
driven_lanedir_min3.2040239450792463
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean3.7249999999999304
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.449081983724458, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040239450792463, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432963329451, "distance-from-start": 1.0307831055466792, "deviation-center-line": 5.91724099846388, "driven_lanedir_consec": 2.091635105125694}, "loop2-000-ego1": {"driven_any": 3.4865836159248382, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880107027760648, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181141974484, "distance-from-start": 1.2351380366112437, "deviation-center-line": 5.586771162996147, "driven_lanedir_consec": 1.473267550700838}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6514789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-020:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0412902884755304
survival_time_median59.99999999999873
deviation-center-line_median1.7778417727931046
in-drivable-lane_median44.79999999999925


other stats
deviation-center-line_max1.7778417727931046
deviation-center-line_mean1.7778417727931046
deviation-center-line_min1.7778417727931046
deviation-heading_max13.562405356268636
deviation-heading_mean13.562405356268636
deviation-heading_median13.562405356268636
deviation-heading_min13.562405356268636
distance-from-start_max0.790952772060576
distance-from-start_mean0.790952772060576
distance-from-start_median0.790952772060576
distance-from-start_min0.790952772060576
driven_any_max7.3149008727526175
driven_any_mean7.3149008727526175
driven_any_median7.3149008727526175
driven_any_min7.3149008727526175
driven_lanedir_consec_max1.0412902884755304
driven_lanedir_consec_mean1.0412902884755304
driven_lanedir_consec_min1.0412902884755304
driven_lanedir_max1.0709319890589997
driven_lanedir_mean1.0709319890589997
driven_lanedir_median1.0709319890589997
driven_lanedir_min1.0709319890589997
in-drivable-lane_max44.79999999999925
in-drivable-lane_mean44.79999999999925
in-drivable-lane_min44.79999999999925
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.3149008727526175, "survival_time": 59.99999999999873, "driven_lanedir": 1.0709319890589997, "in-drivable-lane": 44.79999999999925, "deviation-heading": 13.562405356268636, "distance-from-start": 0.790952772060576, "deviation-center-line": 1.7778417727931046, "driven_lanedir_consec": 1.0412902884755304}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6510640Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.200000000000053
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7222898911877377
deviation-center-line_median0.6263425139703784


other stats
deviation-center-line_max0.6263425139703784
deviation-center-line_mean0.6263425139703784
deviation-center-line_min0.6263425139703784
deviation-heading_max1.417085318647224
deviation-heading_mean1.417085318647224
deviation-heading_median1.417085318647224
deviation-heading_min1.417085318647224
distance-from-start_max0.7201981002422111
distance-from-start_mean0.7201981002422111
distance-from-start_median0.7201981002422111
distance-from-start_min0.7201981002422111
driven_any_max0.7295990048299438
driven_any_mean0.7295990048299438
driven_any_median0.7295990048299438
driven_any_min0.7295990048299438
driven_lanedir_consec_max0.7222898911877377
driven_lanedir_consec_mean0.7222898911877377
driven_lanedir_consec_min0.7222898911877377
driven_lanedir_max0.7222898911877377
driven_lanedir_mean0.7222898911877377
driven_lanedir_median0.7222898911877377
driven_lanedir_min0.7222898911877377
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.7295990048299438, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877377, "in-drivable-lane": 0.0, "deviation-heading": 1.417085318647224, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703784, "driven_lanedir_consec": 0.7222898911877377}}
simulation-passed1
survival_time_max13.200000000000053
survival_time_mean13.200000000000053
survival_time_min13.200000000000053
No reset possible
6492643Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-3of4successnogpu-staging-spot-0-020:14:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.92499999999992
driven_lanedir_consec_median1.6962974393876302
deviation-center-line_median5.6660077048179875


other stats
deviation-center-line_max9.920539816203728
deviation-center-line_mean6.424810657621769
deviation-center-line_min4.446687404647375
deviation-heading_max10.760072335048156
deviation-heading_mean7.75849277281716
deviation-heading_median9.162709521693651
deviation-heading_min1.9484797128331772
distance-from-start_max2.9523651631034435
distance-from-start_mean1.7043556043896877
distance-from-start_median1.5711589276694409
distance-from-start_min0.7227393991164262
driven_any_max3.524085546529847
driven_any_mean2.8239999291942457
driven_any_median3.4851575826810635
driven_any_min0.8015990048850082
driven_lanedir_consec_max3.348811260212561
driven_lanedir_consec_mean1.8837014899010265
driven_lanedir_consec_min0.7933998206162842
driven_lanedir_max3.351348627110138
driven_lanedir_mean2.6742463059555184
driven_lanedir_median3.276118388047826
driven_lanedir_min0.7933998206162842
in-drivable-lane_max4.299999999999898
in-drivable-lane_mean2.0374999999999344
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.5197332868688487, "survival_time": 59.99999999999873, "driven_lanedir": 3.351348627110138, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 9.476018293244575, "distance-from-start": 2.0738235372013047, "deviation-center-line": 4.446687404647375, "driven_lanedir_consec": 2.179559038524113}, "zigzag-000-ego1": {"driven_any": 3.4505818784932787, "survival_time": 59.99999999999873, "driven_lanedir": 3.203425515883091, "in-drivable-lane": 4.299999999999898, "deviation-heading": 8.84940075014273, "distance-from-start": 1.068494318137577, "deviation-center-line": 5.899268750309402, "driven_lanedir_consec": 1.2130358402511474}, "zigzag-000-ego2": {"driven_any": 0.8015990048850082, "survival_time": 59.99999999999873, "driven_lanedir": 0.7933998206162842, "in-drivable-lane": 0.0, "deviation-heading": 1.9484797128331772, "distance-from-start": 0.7227393991164262, "deviation-center-line": 9.920539816203728, "driven_lanedir_consec": 0.7933998206162842}, "zigzag-000-ego3": {"driven_any": 3.524085546529847, "survival_time": 59.99999999999873, "driven_lanedir": 3.348811260212561, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 10.760072335048156, "distance-from-start": 2.9523651631034435, "deviation-center-line": 5.432746659326572, "driven_lanedir_consec": 3.348811260212561}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6479645Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-0of4successnogpu-staging-spot-0-020:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091635105125694
deviation-center-line_median5.91724099846388


other stats
deviation-center-line_max5.91724099846388
deviation-center-line_mean5.91724099846388
deviation-center-line_min5.91724099846388
deviation-heading_max8.389432963329451
deviation-heading_mean8.389432963329451
deviation-heading_median8.389432963329451
deviation-heading_min8.389432963329451
distance-from-start_max1.0307831055466792
distance-from-start_mean1.0307831055466792
distance-from-start_median1.0307831055466792
distance-from-start_min1.0307831055466792
driven_any_max3.449081983724458
driven_any_mean3.449081983724458
driven_any_median3.449081983724458
driven_any_min3.449081983724458
driven_lanedir_consec_max2.091635105125694
driven_lanedir_consec_mean2.091635105125694
driven_lanedir_consec_min2.091635105125694
driven_lanedir_max3.2040239450792463
driven_lanedir_mean3.2040239450792463
driven_lanedir_median3.2040239450792463
driven_lanedir_min3.2040239450792463
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.449081983724458, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040239450792463, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432963329451, "distance-from-start": 1.0307831055466792, "deviation-center-line": 5.91724099846388, "driven_lanedir_consec": 2.091635105125694}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6467676Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-3of4successnogpu-staging-spot-0-020:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.02620788009815445
deviation-center-line_median0.5078452545325405


other stats
deviation-center-line_max0.927053231877248
deviation-center-line_mean0.5493180342782131
deviation-center-line_min0.2545283961705238
deviation-heading_max24.927759797558803
deviation-heading_mean12.75886411102093
deviation-heading_median12.083790865588464
deviation-heading_min1.940114915347987
distance-from-start_max2.463697137894826
distance-from-start_mean0.6299095496275323
distance-from-start_median0.0279705303076513
distance-from-start_min4.440892098500626e-16
driven_any_max5.995138898638472
driven_any_mean1.5127928534510304
driven_any_median0.028016257582558556
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.580966757799386
driven_lanedir_consec_mean1.4083456294989238
driven_lanedir_consec_min0.0
driven_lanedir_max5.983208605322819
driven_lanedir_mean1.508906091379782
driven_lanedir_median0.02620788009815445
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 9.946396239005722, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.3027462438305415, "driven_lanedir_consec": 0.0}, "4way-001-ego1": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 0.927053231877248, "driven_lanedir_consec": 0.0}, "4way-001-ego2": {"driven_any": 0.056032515164580056, "survival_time": 59.99999999999873, "driven_lanedir": 0.05241576019630889, "in-drivable-lane": 0.0, "deviation-heading": 14.22118549217121, "distance-from-start": 0.05594106061530216, "deviation-center-line": 0.7129442652345395, "driven_lanedir_consec": 0.05241576019630889}, "4way-001-ego3": {"driven_any": 5.995138898638472, "survival_time": 59.99999999999873, "driven_lanedir": 5.983208605322819, "in-drivable-lane": 0.0, "deviation-heading": 1.940114915347987, "distance-from-start": 2.463697137894826, "deviation-center-line": 0.2545283961705238, "driven_lanedir_consec": 5.580966757799386}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6455677Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-1of4successnogpu-staging-spot-0-020:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3684768253684605
deviation-center-line_median0.26341057846251453


other stats
deviation-center-line_max0.26341057846251453
deviation-center-line_mean0.26341057846251453
deviation-center-line_min0.26341057846251453
deviation-heading_max2.2732184433064777
deviation-heading_mean2.2732184433064777
deviation-heading_median2.2732184433064777
deviation-heading_min2.2732184433064777
distance-from-start_max0.3686479402497791
distance-from-start_mean0.3686479402497791
distance-from-start_median0.3686479402497791
distance-from-start_min0.3686479402497791
driven_any_max0.3741734844735202
driven_any_mean0.3741734844735202
driven_any_median0.3741734844735202
driven_any_min0.3741734844735202
driven_lanedir_consec_max0.3684768253684605
driven_lanedir_consec_mean0.3684768253684605
driven_lanedir_consec_min0.3684768253684605
driven_lanedir_max0.3684768253684605
driven_lanedir_mean0.3684768253684605
driven_lanedir_median0.3684768253684605
driven_lanedir_min0.3684768253684605
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3741734844735202, "survival_time": 59.99999999999873, "driven_lanedir": 0.3684768253684605, "in-drivable-lane": 0.0, "deviation-heading": 2.2732184433064777, "distance-from-start": 0.3686479402497791, "deviation-center-line": 0.26341057846251453, "driven_lanedir_consec": 0.3684768253684605}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6448680Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-0of4successnogpu-staging-spot-0-020:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065102356188296


other stats
deviation-center-line_max0.4065102356188296
deviation-center-line_mean0.4065102356188296
deviation-center-line_min0.4065102356188296
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max7.63278329429795e-17
distance-from-start_mean7.63278329429795e-17
distance-from-start_median7.63278329429795e-17
distance-from-start_min7.63278329429795e-17
driven_any_max9.15933995315754e-14
driven_any_mean9.15933995315754e-14
driven_any_median9.15933995315754e-14
driven_any_min9.15933995315754e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6440679Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.793469797561154
deviation-center-line_median0.08003747569423085


other stats
deviation-center-line_max0.08003747569423085
deviation-center-line_mean0.08003747569423085
deviation-center-line_min0.08003747569423085
deviation-heading_max0.913163834671925
deviation-heading_mean0.913163834671925
deviation-heading_median0.913163834671925
deviation-heading_min0.913163834671925
distance-from-start_max0.6744700135939992
distance-from-start_mean0.6744700135939992
distance-from-start_median0.6744700135939992
distance-from-start_min0.6744700135939992
driven_any_max0.8000331626182206
driven_any_mean0.8000331626182206
driven_any_median0.8000331626182206
driven_any_min0.8000331626182206
driven_lanedir_consec_max0.793469797561154
driven_lanedir_consec_mean0.793469797561154
driven_lanedir_consec_min0.793469797561154
driven_lanedir_max0.793469797561154
driven_lanedir_mean0.793469797561154
driven_lanedir_median0.793469797561154
driven_lanedir_min0.793469797561154
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8000331626182206, "survival_time": 8.999999999999993, "driven_lanedir": 0.793469797561154, "in-drivable-lane": 0.0, "deviation-heading": 0.913163834671925, "distance-from-start": 0.6744700135939992, "deviation-center-line": 0.08003747569423085, "driven_lanedir_consec": 0.793469797561154}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
6427682Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successnogpu-staging-spot-0-020:13:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.718735763136104
deviation-center-line_median0.3055318569062805


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.056094724894972
deviation-center-line_min0.14491946458638674
deviation-heading_max18.309428016005143
deviation-heading_mean5.962038133066249
deviation-heading_median2.1016846099383484
deviation-heading_min1.3353552963831563
distance-from-start_max3.3735529930090653
distance-from-start_mean2.2469544876361525
distance-from-start_median2.8071324787677723
distance-from-start_min4.440892098500626e-16
driven_any_max5.809528586384186
driven_any_mean3.815527957610135
driven_any_median4.726291622027912
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.79391764651065
driven_lanedir_consec_mean3.8078472931957146
driven_lanedir_consec_min0.0
driven_lanedir_max5.79391764651065
driven_lanedir_mean3.8078491425629943
driven_lanedir_median4.718739461870664
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.678536302590251, "survival_time": 59.99999999999873, "driven_lanedir": 3.6670970298429166, "in-drivable-lane": 0.0, "deviation-heading": 2.004432813280444, "distance-from-start": 2.640003754342585, "deviation-center-line": 0.32324970166177724, "driven_lanedir_consec": 3.667089757433403}, "udem-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.7740469414655715, "survival_time": 59.99999999999873, "driven_lanedir": 5.770381893898411, "in-drivable-lane": 0.0, "deviation-heading": 1.3353552963831563, "distance-from-start": 3.3735529930090653, "deviation-center-line": 0.14491946458638674, "driven_lanedir_consec": 5.7703817688388055}, "udem-000-ego3": {"driven_any": 5.809528586384186, "survival_time": 59.99999999999873, "driven_lanedir": 5.79391764651065, "in-drivable-lane": 0.0, "deviation-heading": 2.1989364065962533, "distance-from-start": 2.97426120319296, "deviation-center-line": 0.2878140121507838, "driven_lanedir_consec": 5.79391764651065}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6412682Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-2of4timeoutnogpu-staging-spot-0-02----No reset possible
6411685Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnogpu-staging-spot-0-020:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.35000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median1.116943263707006
deviation-center-line_median0.11371523984155717


other stats
deviation-center-line_max0.11371523984155717
deviation-center-line_mean0.11371523984155717
deviation-center-line_min0.11371523984155717
deviation-heading_max1.1964666868192868
deviation-heading_mean1.1964666868192868
deviation-heading_median1.1964666868192868
deviation-heading_min1.1964666868192868
distance-from-start_max0.9553119406629068
distance-from-start_mean0.9553119406629068
distance-from-start_median0.9553119406629068
distance-from-start_min0.9553119406629068
driven_any_max1.1261312214304977
driven_any_mean1.1261312214304977
driven_any_median1.1261312214304977
driven_any_min1.1261312214304977
driven_lanedir_consec_max1.116943263707006
driven_lanedir_consec_mean1.116943263707006
driven_lanedir_consec_min1.116943263707006
driven_lanedir_max1.116943263707006
driven_lanedir_mean1.116943263707006
driven_lanedir_median1.116943263707006
driven_lanedir_min1.116943263707006
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1261312214304977, "survival_time": 12.35000000000004, "driven_lanedir": 1.116943263707006, "in-drivable-lane": 0.0, "deviation-heading": 1.1964666868192868, "distance-from-start": 0.9553119406629068, "deviation-center-line": 0.11371523984155717, "driven_lanedir_consec": 1.116943263707006}}
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean12.35000000000004
survival_time_min12.35000000000004
No reset possible
6398685Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6388717Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-1of4successnogpu-staging-spot-0-020:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median3.273341764774173
deviation-center-line_median5.928861955930986


other stats
deviation-center-line_max5.928861955930986
deviation-center-line_mean5.928861955930986
deviation-center-line_min5.928861955930986
deviation-heading_max8.56664395768181
deviation-heading_mean8.56664395768181
deviation-heading_median8.56664395768181
deviation-heading_min8.56664395768181
distance-from-start_max2.0613975353473006
distance-from-start_mean2.0613975353473006
distance-from-start_median2.0613975353473006
distance-from-start_min2.0613975353473006
driven_any_max3.476087222739718
driven_any_mean3.476087222739718
driven_any_median3.476087222739718
driven_any_min3.476087222739718
driven_lanedir_consec_max3.273341764774173
driven_lanedir_consec_mean3.273341764774173
driven_lanedir_consec_min3.273341764774173
driven_lanedir_max3.273341764774173
driven_lanedir_mean3.273341764774173
driven_lanedir_median3.273341764774173
driven_lanedir_min3.273341764774173
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.476087222739718, "survival_time": 59.99999999999873, "driven_lanedir": 3.273341764774173, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.56664395768181, "distance-from-start": 2.0613975353473006, "deviation-center-line": 5.928861955930986, "driven_lanedir_consec": 3.273341764774173}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6385688Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checksuccessnogpu-staging-spot-0-020:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.01953349439361496
deviation-center-line_median0.005218222768142721


other stats
deviation-center-line_max0.005218222768142721
deviation-center-line_mean0.005218222768142721
deviation-center-line_min0.005218222768142721
deviation-heading_max0.25396491855571535
deviation-heading_mean0.25396491855571535
deviation-heading_median0.25396491855571535
deviation-heading_min0.25396491855571535
distance-from-start_max0.022001508006465737
distance-from-start_mean0.022001508006465737
distance-from-start_median0.022001508006465737
distance-from-start_min0.022001508006465737
driven_any_max0.022014748656342877
driven_any_mean0.022014748656342877
driven_any_median0.022014748656342877
driven_any_min0.022014748656342877
driven_lanedir_consec_max0.01953349439361496
driven_lanedir_consec_mean0.01953349439361496
driven_lanedir_consec_min0.01953349439361496
driven_lanedir_max0.01953349439361496
driven_lanedir_mean0.01953349439361496
driven_lanedir_median0.01953349439361496
driven_lanedir_min0.01953349439361496
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.022014748656342877, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01953349439361496, "in-drivable-lane": 0.0, "deviation-heading": 0.25396491855571535, "distance-from-start": 0.022001508006465737, "deviation-center-line": 0.005218222768142721, "driven_lanedir_consec": 0.01953349439361496}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
6384717Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655349065782646
deviation-center-line_median7.1145113238609285


other stats
deviation-center-line_max7.1145113238609285
deviation-center-line_mean7.1145113238609285
deviation-center-line_min7.1145113238609285
deviation-heading_max5.702635608894818
deviation-heading_mean5.702635608894818
deviation-heading_median5.702635608894818
deviation-heading_min5.702635608894818
distance-from-start_max1.6303678384799305
distance-from-start_mean1.6303678384799305
distance-from-start_median1.6303678384799305
distance-from-start_min1.6303678384799305
driven_any_max3.4663369172896528
driven_any_mean3.4663369172896528
driven_any_median3.4663369172896528
driven_any_min3.4663369172896528
driven_lanedir_consec_max3.2655349065782646
driven_lanedir_consec_mean3.2655349065782646
driven_lanedir_consec_min3.2655349065782646
driven_lanedir_max3.2655349065782646
driven_lanedir_mean3.2655349065782646
driven_lanedir_median3.2655349065782646
driven_lanedir_min3.2655349065782646
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172896528, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655349065782646, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635608894818, "distance-from-start": 1.6303678384799305, "deviation-center-line": 7.1145113238609285, "driven_lanedir_consec": 3.2655349065782646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6367721Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation283successyesgpu-staging-spot-0-020:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.024999999999956
driven_lanedir_consec_median2.354349999154554
deviation-center-line_median6.1904900915885825


other stats
deviation-center-line_max7.342897137212387
deviation-center-line_mean5.815429153599174
deviation-center-line_min3.5378392940071444
deviation-heading_max8.643847239934157
deviation-heading_mean5.769308033824521
deviation-heading_median5.462417882322539
deviation-heading_min3.5085491307188437
distance-from-start_max2.1932800589165744
distance-from-start_mean1.7770214145992558
distance-from-start_median1.7822126331012849
distance-from-start_min1.3503803332778783
driven_any_max3.519587859801343
driven_any_mean3.0189647101082344
driven_any_median3.38758803636824
driven_any_min1.7810949078951157
driven_lanedir_consec_max3.321041838958641
driven_lanedir_consec_mean2.428232836144684
driven_lanedir_consec_min1.6831895073109888
driven_lanedir_max3.387629081863654
driven_lanedir_mean2.883329777932324
driven_lanedir_median3.231250261277327
driven_lanedir_min1.6831895073109888
in-drivable-lane_max2.749999999999872
in-drivable-lane_mean2.162499999999953
in-drivable-lane_min1.8500000000000263
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.2780872163787773, "survival_time": 59.99999999999873, "driven_lanedir": 3.1414586835960128, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.270318376228316, "distance-from-start": 2.1932800589165744, "deviation-center-line": 3.5378392940071444, "driven_lanedir_consec": 2.5904401579936844}, "autolab-000-ego1": {"driven_any": 1.7810949078951157, "survival_time": 59.99999999999873, "driven_lanedir": 1.6831895073109888, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.5085491307188437, "distance-from-start": 1.3503803332778783, "deviation-center-line": 7.342897137212387, "driven_lanedir_consec": 1.6831895073109888}, "autolab-000-ego2": {"driven_any": 3.4970888563577023, "survival_time": 59.99999999999873, "driven_lanedir": 3.321041838958641, "in-drivable-lane": 2.749999999999872, "deviation-heading": 8.643847239934157, "distance-from-start": 2.062725629892184, "deviation-center-line": 5.639409153019825, "driven_lanedir_consec": 3.321041838958641}, "autolab-000-ego3": {"driven_any": 3.519587859801343, "survival_time": 59.99999999999873, "driven_lanedir": 3.387629081863654, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654517388416762, "distance-from-start": 1.5016996363103856, "deviation-center-line": 6.74157103015734, "driven_lanedir_consec": 2.1182598403154227}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6361722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-1of4successnogpu-staging-spot-0-020:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.99999999999901
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.420452979729076
deviation-center-line_median4.299642636408967


other stats
deviation-center-line_max4.299642636408967
deviation-center-line_mean4.299642636408967
deviation-center-line_min4.299642636408967
deviation-heading_max7.737882401817608
deviation-heading_mean7.737882401817608
deviation-heading_median7.737882401817608
deviation-heading_min7.737882401817608
distance-from-start_max1.206000789659136
distance-from-start_mean1.206000789659136
distance-from-start_median1.206000789659136
distance-from-start_min1.206000789659136
driven_any_max3.1430848844498547
driven_any_mean3.1430848844498547
driven_any_median3.1430848844498547
driven_any_min3.1430848844498547
driven_lanedir_consec_max1.420452979729076
driven_lanedir_consec_mean1.420452979729076
driven_lanedir_consec_min1.420452979729076
driven_lanedir_max2.9486964161761877
driven_lanedir_mean2.9486964161761877
driven_lanedir_median2.9486964161761877
driven_lanedir_min2.9486964161761877
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.1430848844498547, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486964161761877, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.737882401817608, "distance-from-start": 1.206000789659136, "deviation-center-line": 4.299642636408967, "driven_lanedir_consec": 1.420452979729076}}
simulation-passed1
survival_time_max54.99999999999901
survival_time_mean54.99999999999901
survival_time_min54.99999999999901
No reset possible
6347397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-020:10:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.194248652298141
survival_time_median59.99999999999873
deviation-center-line_median1.663172686549191
in-drivable-lane_median36.74999999999913


other stats
deviation-center-line_max1.663172686549191
deviation-center-line_mean1.663172686549191
deviation-center-line_min1.663172686549191
deviation-heading_max18.667479454770895
deviation-heading_mean18.667479454770895
deviation-heading_median18.667479454770895
deviation-heading_min18.667479454770895
distance-from-start_max0.17519551733080382
distance-from-start_mean0.17519551733080382
distance-from-start_median0.17519551733080382
distance-from-start_min0.17519551733080382
driven_any_max13.749275067001753
driven_any_mean13.749275067001753
driven_any_median13.749275067001753
driven_any_min13.749275067001753
driven_lanedir_consec_max-3.194248652298141
driven_lanedir_consec_mean-3.194248652298141
driven_lanedir_consec_min-3.194248652298141
driven_lanedir_max-3.818027628956399
driven_lanedir_mean-3.818027628956399
driven_lanedir_median-3.818027628956399
driven_lanedir_min-3.818027628956399
in-drivable-lane_max36.74999999999913
in-drivable-lane_mean36.74999999999913
in-drivable-lane_min36.74999999999913
per-episodes
details{"zigzag-000-ego0": {"driven_any": 13.749275067001753, "survival_time": 59.99999999999873, "driven_lanedir": -3.818027628956399, "in-drivable-lane": 36.74999999999913, "deviation-heading": 18.667479454770895, "distance-from-start": 0.17519551733080382, "deviation-center-line": 1.663172686549191, "driven_lanedir_consec": -3.194248652298141}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6303397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4timeoutnogpu-staging-spot-0-02----No reset possible
6288658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-020:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1528847071801782
survival_time_median59.99999999999873
deviation-center-line_median1.419307024102371
in-drivable-lane_median29.69999999999938


other stats
deviation-center-line_max1.419307024102371
deviation-center-line_mean1.419307024102371
deviation-center-line_min1.419307024102371
deviation-heading_max23.577586255996763
deviation-heading_mean23.577586255996763
deviation-heading_median23.577586255996763
deviation-heading_min23.577586255996763
distance-from-start_max0.3187665756111437
distance-from-start_mean0.3187665756111437
distance-from-start_median0.3187665756111437
distance-from-start_min0.3187665756111437
driven_any_max1.3876709462510528
driven_any_mean1.3876709462510528
driven_any_median1.3876709462510528
driven_any_min1.3876709462510528
driven_lanedir_consec_max0.1528847071801782
driven_lanedir_consec_mean0.1528847071801782
driven_lanedir_consec_min0.1528847071801782
driven_lanedir_max0.1528847071801782
driven_lanedir_mean0.1528847071801782
driven_lanedir_median0.1528847071801782
driven_lanedir_min0.1528847071801782
in-drivable-lane_max29.69999999999938
in-drivable-lane_mean29.69999999999938
in-drivable-lane_min29.69999999999938
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3876709462510528, "survival_time": 59.99999999999873, "driven_lanedir": 0.1528847071801782, "in-drivable-lane": 29.69999999999938, "deviation-heading": 23.577586255996763, "distance-from-start": 0.3187665756111437, "deviation-center-line": 1.419307024102371, "driven_lanedir_consec": 0.1528847071801782}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6282672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6270689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-020:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.20000000000001
in-drivable-lane_median7.550000000000012
driven_lanedir_consec_median0.35100782346733106
deviation-center-line_median0.1875173231178998


other stats
deviation-center-line_max0.2707804718914694
deviation-center-line_mean0.1844412573098622
deviation-center-line_min0.0919499111121796
deviation-heading_max1.1917651798930318
deviation-heading_mean0.9622869363024876
deviation-heading_median0.9361472189771176
deviation-heading_min0.7850881273626832
distance-from-start_max1.5123565388898523
distance-from-start_mean1.065915894504796
distance-from-start_median1.022394956672053
distance-from-start_min0.7065171257852256
driven_any_max1.5124649660017897
driven_any_mean1.065965786863606
driven_any_median1.0224346418929502
driven_any_min0.7065288976667349
driven_lanedir_consec_max0.5392423985110799
driven_lanedir_consec_mean0.3468357242213338
driven_lanedir_consec_min0.14608485143959313
driven_lanedir_max0.5392423985110799
driven_lanedir_mean0.3468357242213338
driven_lanedir_median0.35100782346733106
driven_lanedir_min0.14608485143959313
in-drivable-lane_max8.75000000000001
in-drivable-lane_mean7.587500000000013
in-drivable-lane_min6.500000000000015
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7065288976667349, "survival_time": 10.20000000000001, "driven_lanedir": 0.19955231542409413, "in-drivable-lane": 8.45000000000001, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.7065171257852256, "deviation-center-line": 0.125674622775791, "driven_lanedir_consec": 0.19955231542409413}, "zigzag-000-ego1": {"driven_any": 1.5124649660017897, "survival_time": 10.20000000000001, "driven_lanedir": 0.502463331510568, "in-drivable-lane": 6.650000000000015, "deviation-heading": 1.1917651798930318, "distance-from-start": 1.5123565388898523, "deviation-center-line": 0.2493600234600086, "driven_lanedir_consec": 0.502463331510568}, "zigzag-000-ego2": {"driven_any": 0.8448328173529562, "survival_time": 10.20000000000001, "driven_lanedir": 0.5392423985110799, "in-drivable-lane": 6.500000000000015, "deviation-heading": 0.9234724823961894, "distance-from-start": 0.8448159163231234, "deviation-center-line": 0.2707804718914694, "driven_lanedir_consec": 0.5392423985110799}, "zigzag-000-ego3": {"driven_any": 1.200036466432944, "survival_time": 10.20000000000001, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 8.75000000000001, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean10.20000000000001
survival_time_min10.20000000000001
No reset possible
6263691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-020:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
6258697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-020:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.99999999999999
in-drivable-lane_median3.79999999999999
driven_lanedir_consec_median0.08715128455904608
deviation-center-line_median0.08531010260279949


other stats
deviation-center-line_max0.08531010260279949
deviation-center-line_mean0.08531010260279949
deviation-center-line_min0.08531010260279949
deviation-heading_max1.02112502633278
deviation-heading_mean1.02112502633278
deviation-heading_median1.02112502633278
deviation-heading_min1.02112502633278
distance-from-start_max0.6563203604640362
distance-from-start_mean0.6563203604640362
distance-from-start_median0.6563203604640362
distance-from-start_min0.6563203604640362
driven_any_max0.6563320833963245
driven_any_mean0.6563320833963245
driven_any_median0.6563320833963245
driven_any_min0.6563320833963245
driven_lanedir_consec_max0.08715128455904608
driven_lanedir_consec_mean0.08715128455904608
driven_lanedir_consec_min0.08715128455904608
driven_lanedir_max0.08715128455904608
driven_lanedir_mean0.08715128455904608
driven_lanedir_median0.08715128455904608
driven_lanedir_min0.08715128455904608
in-drivable-lane_max3.79999999999999
in-drivable-lane_mean3.79999999999999
in-drivable-lane_min3.79999999999999
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.6563320833963245, "survival_time": 4.99999999999999, "driven_lanedir": 0.08715128455904608, "in-drivable-lane": 3.79999999999999, "deviation-heading": 1.02112502633278, "distance-from-start": 0.6563203604640362, "deviation-center-line": 0.08531010260279949, "driven_lanedir_consec": 0.08715128455904608}}
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_min4.99999999999999
No reset possible
6242765Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-020:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.026882543347192644
deviation-center-line_median0.005699325319969381


other stats
deviation-center-line_max0.005699325319969381
deviation-center-line_mean0.005699325319969381
deviation-center-line_min0.005699325319969381
deviation-heading_max0.3058856656283867
deviation-heading_mean0.3058856656283867
deviation-heading_median0.3058856656283867
deviation-heading_min0.3058856656283867
distance-from-start_max0.0354377687278388
distance-from-start_mean0.0354377687278388
distance-from-start_median0.0354377687278388
distance-from-start_min0.0354377687278388
driven_any_max0.03554958894433152
driven_any_mean0.03554958894433152
driven_any_median0.03554958894433152
driven_any_min0.03554958894433152
driven_lanedir_consec_max0.026882543347192644
driven_lanedir_consec_mean0.026882543347192644
driven_lanedir_consec_min0.026882543347192644
driven_lanedir_max0.026882543347192644
driven_lanedir_mean0.026882543347192644
driven_lanedir_median0.026882543347192644
driven_lanedir_min0.026882543347192644
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03554958894433152, "survival_time": 0.49999999999999994, "driven_lanedir": 0.026882543347192644, "in-drivable-lane": 0.0, "deviation-heading": 0.3058856656283867, "distance-from-start": 0.0354377687278388, "deviation-center-line": 0.005699325319969381, "driven_lanedir_consec": 0.026882543347192644}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
6238385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-020:16:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.62499999999936
driven_lanedir_consec_median-3.09472662290249
deviation-center-line_median2.5475108721775195


other stats
deviation-center-line_max3.5829492817519983
deviation-center-line_mean2.637929428666149
deviation-center-line_min1.8737466885575584
deviation-heading_max28.840951964541276
deviation-heading_mean27.556347346630066
deviation-heading_median27.463430883919777
deviation-heading_min26.45757565413943
distance-from-start_max0.2237257419825006
distance-from-start_mean0.19153058367378584
distance-from-start_median0.1882848630730942
distance-from-start_min0.1658268665664545
driven_any_max12.313280565769558
driven_any_mean11.44455669603046
driven_any_median11.362296865455557
driven_any_min10.740352487441172
driven_lanedir_consec_max-2.3608241220047725
driven_lanedir_consec_mean-3.0909582495403285
driven_lanedir_consec_min-3.8135556303515634
driven_lanedir_max-2.4579478836412125
driven_lanedir_mean-3.4062328045137793
driven_lanedir_median-3.551272064364054
driven_lanedir_min-4.0644392056857965
in-drivable-lane_max28.899999999999217
in-drivable-lane_mean26.11249999999936
in-drivable-lane_min20.29999999999949
per-episodes
details{"loop-000-ego0": {"driven_any": 12.313280565769558, "survival_time": 59.99999999999873, "driven_lanedir": -4.062670223586682, "in-drivable-lane": 27.999999999999375, "deviation-heading": 27.575215351258336, "distance-from-start": 0.1658268665664545, "deviation-center-line": 1.8737466885575584, "driven_lanedir_consec": -3.8135556303515634}, "loop-000-ego1": {"driven_any": 10.740352487441172, "survival_time": 59.99999999999873, "driven_lanedir": -3.039873905141426, "in-drivable-lane": 27.249999999999343, "deviation-heading": 27.35164641658122, "distance-from-start": 0.17477265881089746, "deviation-center-line": 2.025072193574622, "driven_lanedir_consec": -3.039873905141426}, "loop-000-ego2": {"driven_any": 11.2805798568295, "survival_time": 59.99999999999873, "driven_lanedir": -4.0644392056857965, "in-drivable-lane": 20.29999999999949, "deviation-heading": 28.840951964541276, "distance-from-start": 0.2237257419825006, "deviation-center-line": 3.069949550780417, "driven_lanedir_consec": -3.1495793406635544}, "loop-000-ego3": {"driven_any": 11.444013874081612, "survival_time": 59.99999999999873, "driven_lanedir": -2.4579478836412125, "in-drivable-lane": 28.899999999999217, "deviation-heading": 26.45757565413943, "distance-from-start": 0.20179706733529093, "deviation-center-line": 3.5829492817519983, "driven_lanedir_consec": -2.3608241220047725}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6231387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-020:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median33.54999999999912
driven_lanedir_consec_median-2.655869590197556
deviation-center-line_median2.464015177585119


other stats
deviation-center-line_max2.464015177585119
deviation-center-line_mean2.464015177585119
deviation-center-line_min2.464015177585119
deviation-heading_max24.885195492315056
deviation-heading_mean24.885195492315056
deviation-heading_median24.885195492315056
deviation-heading_min24.885195492315056
distance-from-start_max0.1560108135871528
distance-from-start_mean0.1560108135871528
distance-from-start_median0.1560108135871528
distance-from-start_min0.1560108135871528
driven_any_max11.381923687635291
driven_any_mean11.381923687635291
driven_any_median11.381923687635291
driven_any_min11.381923687635291
driven_lanedir_consec_max-2.655869590197556
driven_lanedir_consec_mean-2.655869590197556
driven_lanedir_consec_min-2.655869590197556
driven_lanedir_max-2.655869590197556
driven_lanedir_mean-2.655869590197556
driven_lanedir_median-2.655869590197556
driven_lanedir_min-2.655869590197556
in-drivable-lane_max33.54999999999912
in-drivable-lane_mean33.54999999999912
in-drivable-lane_min33.54999999999912
per-episodes
details{"loop-000-ego0": {"driven_any": 11.381923687635291, "survival_time": 59.99999999999873, "driven_lanedir": -2.655869590197556, "in-drivable-lane": 33.54999999999912, "deviation-heading": 24.885195492315056, "distance-from-start": 0.1560108135871528, "deviation-center-line": 2.464015177585119, "driven_lanedir_consec": -2.655869590197556}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6227388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-020:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.450000000000184
in-drivable-lane_median9.850000000000096
driven_lanedir_consec_median-1.3744065732068893
deviation-center-line_median0.8680309242215604


other stats
deviation-center-line_max0.8680309242215604
deviation-center-line_mean0.8680309242215604
deviation-center-line_min0.8680309242215604
deviation-heading_max9.644254166140184
deviation-heading_mean9.644254166140184
deviation-heading_median9.644254166140184
deviation-heading_min9.644254166140184
distance-from-start_max0.16603230053464438
distance-from-start_mean0.16603230053464438
distance-from-start_median0.16603230053464438
distance-from-start_min0.16603230053464438
driven_any_max4.731790173690621
driven_any_mean4.731790173690621
driven_any_median4.731790173690621
driven_any_min4.731790173690621
driven_lanedir_consec_max-1.3744065732068893
driven_lanedir_consec_mean-1.3744065732068893
driven_lanedir_consec_min-1.3744065732068893
driven_lanedir_max-1.4780763677011692
driven_lanedir_mean-1.4780763677011692
driven_lanedir_median-1.4780763677011692
driven_lanedir_min-1.4780763677011692
in-drivable-lane_max9.850000000000096
in-drivable-lane_mean9.850000000000096
in-drivable-lane_min9.850000000000096
per-episodes
details{"udem-000-ego0": {"driven_any": 4.731790173690621, "survival_time": 22.450000000000184, "driven_lanedir": -1.4780763677011692, "in-drivable-lane": 9.850000000000096, "deviation-heading": 9.644254166140184, "distance-from-start": 0.16603230053464438, "deviation-center-line": 0.8680309242215604, "driven_lanedir_consec": -1.3744065732068893}}
simulation-passed1
survival_time_max22.450000000000184
survival_time_mean22.450000000000184
survival_time_min22.450000000000184
No reset possible
6226388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6220390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-020:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-4.031595690763027
survival_time_median59.99999999999873
deviation-center-line_median4.4652794768293305
in-drivable-lane_median14.349999999999556


other stats
deviation-center-line_max4.4652794768293305
deviation-center-line_mean4.4652794768293305
deviation-center-line_min4.4652794768293305
deviation-heading_max27.732494252626676
deviation-heading_mean27.732494252626676
deviation-heading_median27.732494252626676
deviation-heading_min27.732494252626676
distance-from-start_max0.19353869836049553
distance-from-start_mean0.19353869836049553
distance-from-start_median0.19353869836049553
distance-from-start_min0.19353869836049553
driven_any_max12.16543940883653
driven_any_mean12.16543940883653
driven_any_median12.16543940883653
driven_any_min12.16543940883653
driven_lanedir_consec_max-4.031595690763027
driven_lanedir_consec_mean-4.031595690763027
driven_lanedir_consec_min-4.031595690763027
driven_lanedir_max-5.81714198225667
driven_lanedir_mean-5.81714198225667
driven_lanedir_median-5.81714198225667
driven_lanedir_min-5.81714198225667
in-drivable-lane_max14.349999999999556
in-drivable-lane_mean14.349999999999556
in-drivable-lane_min14.349999999999556
per-episodes
details{"zigzag-000-ego0": {"driven_any": 12.16543940883653, "survival_time": 59.99999999999873, "driven_lanedir": -5.81714198225667, "in-drivable-lane": 14.349999999999556, "deviation-heading": 27.732494252626676, "distance-from-start": 0.19353869836049553, "deviation-center-line": 4.4652794768293305, "driven_lanedir_consec": -4.031595690763027}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6207392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4successnogpu-staging-spot-0-020:19:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.17499999999935
driven_lanedir_consec_median-3.877961435286348
deviation-center-line_median2.5063623492308107


other stats
deviation-center-line_max3.2136894969172296
deviation-center-line_mean2.5011587338238277
deviation-center-line_min1.7782207399164598
deviation-heading_max26.09359231185323
deviation-heading_mean25.251014425811796
deviation-heading_median25.444655344666486
deviation-heading_min24.02115470206098
distance-from-start_max0.16713986628583138
distance-from-start_mean0.16147017672495437
distance-from-start_median0.1639765171629528
distance-from-start_min0.15078780628808044
driven_any_max13.29442878111872
driven_any_mean12.41146323764868
driven_any_median12.475528056793475
driven_any_min11.400368055889052
driven_lanedir_consec_max-3.2151517880611067
driven_lanedir_consec_mean-3.785415532020464
driven_lanedir_consec_min-4.170587469448055
driven_lanedir_max-3.2151517880611067
driven_lanedir_mean-3.8346189717360306
driven_lanedir_median-3.916907380798116
driven_lanedir_min-4.289509337286783
in-drivable-lane_max31.899999999999356
in-drivable-lane_mean29.36249999999936
in-drivable-lane_min27.19999999999937
per-episodes
details{"autolab-000-ego0": {"driven_any": 13.02862326267094, "survival_time": 59.99999999999873, "driven_lanedir": -4.170587469448055, "in-drivable-lane": 31.899999999999356, "deviation-heading": 24.02115470206098, "distance-from-start": 0.16315218423073655, "deviation-center-line": 1.7782207399164598, "driven_lanedir_consec": -4.170587469448055}, "autolab-000-ego1": {"driven_any": 11.400368055889052, "survival_time": 59.99999999999873, "driven_lanedir": -3.2151517880611067, "in-drivable-lane": 27.19999999999937, "deviation-heading": 25.755799675227177, "distance-from-start": 0.15078780628808044, "deviation-center-line": 3.2136894969172296, "driven_lanedir_consec": -3.2151517880611067}, "autolab-000-ego2": {"driven_any": 13.29442878111872, "survival_time": 59.99999999999873, "driven_lanedir": -4.289509337286783, "in-drivable-lane": 27.599999999999408, "deviation-heading": 26.09359231185323, "distance-from-start": 0.1648008500951691, "deviation-center-line": 2.789564986848481, "driven_lanedir_consec": -4.092695578424519}, "autolab-000-ego3": {"driven_any": 11.922432850916012, "survival_time": 59.99999999999873, "driven_lanedir": -3.6632272921481768, "in-drivable-lane": 30.74999999999929, "deviation-heading": 25.1335110141058, "distance-from-start": 0.16713986628583138, "deviation-center-line": 2.2231597116131403, "driven_lanedir_consec": -3.6632272921481768}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6200394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-2of4successnogpu-staging-spot-0-020:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median40.39999999999892
driven_lanedir_consec_median-1.670475099308401
deviation-center-line_median1.8403263513181696


other stats
deviation-center-line_max1.8403263513181696
deviation-center-line_mean1.8403263513181696
deviation-center-line_min1.8403263513181696
deviation-heading_max17.988597986617783
deviation-heading_mean17.988597986617783
deviation-heading_median17.988597986617783
deviation-heading_min17.988597986617783
distance-from-start_max0.2184002995334473
distance-from-start_mean0.2184002995334473
distance-from-start_median0.2184002995334473
distance-from-start_min0.2184002995334473
driven_any_max10.17907036719648
driven_any_mean10.17907036719648
driven_any_median10.17907036719648
driven_any_min10.17907036719648
driven_lanedir_consec_max-1.670475099308401
driven_lanedir_consec_mean-1.670475099308401
driven_lanedir_consec_min-1.670475099308401
driven_lanedir_max-1.670475099308401
driven_lanedir_mean-1.670475099308401
driven_lanedir_median-1.670475099308401
driven_lanedir_min-1.670475099308401
in-drivable-lane_max40.39999999999892
in-drivable-lane_mean40.39999999999892
in-drivable-lane_min40.39999999999892
per-episodes
details{"loop-000-ego0": {"driven_any": 10.17907036719648, "survival_time": 59.99999999999873, "driven_lanedir": -1.670475099308401, "in-drivable-lane": 40.39999999999892, "deviation-heading": 17.988597986617783, "distance-from-start": 0.2184002995334473, "deviation-center-line": 1.8403263513181696, "driven_lanedir_consec": -1.670475099308401}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6196395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4successnogpu-staging-spot-0-020:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.00000000000021
in-drivable-lane_median12.500000000000112
driven_lanedir_consec_median-1.774343093381244
deviation-center-line_median0.4953634040650972


other stats
deviation-center-line_max0.4953634040650972
deviation-center-line_mean0.4953634040650972
deviation-center-line_min0.4953634040650972
deviation-heading_max8.951729015559467
deviation-heading_mean8.951729015559467
deviation-heading_median8.951729015559467
deviation-heading_min8.951729015559467
distance-from-start_max0.16627915309716113
distance-from-start_mean0.16627915309716113
distance-from-start_median0.16627915309716113
distance-from-start_min0.16627915309716113
driven_any_max5.610745647762738
driven_any_mean5.610745647762738
driven_any_median5.610745647762738
driven_any_min5.610745647762738
driven_lanedir_consec_max-1.774343093381244
driven_lanedir_consec_mean-1.774343093381244
driven_lanedir_consec_min-1.774343093381244
driven_lanedir_max-1.7867294401552585
driven_lanedir_mean-1.7867294401552585
driven_lanedir_median-1.7867294401552585
driven_lanedir_min-1.7867294401552585
in-drivable-lane_max12.500000000000112
in-drivable-lane_mean12.500000000000112
in-drivable-lane_min12.500000000000112
per-episodes
details{"4way-000-ego0": {"driven_any": 5.610745647762738, "survival_time": 24.00000000000021, "driven_lanedir": -1.7867294401552585, "in-drivable-lane": 12.500000000000112, "deviation-heading": 8.951729015559467, "distance-from-start": 0.16627915309716113, "deviation-center-line": 0.4953634040650972, "driven_lanedir_consec": -1.774343093381244}}
simulation-passed1
survival_time_max24.00000000000021
survival_time_mean24.00000000000021
survival_time_min24.00000000000021
No reset possible
6191396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-020:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.750000000000146
in-drivable-lane_median8.00000000000006
driven_lanedir_consec_median-1.0883951957090992
deviation-center-line_median0.4343034147757236


other stats
deviation-center-line_max0.4343034147757236
deviation-center-line_mean0.4343034147757236
deviation-center-line_min0.4343034147757236
deviation-heading_max10.41330018564094
deviation-heading_mean10.41330018564094
deviation-heading_median10.41330018564094
deviation-heading_min10.41330018564094
distance-from-start_max0.15624164928735848
distance-from-start_mean0.15624164928735848
distance-from-start_median0.15624164928735848
distance-from-start_min0.15624164928735848
driven_any_max3.7392480382527657
driven_any_mean3.7392480382527657
driven_any_median3.7392480382527657
driven_any_min3.7392480382527657
driven_lanedir_consec_max-1.0883951957090992
driven_lanedir_consec_mean-1.0883951957090992
driven_lanedir_consec_min-1.0883951957090992
driven_lanedir_max-1.0824178372025688
driven_lanedir_mean-1.0824178372025688
driven_lanedir_median-1.0824178372025688
driven_lanedir_min-1.0824178372025688
in-drivable-lane_max8.00000000000006
in-drivable-lane_mean8.00000000000006
in-drivable-lane_min8.00000000000006
per-episodes
details{"4way-000-ego0": {"driven_any": 3.7392480382527657, "survival_time": 19.750000000000146, "driven_lanedir": -1.0824178372025688, "in-drivable-lane": 8.00000000000006, "deviation-heading": 10.41330018564094, "distance-from-start": 0.15624164928735848, "deviation-center-line": 0.4343034147757236, "driven_lanedir_consec": -1.0883951957090992}}
simulation-passed1
survival_time_max19.750000000000146
survival_time_mean19.750000000000146
survival_time_min19.750000000000146
No reset possible
6186396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6181514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4failednogpu-staging-spot-0-020:01:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6180515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-1of4failednogpu-staging-spot-0-020:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6174517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6166518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6163520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6158521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6152522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-2of4failednogpu-staging-spot-0-020:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6149523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-3of4failednogpu-staging-spot-0-020:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6146523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6143524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6140525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6138525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6136527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6134527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6127529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-0of4successnogpu-staging-spot-0-020:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median10.080984056632875
deviation-center-line_median2.8463454094456777


other stats
deviation-center-line_max2.8463454094456777
deviation-center-line_mean2.8463454094456777
deviation-center-line_min2.8463454094456777
deviation-heading_max11.994294290841925
deviation-heading_mean11.994294290841925
deviation-heading_median11.994294290841925
deviation-heading_min11.994294290841925
distance-from-start_max1.0793242498785331
distance-from-start_mean1.0793242498785331
distance-from-start_median1.0793242498785331
distance-from-start_min1.0793242498785331
driven_any_max10.397446904945635
driven_any_mean10.397446904945635
driven_any_median10.397446904945635
driven_any_min10.397446904945635
driven_lanedir_consec_max10.080984056632875
driven_lanedir_consec_mean10.080984056632875
driven_lanedir_consec_min10.080984056632875
driven_lanedir_max10.080984056632875
driven_lanedir_mean10.080984056632875
driven_lanedir_median10.080984056632875
driven_lanedir_min10.080984056632875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.397446904945635, "survival_time": 59.99999999999873, "driven_lanedir": 10.080984056632875, "in-drivable-lane": 0.0, "deviation-heading": 11.994294290841925, "distance-from-start": 1.0793242498785331, "deviation-center-line": 2.8463454094456777, "driven_lanedir_consec": 10.080984056632875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6123530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-020:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median10.042521484111086
deviation-center-line_median2.825033430620078


other stats
deviation-center-line_max2.825033430620078
deviation-center-line_mean2.825033430620078
deviation-center-line_min2.825033430620078
deviation-heading_max12.380549841550424
deviation-heading_mean12.380549841550424
deviation-heading_median12.380549841550424
deviation-heading_min12.380549841550424
distance-from-start_max1.092253240357741
distance-from-start_mean1.092253240357741
distance-from-start_median1.092253240357741
distance-from-start_min1.092253240357741
driven_any_max10.385251431531085
driven_any_mean10.385251431531085
driven_any_median10.385251431531085
driven_any_min10.385251431531085
driven_lanedir_consec_max10.042521484111086
driven_lanedir_consec_mean10.042521484111086
driven_lanedir_consec_min10.042521484111086
driven_lanedir_max10.042521484111086
driven_lanedir_mean10.042521484111086
driven_lanedir_median10.042521484111086
driven_lanedir_min10.042521484111086
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.385251431531085, "survival_time": 59.99999999999873, "driven_lanedir": 10.042521484111086, "in-drivable-lane": 0.0, "deviation-heading": 12.380549841550424, "distance-from-start": 1.092253240357741, "deviation-center-line": 2.825033430620078, "driven_lanedir_consec": 10.042521484111086}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6120531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6115532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-020:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.45000000000014
in-drivable-lane_median0.0
driven_lanedir_consec_median2.689812857775798
deviation-center-line_median1.2359282399540954


other stats
deviation-center-line_max1.2359282399540954
deviation-center-line_mean1.2359282399540954
deviation-center-line_min1.2359282399540954
deviation-heading_max6.015780148826323
deviation-heading_mean6.015780148826323
deviation-heading_median6.015780148826323
deviation-heading_min6.015780148826323
distance-from-start_max1.030020145176226
distance-from-start_mean1.030020145176226
distance-from-start_median1.030020145176226
distance-from-start_min1.030020145176226
driven_any_max2.8605434364041677
driven_any_mean2.8605434364041677
driven_any_median2.8605434364041677
driven_any_min2.8605434364041677
driven_lanedir_consec_max2.689812857775798
driven_lanedir_consec_mean2.689812857775798
driven_lanedir_consec_min2.689812857775798
driven_lanedir_max2.689812857775798
driven_lanedir_mean2.689812857775798
driven_lanedir_median2.689812857775798
driven_lanedir_min2.689812857775798
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.8605434364041677, "survival_time": 19.45000000000014, "driven_lanedir": 2.689812857775798, "in-drivable-lane": 0.0, "deviation-heading": 6.015780148826323, "distance-from-start": 1.030020145176226, "deviation-center-line": 1.2359282399540954, "driven_lanedir_consec": 2.689812857775798}}
simulation-passed1
survival_time_max19.45000000000014
survival_time_mean19.45000000000014
survival_time_min19.45000000000014
No reset possible
6114532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6113532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6101535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.9249999999999696
driven_lanedir_consec_median9.59821692090932
deviation-center-line_median3.13727398077429


other stats
deviation-center-line_max3.829603984218409
deviation-center-line_mean3.13727398077429
deviation-center-line_min2.444943977330172
deviation-heading_max22.77933312289784
deviation-heading_mean16.882329375875283
deviation-heading_median16.882329375875283
deviation-heading_min10.985325628852724
distance-from-start_max1.6135251450660764
distance-from-start_mean1.3107017356424766
distance-from-start_median1.3107017356424766
distance-from-start_min1.007878326218877
driven_any_max11.310602276810837
driven_any_mean10.976091236512888
driven_any_median10.976091236512888
driven_any_min10.64158019621494
driven_lanedir_consec_max10.37026143310928
driven_lanedir_consec_mean9.59821692090932
driven_lanedir_consec_min8.826172408709361
driven_lanedir_max10.37026143310928
driven_lanedir_mean9.59821692090932
driven_lanedir_median9.59821692090932
driven_lanedir_min8.826172408709361
in-drivable-lane_max5.849999999999939
in-drivable-lane_mean2.9249999999999696
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.310602276810837, "survival_time": 59.99999999999873, "driven_lanedir": 8.826172408709361, "in-drivable-lane": 5.849999999999939, "deviation-heading": 22.77933312289784, "distance-from-start": 1.6135251450660764, "deviation-center-line": 3.829603984218409, "driven_lanedir_consec": 8.826172408709361}, "loop2-000-ego1": {"driven_any": 10.64158019621494, "survival_time": 59.99999999999873, "driven_lanedir": 10.37026143310928, "in-drivable-lane": 0.0, "deviation-heading": 10.985325628852724, "distance-from-start": 1.007878326218877, "deviation-center-line": 2.444943977330172, "driven_lanedir_consec": 10.37026143310928}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6097536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-020:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.4500000000001
in-drivable-lane_median2.150000000000013
driven_lanedir_consec_median2.1402117594427716
deviation-center-line_median0.980651034361668


other stats
deviation-center-line_max0.980651034361668
deviation-center-line_mean0.980651034361668
deviation-center-line_min0.980651034361668
deviation-heading_max6.4204675658794885
deviation-heading_mean6.4204675658794885
deviation-heading_median6.4204675658794885
deviation-heading_min6.4204675658794885
distance-from-start_max2.003013835301824
distance-from-start_mean2.003013835301824
distance-from-start_median2.003013835301824
distance-from-start_min2.003013835301824
driven_any_max2.891188444650364
driven_any_mean2.891188444650364
driven_any_median2.891188444650364
driven_any_min2.891188444650364
driven_lanedir_consec_max2.1402117594427716
driven_lanedir_consec_mean2.1402117594427716
driven_lanedir_consec_min2.1402117594427716
driven_lanedir_max2.1402117594427716
driven_lanedir_mean2.1402117594427716
driven_lanedir_median2.1402117594427716
driven_lanedir_min2.1402117594427716
in-drivable-lane_max2.150000000000013
in-drivable-lane_mean2.150000000000013
in-drivable-lane_min2.150000000000013
per-episodes
details{"loop-000-ego0": {"driven_any": 2.891188444650364, "survival_time": 16.4500000000001, "driven_lanedir": 2.1402117594427716, "in-drivable-lane": 2.150000000000013, "deviation-heading": 6.4204675658794885, "distance-from-start": 2.003013835301824, "deviation-center-line": 0.980651034361668, "driven_lanedir_consec": 2.1402117594427716}}
simulation-passed1
survival_time_max16.4500000000001
survival_time_mean16.4500000000001
survival_time_min16.4500000000001
No reset possible
6090537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-2of4successnogpu-staging-spot-0-020:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.15000000000011
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0122533972112104
deviation-center-line_median0.8505302138212144


other stats
deviation-center-line_max0.8505302138212144
deviation-center-line_mean0.8505302138212144
deviation-center-line_min0.8505302138212144
deviation-heading_max4.156193411761528
deviation-heading_mean4.156193411761528
deviation-heading_median4.156193411761528
deviation-heading_min4.156193411761528
distance-from-start_max1.908487963174964
distance-from-start_mean1.908487963174964
distance-from-start_median1.908487963174964
distance-from-start_min1.908487963174964
driven_any_max3.1309911784385633
driven_any_mean3.1309911784385633
driven_any_median3.1309911784385633
driven_any_min3.1309911784385633
driven_lanedir_consec_max3.0122533972112104
driven_lanedir_consec_mean3.0122533972112104
driven_lanedir_consec_min3.0122533972112104
driven_lanedir_max3.0122533972112104
driven_lanedir_mean3.0122533972112104
driven_lanedir_median3.0122533972112104
driven_lanedir_min3.0122533972112104
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.1309911784385633, "survival_time": 17.15000000000011, "driven_lanedir": 3.0122533972112104, "in-drivable-lane": 0.0, "deviation-heading": 4.156193411761528, "distance-from-start": 1.908487963174964, "deviation-center-line": 0.8505302138212144, "driven_lanedir_consec": 3.0122533972112104}}
simulation-passed1
survival_time_max17.15000000000011
survival_time_mean17.15000000000011
survival_time_min17.15000000000011
No reset possible
6087538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6080539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6077539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6061541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-020:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.151672248323974
survival_time_median59.99999999999873
deviation-center-line_median2.6039050273291737
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.6039050273291737
deviation-center-line_mean2.6039050273291737
deviation-center-line_min2.6039050273291737
deviation-heading_max11.559475782918849
deviation-heading_mean11.559475782918849
deviation-heading_median11.559475782918849
deviation-heading_min11.559475782918849
distance-from-start_max1.0852482685953868
distance-from-start_mean1.0852482685953868
distance-from-start_median1.0852482685953868
distance-from-start_min1.0852482685953868
driven_any_max10.437295163335447
driven_any_mean10.437295163335447
driven_any_median10.437295163335447
driven_any_min10.437295163335447
driven_lanedir_consec_max10.151672248323974
driven_lanedir_consec_mean10.151672248323974
driven_lanedir_consec_min10.151672248323974
driven_lanedir_max10.151672248323974
driven_lanedir_mean10.151672248323974
driven_lanedir_median10.151672248323974
driven_lanedir_min10.151672248323974
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.437295163335447, "survival_time": 59.99999999999873, "driven_lanedir": 10.151672248323974, "in-drivable-lane": 0.0, "deviation-heading": 11.559475782918849, "distance-from-start": 1.0852482685953868, "deviation-center-line": 2.6039050273291737, "driven_lanedir_consec": 10.151672248323974}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6054600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-020:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6041603Bea Baselines 🐤template-rosaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.200000000000024
in-drivable-lane_median9.17500000000002
driven_lanedir_consec_median0.3363032928640327
deviation-center-line_median0.12032850500659624


other stats
deviation-center-line_max0.21629600801644336
deviation-center-line_mean0.1352505036179083
deviation-center-line_min0.08404899644199727
deviation-heading_max2.2777553157508748
deviation-heading_mean1.0787527316687395
deviation-heading_median0.7753345998295373
deviation-heading_min0.4865864112650087
distance-from-start_max2.564393255853321
distance-from-start_mean1.8804894372391896
distance-from-start_median1.804570018097338
distance-from-start_min1.3484244569087611
driven_any_max3.0766874087611806
driven_any_mean2.042054378751691
driven_any_median1.8351288583705103
driven_any_min1.421272389504564
driven_lanedir_consec_max0.6532312863137225
driven_lanedir_consec_mean0.3733287913135419
driven_lanedir_consec_min0.1674772932123798
driven_lanedir_max0.6532312863137225
driven_lanedir_mean0.3733287913135419
driven_lanedir_median0.3363032928640327
driven_lanedir_min0.1674772932123798
in-drivable-lane_max10.150000000000023
in-drivable-lane_mean9.212500000000023
in-drivable-lane_min8.350000000000026
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.0766874087611806, "survival_time": 11.200000000000024, "driven_lanedir": 0.4183156041371714, "in-drivable-lane": 8.500000000000018, "deviation-heading": 2.2777553157508748, "distance-from-start": 2.564393255853321, "deviation-center-line": 0.21629600801644336, "driven_lanedir_consec": 0.4183156041371714}, "autolab-000-ego1": {"driven_any": 1.9678289787425365, "survival_time": 11.200000000000024, "driven_lanedir": 0.1674772932123798, "in-drivable-lane": 10.150000000000023, "deviation-heading": 0.5258971945608344, "distance-from-start": 1.925699706125836, "deviation-center-line": 0.09016431200401492, "driven_lanedir_consec": 0.1674772932123798}, "autolab-000-ego2": {"driven_any": 1.702428737998484, "survival_time": 11.200000000000024, "driven_lanedir": 0.6532312863137225, "in-drivable-lane": 8.350000000000026, "deviation-heading": 1.0247720050982403, "distance-from-start": 1.6834403300688403, "deviation-center-line": 0.15049269800917758, "driven_lanedir_consec": 0.6532312863137225}, "autolab-000-ego3": {"driven_any": 1.421272389504564, "survival_time": 11.200000000000024, "driven_lanedir": 0.254290981590894, "in-drivable-lane": 9.850000000000025, "deviation-heading": 0.4865864112650087, "distance-from-start": 1.3484244569087611, "deviation-center-line": 0.08404899644199727, "driven_lanedir_consec": 0.254290981590894}}
simulation-passed1
survival_time_max11.200000000000024
survival_time_mean11.200000000000024
survival_time_min11.200000000000024
No reset possible
6032605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-020:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6999999999999984
in-drivable-lane_median1.349999999999998
driven_lanedir_consec_median0.2621988652167031
deviation-center-line_median0.09664509273831212


other stats
deviation-center-line_max0.09664509273831212
deviation-center-line_mean0.09664509273831212
deviation-center-line_min0.09664509273831212
deviation-heading_max0.623955604459786
deviation-heading_mean0.623955604459786
deviation-heading_median0.623955604459786
deviation-heading_min0.623955604459786
distance-from-start_max0.4759248453118993
distance-from-start_mean0.4759248453118993
distance-from-start_median0.4759248453118993
distance-from-start_min0.4759248453118993
driven_any_max0.4765436925720091
driven_any_mean0.4765436925720091
driven_any_median0.4765436925720091
driven_any_min0.4765436925720091
driven_lanedir_consec_max0.2621988652167031
driven_lanedir_consec_mean0.2621988652167031
driven_lanedir_consec_min0.2621988652167031
driven_lanedir_max0.2621988652167031
driven_lanedir_mean0.2621988652167031
driven_lanedir_median0.2621988652167031
driven_lanedir_min0.2621988652167031
in-drivable-lane_max1.349999999999998
in-drivable-lane_mean1.349999999999998
in-drivable-lane_min1.349999999999998
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4765436925720091, "survival_time": 2.6999999999999984, "driven_lanedir": 0.2621988652167031, "in-drivable-lane": 1.349999999999998, "deviation-heading": 0.623955604459786, "distance-from-start": 0.4759248453118993, "deviation-center-line": 0.09664509273831212, "driven_lanedir_consec": 0.2621988652167031}}
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.6999999999999984
survival_time_min2.6999999999999984
No reset possible
6024607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6014610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-020:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.249999999999986
in-drivable-lane_median3.199999999999989
driven_lanedir_consec_median0.3646223318982426
deviation-center-line_median0.2133145068942855


other stats
deviation-center-line_max0.39846288906696714
deviation-center-line_mean0.22187845883649895
deviation-center-line_min0.06242193249045773
deviation-heading_max3.614482923882997
deviation-heading_mean1.5698638046604072
deviation-heading_median1.0108243954411191
deviation-heading_min0.6433235038763937
distance-from-start_max1.4519766372087843
distance-from-start_mean0.997816533254315
distance-from-start_median1.2601029295262465
distance-from-start_min0.01908363675598338
driven_any_max1.5004277912075634
driven_any_mean1.0245060200725635
driven_any_median1.2892550661960458
driven_any_min0.01908615669059921
driven_lanedir_consec_max0.8523967021931922
driven_lanedir_consec_mean0.3993335776478462
driven_lanedir_consec_min0.01569294460170756
driven_lanedir_max0.8523967021931922
driven_lanedir_mean0.3993335776478462
driven_lanedir_median0.3646223318982426
driven_lanedir_min0.01569294460170756
in-drivable-lane_max5.349999999999985
in-drivable-lane_mean2.937499999999991
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.5004277912075634, "survival_time": 6.249999999999986, "driven_lanedir": 0.12617004396451303, "in-drivable-lane": 5.349999999999985, "deviation-heading": 0.6433235038763937, "distance-from-start": 1.4519766372087843, "deviation-center-line": 0.06242193249045773, "driven_lanedir_consec": 0.12617004396451303}, "zigzag-000-ego1": {"driven_any": 1.1988908619502123, "survival_time": 6.249999999999986, "driven_lanedir": 0.6030746198319723, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 0.8203168186811655, "distance-from-start": 1.161300398666676, "deviation-center-line": 0.12315403578689048, "driven_lanedir_consec": 0.6030746198319723}, "zigzag-000-ego2": {"driven_any": 1.3796192704418793, "survival_time": 6.249999999999986, "driven_lanedir": 0.8523967021931922, "in-drivable-lane": 2.8499999999999908, "deviation-heading": 1.2013319722010731, "distance-from-start": 1.3589054603858166, "deviation-center-line": 0.3034749780016805, "driven_lanedir_consec": 0.8523967021931922}, "zigzag-000-ego3": {"driven_any": 0.01908615669059921, "survival_time": 6.249999999999986, "driven_lanedir": 0.01569294460170756, "in-drivable-lane": 0.0, "deviation-heading": 3.614482923882997, "distance-from-start": 0.01908363675598338, "deviation-center-line": 0.39846288906696714, "driven_lanedir_consec": 0.01569294460170756}}
simulation-passed1
survival_time_max6.249999999999986
survival_time_mean6.249999999999986
survival_time_min6.249999999999986
No reset possible
6010611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-020:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3999999999999995
in-drivable-lane_median1.4499999999999993
driven_lanedir_consec_median0.15219653474417605
deviation-center-line_median0.0695773432379611


other stats
deviation-center-line_max0.0695773432379611
deviation-center-line_mean0.0695773432379611
deviation-center-line_min0.0695773432379611
deviation-heading_max0.6210146553308086
deviation-heading_mean0.6210146553308086
deviation-heading_median0.6210146553308086
deviation-heading_min0.6210146553308086
distance-from-start_max0.43583273761969793
distance-from-start_mean0.43583273761969793
distance-from-start_median0.43583273761969793
distance-from-start_min0.43583273761969793
driven_any_max0.43594990280848417
driven_any_mean0.43594990280848417
driven_any_median0.43594990280848417
driven_any_min0.43594990280848417
driven_lanedir_consec_max0.15219653474417605
driven_lanedir_consec_mean0.15219653474417605
driven_lanedir_consec_min0.15219653474417605
driven_lanedir_max0.15219653474417605
driven_lanedir_mean0.15219653474417605
driven_lanedir_median0.15219653474417605
driven_lanedir_min0.15219653474417605
in-drivable-lane_max1.4499999999999993
in-drivable-lane_mean1.4499999999999993
in-drivable-lane_min1.4499999999999993
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.43594990280848417, "survival_time": 2.3999999999999995, "driven_lanedir": 0.15219653474417605, "in-drivable-lane": 1.4499999999999993, "deviation-heading": 0.6210146553308086, "distance-from-start": 0.43583273761969793, "deviation-center-line": 0.0695773432379611, "driven_lanedir_consec": 0.15219653474417605}}
simulation-passed1
survival_time_max2.3999999999999995
survival_time_mean2.3999999999999995
survival_time_min2.3999999999999995
No reset possible
5981618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-020:14:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median6.8749999999997975
driven_lanedir_consec_median5.783139149391309
deviation-center-line_median3.644957791251009


other stats
deviation-center-line_max4.609775368681403
deviation-center-line_mean3.826865861436436
deviation-center-line_min3.407772494562325
deviation-heading_max15.530852313897212
deviation-heading_mean13.91403183798198
deviation-heading_median13.886284137874956
deviation-heading_min12.3527067622808
distance-from-start_max3.9567823731252574
distance-from-start_mean3.266967809804136
distance-from-start_median3.153636532725061
distance-from-start_min2.803815800641165
driven_any_max7.914196025040705
driven_any_mean7.914132320789741
driven_any_median7.914155490271685
driven_any_min7.914022277574889
driven_lanedir_consec_max6.653404461763989
driven_lanedir_consec_mean5.453815893602205
driven_lanedir_consec_min3.595580813862214
driven_lanedir_max6.7587307457049
driven_lanedir_mean6.527739575191516
driven_lanedir_median6.562293536417327
driven_lanedir_min6.227640482226512
in-drivable-lane_max8.399999999999608
in-drivable-lane_mean6.7999999999997875
in-drivable-lane_min5.049999999999948
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.91414087905068, "survival_time": 59.99999999999873, "driven_lanedir": 6.7587307457049, "in-drivable-lane": 5.049999999999948, "deviation-heading": 14.55979436621905, "distance-from-start": 2.803815800641165, "deviation-center-line": 3.407772494562325, "driven_lanedir_consec": 5.996394598160945}, "zigzag-000-ego1": {"driven_any": 7.914196025040705, "survival_time": 59.99999999999873, "driven_lanedir": 6.653404461763989, "in-drivable-lane": 6.549999999999783, "deviation-heading": 12.3527067622808, "distance-from-start": 3.1854603345610566, "deviation-center-line": 4.609775368681403, "driven_lanedir_consec": 6.653404461763989}, "zigzag-000-ego2": {"driven_any": 7.91417010149269, "survival_time": 59.99999999999873, "driven_lanedir": 6.471182611070665, "in-drivable-lane": 7.199999999999811, "deviation-heading": 13.212773909530862, "distance-from-start": 3.121812730889066, "deviation-center-line": 3.4213818080677543, "driven_lanedir_consec": 3.595580813862214}, "zigzag-000-ego3": {"driven_any": 7.914022277574889, "survival_time": 59.99999999999873, "driven_lanedir": 6.227640482226512, "in-drivable-lane": 8.399999999999608, "deviation-heading": 15.530852313897212, "distance-from-start": 3.9567823731252574, "deviation-center-line": 3.8685337744342623, "driven_lanedir_consec": 5.5698837006216735}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5979619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.249999999999982
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7725904197808788
deviation-center-line_median0.5396222928439485


other stats
deviation-center-line_max0.5396222928439485
deviation-center-line_mean0.5396222928439485
deviation-center-line_min0.5396222928439485
deviation-heading_max1.8793666422285111
deviation-heading_mean1.8793666422285111
deviation-heading_median1.8793666422285111
deviation-heading_min1.8793666422285111
distance-from-start_max0.624036016299673
distance-from-start_mean0.624036016299673
distance-from-start_median0.624036016299673
distance-from-start_min0.624036016299673
driven_any_max0.8112127063959571
driven_any_mean0.8112127063959571
driven_any_median0.8112127063959571
driven_any_min0.8112127063959571
driven_lanedir_consec_max0.7725904197808788
driven_lanedir_consec_mean0.7725904197808788
driven_lanedir_consec_min0.7725904197808788
driven_lanedir_max0.7725904197808788
driven_lanedir_mean0.7725904197808788
driven_lanedir_median0.7725904197808788
driven_lanedir_min0.7725904197808788
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8112127063959571, "survival_time": 7.249999999999982, "driven_lanedir": 0.7725904197808788, "in-drivable-lane": 0.0, "deviation-heading": 1.8793666422285111, "distance-from-start": 0.624036016299673, "deviation-center-line": 0.5396222928439485, "driven_lanedir_consec": 0.7725904197808788}}
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean7.249999999999982
survival_time_min7.249999999999982
No reset possible
5971621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-020:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.700000000000074
in-drivable-lane_median1.850000000000013
driven_lanedir_consec_median0.8860773293359598
deviation-center-line_median1.0503838768945215


other stats
deviation-center-line_max1.0503838768945215
deviation-center-line_mean1.0503838768945215
deviation-center-line_min1.0503838768945215
deviation-heading_max3.3726716296307395
deviation-heading_mean3.3726716296307395
deviation-heading_median3.3726716296307395
deviation-heading_min3.3726716296307395
distance-from-start_max0.6478286432603754
distance-from-start_mean0.6478286432603754
distance-from-start_median0.6478286432603754
distance-from-start_min0.6478286432603754
driven_any_max1.806909960856241
driven_any_mean1.806909960856241
driven_any_median1.806909960856241
driven_any_min1.806909960856241
driven_lanedir_consec_max0.8860773293359598
driven_lanedir_consec_mean0.8860773293359598
driven_lanedir_consec_min0.8860773293359598
driven_lanedir_max1.48657419151416
driven_lanedir_mean1.48657419151416
driven_lanedir_median1.48657419151416
driven_lanedir_min1.48657419151416
in-drivable-lane_max1.850000000000013
in-drivable-lane_mean1.850000000000013
in-drivable-lane_min1.850000000000013
per-episodes
details{"udem-000-ego0": {"driven_any": 1.806909960856241, "survival_time": 14.700000000000074, "driven_lanedir": 1.48657419151416, "in-drivable-lane": 1.850000000000013, "deviation-heading": 3.3726716296307395, "distance-from-start": 0.6478286432603754, "deviation-center-line": 1.0503838768945215, "driven_lanedir_consec": 0.8860773293359598}}
simulation-passed1
survival_time_max14.700000000000074
survival_time_mean14.700000000000074
survival_time_min14.700000000000074
No reset possible
5969621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5963625Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:07:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.150000000000254
in-drivable-lane_median0.7250000000000012
driven_lanedir_consec_median2.220950853067273
deviation-center-line_median1.6310503744113074


other stats
deviation-center-line_max2.27140149411102
deviation-center-line_mean1.5115499120191818
deviation-center-line_min0.5126974051430926
deviation-heading_max20.897170154090276
deviation-heading_mean8.10917298360102
deviation-heading_median5.137568083824412
deviation-heading_min1.2643856126649764
distance-from-start_max2.6421931889881867
distance-from-start_mean1.5111162987836586
distance-from-start_median1.701136003073224
distance-from-start_min2.482534153247273e-16
driven_any_max4.25666091498915
driven_any_mean2.3991760180166346
driven_any_median2.670021578538611
driven_any_min1.6459201436029336e-13
driven_lanedir_consec_max3.332193518429845
driven_lanedir_consec_mean1.9435238061410975
driven_lanedir_consec_min0.0
driven_lanedir_max3.672922511952528
driven_lanedir_mean2.1649772421920805
driven_lanedir_median2.493493228407897
driven_lanedir_min0.0
in-drivable-lane_max3.2000000000000455
in-drivable-lane_mean1.162500000000012
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 4.25666091498915, "survival_time": 33.150000000000254, "driven_lanedir": 3.672922511952528, "in-drivable-lane": 3.2000000000000455, "deviation-heading": 5.043930177851429, "distance-from-start": 2.6421931889881867, "deviation-center-line": 2.27140149411102, "driven_lanedir_consec": 3.332193518429845}, "loop-000-ego1": {"driven_any": 3.420149220609966, "survival_time": 33.150000000000254, "driven_lanedir": 3.074008963525806, "in-drivable-lane": 1.4500000000000024, "deviation-heading": 5.231205989797394, "distance-from-start": 1.98741272862672, "deviation-center-line": 1.7358401508694576, "driven_lanedir_consec": 2.528924212844558}, "loop-000-ego2": {"driven_any": 1.9198939364672567, "survival_time": 33.150000000000254, "driven_lanedir": 1.9129774932899877, "in-drivable-lane": 0.0, "deviation-heading": 1.2643856126649764, "distance-from-start": 1.4148592775197284, "deviation-center-line": 0.5126974051430926, "driven_lanedir_consec": 1.9129774932899877}, "loop-000-ego3": {"driven_any": 1.6459201436029336e-13, "survival_time": 33.150000000000254, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 20.897170154090276, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 1.5262605979531572, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max33.150000000000254
survival_time_mean33.150000000000254
survival_time_min33.150000000000254
No reset possible
5947648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-020:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.79999999999889
driven_lanedir_consec_median0.2696930719897126
deviation-center-line_median0.792601083085307


other stats
deviation-center-line_max0.792601083085307
deviation-center-line_mean0.792601083085307
deviation-center-line_min0.792601083085307
deviation-heading_max4.495311222482838
deviation-heading_mean4.495311222482838
deviation-heading_median4.495311222482838
deviation-heading_min4.495311222482838
distance-from-start_max0.507208581058995
distance-from-start_mean0.507208581058995
distance-from-start_median0.507208581058995
distance-from-start_min0.507208581058995
driven_any_max4.5756483576159335
driven_any_mean4.5756483576159335
driven_any_median4.5756483576159335
driven_any_min4.5756483576159335
driven_lanedir_consec_max0.2696930719897126
driven_lanedir_consec_mean0.2696930719897126
driven_lanedir_consec_min0.2696930719897126
driven_lanedir_max0.2696930719897126
driven_lanedir_mean0.2696930719897126
driven_lanedir_median0.2696930719897126
driven_lanedir_min0.2696930719897126
in-drivable-lane_max53.79999999999889
in-drivable-lane_mean53.79999999999889
in-drivable-lane_min53.79999999999889
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.5756483576159335, "survival_time": 59.99999999999873, "driven_lanedir": 0.2696930719897126, "in-drivable-lane": 53.79999999999889, "deviation-heading": 4.495311222482838, "distance-from-start": 0.507208581058995, "deviation-center-line": 0.792601083085307, "driven_lanedir_consec": 0.2696930719897126}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5933650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-020:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median47.44999999999861
driven_lanedir_consec_median0.9117694699509472
deviation-center-line_median1.031159832678499


other stats
deviation-center-line_max1.031159832678499
deviation-center-line_mean1.031159832678499
deviation-center-line_min1.031159832678499
deviation-heading_max9.445300293187191
deviation-heading_mean9.445300293187191
deviation-heading_median9.445300293187191
deviation-heading_min9.445300293187191
distance-from-start_max0.3772444909583472
distance-from-start_mean0.3772444909583472
distance-from-start_median0.3772444909583472
distance-from-start_min0.3772444909583472
driven_any_max6.959579633092092
driven_any_mean6.959579633092092
driven_any_median6.959579633092092
driven_any_min6.959579633092092
driven_lanedir_consec_max0.9117694699509472
driven_lanedir_consec_mean0.9117694699509472
driven_lanedir_consec_min0.9117694699509472
driven_lanedir_max0.9117694699509472
driven_lanedir_mean0.9117694699509472
driven_lanedir_median0.9117694699509472
driven_lanedir_min0.9117694699509472
in-drivable-lane_max47.44999999999861
in-drivable-lane_mean47.44999999999861
in-drivable-lane_min47.44999999999861
per-episodes
details{"udem1-000-ego0": {"driven_any": 6.959579633092092, "survival_time": 59.99999999999873, "driven_lanedir": 0.9117694699509472, "in-drivable-lane": 47.44999999999861, "deviation-heading": 9.445300293187191, "distance-from-start": 0.3772444909583472, "deviation-center-line": 1.031159832678499, "driven_lanedir_consec": 0.9117694699509472}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5909653Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:15:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median43.97499999999883
driven_lanedir_consec_median1.0486819878335374
deviation-center-line_median0.8846623408446322


other stats
deviation-center-line_max2.7624626207296523
deviation-center-line_mean1.2922560704333188
deviation-center-line_min0.637236979314359
deviation-heading_max37.82293240559152
deviation-heading_mean17.199165913664984
deviation-heading_median12.14594461518937
deviation-heading_min6.681842018689667
distance-from-start_max1.469911933211819
distance-from-start_mean0.6125016115980991
distance-from-start_median0.49004725659028847
distance-from-start_min2.482534153247273e-16
driven_any_max9.004913549832464
driven_any_mean5.688977124604843
driven_any_median6.875497474293304
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max1.492169895692025
driven_lanedir_consec_mean0.897383467839775
driven_lanedir_consec_min0.0
driven_lanedir_max1.492169895692025
driven_lanedir_mean0.8975248982979318
driven_lanedir_median1.048964848749851
driven_lanedir_min0.0
in-drivable-lane_max52.1999999999987
in-drivable-lane_mean35.037499999999085
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 8.45605201563336, "survival_time": 59.99999999999873, "driven_lanedir": 1.4882957575499227, "in-drivable-lane": 38.14999999999901, "deviation-heading": 17.34768530727425, "distance-from-start": 1.469911933211819, "deviation-center-line": 0.9710133187243716, "driven_lanedir_consec": 1.4882957575499227}, "loop-000-ego1": {"driven_any": 9.004913549832464, "survival_time": 59.99999999999873, "driven_lanedir": 0.6096339399497792, "in-drivable-lane": 52.1999999999987, "deviation-heading": 6.681842018689667, "distance-from-start": 0.4415315786625899, "deviation-center-line": 0.637236979314359, "driven_lanedir_consec": 0.6090682181171518}, "loop-000-ego2": {"driven_any": 5.29494293295325, "survival_time": 59.99999999999873, "driven_lanedir": 1.492169895692025, "in-drivable-lane": 49.79999999999865, "deviation-heading": 6.94420392310449, "distance-from-start": 0.538562934517987, "deviation-center-line": 0.798311362964893, "driven_lanedir_consec": 1.492169895692025}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5907654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-020:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.55000000000003
in-drivable-lane_median6.10000000000002
driven_lanedir_consec_median0.4348914359933298
deviation-center-line_median0.4053162217690238


other stats
deviation-center-line_max0.4053162217690238
deviation-center-line_mean0.4053162217690238
deviation-center-line_min0.4053162217690238
deviation-heading_max3.87910346013022
deviation-heading_mean3.87910346013022
deviation-heading_median3.87910346013022
deviation-heading_min3.87910346013022
distance-from-start_max0.19363567092331355
distance-from-start_mean0.19363567092331355
distance-from-start_median0.19363567092331355
distance-from-start_min0.19363567092331355
driven_any_max1.330797673467701
driven_any_mean1.330797673467701
driven_any_median1.330797673467701
driven_any_min1.330797673467701
driven_lanedir_consec_max0.4348914359933298
driven_lanedir_consec_mean0.4348914359933298
driven_lanedir_consec_min0.4348914359933298
driven_lanedir_max0.4348914359933298
driven_lanedir_mean0.4348914359933298
driven_lanedir_median0.4348914359933298
driven_lanedir_min0.4348914359933298
in-drivable-lane_max6.10000000000002
in-drivable-lane_mean6.10000000000002
in-drivable-lane_min6.10000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.330797673467701, "survival_time": 11.55000000000003, "driven_lanedir": 0.4348914359933298, "in-drivable-lane": 6.10000000000002, "deviation-heading": 3.87910346013022, "distance-from-start": 0.19363567092331355, "deviation-center-line": 0.4053162217690238, "driven_lanedir_consec": 0.4348914359933298}}
simulation-passed1
survival_time_max11.55000000000003
survival_time_mean11.55000000000003
survival_time_min11.55000000000003
No reset possible
5905654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-020:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.6500000000001
in-drivable-lane_median8.50000000000006
driven_lanedir_consec_median0.9179853804193344
deviation-center-line_median0.5954077272045879


other stats
deviation-center-line_max0.5954077272045879
deviation-center-line_mean0.5954077272045879
deviation-center-line_min0.5954077272045879
deviation-heading_max5.937124093559925
deviation-heading_mean5.937124093559925
deviation-heading_median5.937124093559925
deviation-heading_min5.937124093559925
distance-from-start_max0.2685023148169614
distance-from-start_mean0.2685023148169614
distance-from-start_median0.2685023148169614
distance-from-start_min0.2685023148169614
driven_any_max2.8868533447935136
driven_any_mean2.8868533447935136
driven_any_median2.8868533447935136
driven_any_min2.8868533447935136
driven_lanedir_consec_max0.9179853804193344
driven_lanedir_consec_mean0.9179853804193344
driven_lanedir_consec_min0.9179853804193344
driven_lanedir_max0.9179853804193344
driven_lanedir_mean0.9179853804193344
driven_lanedir_median0.9179853804193344
driven_lanedir_min0.9179853804193344
in-drivable-lane_max8.50000000000006
in-drivable-lane_mean8.50000000000006
in-drivable-lane_min8.50000000000006
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.8868533447935136, "survival_time": 16.6500000000001, "driven_lanedir": 0.9179853804193344, "in-drivable-lane": 8.50000000000006, "deviation-heading": 5.937124093559925, "distance-from-start": 0.2685023148169614, "deviation-center-line": 0.5954077272045879, "driven_lanedir_consec": 0.9179853804193344}}
simulation-passed1
survival_time_max16.6500000000001
survival_time_mean16.6500000000001
survival_time_min16.6500000000001
No reset possible
5902655Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-1of4successnogpu-staging-spot-0-020:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.149999999999997
in-drivable-lane_median1.149999999999996
driven_lanedir_consec_median0.3493860683581915
deviation-center-line_median0.10198879776348292


other stats
deviation-center-line_max0.10198879776348292
deviation-center-line_mean0.10198879776348292
deviation-center-line_min0.10198879776348292
deviation-heading_max0.9746116701063742
deviation-heading_mean0.9746116701063742
deviation-heading_median0.9746116701063742
deviation-heading_min0.9746116701063742
distance-from-start_max0.4407373082713003
distance-from-start_mean0.4407373082713003
distance-from-start_median0.4407373082713003
distance-from-start_min0.4407373082713003
driven_any_max0.5303834970348619
driven_any_mean0.5303834970348619
driven_any_median0.5303834970348619
driven_any_min0.5303834970348619
driven_lanedir_consec_max0.3493860683581915
driven_lanedir_consec_mean0.3493860683581915
driven_lanedir_consec_min0.3493860683581915
driven_lanedir_max0.3493860683581915
driven_lanedir_mean0.3493860683581915
driven_lanedir_median0.3493860683581915
driven_lanedir_min0.3493860683581915
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean1.149999999999996
in-drivable-lane_min1.149999999999996
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5303834970348619, "survival_time": 3.149999999999997, "driven_lanedir": 0.3493860683581915, "in-drivable-lane": 1.149999999999996, "deviation-heading": 0.9746116701063742, "distance-from-start": 0.4407373082713003, "deviation-center-line": 0.10198879776348292, "driven_lanedir_consec": 0.3493860683581915}}
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean3.149999999999997
survival_time_min3.149999999999997
No reset possible
5894656Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-1of4successnogpu-staging-spot-0-020:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.649999999999995
in-drivable-lane_median2.0499999999999945
driven_lanedir_consec_median0.15842790513860328
deviation-center-line_median0.07354978277627106


other stats
deviation-center-line_max0.07354978277627106
deviation-center-line_mean0.07354978277627106
deviation-center-line_min0.07354978277627106
deviation-heading_max1.0348347393250272
deviation-heading_mean1.0348347393250272
deviation-heading_median1.0348347393250272
deviation-heading_min1.0348347393250272
distance-from-start_max0.299551059788989
distance-from-start_mean0.299551059788989
distance-from-start_median0.299551059788989
distance-from-start_min0.299551059788989
driven_any_max0.5263753556600527
driven_any_mean0.5263753556600527
driven_any_median0.5263753556600527
driven_any_min0.5263753556600527
driven_lanedir_consec_max0.15842790513860328
driven_lanedir_consec_mean0.15842790513860328
driven_lanedir_consec_min0.15842790513860328
driven_lanedir_max0.15842790513860328
driven_lanedir_mean0.15842790513860328
driven_lanedir_median0.15842790513860328
driven_lanedir_min0.15842790513860328
in-drivable-lane_max2.0499999999999945
in-drivable-lane_mean2.0499999999999945
in-drivable-lane_min2.0499999999999945
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5263753556600527, "survival_time": 3.649999999999995, "driven_lanedir": 0.15842790513860328, "in-drivable-lane": 2.0499999999999945, "deviation-heading": 1.0348347393250272, "distance-from-start": 0.299551059788989, "deviation-center-line": 0.07354978277627106, "driven_lanedir_consec": 0.15842790513860328}}
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.649999999999995
survival_time_min3.649999999999995
No reset possible
5886657Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-020:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.99999999999999
in-drivable-lane_median2.649999999999994
driven_lanedir_consec_median0.11677661518847147
deviation-center-line_median0.0423779658869845


other stats
deviation-center-line_max0.0423779658869845
deviation-center-line_mean0.0423779658869845
deviation-center-line_min0.0423779658869845
deviation-heading_max1.6013173610056586
deviation-heading_mean1.6013173610056586
deviation-heading_median1.6013173610056586
deviation-heading_min1.6013173610056586
distance-from-start_max0.10035666284965382
distance-from-start_mean0.10035666284965382
distance-from-start_median0.10035666284965382
distance-from-start_min0.10035666284965382
driven_any_max0.2710570776986369
driven_any_mean0.2710570776986369
driven_any_median0.2710570776986369
driven_any_min0.2710570776986369
driven_lanedir_consec_max0.11677661518847147
driven_lanedir_consec_mean0.11677661518847147
driven_lanedir_consec_min0.11677661518847147
driven_lanedir_max0.11677661518847147
driven_lanedir_mean0.11677661518847147
driven_lanedir_median0.11677661518847147
driven_lanedir_min0.11677661518847147
in-drivable-lane_max2.649999999999994
in-drivable-lane_mean2.649999999999994
in-drivable-lane_min2.649999999999994
per-episodes
details{"4way-000-ego0": {"driven_any": 0.2710570776986369, "survival_time": 4.99999999999999, "driven_lanedir": 0.11677661518847147, "in-drivable-lane": 2.649999999999994, "deviation-heading": 1.6013173610056586, "distance-from-start": 0.10035666284965382, "deviation-center-line": 0.0423779658869845, "driven_lanedir_consec": 0.11677661518847147}}
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_min4.99999999999999
No reset possible
5883657Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-020:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5874660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-0of4failednogpu-staging-spot-0-020:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5868662Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-3of4failednogpu-staging-spot-0-020:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5863663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5856664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5851666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5847667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5841668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failednogpu-staging-spot-0-020:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5836669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5832670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-0of4failednogpu-staging-spot-0-020:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5828671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5816673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5801706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-020:08:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.24999999999968
in-drivable-lane_median30.94999999999972
driven_lanedir_consec_median0.21786067233483597
deviation-center-line_median1.03377506159595


other stats
deviation-center-line_max1.03377506159595
deviation-center-line_mean1.03377506159595
deviation-center-line_min1.03377506159595
deviation-heading_max10.709657934936162
deviation-heading_mean10.709657934936162
deviation-heading_median10.709657934936162
deviation-heading_min10.709657934936162
distance-from-start_max1.009340436005919
distance-from-start_mean1.009340436005919
distance-from-start_median1.009340436005919
distance-from-start_min1.009340436005919
driven_any_max10.497249092993233
driven_any_mean10.497249092993233
driven_any_median10.497249092993233
driven_any_min10.497249092993233
driven_lanedir_consec_max0.21786067233483597
driven_lanedir_consec_mean0.21786067233483597
driven_lanedir_consec_min0.21786067233483597
driven_lanedir_max0.19985118839069793
driven_lanedir_mean0.19985118839069793
driven_lanedir_median0.19985118839069793
driven_lanedir_min0.19985118839069793
in-drivable-lane_max30.94999999999972
in-drivable-lane_mean30.94999999999972
in-drivable-lane_min30.94999999999972
per-episodes
details{"4way-000-ego0": {"driven_any": 10.497249092993233, "survival_time": 43.24999999999968, "driven_lanedir": 0.19985118839069793, "in-drivable-lane": 30.94999999999972, "deviation-heading": 10.709657934936162, "distance-from-start": 1.009340436005919, "deviation-center-line": 1.03377506159595, "driven_lanedir_consec": 0.21786067233483597}}
simulation-passed1
survival_time_max43.24999999999968
survival_time_mean43.24999999999968
survival_time_min43.24999999999968
No reset possible
5792709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-0of4successnogpu-staging-spot-0-020:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.75000000000022
in-drivable-lane_median29.825000000000212
driven_lanedir_consec_median0.21731228142323933
deviation-center-line_median0.3331807431846997


other stats
deviation-center-line_max0.7655512378412563
deviation-center-line_mean0.379245390698747
deviation-center-line_min0.0850688385843324
deviation-heading_max5.708723015945328
deviation-heading_mean2.8582267855416443
deviation-heading_median2.247219992369361
deviation-heading_min1.229744141482529
distance-from-start_max0.9340577697896516
distance-from-start_mean0.6073071039932331
distance-from-start_median0.5461575079396492
distance-from-start_min0.4028556303039823
driven_any_max8.310583890769195
driven_any_mean3.410525124545609
driven_any_median2.453720078564638
driven_any_min0.4240764502839678
driven_lanedir_consec_max0.3926134494082678
driven_lanedir_consec_mean0.2327684277313727
driven_lanedir_consec_min0.10383569867074448
driven_lanedir_max0.3926134494082678
driven_lanedir_mean0.2281267458150863
driven_lanedir_median0.21016777279894416
driven_lanedir_min0.09955798825418904
in-drivable-lane_max31.650000000000222
in-drivable-lane_mean29.125000000000213
in-drivable-lane_min25.2000000000002
per-episodes
details{"udem-000-ego0": {"driven_any": 8.310583890769195, "survival_time": 33.75000000000022, "driven_lanedir": 0.25382856508768814, "in-drivable-lane": 25.2000000000002, "deviation-heading": 5.708723015945328, "distance-from-start": 0.9340577697896516, "deviation-center-line": 0.7655512378412563, "driven_lanedir_consec": 0.2718370953578422}, "udem-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 33.75000000000022, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 31.650000000000222, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "udem-000-ego2": {"driven_any": 2.4390062983425578, "survival_time": 33.75000000000022, "driven_lanedir": 0.1665069805102002, "in-drivable-lane": 29.350000000000215, "deviation-heading": 2.144336915325389, "distance-from-start": 0.5461575079396477, "deviation-center-line": 0.3777614073769809, "driven_lanedir_consec": 0.16278746748863648}, "udem-000-ego3": {"driven_any": 2.4684338587867183, "survival_time": 33.75000000000022, "driven_lanedir": 0.09955798825418904, "in-drivable-lane": 30.30000000000021, "deviation-heading": 2.350103069413333, "distance-from-start": 0.5461575079396509, "deviation-center-line": 0.2886000789924186, "driven_lanedir_consec": 0.10383569867074448}}
simulation-passed1
survival_time_max33.75000000000022
survival_time_mean33.75000000000022
survival_time_min33.75000000000022
No reset possible
5789709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5781711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-020:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.70000000000028
in-drivable-lane_median26.450000000000227
driven_lanedir_consec_median0.01242473178359728
deviation-center-line_median0.584969651111141


other stats
deviation-center-line_max0.584969651111141
deviation-center-line_mean0.584969651111141
deviation-center-line_min0.584969651111141
deviation-heading_max4.775258874675082
deviation-heading_mean4.775258874675082
deviation-heading_median4.775258874675082
deviation-heading_min4.775258874675082
distance-from-start_max0.9340577697896082
distance-from-start_mean0.9340577697896082
distance-from-start_median0.9340577697896082
distance-from-start_min0.9340577697896082
driven_any_max8.108127605402737
driven_any_mean8.108127605402737
driven_any_median8.108127605402737
driven_any_min8.108127605402737
driven_lanedir_consec_max0.01242473178359728
driven_lanedir_consec_mean0.01242473178359728
driven_lanedir_consec_min0.01242473178359728
driven_lanedir_max0.015771073882231215
driven_lanedir_mean0.015771073882231215
driven_lanedir_median0.015771073882231215
driven_lanedir_min0.015771073882231215
in-drivable-lane_max26.450000000000227
in-drivable-lane_mean26.450000000000227
in-drivable-lane_min26.450000000000227
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.108127605402737, "survival_time": 32.70000000000028, "driven_lanedir": 0.015771073882231215, "in-drivable-lane": 26.450000000000227, "deviation-heading": 4.775258874675082, "distance-from-start": 0.9340577697896082, "deviation-center-line": 0.584969651111141, "driven_lanedir_consec": 0.01242473178359728}}
simulation-passed1
survival_time_max32.70000000000028
survival_time_mean32.70000000000028
survival_time_min32.70000000000028
No reset possible
5762732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-020:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-4.299721525491407e-05
deviation-center-line_median1.511718550059415


other stats
deviation-center-line_max2.9467617678498437
deviation-center-line_mean1.5769838576829665
deviation-center-line_min0.33773656276319197
deviation-heading_max32.249113233675025
deviation-heading_mean22.839465954359294
deviation-heading_median22.597238933513907
deviation-heading_min13.91427271673436
distance-from-start_max9.155133597044477e-16
distance-from-start_mean5.3805908476715e-16
distance-from-start_median6.183614896820762e-16
distance-from-start_min0.0
driven_any_max1.0986160316453499e-12
driven_any_mean6.456709017205911e-13
driven_any_median7.420337876185071e-13
driven_any_min0.0
driven_lanedir_consec_max4.4323372971888375e-06
driven_lanedir_consec_mean-9.191609703362856e-05
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max4.4323372971888375e-06
driven_lanedir_mean-9.191609703362856e-05
driven_lanedir_median-4.299721525491407e-05
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -8.599443050982813e-05, "in-drivable-lane": 0.0, "deviation-heading": 30.71291327085948, "distance-from-start": 0.0, "deviation-center-line": 2.1284946700229703, "driven_lanedir_consec": -8.599443050982813e-05}, "zigzag-000-ego2": {"driven_any": 1.084387286371958e-12, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 9.036560719766057e-16, "deviation-center-line": 2.9467617678498437, "driven_lanedir_consec": -0.000286102294921875}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5752735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-020:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948943425963037


other stats
deviation-center-line_max0.8948943425963037
deviation-center-line_mean0.8948943425963037
deviation-center-line_min0.8948943425963037
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.3877787807814454e-16
distance-from-start_mean1.3877787807814454e-16
distance-from-start_median1.3877787807814454e-16
distance-from-start_min1.3877787807814454e-16
driven_any_max1.665334536937735e-13
driven_any_mean1.665334536937735e-13
driven_any_median1.665334536937735e-13
driven_any_min1.665334536937735e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5750735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5748736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5741737Bea Baselines 🐤baseline-duckietown-mlaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-020:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median0.8949084199908882
in-drivable-lane_median0.0


other stats
deviation-center-line_max0.8949084199908882
deviation-center-line_mean0.8949084199908882
deviation-center-line_min0.8949084199908882
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.8949084199908882, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5735739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.9374516435613804


other stats
deviation-center-line_max3.4683898658648995
deviation-center-line_mean1.9374516435613804
deviation-center-line_min0.4065134212578614
deviation-heading_max40.967332753486225
deviation-heading_mean29.638380384745684
deviation-heading_median29.638380384745684
deviation-heading_min18.309428016005143
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min0.0
driven_any_max1.3322676295501878e-13
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.4065134212578614, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 0.0, "deviation-center-line": 3.4683898658648995, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5731740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-020:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.40649934386321146


other stats
deviation-center-line_max0.40649934386321146
deviation-center-line_mean0.40649934386321146
deviation-center-line_min0.40649934386321146
deviation-heading_max40.967332753486225
deviation-heading_mean40.967332753486225
deviation-heading_median40.967332753486225
deviation-heading_min40.967332753486225
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 0.0, "deviation-center-line": 0.40649934386321146, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5703749Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4failednogpu-staging-spot-0-020:01:01
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5697751Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-2of4failednogpu-staging-spot-0-020:01:11
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5688752Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-0of4failednogpu-staging-spot-0-020:02:34
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5683754Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-020:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5678755Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-020:01:01
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5672756Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:00:59
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5668757Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4failednogpu-staging-spot-0-020:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5662758Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-3of4failednogpu-staging-spot-0-020:01:12
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5653760Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-2of4failednogpu-staging-spot-0-020:01:17
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5647761Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-2of4failednogpu-staging-spot-0-020:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5642762Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-3of4failednogpu-staging-spot-0-020:00:58
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5637762Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-020:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5626633Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-3of4successnogpu-staging-spot-0-020:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573452
deviation-heading_mean11.057314603573452
deviation-heading_median11.057314603573452
deviation-heading_min11.057314603573452
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019539
driven_any_mean3.452076592019539
driven_any_median3.452076592019539
driven_any_min3.452076592019539
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5612636Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-1of4successnogpu-staging-spot-0-020:13:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.4749999999999552
driven_lanedir_consec_median3.4002821622357984
deviation-center-line_median5.992377953630339


other stats
deviation-center-line_max7.516029088900642
deviation-center-line_mean6.078065413935748
deviation-center-line_min4.81147665958167
deviation-heading_max12.168685206029926
deviation-heading_mean6.8808867794243
deviation-heading_median6.217393990233779
deviation-heading_min2.9200739311997133
distance-from-start_max3.0901348300566136
distance-from-start_mean2.5082472337191244
distance-from-start_median2.747884262658891
distance-from-start_min1.4470855795021027
driven_any_max3.549582457242765
driven_any_mean3.534964335885894
driven_any_median3.5353456174417777
driven_any_min3.5195836514172565
driven_lanedir_consec_max3.485653904322902
driven_lanedir_consec_mean3.0923220036529804
driven_lanedir_consec_min2.0830697858174214
driven_lanedir_max3.485653904322902
driven_lanedir_mean3.409680770298687
driven_lanedir_median3.4002821622357984
driven_lanedir_min3.3525048524002488
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4874999999999703
in-drivable-lane_min0.9999999999999432
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963269625904, "survival_time": 59.99999999999873, "driven_lanedir": 3.485653904322902, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200739311997133, "distance-from-start": 2.876631299535302, "deviation-center-line": 7.516029088900642, "driven_lanedir_consec": 3.485653904322902}, "autolab-000-ego1": {"driven_any": 3.524094907920965, "survival_time": 59.99999999999873, "driven_lanedir": 3.4260604158491743, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.516330158155915, "distance-from-start": 2.6191372257824805, "deviation-center-line": 6.510873598064531, "driven_lanedir_consec": 3.4260604158491743}, "autolab-000-ego2": {"driven_any": 3.549582457242765, "survival_time": 59.99999999999873, "driven_lanedir": 3.3745039086224224, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 12.168685206029926, "distance-from-start": 3.0901348300566136, "deviation-center-line": 4.81147665958167, "driven_lanedir_consec": 3.3745039086224224}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5596641Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-1of4successnogpu-staging-spot-0-020:11:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.047658018790259
deviation-center-line_median5.126485444166568


other stats
deviation-center-line_max5.126485444166568
deviation-center-line_mean5.126485444166568
deviation-center-line_min5.126485444166568
deviation-heading_max11.28545261059378
deviation-heading_mean11.28545261059378
deviation-heading_median11.28545261059378
deviation-heading_min11.28545261059378
distance-from-start_max1.221190637429476
distance-from-start_mean1.221190637429476
distance-from-start_median1.221190637429476
distance-from-start_min1.221190637429476
driven_any_max3.44907658257651
driven_any_mean3.44907658257651
driven_any_median3.44907658257651
driven_any_min3.44907658257651
driven_lanedir_consec_max2.047658018790259
driven_lanedir_consec_mean2.047658018790259
driven_lanedir_consec_min2.047658018790259
driven_lanedir_max3.1600582421938994
driven_lanedir_mean3.1600582421938994
driven_lanedir_median3.1600582421938994
driven_lanedir_min3.1600582421938994
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.44907658257651, "survival_time": 59.99999999999873, "driven_lanedir": 3.1600582421938994, "in-drivable-lane": 4.349999999999895, "deviation-heading": 11.28545261059378, "distance-from-start": 1.221190637429476, "deviation-center-line": 5.126485444166568, "driven_lanedir_consec": 2.047658018790259}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5589674Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnogpu-staging-spot-0-020:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.833625978773518
deviation-center-line_median0.2109719022502864


other stats
deviation-center-line_max0.2109719022502864
deviation-center-line_mean0.2109719022502864
deviation-center-line_min0.2109719022502864
deviation-heading_max1.8837432004186612
deviation-heading_mean1.8837432004186612
deviation-heading_median1.8837432004186612
deviation-heading_min1.8837432004186612
distance-from-start_max2.0412677228822265
distance-from-start_mean2.0412677228822265
distance-from-start_median2.0412677228822265
distance-from-start_min2.0412677228822265
driven_any_max5.844418063649684
driven_any_mean5.844418063649684
driven_any_median5.844418063649684
driven_any_min5.844418063649684
driven_lanedir_consec_max5.833625978773518
driven_lanedir_consec_mean5.833625978773518
driven_lanedir_consec_min5.833625978773518
driven_lanedir_max5.833625978773518
driven_lanedir_mean5.833625978773518
driven_lanedir_median5.833625978773518
driven_lanedir_min5.833625978773518
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.844418063649684, "survival_time": 59.99999999999873, "driven_lanedir": 5.833625978773518, "in-drivable-lane": 0.0, "deviation-heading": 1.8837432004186612, "distance-from-start": 2.0412677228822265, "deviation-center-line": 0.2109719022502864, "driven_lanedir_consec": 5.833625978773518}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5582675Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.264594837893251
deviation-center-line_median0.28403774670947396


other stats
deviation-center-line_max0.28403774670947396
deviation-center-line_mean0.28403774670947396
deviation-center-line_min0.28403774670947396
deviation-heading_max2.5503075981833923
deviation-heading_mean2.5503075981833923
deviation-heading_median2.5503075981833923
deviation-heading_min2.5503075981833923
distance-from-start_max2.335178961035186
distance-from-start_mean2.335178961035186
distance-from-start_median2.335178961035186
distance-from-start_min2.335178961035186
driven_any_max5.798216571405931
driven_any_mean5.798216571405931
driven_any_median5.798216571405931
driven_any_min5.798216571405931
driven_lanedir_consec_max5.264594837893251
driven_lanedir_consec_mean5.264594837893251
driven_lanedir_consec_min5.264594837893251
driven_lanedir_max5.785255183788413
driven_lanedir_mean5.785255183788413
driven_lanedir_median5.785255183788413
driven_lanedir_min5.785255183788413
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.798216571405931, "survival_time": 59.99999999999873, "driven_lanedir": 5.785255183788413, "in-drivable-lane": 0.0, "deviation-heading": 2.5503075981833923, "distance-from-start": 2.335178961035186, "deviation-center-line": 0.28403774670947396, "driven_lanedir_consec": 5.264594837893251}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5571677Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.331344237139176
deviation-center-line_median0.14341993721660595


other stats
deviation-center-line_max0.14341993721660595
deviation-center-line_mean0.14341993721660595
deviation-center-line_min0.14341993721660595
deviation-heading_max1.3020944572743824
deviation-heading_mean1.3020944572743824
deviation-heading_median1.3020944572743824
deviation-heading_min1.3020944572743824
distance-from-start_max2.952739272534191
distance-from-start_mean2.952739272534191
distance-from-start_median2.952739272534191
distance-from-start_min2.952739272534191
driven_any_max5.629455349358906
driven_any_mean5.629455349358906
driven_any_median5.629455349358906
driven_any_min5.629455349358906
driven_lanedir_consec_max5.331344237139176
driven_lanedir_consec_mean5.331344237139176
driven_lanedir_consec_min5.331344237139176
driven_lanedir_max5.62600246220405
driven_lanedir_mean5.62600246220405
driven_lanedir_median5.62600246220405
driven_lanedir_min5.62600246220405
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.629455349358906, "survival_time": 59.99999999999873, "driven_lanedir": 5.62600246220405, "in-drivable-lane": 0.0, "deviation-heading": 1.3020944572743824, "distance-from-start": 2.952739272534191, "deviation-center-line": 0.14341993721660595, "driven_lanedir_consec": 5.331344237139176}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5569679Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnogpu-staging-spot-0-020:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.750000000000117
in-drivable-lane_median0.0
driven_lanedir_consec_median1.53847507295702
deviation-center-line_median0.16257777325206482


other stats
deviation-center-line_max0.16257777325206482
deviation-center-line_mean0.16257777325206482
deviation-center-line_min0.16257777325206482
deviation-heading_max1.4712837581470402
deviation-heading_mean1.4712837581470402
deviation-heading_median1.4712837581470402
deviation-heading_min1.4712837581470402
distance-from-start_max1.0671562227466285
distance-from-start_mean1.0671562227466285
distance-from-start_median1.0671562227466285
distance-from-start_min1.0671562227466285
driven_any_max1.547713297174875
driven_any_mean1.547713297174875
driven_any_median1.547713297174875
driven_any_min1.547713297174875
driven_lanedir_consec_max1.53847507295702
driven_lanedir_consec_mean1.53847507295702
driven_lanedir_consec_min1.53847507295702
driven_lanedir_max1.53847507295702
driven_lanedir_mean1.53847507295702
driven_lanedir_median1.53847507295702
driven_lanedir_min1.53847507295702
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.547713297174875, "survival_time": 17.750000000000117, "driven_lanedir": 1.53847507295702, "in-drivable-lane": 0.0, "deviation-heading": 1.4712837581470402, "distance-from-start": 1.0671562227466285, "deviation-center-line": 0.16257777325206482, "driven_lanedir_consec": 1.53847507295702}}
simulation-passed1
survival_time_max17.750000000000117
survival_time_mean17.750000000000117
survival_time_min17.750000000000117
No reset possible
5554397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-020:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.508914487410617
survival_time_median59.99999999999873
deviation-center-line_median3.7220634395679064
in-drivable-lane_median20.699999999999527


other stats
deviation-center-line_max3.7220634395679064
deviation-center-line_mean3.7220634395679064
deviation-center-line_min3.7220634395679064
deviation-heading_max24.81955583235512
deviation-heading_mean24.81955583235512
deviation-heading_median24.81955583235512
deviation-heading_min24.81955583235512
distance-from-start_max0.20119128745201284
distance-from-start_mean0.20119128745201284
distance-from-start_median0.20119128745201284
distance-from-start_min0.20119128745201284
driven_any_max14.869595278037924
driven_any_mean14.869595278037924
driven_any_median14.869595278037924
driven_any_min14.869595278037924
driven_lanedir_consec_max-3.508914487410617
driven_lanedir_consec_mean-3.508914487410617
driven_lanedir_consec_min-3.508914487410617
driven_lanedir_max-6.736372641948749
driven_lanedir_mean-6.736372641948749
driven_lanedir_median-6.736372641948749
driven_lanedir_min-6.736372641948749
in-drivable-lane_max20.699999999999527
in-drivable-lane_mean20.699999999999527
in-drivable-lane_min20.699999999999527
per-episodes
details{"zigzag-000-ego0": {"driven_any": 14.869595278037924, "survival_time": 59.99999999999873, "driven_lanedir": -6.736372641948749, "in-drivable-lane": 20.699999999999527, "deviation-heading": 24.81955583235512, "distance-from-start": 0.20119128745201284, "deviation-center-line": 3.7220634395679064, "driven_lanedir_consec": -3.508914487410617}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5545658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-2of4successnogpu-staging-spot-0-020:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4026627006405494
survival_time_median59.99999999999873
deviation-center-line_median2.2306359597243044
in-drivable-lane_median21.549999999999496


other stats
deviation-center-line_max2.2306359597243044
deviation-center-line_mean2.2306359597243044
deviation-center-line_min2.2306359597243044
deviation-heading_max26.18505006180407
deviation-heading_mean26.18505006180407
deviation-heading_median26.18505006180407
deviation-heading_min26.18505006180407
distance-from-start_max0.3696795106221189
distance-from-start_mean0.3696795106221189
distance-from-start_median0.3696795106221189
distance-from-start_min0.3696795106221189
driven_any_max7.710976944352827
driven_any_mean7.710976944352827
driven_any_median7.710976944352827
driven_any_min7.710976944352827
driven_lanedir_consec_max3.4026627006405494
driven_lanedir_consec_mean3.4026627006405494
driven_lanedir_consec_min3.4026627006405494
driven_lanedir_max3.4026627006405494
driven_lanedir_mean3.4026627006405494
driven_lanedir_median3.4026627006405494
driven_lanedir_min3.4026627006405494
in-drivable-lane_max21.549999999999496
in-drivable-lane_mean21.549999999999496
in-drivable-lane_min21.549999999999496
per-episodes
details{"loop-000-ego0": {"driven_any": 7.710976944352827, "survival_time": 59.99999999999873, "driven_lanedir": 3.4026627006405494, "in-drivable-lane": 21.549999999999496, "deviation-heading": 26.18505006180407, "distance-from-start": 0.3696795106221189, "deviation-center-line": 2.2306359597243044, "driven_lanedir_consec": 3.4026627006405494}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5531683Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4successnogpu-staging-spot-0-020:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.336853929439388
deviation-center-line_median0.1833290916203121


other stats
deviation-center-line_max0.1833290916203121
deviation-center-line_mean0.1833290916203121
deviation-center-line_min0.1833290916203121
deviation-heading_max1.3122340748484589
deviation-heading_mean1.3122340748484589
deviation-heading_median1.3122340748484589
deviation-heading_min1.3122340748484589
distance-from-start_max3.367405434986393
distance-from-start_mean3.367405434986393
distance-from-start_median3.367405434986393
distance-from-start_min3.367405434986393
driven_any_max5.634085005948749
driven_any_mean5.634085005948749
driven_any_median5.634085005948749
driven_any_min5.634085005948749
driven_lanedir_consec_max5.336853929439388
driven_lanedir_consec_mean5.336853929439388
driven_lanedir_consec_min5.336853929439388
driven_lanedir_max5.629595525675495
driven_lanedir_mean5.629595525675495
driven_lanedir_median5.629595525675495
driven_lanedir_min5.629595525675495
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.634085005948749, "survival_time": 59.99999999999873, "driven_lanedir": 5.629595525675495, "in-drivable-lane": 0.0, "deviation-heading": 1.3122340748484589, "distance-from-start": 3.367405434986393, "deviation-center-line": 0.1833290916203121, "driven_lanedir_consec": 5.336853929439388}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5517686Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-1of4successnogpu-staging-spot-0-020:10:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2066560653618428
deviation-center-line_median0.2023394713538787


other stats
deviation-center-line_max0.2023394713538787
deviation-center-line_mean0.2023394713538787
deviation-center-line_min0.2023394713538787
deviation-heading_max1.3100325783735285
deviation-heading_mean1.3100325783735285
deviation-heading_median1.3100325783735285
deviation-heading_min1.3100325783735285
distance-from-start_max1.7432818598575894
distance-from-start_mean1.7432818598575894
distance-from-start_median1.7432818598575894
distance-from-start_min1.7432818598575894
driven_any_max2.2165794083935064
driven_any_mean2.2165794083935064
driven_any_median2.2165794083935064
driven_any_min2.2165794083935064
driven_lanedir_consec_max2.2066560653618428
driven_lanedir_consec_mean2.2066560653618428
driven_lanedir_consec_min2.2066560653618428
driven_lanedir_max2.2066560653618428
driven_lanedir_mean2.2066560653618428
driven_lanedir_median2.2066560653618428
driven_lanedir_min2.2066560653618428
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.2165794083935064, "survival_time": 59.99999999999873, "driven_lanedir": 2.2066560653618428, "in-drivable-lane": 0.0, "deviation-heading": 1.3100325783735285, "distance-from-start": 1.7432818598575894, "deviation-center-line": 0.2023394713538787, "driven_lanedir_consec": 2.2066560653618428}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5508717Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655349065782646
deviation-center-line_median7.1145113238609285


other stats
deviation-center-line_max7.1145113238609285
deviation-center-line_mean7.1145113238609285
deviation-center-line_min7.1145113238609285
deviation-heading_max5.702635608894818
deviation-heading_mean5.702635608894818
deviation-heading_median5.702635608894818
deviation-heading_min5.702635608894818
distance-from-start_max1.6303678384799305
distance-from-start_mean1.6303678384799305
distance-from-start_median1.6303678384799305
distance-from-start_min1.6303678384799305
driven_any_max3.4663369172896528
driven_any_mean3.4663369172896528
driven_any_median3.4663369172896528
driven_any_min3.4663369172896528
driven_lanedir_consec_max3.2655349065782646
driven_lanedir_consec_mean3.2655349065782646
driven_lanedir_consec_min3.2655349065782646
driven_lanedir_max3.2655349065782646
driven_lanedir_mean3.2655349065782646
driven_lanedir_median3.2655349065782646
driven_lanedir_min3.2655349065782646
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4663369172896528, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655349065782646, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635608894818, "distance-from-start": 1.6303678384799305, "deviation-center-line": 7.1145113238609285, "driven_lanedir_consec": 3.2655349065782646}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5499720Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-3of4successnogpu-staging-spot-0-020:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.2000000000000313
driven_lanedir_consec_median3.0719634979059167
deviation-center-line_median2.5127522585495656


other stats
deviation-center-line_max2.5127522585495656
deviation-center-line_mean2.5127522585495656
deviation-center-line_min2.5127522585495656
deviation-heading_max5.80643510594152
deviation-heading_mean5.80643510594152
deviation-heading_median5.80643510594152
deviation-heading_min5.80643510594152
distance-from-start_max2.558018844429722
distance-from-start_mean2.558018844429722
distance-from-start_median2.558018844429722
distance-from-start_min2.558018844429722
driven_any_max3.5135741911352505
driven_any_mean3.5135741911352505
driven_any_median3.5135741911352505
driven_any_min3.5135741911352505
driven_lanedir_consec_max3.0719634979059167
driven_lanedir_consec_mean3.0719634979059167
driven_lanedir_consec_min3.0719634979059167
driven_lanedir_max3.3771987735835296
driven_lanedir_mean3.3771987735835296
driven_lanedir_median3.3771987735835296
driven_lanedir_min3.3771987735835296
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean2.2000000000000313
in-drivable-lane_min2.2000000000000313
per-episodes
details{"4way-001-ego0": {"driven_any": 3.5135741911352505, "survival_time": 59.99999999999873, "driven_lanedir": 3.3771987735835296, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.80643510594152, "distance-from-start": 2.558018844429722, "deviation-center-line": 2.5127522585495656, "driven_lanedir_consec": 3.0719634979059167}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5492721Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation274successyesgpu-staging-spot-0-020:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.6749999999999297
driven_lanedir_consec_median2.3321113195925243
deviation-center-line_median6.13698068030466


other stats
deviation-center-line_max7.3703625029550865
deviation-center-line_mean6.13698068030466
deviation-center-line_min4.903598857654233
deviation-heading_max7.744574522534287
deviation-heading_mean7.106635261644851
deviation-heading_median7.106635261644851
deviation-heading_min6.468696000755416
distance-from-start_max1.648096422950854
distance-from-start_mean1.427048606043876
distance-from-start_median1.427048606043876
distance-from-start_min1.2060007891368982
driven_any_max3.4850840176976017
driven_any_mean3.4693367131671256
driven_any_median3.4693367131671256
driven_any_min3.45358940863665
driven_lanedir_consec_max3.243830720825712
driven_lanedir_consec_mean2.3321113195925243
driven_lanedir_consec_min1.420391918359337
driven_lanedir_max3.2905374079610175
driven_lanedir_mean3.2671840643933647
driven_lanedir_median3.2671840643933647
driven_lanedir_min3.243830720825712
in-drivable-lane_max4.199999999999893
in-drivable-lane_mean3.6749999999999297
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840176976017, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905374079610175, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574522534287, "distance-from-start": 1.2060007891368982, "deviation-center-line": 4.903598857654233, "driven_lanedir_consec": 1.420391918359337}, "loop2-000-ego1": {"driven_any": 3.45358940863665, "survival_time": 59.99999999999873, "driven_lanedir": 3.243830720825712, "in-drivable-lane": 4.199999999999893, "deviation-heading": 6.468696000755416, "distance-from-start": 1.648096422950854, "deviation-center-line": 7.3703625029550865, "driven_lanedir_consec": 3.243830720825712}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5478725Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-testingsim-1of4successnogpu-staging-spot-0-020:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.524999999999913
driven_lanedir_consec_median3.308912230691319
deviation-center-line_median5.839787488914961


other stats
deviation-center-line_max6.75698913278279
deviation-center-line_mean5.607974470532437
deviation-center-line_min3.995333771517034
deviation-heading_max5.165930098360049
deviation-heading_mean3.4922882996813627
deviation-heading_median3.1489691860187023
deviation-heading_min2.505284728327996
distance-from-start_max2.844526796079213
distance-from-start_mean2.6321833509136905
distance-from-start_median2.6691116440946443
distance-from-start_min2.345983319386262
driven_any_max3.546596859746292
driven_any_mean3.3294948001229945
driven_any_median3.4483923771628326
driven_any_min2.8745975864200206
driven_lanedir_consec_max3.48918283336121
driven_lanedir_consec_mean3.2409226052967446
driven_lanedir_consec_min2.856683126443131
driven_lanedir_max3.4891830167308333
driven_lanedir_mean3.240922684725338
driven_lanedir_median3.3089122779817615
driven_lanedir_min2.856683166206994
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean1.6624999999999472
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.8745975864200206, "survival_time": 59.99999999999873, "driven_lanedir": 2.856683166206994, "in-drivable-lane": 0.0, "deviation-heading": 3.003828160596244, "distance-from-start": 2.345983319386262, "deviation-center-line": 5.525958630071963, "driven_lanedir_consec": 2.856683126443131}, "udem-000-ego1": {"driven_any": 3.4250950541374743, "survival_time": 59.99999999999873, "driven_lanedir": 3.325682803155688, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 3.2941102114411605, "distance-from-start": 2.844526796079213, "deviation-center-line": 6.15361634775796, "driven_lanedir_consec": 3.325682803155688}, "udem-000-ego2": {"driven_any": 3.546596859746292, "survival_time": 59.99999999999873, "driven_lanedir": 3.4891830167308333, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.505284728327996, "distance-from-start": 2.6431774016078946, "deviation-center-line": 3.995333771517034, "driven_lanedir_consec": 3.48918283336121}, "udem-000-ego3": {"driven_any": 3.4716897001881915, "survival_time": 59.99999999999873, "driven_lanedir": 3.2921417528078356, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165930098360049, "distance-from-start": 2.6950458865813935, "deviation-center-line": 6.75698913278279, "driven_lanedir_consec": 3.29214165822695}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5468727Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-3of4successnogpu-staging-spot-0-020:07:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.024999999999899
driven_lanedir_consec_median2.732641298569841
deviation-center-line_median5.783205159116111


other stats
deviation-center-line_max7.544965157820116
deviation-center-line_mean5.7497675193698345
deviation-center-line_min3.887694601427
deviation-heading_max10.583931080973072
deviation-heading_mean9.151368086839163
deviation-heading_median9.268364351217574
deviation-heading_min7.484812563948442
distance-from-start_max2.813869612393969
distance-from-start_mean2.084478573533678
distance-from-start_median1.905962653534861
distance-from-start_min1.712119374671022
driven_any_max3.546589753346208
driven_any_mean3.4746585890034973
driven_any_median3.458908334341295
driven_any_min3.434227933985191
driven_lanedir_consec_max3.4309687141204037
driven_lanedir_consec_mean2.7748390965881633
driven_lanedir_consec_min2.2031050750925667
driven_lanedir_max3.4309687141204037
driven_lanedir_mean3.2525878379342834
driven_lanedir_median3.2151491306395874
driven_lanedir_min3.1490843763375547
in-drivable-lane_max4.849999999999876
in-drivable-lane_mean3.499999999999903
in-drivable-lane_min1.0999999999999377
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.434227933985191, "survival_time": 59.99999999999873, "driven_lanedir": 3.1490843763375547, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.12511562520589, "distance-from-start": 1.712119374671022, "deviation-center-line": 6.026388852659691, "driven_lanedir_consec": 2.2261398186252195}, "zigzag-000-ego1": {"driven_any": 3.455238818983606, "survival_time": 59.99999999999873, "driven_lanedir": 3.239142778514463, "in-drivable-lane": 4.149999999999885, "deviation-heading": 7.484812563948442, "distance-from-start": 1.7151458090928755, "deviation-center-line": 7.544965157820116, "driven_lanedir_consec": 3.239142778514463}, "zigzag-000-ego2": {"driven_any": 3.546589753346208, "survival_time": 59.99999999999873, "driven_lanedir": 3.4309687141204037, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 8.411613077229257, "distance-from-start": 2.813869612393969, "deviation-center-line": 3.887694601427, "driven_lanedir_consec": 3.4309687141204037}, "zigzag-000-ego3": {"driven_any": 3.462577849698985, "survival_time": 59.99999999999873, "driven_lanedir": 3.1911554827647115, "in-drivable-lane": 3.8999999999999138, "deviation-heading": 10.583931080973072, "distance-from-start": 2.0967794979768466, "deviation-center-line": 5.54002146557253, "driven_lanedir_consec": 2.2031050750925667}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5459729Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-2of4successnogpu-staging-spot-0-020:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6903637368165474
deviation-center-line_median5.3052701976903025


other stats
deviation-center-line_max5.3052701976903025
deviation-center-line_mean5.3052701976903025
deviation-center-line_min5.3052701976903025
deviation-heading_max5.395915130465752
deviation-heading_mean5.395915130465752
deviation-heading_median5.395915130465752
deviation-heading_min5.395915130465752
distance-from-start_max1.3909655253694608
distance-from-start_mean1.3909655253694608
distance-from-start_median1.3909655253694608
distance-from-start_min1.3909655253694608
driven_any_max3.5195876463774605
driven_any_mean3.5195876463774605
driven_any_median3.5195876463774605
driven_any_min3.5195876463774605
driven_lanedir_consec_max1.6903637368165474
driven_lanedir_consec_mean1.6903637368165474
driven_lanedir_consec_min1.6903637368165474
driven_lanedir_max3.3875012546504166
driven_lanedir_mean3.3875012546504166
driven_lanedir_median3.3875012546504166
driven_lanedir_min3.3875012546504166
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5195876463774605, "survival_time": 59.99999999999873, "driven_lanedir": 3.3875012546504166, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395915130465752, "distance-from-start": 1.3909655253694608, "deviation-center-line": 5.3052701976903025, "driven_lanedir_consec": 1.6903637368165474}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5454731Bea Baselines 🐤minimal-agent-stateaido-hello-sim-state-validationsanity-checksuccessnogpu-staging-spot-0-020:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.01010041184137167
deviation-center-line_median0.006374441191151069


other stats
deviation-center-line_max0.006374441191151069
deviation-center-line_mean0.006374441191151069
deviation-center-line_min0.006374441191151069
deviation-heading_max0.2614212407761816
deviation-heading_mean0.2614212407761816
deviation-heading_median0.2614212407761816
deviation-heading_min0.2614212407761816
distance-from-start_max0.011536496219628762
distance-from-start_mean0.011536496219628762
distance-from-start_median0.011536496219628762
distance-from-start_min0.011536496219628762
driven_any_max0.01153864640232521
driven_any_mean0.01153864640232521
driven_any_median0.01153864640232521
driven_any_min0.01153864640232521
driven_lanedir_consec_max0.01010041184137167
driven_lanedir_consec_mean0.01010041184137167
driven_lanedir_consec_min0.01010041184137167
driven_lanedir_max0.01010041184137167
driven_lanedir_mean0.01010041184137167
driven_lanedir_median0.01010041184137167
driven_lanedir_min0.01010041184137167
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.01153864640232521, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01010041184137167, "in-drivable-lane": 0.0, "deviation-heading": 0.2614212407761816, "distance-from-start": 0.011536496219628762, "deviation-center-line": 0.006374441191151069, "driven_lanedir_consec": 0.01010041184137167}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5444691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-020:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
5437692Bea Baselines 🐤minimal-agentaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-020:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5432694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1380110688095861
survival_time_median7.549999999999981
deviation-center-line_median0.09382161194536316
in-drivable-lane_median6.099999999999981


other stats
deviation-center-line_max0.09382161194536316
deviation-center-line_mean0.09382161194536316
deviation-center-line_min0.09382161194536316
deviation-heading_max0.9675206445358722
deviation-heading_mean0.9675206445358722
deviation-heading_median0.9675206445358722
deviation-heading_min0.9675206445358722
distance-from-start_max1.0727030809325406
distance-from-start_mean1.0727030809325406
distance-from-start_median1.0727030809325406
distance-from-start_min1.0727030809325406
driven_any_max1.0728646211091792
driven_any_mean1.0728646211091792
driven_any_median1.0728646211091792
driven_any_min1.0728646211091792
driven_lanedir_consec_max0.1380110688095861
driven_lanedir_consec_mean0.1380110688095861
driven_lanedir_consec_min0.1380110688095861
driven_lanedir_max0.1380110688095861
driven_lanedir_mean0.1380110688095861
driven_lanedir_median0.1380110688095861
driven_lanedir_min0.1380110688095861
in-drivable-lane_max6.099999999999981
in-drivable-lane_mean6.099999999999981
in-drivable-lane_min6.099999999999981
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0728646211091792, "survival_time": 7.549999999999981, "driven_lanedir": 0.1380110688095861, "in-drivable-lane": 6.099999999999981, "deviation-heading": 0.9675206445358722, "distance-from-start": 1.0727030809325406, "deviation-center-line": 0.09382161194536316, "driven_lanedir_consec": 0.1380110688095861}}
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean7.549999999999981
survival_time_min7.549999999999981
No reset possible
5424696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-020:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.324999999999993
driven_lanedir_consec_median0.1871224013646781
deviation-center-line_median0.15552364466166196


other stats
deviation-center-line_max0.20320919013322583
deviation-center-line_mean0.15552364466166196
deviation-center-line_min0.10783809919009804
deviation-heading_max0.9508048428349386
deviation-heading_mean0.7622210804954066
deviation-heading_median0.7622210804954066
deviation-heading_min0.5736373181558745
distance-from-start_max0.4813616860528347
distance-from-start_mean0.481361686052834
distance-from-start_median0.481361686052834
distance-from-start_min0.4813616860528333
driven_any_max0.4813712171148974
driven_any_mean0.48137121711489705
driven_any_median0.48137121711489705
driven_any_min0.4813712171148967
driven_lanedir_consec_max0.2375799978131203
driven_lanedir_consec_mean0.1871224013646781
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.2375799978131203
driven_lanedir_mean0.1871224013646781
driven_lanedir_median0.1871224013646781
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.5499999999999936
in-drivable-lane_mean2.324999999999993
in-drivable-lane_min2.099999999999993
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4813712171148974, "survival_time": 3.949999999999994, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4813616860528333, "deviation-center-line": 0.10783809919009804, "driven_lanedir_consec": 0.13666480491623578}, "loop2-000-ego1": {"driven_any": 0.4813712171148967, "survival_time": 3.949999999999994, "driven_lanedir": 0.2375799978131203, "in-drivable-lane": 2.099999999999993, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.4813616860528347, "deviation-center-line": 0.20320919013322583, "driven_lanedir_consec": 0.2375799978131203}}
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
5416698Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4successnogpu-staging-spot-0-020:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.199999999999986
in-drivable-lane_median4.799999999999986
driven_lanedir_consec_median0.13666552017194578
deviation-center-line_median0.10783835333106152


other stats
deviation-center-line_max0.10783835333106152
deviation-center-line_mean0.10783835333106152
deviation-center-line_min0.10783835333106152
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max0.8528594113978589
distance-from-start_mean0.8528594113978589
distance-from-start_median0.8528594113978589
distance-from-start_min0.8528594113978589
driven_any_max0.8528767649869702
driven_any_mean0.8528767649869702
driven_any_median0.8528767649869702
driven_any_min0.8528767649869702
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean4.799999999999986
in-drivable-lane_min4.799999999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8528767649869702, "survival_time": 6.199999999999986, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.9508048428349394, "distance-from-start": 0.8528594113978589, "deviation-center-line": 0.10783835333106152, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
5410700Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-020:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.049999999999994
in-drivable-lane_median2.6499999999999932
driven_lanedir_consec_median0.13666480491620847
deviation-center-line_median0.1078383533310603


other stats
deviation-center-line_max0.1078383533310603
deviation-center-line_mean0.1078383533310603
deviation-center-line_min0.1078383533310603
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max0.4978300060106534
distance-from-start_mean0.4978300060106534
distance-from-start_median0.4978300060106534
distance-from-start_min0.4978300060106534
driven_any_max0.49784012437011577
driven_any_mean0.49784012437011577
driven_any_median0.49784012437011577
driven_any_min0.49784012437011577
driven_lanedir_consec_max0.13666480491620847
driven_lanedir_consec_mean0.13666480491620847
driven_lanedir_consec_min0.13666480491620847
driven_lanedir_max0.13666480491620847
driven_lanedir_mean0.13666480491620847
driven_lanedir_median0.13666480491620847
driven_lanedir_min0.13666480491620847
in-drivable-lane_max2.6499999999999932
in-drivable-lane_mean2.6499999999999932
in-drivable-lane_min2.6499999999999932
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.49784012437011577, "survival_time": 4.049999999999994, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 2.6499999999999932, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.4978300060106534, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491620847}}
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean4.049999999999994
survival_time_min4.049999999999994
No reset possible
5404701Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-020:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31048072934281246
survival_time_median11.60000000000003
deviation-center-line_median0.4653925586404334
in-drivable-lane_median7.549999999999989


other stats
deviation-center-line_max0.4653925586404334
deviation-center-line_mean0.4653925586404334
deviation-center-line_min0.4653925586404334
deviation-heading_max2.661550166530275
deviation-heading_mean2.661550166530275
deviation-heading_median2.661550166530275
deviation-heading_min2.661550166530275
distance-from-start_max1.7416408001353556
distance-from-start_mean1.7416408001353556
distance-from-start_median1.7416408001353556
distance-from-start_min1.7416408001353556
driven_any_max1.741750684261698
driven_any_mean1.741750684261698
driven_any_median1.741750684261698
driven_any_min1.741750684261698
driven_lanedir_consec_max0.31048072934281246
driven_lanedir_consec_mean0.31048072934281246
driven_lanedir_consec_min0.31048072934281246
driven_lanedir_max0.31048072934281246
driven_lanedir_mean0.31048072934281246
driven_lanedir_median0.31048072934281246
driven_lanedir_min0.31048072934281246
in-drivable-lane_max7.549999999999989
in-drivable-lane_mean7.549999999999989
in-drivable-lane_min7.549999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.741750684261698, "survival_time": 11.60000000000003, "driven_lanedir": 0.31048072934281246, "in-drivable-lane": 7.549999999999989, "deviation-heading": 2.661550166530275, "distance-from-start": 1.7416408001353556, "deviation-center-line": 0.4653925586404334, "driven_lanedir_consec": 0.31048072934281246}}
simulation-passed1
survival_time_max11.60000000000003
survival_time_mean11.60000000000003
survival_time_min11.60000000000003
No reset possible
5398702Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-020:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.14999999999998
in-drivable-lane_median5.7749999999999835
driven_lanedir_consec_median0.25930808994624444
deviation-center-line_median0.24034425647007196


other stats
deviation-center-line_max0.6912492474647307
deviation-center-line_mean0.3199439942779757
deviation-center-line_min0.10783821670702835
deviation-heading_max2.3391888095272977
deviation-heading_mean1.1429380079662843
deviation-heading_median0.8294629520909831
deviation-heading_min0.5736373181558746
distance-from-start_max1.1752764064730967
distance-from-start_mean0.7619857456783958
distance-from-start_median0.7539328643495457
distance-from-start_min0.36480084754139513
driven_any_max1.1753349118357472
driven_any_mean0.762016348446223
driven_any_median0.7539616451964262
driven_any_min0.3648071915562925
driven_lanedir_consec_max0.6611857977727726
driven_lanedir_consec_mean0.3291169340639534
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.9897866542941732
driven_lanedir_mean0.41126714819430354
driven_lanedir_median0.25930808994624444
driven_lanedir_min0.1366657585905522
in-drivable-lane_max6.7499999999999805
in-drivable-lane_mean4.574999999999987
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239873088, "survival_time": 8.14999999999998, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 6.7499999999999805, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595201, "deviation-center-line": 0.10783821670702835, "driven_lanedir_consec": 0.1366657585905522}, "4way-000-ego1": {"driven_any": 0.3648071915562925, "survival_time": 8.14999999999998, "driven_lanedir": 0.2375799978131203, "in-drivable-lane": 6.29999999999998, "deviation-heading": 0.5736373181558746, "distance-from-start": 0.36480084754139513, "deviation-center-line": 0.20320962418622704, "driven_lanedir_consec": 0.2375799978131203}, "4way-000-ego2": {"driven_any": 0.9932647664055434, "survival_time": 8.14999999999998, "driven_lanedir": 0.9897866542941732, "in-drivable-lane": 0.0, "deviation-heading": 0.7081210613470272, "distance-from-start": 0.9932177858395712, "deviation-center-line": 0.6912492474647307, "driven_lanedir_consec": 0.6611857977727726}, "4way-000-ego3": {"driven_any": 1.1753349118357472, "survival_time": 8.14999999999998, "driven_lanedir": 0.28103618207936854, "in-drivable-lane": 5.249999999999987, "deviation-heading": 2.3391888095272977, "distance-from-start": 1.1752764064730967, "deviation-center-line": 0.2774788887539169, "driven_lanedir_consec": 0.28103618207936854}}
simulation-passed1
survival_time_max8.14999999999998
survival_time_mean8.14999999999998
survival_time_min8.14999999999998
No reset possible
5392645Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-1of4successnogpu-staging-spot-0-020:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6648897347487026
deviation-center-line_median4.9388161979484995


other stats
deviation-center-line_max4.9388161979484995
deviation-center-line_mean4.9388161979484995
deviation-center-line_min4.9388161979484995
deviation-heading_max7.489030374236871
deviation-heading_mean7.489030374236871
deviation-heading_median7.489030374236871
deviation-heading_min7.489030374236871
distance-from-start_max1.3909655084060193
distance-from-start_mean1.3909655084060193
distance-from-start_median1.3909655084060193
distance-from-start_min1.3909655084060193
driven_any_max3.519584618867418
driven_any_mean3.519584618867418
driven_any_median3.519584618867418
driven_any_min3.519584618867418
driven_lanedir_consec_max1.6648897347487026
driven_lanedir_consec_mean1.6648897347487026
driven_lanedir_consec_min1.6648897347487026
driven_lanedir_max3.362091194105441
driven_lanedir_mean3.362091194105441
driven_lanedir_median3.362091194105441
driven_lanedir_min3.362091194105441
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519584618867418, "survival_time": 59.99999999999873, "driven_lanedir": 3.362091194105441, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 7.489030374236871, "distance-from-start": 1.3909655084060193, "deviation-center-line": 4.9388161979484995, "driven_lanedir_consec": 1.6648897347487026}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5387434Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failednogpu-staging-spot-0-020:01:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5381435Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failednogpu-staging-spot-0-020:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5376436Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-2of4failednogpu-staging-spot-0-020:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5369437Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5365440Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-020:02:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5349440Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-020:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5346496Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5337467Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4successnogpu-staging-spot-0-020:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.999999999999865
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.2478265130959194
deviation-center-line_median5.152132780323252


other stats
deviation-center-line_max5.152132780323252
deviation-center-line_mean5.152132780323252
deviation-center-line_min5.152132780323252
deviation-heading_max2.495559265059334
deviation-heading_mean2.495559265059334
deviation-heading_median2.495559265059334
deviation-heading_min2.495559265059334
distance-from-start_max1.7870695980437394
distance-from-start_mean1.7870695980437394
distance-from-start_median1.7870695980437394
distance-from-start_min1.7870695980437394
driven_any_max2.3045969519229774
driven_any_mean2.3045969519229774
driven_any_median2.3045969519229774
driven_any_min2.3045969519229774
driven_lanedir_consec_max2.2478265130959194
driven_lanedir_consec_mean2.2478265130959194
driven_lanedir_consec_min2.2478265130959194
driven_lanedir_max2.2478265130959194
driven_lanedir_mean2.2478265130959194
driven_lanedir_median2.2478265130959194
driven_lanedir_min2.2478265130959194
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-001-ego0": {"driven_any": 2.3045969519229774, "survival_time": 39.999999999999865, "driven_lanedir": 2.2478265130959194, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.495559265059334, "distance-from-start": 1.7870695980437394, "deviation-center-line": 5.152132780323252, "driven_lanedir_consec": 2.2478265130959194}}
simulation-passed1
survival_time_max39.999999999999865
survival_time_mean39.999999999999865
survival_time_min39.999999999999865
No reset possible
5328469Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.099999999999845
driven_lanedir_consec_median3.2655265789104
deviation-center-line_median7.114511199103643


other stats
deviation-center-line_max7.114511199103643
deviation-center-line_mean7.114511199103643
deviation-center-line_min7.114511199103643
deviation-heading_max5.702635580930089
deviation-heading_mean5.702635580930089
deviation-heading_median5.702635580930089
deviation-heading_min5.702635580930089
distance-from-start_max1.6303678440695035
distance-from-start_mean1.6303678440695035
distance-from-start_median1.6303678440695035
distance-from-start_min1.6303678440695035
driven_any_max3.466336917289666
driven_any_mean3.466336917289666
driven_any_median3.466336917289666
driven_any_min3.466336917289666
driven_lanedir_consec_max3.2655265789104
driven_lanedir_consec_mean3.2655265789104
driven_lanedir_consec_min3.2655265789104
driven_lanedir_max3.2655265789104
driven_lanedir_mean3.2655265789104
driven_lanedir_median3.2655265789104
driven_lanedir_min3.2655265789104
in-drivable-lane_max4.099999999999845
in-drivable-lane_mean4.099999999999845
in-drivable-lane_min4.099999999999845
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5321483Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353535


other stats
deviation-center-line_max0.8948975282353535
deviation-center-line_mean0.8948975282353535
deviation-center-line_min0.8948975282353535
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.482534153247273e-16
distance-from-start_mean2.482534153247273e-16
distance-from-start_median2.482534153247273e-16
distance-from-start_min2.482534153247273e-16
driven_any_max2.9790409838966753e-13
driven_any_mean2.9790409838966753e-13
driven_any_median2.9790409838966753e-13
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5310486Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-020:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.850000000000048
in-drivable-lane_median9.600000000000051
driven_lanedir_consec_median0.395970381094496
deviation-center-line_median0.2727382860816283


other stats
deviation-center-line_max0.3711793675074804
deviation-center-line_mean0.26307006175696934
deviation-center-line_min0.13562430735714032
deviation-heading_max2.5383505748046193
deviation-heading_mean1.5839275146723817
deviation-heading_median1.5305477977075064
deviation-heading_min0.7362638884698938
distance-from-start_max1.9486947141078033
distance-from-start_mean1.6104892935754336
distance-from-start_median1.6878960391209077
distance-from-start_min1.117470381952116
driven_any_max1.9488515657780785
driven_any_mean1.6105973523255763
driven_any_median1.6880059043797089
driven_any_min1.1175260347648104
driven_lanedir_consec_max0.6388965134503066
driven_lanedir_consec_mean0.3976334018683764
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.6388965134503066
driven_lanedir_mean0.3976334018683764
driven_lanedir_median0.395970381094496
driven_lanedir_min0.15969633183420706
in-drivable-lane_max11.400000000000048
in-drivable-lane_mean9.612500000000054
in-drivable-lane_min7.850000000000057
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.9488515657780785, "survival_time": 12.850000000000048, "driven_lanedir": 0.3312247708304017, "in-drivable-lane": 9.550000000000052, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9486947141078033, "deviation-center-line": 0.26973515872126547, "driven_lanedir_consec": 0.3312247708304017}, "autolab-000-ego1": {"driven_any": 1.1175260347648104, "survival_time": 12.850000000000048, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 11.400000000000048, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.117470381952116, "deviation-center-line": 0.13562430735714032, "driven_lanedir_consec": 0.15969633183420706}, "autolab-000-ego2": {"driven_any": 1.6921542763568478, "survival_time": 12.850000000000048, "driven_lanedir": 0.6388965134503066, "in-drivable-lane": 7.850000000000057, "deviation-heading": 2.313286124467676, "distance-from-start": 1.6920444051025798, "deviation-center-line": 0.3711793675074804, "driven_lanedir_consec": 0.6388965134503066}, "autolab-000-ego3": {"driven_any": 1.68385753240257, "survival_time": 12.850000000000048, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 9.650000000000052, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
5290474Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnogpu-staging-spot-0-020:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7226359618167388
deviation-center-line_median0.5300716056782957


other stats
deviation-center-line_max3.450684914636027
deviation-center-line_mean1.1544116353398692
deviation-center-line_min0.10681841536685864
deviation-heading_max26.9052448670844
deviation-heading_mean13.564778629547629
deviation-heading_median13.197767646759738
deviation-heading_min0.958334357586633
distance-from-start_max2.6184795314376466
distance-from-start_mean1.0433272824408664
distance-from-start_median0.7774147991629091
distance-from-start_min4.440892098500626e-16
driven_any_max4.40268670413701
driven_any_mean1.962564046936972
driven_any_median1.7237847418051728
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max4.396263615957334
driven_lanedir_consec_mean1.9603838848977029
driven_lanedir_consec_min0.0
driven_lanedir_max4.396272526695297
driven_lanedir_mean1.960407277995468
driven_lanedir_median1.722678292643288
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.4475694836097963, "survival_time": 59.99999999999873, "driven_lanedir": 3.445356585286576, "in-drivable-lane": 0.0, "deviation-heading": 0.958334357586633, "distance-from-start": 1.5548295983258178, "deviation-center-line": 0.10681841536685864, "driven_lanedir_consec": 3.4452719236334777}, "udem-001-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.9270500462381008, "driven_lanedir_consec": 0.0}, "udem-001-ego2": {"driven_any": 4.40268670413701, "survival_time": 59.99999999999873, "driven_lanedir": 4.396272526695297, "in-drivable-lane": 0.0, "deviation-heading": 1.4677754959606737, "distance-from-start": 2.6184795314376466, "deviation-center-line": 0.13309316511849048, "driven_lanedir_consec": 4.396263615957334}, "udem-001-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.450684914636027, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5284498Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-020:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666480491623578
survival_time_median10.85000000000002
deviation-center-line_median0.10783802485852027
in-drivable-lane_median9.45000000000002


other stats
deviation-center-line_max0.10783802485852027
deviation-center-line_mean0.10783802485852027
deviation-center-line_min0.10783802485852027
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575137
distance-from-start_mean1.6182798682575137
distance-from-start_median1.6182798682575137
distance-from-start_min1.6182798682575137
driven_any_max1.6183892771013906
driven_any_mean1.6183892771013906
driven_any_median1.6183892771013906
driven_any_min1.6183892771013906
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6183892771013906, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575137, "deviation-center-line": 0.10783802485852027, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
5279490Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-020:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5271474Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-1of4successnogpu-staging-spot-0-020:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.936310579945818
deviation-center-line_median0.26372827402668186


other stats
deviation-center-line_max2.128491974247639
deviation-center-line_mean0.7030908912030065
deviation-center-line_min0.15641504251102295
deviation-heading_max30.712966764077652
deviation-heading_mean9.10600170233707
deviation-heading_median2.0959285656971662
deviation-heading_min1.519182913876287
distance-from-start_max3.291290161140417
distance-from-start_mean2.000663875464858
distance-from-start_median2.355682670359506
distance-from-start_min2.2887833992611187e-16
driven_any_max5.472269552385587
driven_any_mean3.941216020142065
driven_any_median5.146297264091199
driven_any_min2.746540079113375e-13
driven_lanedir_consec_max5.464251838075039
driven_lanedir_consec_mean3.834218249491669
driven_lanedir_consec_min0.0
driven_lanedir_max5.464251961251795
driven_lanedir_mean3.935073893557231
driven_lanedir_median5.138021806488564
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 5.472269552385587, "survival_time": 59.99999999999873, "driven_lanedir": 5.464251961251795, "in-drivable-lane": 0.0, "deviation-heading": 1.519182913876287, "distance-from-start": 3.291290161140417, "deviation-center-line": 0.15641504251102295, "driven_lanedir_consec": 5.464251838075039}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.220571614669939, "survival_time": 59.99999999999873, "driven_lanedir": 5.2126441633627945, "in-drivable-lane": 0.0, "deviation-heading": 2.2071350622741748, "distance-from-start": 2.4394694270451596, "deviation-center-line": 0.26092105692879514, "driven_lanedir_consec": 5.2126441633627945}, "udem-000-ego3": {"driven_any": 5.072022913512461, "survival_time": 59.99999999999873, "driven_lanedir": 5.063399449614334, "in-drivable-lane": 0.0, "deviation-heading": 1.9847220691201577, "distance-from-start": 2.2718959136738524, "deviation-center-line": 0.26653549112456865, "driven_lanedir_consec": 4.659976996528842}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5264476Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation274successyesgpu-staging-spot-0-020:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.381330906743559
deviation-center-line_median0.3759399942892944


other stats
deviation-center-line_max0.4050492367024026
deviation-center-line_mean0.3759399942892944
deviation-center-line_min0.346830751876186
deviation-heading_max3.1141410438173027
deviation-heading_mean3.1134951286938968
deviation-heading_median3.1134951286938968
deviation-heading_min3.1128492135704913
distance-from-start_max1.5440903882735502
distance-from-start_mean1.3058755968972466
distance-from-start_median1.3058755968972466
distance-from-start_min1.0676608055209431
driven_any_max5.64000698925217
driven_any_mean5.394808261278103
driven_any_median5.394808261278103
driven_any_min5.149609533304037
driven_lanedir_consec_max5.624383264436496
driven_lanedir_consec_mean5.381330906743559
driven_lanedir_consec_min5.138278549050622
driven_lanedir_max5.624383264436496
driven_lanedir_mean5.381330906743559
driven_lanedir_median5.381330906743559
driven_lanedir_min5.138278549050622
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.64000698925217, "survival_time": 59.99999999999873, "driven_lanedir": 5.624383264436496, "in-drivable-lane": 0.0, "deviation-heading": 3.1128492135704913, "distance-from-start": 1.0676608055209431, "deviation-center-line": 0.4050492367024026, "driven_lanedir_consec": 5.624383264436496}, "loop2-000-ego1": {"driven_any": 5.149609533304037, "survival_time": 59.99999999999873, "driven_lanedir": 5.138278549050622, "in-drivable-lane": 0.0, "deviation-heading": 3.1141410438173027, "distance-from-start": 1.5440903882735502, "deviation-center-line": 0.346830751876186, "driven_lanedir_consec": 5.138278549050622}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5260478Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-3of4successnogpu-staging-spot-0-020:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.0002213201227618811
deviation-center-line_median0.4065062534344534


other stats
deviation-center-line_max0.4065062534344534
deviation-center-line_mean0.4065062534344534
deviation-center-line_min0.4065062534344534
deviation-heading_max40.96738790126906
deviation-heading_mean40.96738790126906
deviation-heading_median40.96738790126906
deviation-heading_min40.96738790126906
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max-0.0002213201227618811
driven_lanedir_consec_mean-0.0002213201227618811
driven_lanedir_consec_min-0.0002213201227618811
driven_lanedir_max-0.0002213201227618811
driven_lanedir_mean-0.0002213201227618811
driven_lanedir_median-0.0002213201227618811
driven_lanedir_min-0.0002213201227618811
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.0002213201227618811, "in-drivable-lane": 0.0, "deviation-heading": 40.96738790126906, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.4065062534344534, "driven_lanedir_consec": -0.0002213201227618811}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5256491Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-020:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19695248970180224
survival_time_median10.100000000000009
deviation-center-line_median0.1253905065384011
in-drivable-lane_median8.350000000000009


other stats
deviation-center-line_max0.1253905065384011
deviation-center-line_mean0.1253905065384011
deviation-center-line_min0.1253905065384011
deviation-heading_max0.9520924629376072
deviation-heading_mean0.9520924629376072
deviation-heading_median0.9520924629376072
deviation-heading_min0.9520924629376072
distance-from-start_max1.4926447664752691
distance-from-start_mean1.4926447664752691
distance-from-start_median1.4926447664752691
distance-from-start_min1.4926447664752691
driven_any_max1.4929097725804397
driven_any_mean1.4929097725804397
driven_any_median1.4929097725804397
driven_any_min1.4929097725804397
driven_lanedir_consec_max0.19695248970180224
driven_lanedir_consec_mean0.19695248970180224
driven_lanedir_consec_min0.19695248970180224
driven_lanedir_max0.19695248970180224
driven_lanedir_mean0.19695248970180224
driven_lanedir_median0.19695248970180224
driven_lanedir_min0.19695248970180224
in-drivable-lane_max8.350000000000009
in-drivable-lane_mean8.350000000000009
in-drivable-lane_min8.350000000000009
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.4929097725804397, "survival_time": 10.100000000000009, "driven_lanedir": 0.19695248970180224, "in-drivable-lane": 8.350000000000009, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.4926447664752691, "deviation-center-line": 0.1253905065384011, "driven_lanedir_consec": 0.19695248970180224}}
simulation-passed1
survival_time_max10.100000000000009
survival_time_mean10.100000000000009
survival_time_min10.100000000000009
No reset possible
5233484Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-1of4successnogpu-staging-spot-0-020:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2066560653618428
deviation-center-line_median0.2023394713538787


other stats
deviation-center-line_max0.2023394713538787
deviation-center-line_mean0.2023394713538787
deviation-center-line_min0.2023394713538787
deviation-heading_max1.3100325783735285
deviation-heading_mean1.3100325783735285
deviation-heading_median1.3100325783735285
deviation-heading_min1.3100325783735285
distance-from-start_max1.7432818598575894
distance-from-start_mean1.7432818598575894
distance-from-start_median1.7432818598575894
distance-from-start_min1.7432818598575894
driven_any_max2.2165794083935064
driven_any_mean2.2165794083935064
driven_any_median2.2165794083935064
driven_any_min2.2165794083935064
driven_lanedir_consec_max2.2066560653618428
driven_lanedir_consec_mean2.2066560653618428
driven_lanedir_consec_min2.2066560653618428
driven_lanedir_max2.2066560653618428
driven_lanedir_mean2.2066560653618428
driven_lanedir_median2.2066560653618428
driven_lanedir_min2.2066560653618428
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.2165794083935064, "survival_time": 59.99999999999873, "driven_lanedir": 2.2066560653618428, "in-drivable-lane": 0.0, "deviation-heading": 1.3100325783735285, "distance-from-start": 1.7432818598575894, "deviation-center-line": 0.2023394713538787, "driven_lanedir_consec": 2.2066560653618428}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5226495Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-1of4successnogpu-staging-spot-0-020:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.199999999999986
in-drivable-lane_median4.799999999999986
driven_lanedir_consec_median0.13666552017194578
deviation-center-line_median0.10783835333106152


other stats
deviation-center-line_max0.10783835333106152
deviation-center-line_mean0.10783835333106152
deviation-center-line_min0.10783835333106152
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max0.8528594113978589
distance-from-start_mean0.8528594113978589
distance-from-start_median0.8528594113978589
distance-from-start_min0.8528594113978589
driven_any_max0.8528767649869702
driven_any_mean0.8528767649869702
driven_any_median0.8528767649869702
driven_any_min0.8528767649869702
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean4.799999999999986
in-drivable-lane_min4.799999999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8528767649869702, "survival_time": 6.199999999999986, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.9508048428349394, "distance-from-start": 0.8528594113978589, "deviation-center-line": 0.10783835333106152, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
5200572Bea Baselines 🐤daffy-staging-16caac0a4bd50fc9a46ec14fc15139fc97a0bb05aido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-020:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5196581Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:2a620f13d933884ac356bb84c887dbbc4a628378aido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-020:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5190600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-020:05:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible