Duckietown Challenges Home Challenges Submissions

Evaluator 21

ID21
evaluatorgpu-staging-spot-0-04
owneruser1000001
machinegpu-staging-spot-0
processgpu-staging-spot-0-04
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success190 5198
# timeout5 6302
# failed57 5194
# error
# aborted
# host-error10 5351
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)246.2 GB
Disk (MB)969.3 GB
Disk available (MB)892.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7487805Bea Baselines 🐤challenge-aido_LF-baseline-duckietown:daffy-staging:06423b9f834b346c04889a28f919db3673a8d2c1aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-040:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.009306515161646711
deviation-center-line_median0.007007151405106795


other stats
deviation-center-line_max0.007007151405106795
deviation-center-line_mean0.007007151405106795
deviation-center-line_min0.007007151405106795
deviation-heading_max0.2628566810808864
deviation-heading_mean0.2628566810808864
deviation-heading_median0.2628566810808864
deviation-heading_min0.2628566810808864
distance-from-start_max0.010491090059085538
distance-from-start_mean0.010491090059085538
distance-from-start_median0.010491090059085538
distance-from-start_min0.010491090059085538
driven_any_max0.010496497299717618
driven_any_mean0.010496497299717618
driven_any_median0.010496497299717618
driven_any_min0.010496497299717618
driven_lanedir_consec_max0.009306515161646711
driven_lanedir_consec_mean0.009306515161646711
driven_lanedir_consec_min0.009306515161646711
driven_lanedir_max0.009306515161646711
driven_lanedir_mean0.009306515161646711
driven_lanedir_median0.009306515161646711
driven_lanedir_min0.009306515161646711
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.010496497299717618, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009306515161646711, "in-drivable-lane": 0.0, "deviation-heading": 0.2628566810808864, "distance-from-start": 0.010491090059085538, "deviation-center-line": 0.007007151405106795, "driven_lanedir_consec": 0.009306515161646711}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
7485804Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-040:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.060557516498081165
deviation-center-line_median0.00790083054938961


other stats
deviation-center-line_max0.00790083054938961
deviation-center-line_mean0.00790083054938961
deviation-center-line_min0.00790083054938961
deviation-heading_max0.2902359379007676
deviation-heading_mean0.2902359379007676
deviation-heading_median0.2902359379007676
deviation-heading_min0.2902359379007676
distance-from-start_max0.07507118072899445
distance-from-start_mean0.07507118072899445
distance-from-start_median0.07507118072899445
distance-from-start_min0.07507118072899445
driven_any_max0.07512694590758906
driven_any_mean0.07512694590758906
driven_any_median0.07512694590758906
driven_any_min0.07512694590758906
driven_lanedir_consec_max0.060557516498081165
driven_lanedir_consec_mean0.060557516498081165
driven_lanedir_consec_min0.060557516498081165
driven_lanedir_max0.060557516498081165
driven_lanedir_mean0.060557516498081165
driven_lanedir_median0.060557516498081165
driven_lanedir_min0.060557516498081165
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.07512694590758906, "survival_time": 0.49999999999999994, "driven_lanedir": 0.060557516498081165, "in-drivable-lane": 0.0, "deviation-heading": 0.2902359379007676, "distance-from-start": 0.07507118072899445, "deviation-center-line": 0.00790083054938961, "driven_lanedir_consec": 0.060557516498081165}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
7480802Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551aido-hello-sim-validationsanity-checktimeoutnogpu-staging-spot-0-04----No reset possible
7475796Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:4f78c63aa6d3b56db61748d0875daf8a08ba14a1aido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-040:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7473801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-040:05:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7461385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:16:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.749999999999424
driven_lanedir_consec_median-3.1120275915339457
deviation-center-line_median3.114011372447628


other stats
deviation-center-line_max3.561824671847342
deviation-center-line_mean2.939809351606997
deviation-center-line_min1.96938998968539
deviation-heading_max28.25174285100556
deviation-heading_mean27.958705051019855
deviation-heading_median28.16401668631156
deviation-heading_min27.255043980450736
distance-from-start_max0.2935990691181599
distance-from-start_mean0.19717683809604253
distance-from-start_median0.17076521839440606
distance-from-start_min0.15357784647719802
driven_any_max12.32169567939114
driven_any_mean11.961596102669912
driven_any_median12.093207234156049
driven_any_min11.338274262976418
driven_lanedir_consec_max-1.808849962114761
driven_lanedir_consec_mean-2.939598568754881
driven_lanedir_consec_min-3.72548912983687
driven_lanedir_max-3.199860812980071
driven_lanedir_mean-4.056332030935877
driven_lanedir_median-3.743113546311953
driven_lanedir_min-5.539240218139533
in-drivable-lane_max26.949999999999328
in-drivable-lane_mean24.04999999999936
in-drivable-lane_min19.74999999999926
per-episodes
details{"loop-000-ego0": {"driven_any": 12.32169567939114, "survival_time": 59.99999999999873, "driven_lanedir": -3.977892802306652, "in-drivable-lane": 26.949999999999328, "deviation-heading": 28.25174285100556, "distance-from-start": 0.16355805317189143, "deviation-center-line": 1.96938998968539, "driven_lanedir_consec": -3.72548912983687}, "loop-000-ego1": {"driven_any": 11.338274262976418, "survival_time": 59.99999999999873, "driven_lanedir": -3.199860812980071, "in-drivable-lane": 24.949999999999413, "deviation-heading": 28.225887199766145, "distance-from-start": 0.15357784647719802, "deviation-center-line": 2.985491948507783, "driven_lanedir_consec": -3.199860812980071}, "loop-000-ego2": {"driven_any": 12.319886935855848, "survival_time": 59.99999999999873, "driven_lanedir": -5.539240218139533, "in-drivable-lane": 19.74999999999926, "deviation-heading": 28.102146172856976, "distance-from-start": 0.2935990691181599, "deviation-center-line": 3.561824671847342, "driven_lanedir_consec": -1.808849962114761}, "loop-000-ego3": {"driven_any": 11.866527532456246, "survival_time": 59.99999999999873, "driven_lanedir": -3.508334290317254, "in-drivable-lane": 24.549999999999432, "deviation-heading": 27.255043980450736, "distance-from-start": 0.17797238361692072, "deviation-center-line": 3.242530796387473, "driven_lanedir_consec": -3.024194370087821}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7459386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-0of4successnogpu-staging-spot-0-040:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median33.899999999999054
driven_lanedir_consec_median-3.041131961279033
deviation-center-line_median2.2079875095615473


other stats
deviation-center-line_max2.2079875095615473
deviation-center-line_mean2.2079875095615473
deviation-center-line_min2.2079875095615473
deviation-heading_max22.32063187596985
deviation-heading_mean22.32063187596985
deviation-heading_median22.32063187596985
deviation-heading_min22.32063187596985
distance-from-start_max0.16528965738714918
distance-from-start_mean0.16528965738714918
distance-from-start_median0.16528965738714918
distance-from-start_min0.16528965738714918
driven_any_max11.56070948068956
driven_any_mean11.56070948068956
driven_any_median11.56070948068956
driven_any_min11.56070948068956
driven_lanedir_consec_max-3.041131961279033
driven_lanedir_consec_mean-3.041131961279033
driven_lanedir_consec_min-3.041131961279033
driven_lanedir_max-3.321489995145067
driven_lanedir_mean-3.321489995145067
driven_lanedir_median-3.321489995145067
driven_lanedir_min-3.321489995145067
in-drivable-lane_max33.899999999999054
in-drivable-lane_mean33.899999999999054
in-drivable-lane_min33.899999999999054
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.56070948068956, "survival_time": 59.99999999999873, "driven_lanedir": -3.321489995145067, "in-drivable-lane": 33.899999999999054, "deviation-heading": 22.32063187596985, "distance-from-start": 0.16528965738714918, "deviation-center-line": 2.2079875095615473, "driven_lanedir_consec": -3.041131961279033}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7455386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-040:06:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median12.69999999999976
driven_lanedir_consec_median-5.917610945367105
deviation-center-line_median4.161348723788685


other stats
deviation-center-line_max4.161348723788685
deviation-center-line_mean4.161348723788685
deviation-center-line_min4.161348723788685
deviation-heading_max30.802465543325884
deviation-heading_mean30.802465543325884
deviation-heading_median30.802465543325884
deviation-heading_min30.802465543325884
distance-from-start_max0.16488395480113613
distance-from-start_mean0.16488395480113613
distance-from-start_median0.16488395480113613
distance-from-start_min0.16488395480113613
driven_any_max15.741872177118744
driven_any_mean15.741872177118744
driven_any_median15.741872177118744
driven_any_min15.741872177118744
driven_lanedir_consec_max-5.917610945367105
driven_lanedir_consec_mean-5.917610945367105
driven_lanedir_consec_min-5.917610945367105
driven_lanedir_max-8.661085957811627
driven_lanedir_mean-8.661085957811627
driven_lanedir_median-8.661085957811627
driven_lanedir_min-8.661085957811627
in-drivable-lane_max12.69999999999976
in-drivable-lane_mean12.69999999999976
in-drivable-lane_min12.69999999999976
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.741872177118744, "survival_time": 59.99999999999873, "driven_lanedir": -8.661085957811627, "in-drivable-lane": 12.69999999999976, "deviation-heading": 30.802465543325884, "distance-from-start": 0.16488395480113613, "deviation-center-line": 4.161348723788685, "driven_lanedir_consec": -5.917610945367105}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7452387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.84999999999907
driven_lanedir_consec_median-1.9817195499284217
deviation-center-line_median2.906633514798044


other stats
deviation-center-line_max2.906633514798044
deviation-center-line_mean2.906633514798044
deviation-center-line_min2.906633514798044
deviation-heading_max25.819381639037648
deviation-heading_mean25.819381639037648
deviation-heading_median25.819381639037648
deviation-heading_min25.819381639037648
distance-from-start_max0.16371495688443158
distance-from-start_mean0.16371495688443158
distance-from-start_median0.16371495688443158
distance-from-start_min0.16371495688443158
driven_any_max10.60258994103442
driven_any_mean10.60258994103442
driven_any_median10.60258994103442
driven_any_min10.60258994103442
driven_lanedir_consec_max-1.9817195499284217
driven_lanedir_consec_mean-1.9817195499284217
driven_lanedir_consec_min-1.9817195499284217
driven_lanedir_max-2.208433704715402
driven_lanedir_mean-2.208433704715402
driven_lanedir_median-2.208433704715402
driven_lanedir_min-2.208433704715402
in-drivable-lane_max29.84999999999907
in-drivable-lane_mean29.84999999999907
in-drivable-lane_min29.84999999999907
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.60258994103442, "survival_time": 59.99999999999873, "driven_lanedir": -2.208433704715402, "in-drivable-lane": 29.84999999999907, "deviation-heading": 25.819381639037648, "distance-from-start": 0.16371495688443158, "deviation-center-line": 2.906633514798044, "driven_lanedir_consec": -1.9817195499284217}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7444389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-040:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median15.69999999999972
driven_lanedir_consec_median-4.9381349371828325
deviation-center-line_median4.2473386713610575


other stats
deviation-center-line_max4.2473386713610575
deviation-center-line_mean4.2473386713610575
deviation-center-line_min4.2473386713610575
deviation-heading_max28.818668935352925
deviation-heading_mean28.818668935352925
deviation-heading_median28.818668935352925
deviation-heading_min28.818668935352925
distance-from-start_max0.18732556409429865
distance-from-start_mean0.18732556409429865
distance-from-start_median0.18732556409429865
distance-from-start_min0.18732556409429865
driven_any_max15.797569844406004
driven_any_mean15.797569844406004
driven_any_median15.797569844406004
driven_any_min15.797569844406004
driven_lanedir_consec_max-4.9381349371828325
driven_lanedir_consec_mean-4.9381349371828325
driven_lanedir_consec_min-4.9381349371828325
driven_lanedir_max-8.311474656868752
driven_lanedir_mean-8.311474656868752
driven_lanedir_median-8.311474656868752
driven_lanedir_min-8.311474656868752
in-drivable-lane_max15.69999999999972
in-drivable-lane_mean15.69999999999972
in-drivable-lane_min15.69999999999972
per-episodes
details{"4way-000-ego0": {"driven_any": 15.797569844406004, "survival_time": 59.99999999999873, "driven_lanedir": -8.311474656868752, "in-drivable-lane": 15.69999999999972, "deviation-heading": 28.818668935352925, "distance-from-start": 0.18732556409429865, "deviation-center-line": 4.2473386713610575, "driven_lanedir_consec": -4.9381349371828325}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7429392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:17:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median32.09999999999915
driven_lanedir_consec_median-2.324494356495527
deviation-center-line_median2.2677269783279295


other stats
deviation-center-line_max4.487069802055514
deviation-center-line_mean2.622964038565134
deviation-center-line_min1.4693323955491615
deviation-heading_max24.502822183975987
deviation-heading_mean16.809388074881607
deviation-heading_median16.830359471310793
deviation-heading_min9.07401117292885
distance-from-start_max0.16796232451580118
distance-from-start_mean0.13830183960144554
distance-from-start_median0.15824983654907576
distance-from-start_min0.06874536079182941
driven_any_max15.256228704551296
driven_any_mean9.7940953697747
driven_any_median11.9248340801321
driven_any_min0.07048461428331204
driven_lanedir_consec_max0.06632886269851967
driven_lanedir_consec_mean-2.0433746510605135
driven_lanedir_consec_min-3.5908387539495203
driven_lanedir_max0.06632886269851967
driven_lanedir_mean-2.539175867574401
driven_lanedir_median-2.460698364008824
driven_lanedir_min-5.3016356049784745
in-drivable-lane_max47.099999999998886
in-drivable-lane_mean27.824999999999296
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.716383342295169, "survival_time": 59.99999999999873, "driven_lanedir": -3.5908387539495203, "in-drivable-lane": 32.54999999999929, "deviation-heading": 24.502822183975987, "distance-from-start": 0.15198138353463445, "deviation-center-line": 2.080481411092518, "driven_lanedir_consec": -3.5908387539495203}, "zigzag-000-ego1": {"driven_any": 12.13328481796903, "survival_time": 59.99999999999873, "driven_lanedir": -1.3305579740681277, "in-drivable-lane": 47.099999999998886, "deviation-heading": 13.631219064584338, "distance-from-start": 0.1645182895635171, "deviation-center-line": 1.4693323955491615, "driven_lanedir_consec": -1.3305579740681277}, "zigzag-000-ego2": {"driven_any": 15.256228704551296, "survival_time": 59.99999999999873, "driven_lanedir": -5.3016356049784745, "in-drivable-lane": 31.64999999999901, "deviation-heading": 20.02949987803725, "distance-from-start": 0.16796232451580118, "deviation-center-line": 2.454972545563341, "driven_lanedir_consec": -3.3184307389229257}, "zigzag-000-ego3": {"driven_any": 0.07048461428331204, "survival_time": 59.99999999999873, "driven_lanedir": 0.06632886269851967, "in-drivable-lane": 0.0, "deviation-heading": 9.07401117292885, "distance-from-start": 0.06874536079182941, "deviation-center-line": 4.487069802055514, "driven_lanedir_consec": 0.06632886269851967}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7428392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-0of4host-errornogpu-staging-spot-0-040:01:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7425393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-040:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median38.74999999999916
driven_lanedir_consec_median-2.249878681879971
deviation-center-line_median2.12015378424749


other stats
deviation-center-line_max2.12015378424749
deviation-center-line_mean2.12015378424749
deviation-center-line_min2.12015378424749
deviation-heading_max18.168272505169817
deviation-heading_mean18.168272505169817
deviation-heading_median18.168272505169817
deviation-heading_min18.168272505169817
distance-from-start_max0.1682471543565209
distance-from-start_mean0.1682471543565209
distance-from-start_median0.1682471543565209
distance-from-start_min0.1682471543565209
driven_any_max11.999210129767803
driven_any_mean11.999210129767803
driven_any_median11.999210129767803
driven_any_min11.999210129767803
driven_lanedir_consec_max-2.249878681879971
driven_lanedir_consec_mean-2.249878681879971
driven_lanedir_consec_min-2.249878681879971
driven_lanedir_max-2.496092936352425
driven_lanedir_mean-2.496092936352425
driven_lanedir_median-2.496092936352425
driven_lanedir_min-2.496092936352425
in-drivable-lane_max38.74999999999916
in-drivable-lane_mean38.74999999999916
in-drivable-lane_min38.74999999999916
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.999210129767803, "survival_time": 59.99999999999873, "driven_lanedir": -2.496092936352425, "in-drivable-lane": 38.74999999999916, "deviation-heading": 18.168272505169817, "distance-from-start": 0.1682471543565209, "deviation-center-line": 2.12015378424749, "driven_lanedir_consec": -2.249878681879971}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7421395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-1of4successnogpu-staging-spot-0-040:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.350000000000056
in-drivable-lane_median6.800000000000025
driven_lanedir_consec_median-0.9715523639153774
deviation-center-line_median0.2925412352625081


other stats
deviation-center-line_max0.2925412352625081
deviation-center-line_mean0.2925412352625081
deviation-center-line_min0.2925412352625081
deviation-heading_max5.085581386454162
deviation-heading_mean5.085581386454162
deviation-heading_median5.085581386454162
deviation-heading_min5.085581386454162
distance-from-start_max0.1637941593536477
distance-from-start_mean0.1637941593536477
distance-from-start_median0.1637941593536477
distance-from-start_min0.1637941593536477
driven_any_max3.012450779897227
driven_any_mean3.012450779897227
driven_any_median3.012450779897227
driven_any_min3.012450779897227
driven_lanedir_consec_max-0.9715523639153774
driven_lanedir_consec_mean-0.9715523639153774
driven_lanedir_consec_min-0.9715523639153774
driven_lanedir_max-0.9599696008825532
driven_lanedir_mean-0.9599696008825532
driven_lanedir_median-0.9599696008825532
driven_lanedir_min-0.9599696008825532
in-drivable-lane_max6.800000000000025
in-drivable-lane_mean6.800000000000025
in-drivable-lane_min6.800000000000025
per-episodes
details{"4way-000-ego0": {"driven_any": 3.012450779897227, "survival_time": 13.350000000000056, "driven_lanedir": -0.9599696008825532, "in-drivable-lane": 6.800000000000025, "deviation-heading": 5.085581386454162, "distance-from-start": 0.1637941593536477, "deviation-center-line": 0.2925412352625081, "driven_lanedir_consec": -0.9715523639153774}}
simulation-passed1
survival_time_max13.350000000000056
survival_time_mean13.350000000000056
survival_time_min13.350000000000056
No reset possible
7419395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7416396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7415398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7409514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-2of4failednogpu-staging-spot-0-040:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7404515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednogpu-staging-spot-0-040:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7398516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednogpu-staging-spot-0-040:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7395517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7391519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7387519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-040:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7382521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednogpu-staging-spot-0-040:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7379522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-3of4failednogpu-staging-spot-0-040:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7377522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-0of4failednogpu-staging-spot-0-040:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7359528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:13:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.393506347000782
deviation-center-line_median2.7950731246143987


other stats
deviation-center-line_max4.249963046419399
deviation-center-line_mean3.036474974767568
deviation-center-line_min2.305790603422075
deviation-heading_max13.962390495124298
deviation-heading_mean12.222333535150243
deviation-heading_median13.55381080419554
deviation-heading_min7.8193220370856045
distance-from-start_max4.460467312165887
distance-from-start_mean2.7990468053090303
distance-from-start_median2.4688065671441803
distance-from-start_min1.7981067747818738
driven_any_max9.264900492124054
driven_any_mean5.236452877239218
driven_any_median4.538305835440314
driven_any_min2.6042993459521906
driven_lanedir_consec_max8.351977109669585
driven_lanedir_consec_mean4.904212906839703
driven_lanedir_consec_min2.4778618236876624
driven_lanedir_max8.351977109669585
driven_lanedir_mean4.904212906839703
driven_lanedir_median4.393506347000782
driven_lanedir_min2.4778618236876624
in-drivable-lane_max2.099999999999987
in-drivable-lane_mean0.5249999999999968
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.6042993459521906, "survival_time": 59.99999999999873, "driven_lanedir": 2.4778618236876624, "in-drivable-lane": 0.0, "deviation-heading": 13.65769074885314, "distance-from-start": 2.159885644215329, "deviation-center-line": 4.249963046419399, "driven_lanedir_consec": 2.4778618236876624}, "autolab-000-ego1": {"driven_any": 9.264900492124054, "survival_time": 59.99999999999873, "driven_lanedir": 8.351977109669585, "in-drivable-lane": 2.099999999999987, "deviation-heading": 13.449930859537936, "distance-from-start": 4.460467312165887, "deviation-center-line": 2.305790603422075, "driven_lanedir_consec": 8.351977109669585}, "autolab-000-ego2": {"driven_any": 5.765022157753954, "survival_time": 59.99999999999873, "driven_lanedir": 5.60356686224274, "in-drivable-lane": 0.0, "deviation-heading": 7.8193220370856045, "distance-from-start": 2.7777274900730315, "deviation-center-line": 2.4874042272699537, "driven_lanedir_consec": 5.60356686224274}, "autolab-000-ego3": {"driven_any": 3.311589513126673, "survival_time": 59.99999999999873, "driven_lanedir": 3.183445831758824, "in-drivable-lane": 0.0, "deviation-heading": 13.962390495124298, "distance-from-start": 1.7981067747818738, "deviation-center-line": 3.1027420219588437, "driven_lanedir_consec": 3.183445831758824}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7357529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-040:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.30000000000014
in-drivable-lane_median0.0
driven_lanedir_consec_median2.7087144093213107
deviation-center-line_median0.609793225923325


other stats
deviation-center-line_max0.609793225923325
deviation-center-line_mean0.609793225923325
deviation-center-line_min0.609793225923325
deviation-heading_max4.178592887503774
deviation-heading_mean4.178592887503774
deviation-heading_median4.178592887503774
deviation-heading_min4.178592887503774
distance-from-start_max2.423640079529314
distance-from-start_mean2.423640079529314
distance-from-start_median2.423640079529314
distance-from-start_min2.423640079529314
driven_any_max2.7795196694942503
driven_any_mean2.7795196694942503
driven_any_median2.7795196694942503
driven_any_min2.7795196694942503
driven_lanedir_consec_max2.7087144093213107
driven_lanedir_consec_mean2.7087144093213107
driven_lanedir_consec_min2.7087144093213107
driven_lanedir_max2.7087144093213107
driven_lanedir_mean2.7087144093213107
driven_lanedir_median2.7087144093213107
driven_lanedir_min2.7087144093213107
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.7795196694942503, "survival_time": 19.30000000000014, "driven_lanedir": 2.7087144093213107, "in-drivable-lane": 0.0, "deviation-heading": 4.178592887503774, "distance-from-start": 2.423640079529314, "deviation-center-line": 0.609793225923325, "driven_lanedir_consec": 2.7087144093213107}}
simulation-passed1
survival_time_max19.30000000000014
survival_time_mean19.30000000000014
survival_time_min19.30000000000014
No reset possible
7355529Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-validationsim-1of4successnogpu-staging-spot-0-040:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.450000000000042
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1728094032015275
deviation-center-line_median0.30721683937693656


other stats
deviation-center-line_max0.30721683937693656
deviation-center-line_mean0.30721683937693656
deviation-center-line_min0.30721683937693656
deviation-heading_max2.756103228252153
deviation-heading_mean2.756103228252153
deviation-heading_median2.756103228252153
deviation-heading_min2.756103228252153
distance-from-start_max1.0804728988992465
distance-from-start_mean1.0804728988992465
distance-from-start_median1.0804728988992465
distance-from-start_min1.0804728988992465
driven_any_max1.222893976578596
driven_any_mean1.222893976578596
driven_any_median1.222893976578596
driven_any_min1.222893976578596
driven_lanedir_consec_max1.1728094032015275
driven_lanedir_consec_mean1.1728094032015275
driven_lanedir_consec_min1.1728094032015275
driven_lanedir_max1.1728094032015275
driven_lanedir_mean1.1728094032015275
driven_lanedir_median1.1728094032015275
driven_lanedir_min1.1728094032015275
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.222893976578596, "survival_time": 12.450000000000042, "driven_lanedir": 1.1728094032015275, "in-drivable-lane": 0.0, "deviation-heading": 2.756103228252153, "distance-from-start": 1.0804728988992465, "deviation-center-line": 0.30721683937693656, "driven_lanedir_consec": 1.1728094032015275}}
simulation-passed1
survival_time_max12.450000000000042
survival_time_mean12.450000000000042
survival_time_min12.450000000000042
No reset possible
7341531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-040:10:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.44999999999904
in-drivable-lane_median2.1000000000000076
driven_lanedir_consec_median8.167555819248385
deviation-center-line_median3.1949333202330013


other stats
deviation-center-line_max3.1949333202330013
deviation-center-line_mean3.1949333202330013
deviation-center-line_min3.1949333202330013
deviation-heading_max13.618676080464155
deviation-heading_mean13.618676080464155
deviation-heading_median13.618676080464155
deviation-heading_min13.618676080464155
distance-from-start_max3.022843530343279
distance-from-start_mean3.022843530343279
distance-from-start_median3.022843530343279
distance-from-start_min3.022843530343279
driven_any_max9.429919451886194
driven_any_mean9.429919451886194
driven_any_median9.429919451886194
driven_any_min9.429919451886194
driven_lanedir_consec_max8.167555819248385
driven_lanedir_consec_mean8.167555819248385
driven_lanedir_consec_min8.167555819248385
driven_lanedir_max8.444511958287347
driven_lanedir_mean8.444511958287347
driven_lanedir_median8.444511958287347
driven_lanedir_min8.444511958287347
in-drivable-lane_max2.1000000000000076
in-drivable-lane_mean2.1000000000000076
in-drivable-lane_min2.1000000000000076
per-episodes
details{"4way-000-ego0": {"driven_any": 9.429919451886194, "survival_time": 54.44999999999904, "driven_lanedir": 8.444511958287347, "in-drivable-lane": 2.1000000000000076, "deviation-heading": 13.618676080464155, "distance-from-start": 3.022843530343279, "deviation-center-line": 3.1949333202330013, "driven_lanedir_consec": 8.167555819248385}}
simulation-passed1
survival_time_max54.44999999999904
survival_time_mean54.44999999999904
survival_time_min54.44999999999904
No reset possible
7334532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4host-errornogpu-staging-spot-0-040:00:34
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7305535Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:14:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.20000000000000284
driven_lanedir_consec_median5.287396623325385
deviation-center-line_median3.76414782795827


other stats
deviation-center-line_max5.604023521883117
deviation-center-line_mean4.145850737614323
deviation-center-line_min3.4510837726576367
deviation-heading_max28.078210845349183
deviation-heading_mean17.45183019029706
deviation-heading_median15.2432952329332
deviation-heading_min11.242519449972658
distance-from-start_max4.0786972976485965
distance-from-start_mean2.0053756519471806
distance-from-start_median1.959506821870161
distance-from-start_min0.02379166639980348
driven_any_max9.21969677083588
driven_any_mean5.0634103373005
driven_any_median5.505063986303844
driven_any_min0.02381660575843119
driven_lanedir_consec_max8.82267240210557
driven_lanedir_consec_mean4.854413492023413
driven_lanedir_consec_min0.020188319337316685
driven_lanedir_max8.82267240210557
driven_lanedir_mean4.854413492023413
driven_lanedir_median5.287396623325385
driven_lanedir_min0.020188319337316685
in-drivable-lane_max0.5999999999999659
in-drivable-lane_mean0.2499999999999929
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.772828100232585, "survival_time": 59.99999999999873, "driven_lanedir": 8.526785383266038, "in-drivable-lane": 0.0, "deviation-heading": 11.242519449972658, "distance-from-start": 4.0786972976485965, "deviation-center-line": 3.4975468253759, "driven_lanedir_consec": 8.526785383266038}, "zigzag-000-ego1": {"driven_any": 9.21969677083588, "survival_time": 59.99999999999873, "driven_lanedir": 8.82267240210557, "in-drivable-lane": 0.5999999999999659, "deviation-heading": 12.01282440468717, "distance-from-start": 2.362479777846067, "deviation-center-line": 3.4510837726576367, "driven_lanedir_consec": 8.82267240210557}, "zigzag-000-ego2": {"driven_any": 2.237299872375101, "survival_time": 59.99999999999873, "driven_lanedir": 2.048007863384732, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 18.473766061179234, "distance-from-start": 1.556533865894255, "deviation-center-line": 5.604023521883117, "driven_lanedir_consec": 2.048007863384732}, "zigzag-000-ego3": {"driven_any": 0.02381660575843119, "survival_time": 59.99999999999873, "driven_lanedir": 0.020188319337316685, "in-drivable-lane": 0.0, "deviation-heading": 28.078210845349183, "distance-from-start": 0.02379166639980348, "deviation-center-line": 4.03074883054064, "driven_lanedir_consec": 0.020188319337316685}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7296536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-040:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.750000000000018
in-drivable-lane_median2.3500000000000156
driven_lanedir_consec_median1.116640394823855
deviation-center-line_median0.5317041353557004


other stats
deviation-center-line_max0.5317041353557004
deviation-center-line_mean0.5317041353557004
deviation-center-line_min0.5317041353557004
deviation-heading_max4.6402073206001715
deviation-heading_mean4.6402073206001715
deviation-heading_median4.6402073206001715
deviation-heading_min4.6402073206001715
distance-from-start_max1.190481160917516
distance-from-start_mean1.190481160917516
distance-from-start_median1.190481160917516
distance-from-start_min1.190481160917516
driven_any_max1.8364437250206664
driven_any_mean1.8364437250206664
driven_any_median1.8364437250206664
driven_any_min1.8364437250206664
driven_lanedir_consec_max1.116640394823855
driven_lanedir_consec_mean1.116640394823855
driven_lanedir_consec_min1.116640394823855
driven_lanedir_max1.116640394823855
driven_lanedir_mean1.116640394823855
driven_lanedir_median1.116640394823855
driven_lanedir_min1.116640394823855
in-drivable-lane_max2.3500000000000156
in-drivable-lane_mean2.3500000000000156
in-drivable-lane_min2.3500000000000156
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8364437250206664, "survival_time": 10.750000000000018, "driven_lanedir": 1.116640394823855, "in-drivable-lane": 2.3500000000000156, "deviation-heading": 4.6402073206001715, "distance-from-start": 1.190481160917516, "deviation-center-line": 0.5317041353557004, "driven_lanedir_consec": 1.116640394823855}}
simulation-passed1
survival_time_max10.750000000000018
survival_time_mean10.750000000000018
survival_time_min10.750000000000018
No reset possible
7293538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7284539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-040:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.599999999999995
in-drivable-lane_median0.0
driven_lanedir_consec_median0.44373351284336726
deviation-center-line_median0.22917277800320185


other stats
deviation-center-line_max0.22917277800320185
deviation-center-line_mean0.22917277800320185
deviation-center-line_min0.22917277800320185
deviation-heading_max1.346425313411436
deviation-heading_mean1.346425313411436
deviation-heading_median1.346425313411436
deviation-heading_min1.346425313411436
distance-from-start_max0.4489490168327477
distance-from-start_mean0.4489490168327477
distance-from-start_median0.4489490168327477
distance-from-start_min0.4489490168327477
driven_any_max0.47161039995409193
driven_any_mean0.47161039995409193
driven_any_median0.47161039995409193
driven_any_min0.47161039995409193
driven_lanedir_consec_max0.44373351284336726
driven_lanedir_consec_mean0.44373351284336726
driven_lanedir_consec_min0.44373351284336726
driven_lanedir_max0.44373351284336726
driven_lanedir_mean0.44373351284336726
driven_lanedir_median0.44373351284336726
driven_lanedir_min0.44373351284336726
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.47161039995409193, "survival_time": 3.599999999999995, "driven_lanedir": 0.44373351284336726, "in-drivable-lane": 0.0, "deviation-heading": 1.346425313411436, "distance-from-start": 0.4489490168327477, "deviation-center-line": 0.22917277800320185, "driven_lanedir_consec": 0.44373351284336726}}
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean3.599999999999995
survival_time_min3.599999999999995
No reset possible
7228618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:16:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median11.799999999999509
driven_lanedir_consec_median5.7158312587507245
deviation-center-line_median4.464600094561963


other stats
deviation-center-line_max4.898760441393026
deviation-center-line_mean4.418600172059673
deviation-center-line_min3.846440057721742
deviation-heading_max12.951435972129628
deviation-heading_mean11.468133420433023
deviation-heading_median12.387100035789071
deviation-heading_min8.146897638024319
distance-from-start_max4.281118089088356
distance-from-start_mean3.61787069594306
distance-from-start_median3.737936414556742
distance-from-start_min2.7144918655703987
driven_any_max7.914331529946385
driven_any_mean7.914295178072864
driven_any_median7.914295597456691
driven_any_min7.914257987431688
driven_lanedir_consec_max7.082925116176532
driven_lanedir_consec_mean5.779044021303334
driven_lanedir_consec_min4.6015884515353545
driven_lanedir_max7.082925116176532
driven_lanedir_mean6.10208820855613
driven_lanedir_median6.007592575594164
driven_lanedir_min5.3102425668596585
in-drivable-lane_max15.999999999999652
in-drivable-lane_mean10.74999999999966
in-drivable-lane_min3.3999999999999684
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.914316978631, "survival_time": 59.99999999999873, "driven_lanedir": 5.3102425668596585, "in-drivable-lane": 15.999999999999652, "deviation-heading": 12.319951819236271, "distance-from-start": 3.8668510749749503, "deviation-center-line": 3.846440057721742, "driven_lanedir_consec": 5.3102425668596585}, "autolab-000-ego1": {"driven_any": 7.914274216282384, "survival_time": 59.99999999999873, "driven_lanedir": 5.893765200546538, "in-drivable-lane": 11.949999999999449, "deviation-heading": 12.454248252341872, "distance-from-start": 4.281118089088356, "deviation-center-line": 4.898760441393026, "driven_lanedir_consec": 4.6015884515353545}, "autolab-000-ego2": {"driven_any": 7.914331529946385, "survival_time": 59.99999999999873, "driven_lanedir": 6.121419950641791, "in-drivable-lane": 11.649999999999563, "deviation-heading": 8.146897638024319, "distance-from-start": 2.7144918655703987, "deviation-center-line": 4.12368238390901, "driven_lanedir_consec": 6.121419950641791}, "autolab-000-ego3": {"driven_any": 7.914257987431688, "survival_time": 59.99999999999873, "driven_lanedir": 7.082925116176532, "in-drivable-lane": 3.3999999999999684, "deviation-heading": 12.951435972129628, "distance-from-start": 3.6090217541385345, "deviation-center-line": 4.805517805214915, "driven_lanedir_consec": 7.082925116176532}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7212605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-040:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median4.249999999999989
driven_lanedir_consec_median0.1399622467981958
deviation-center-line_median0.056651463240947955


other stats
deviation-center-line_max0.056651463240947955
deviation-center-line_mean0.056651463240947955
deviation-center-line_min0.056651463240947955
deviation-heading_max0.636708198345242
deviation-heading_mean0.636708198345242
deviation-heading_median0.636708198345242
deviation-heading_min0.636708198345242
distance-from-start_max1.1915717590491754
distance-from-start_mean1.1915717590491754
distance-from-start_median1.1915717590491754
distance-from-start_min1.1915717590491754
driven_any_max1.2669121153499496
driven_any_mean1.2669121153499496
driven_any_median1.2669121153499496
driven_any_min1.2669121153499496
driven_lanedir_consec_max0.1399622467981958
driven_lanedir_consec_mean0.1399622467981958
driven_lanedir_consec_min0.1399622467981958
driven_lanedir_max0.1399622467981958
driven_lanedir_mean0.1399622467981958
driven_lanedir_median0.1399622467981958
driven_lanedir_min0.1399622467981958
in-drivable-lane_max4.249999999999989
in-drivable-lane_mean4.249999999999989
in-drivable-lane_min4.249999999999989
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.2669121153499496, "survival_time": 5.1999999999999895, "driven_lanedir": 0.1399622467981958, "in-drivable-lane": 4.249999999999989, "deviation-heading": 0.636708198345242, "distance-from-start": 1.1915717590491754, "deviation-center-line": 0.056651463240947955, "driven_lanedir_consec": 0.1399622467981958}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
7204604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-1of4successnogpu-staging-spot-0-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.449999999999981
in-drivable-lane_median4.799999999999987
driven_lanedir_consec_median0.15203003171421647
deviation-center-line_median0.19816025126827191


other stats
deviation-center-line_max0.19816025126827191
deviation-center-line_mean0.19816025126827191
deviation-center-line_min0.19816025126827191
deviation-heading_max3.0265119847708113
deviation-heading_mean3.0265119847708113
deviation-heading_median3.0265119847708113
deviation-heading_min3.0265119847708113
distance-from-start_max1.7208946855527565
distance-from-start_mean1.7208946855527565
distance-from-start_median1.7208946855527565
distance-from-start_min1.7208946855527565
driven_any_max1.823795035926509
driven_any_mean1.823795035926509
driven_any_median1.823795035926509
driven_any_min1.823795035926509
driven_lanedir_consec_max0.15203003171421647
driven_lanedir_consec_mean0.15203003171421647
driven_lanedir_consec_min0.15203003171421647
driven_lanedir_max0.2077267131228666
driven_lanedir_mean0.2077267131228666
driven_lanedir_median0.2077267131228666
driven_lanedir_min0.2077267131228666
in-drivable-lane_max4.799999999999987
in-drivable-lane_mean4.799999999999987
in-drivable-lane_min4.799999999999987
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.823795035926509, "survival_time": 7.449999999999981, "driven_lanedir": 0.2077267131228666, "in-drivable-lane": 4.799999999999987, "deviation-heading": 3.0265119847708113, "distance-from-start": 1.7208946855527565, "deviation-center-line": 0.19816025126827191, "driven_lanedir_consec": 0.15203003171421647}}
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean7.449999999999981
survival_time_min7.449999999999981
No reset possible
7193606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7184606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-040:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median1.0499999999999992
driven_lanedir_consec_median0.2475373948976196
deviation-center-line_median0.09981588303175008


other stats
deviation-center-line_max0.09981588303175008
deviation-center-line_mean0.09981588303175008
deviation-center-line_min0.09981588303175008
deviation-heading_max0.6316030975203645
deviation-heading_mean0.6316030975203645
deviation-heading_median0.6316030975203645
deviation-heading_min0.6316030975203645
distance-from-start_max0.378304646037723
distance-from-start_mean0.378304646037723
distance-from-start_median0.378304646037723
distance-from-start_min0.378304646037723
driven_any_max0.38245149710774495
driven_any_mean0.38245149710774495
driven_any_median0.38245149710774495
driven_any_min0.38245149710774495
driven_lanedir_consec_max0.2475373948976196
driven_lanedir_consec_mean0.2475373948976196
driven_lanedir_consec_min0.2475373948976196
driven_lanedir_max0.2475373948976196
driven_lanedir_mean0.2475373948976196
driven_lanedir_median0.2475373948976196
driven_lanedir_min0.2475373948976196
in-drivable-lane_max1.0499999999999992
in-drivable-lane_mean1.0499999999999992
in-drivable-lane_min1.0499999999999992
per-episodes
details{"udem-000-ego0": {"driven_any": 0.38245149710774495, "survival_time": 2.3499999999999996, "driven_lanedir": 0.2475373948976196, "in-drivable-lane": 1.0499999999999992, "deviation-heading": 0.6316030975203645, "distance-from-start": 0.378304646037723, "deviation-center-line": 0.09981588303175008, "driven_lanedir_consec": 0.2475373948976196}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
7175607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7167609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.299999999999989
in-drivable-lane_median3.69999999999999
driven_lanedir_consec_median0.27938354975832635
deviation-center-line_median0.11730526346692877


other stats
deviation-center-line_max0.1957227485603775
deviation-center-line_mean0.12781518317665053
deviation-center-line_min0.08092745721236709
deviation-heading_max1.5543924043878754
deviation-heading_mean0.9764080026046498
deviation-heading_median0.9578045600752284
deviation-heading_min0.4356304858802663
distance-from-start_max1.2104698751598446
distance-from-start_mean0.9151585283110386
distance-from-start_median1.0415545347643906
distance-from-start_min0.3670551685555283
driven_any_max1.2436320886508725
driven_any_mean0.9382410184512036
driven_any_median1.0710368377785853
driven_any_min0.3672583095967713
driven_lanedir_consec_max0.5808955904385324
driven_lanedir_consec_mean0.3289187368510792
driven_lanedir_consec_min0.17601225744913165
driven_lanedir_max0.5808955904385324
driven_lanedir_mean0.3289187368510792
driven_lanedir_median0.27938354975832635
driven_lanedir_min0.17601225744913165
in-drivable-lane_max4.199999999999989
in-drivable-lane_mean3.5624999999999902
in-drivable-lane_min2.6499999999999924
per-episodes
details{"4way-000-ego0": {"driven_any": 1.231706498861756, "survival_time": 5.299999999999989, "driven_lanedir": 0.2564453809481595, "in-drivable-lane": 3.4499999999999913, "deviation-heading": 1.5543924043878754, "distance-from-start": 1.1945710504810896, "deviation-center-line": 0.14177849244281726, "driven_lanedir_consec": 0.2564453809481595}, "4way-000-ego1": {"driven_any": 0.3672583095967713, "survival_time": 5.299999999999989, "driven_lanedir": 0.17601225744913165, "in-drivable-lane": 4.199999999999989, "deviation-heading": 0.5398275741840997, "distance-from-start": 0.3670551685555283, "deviation-center-line": 0.09283203449104029, "driven_lanedir_consec": 0.17601225744913165}, "4way-000-ego2": {"driven_any": 1.2436320886508725, "survival_time": 5.299999999999989, "driven_lanedir": 0.5808955904385324, "in-drivable-lane": 2.6499999999999924, "deviation-heading": 1.3757815459663572, "distance-from-start": 1.2104698751598446, "deviation-center-line": 0.1957227485603775, "driven_lanedir_consec": 0.5808955904385324}, "4way-000-ego3": {"driven_any": 0.9103671766954146, "survival_time": 5.299999999999989, "driven_lanedir": 0.3023217185684932, "in-drivable-lane": 3.9499999999999886, "deviation-heading": 0.4356304858802663, "distance-from-start": 0.8885380190476918, "deviation-center-line": 0.08092745721236709, "driven_lanedir_consec": 0.3023217185684932}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_min5.299999999999989
No reset possible
7159610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-040:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.349999999999998
in-drivable-lane_median7.65
driven_lanedir_consec_median0.19285877552042777
deviation-center-line_median0.1516770369031386


other stats
deviation-center-line_max0.2397452906059252
deviation-center-line_mean0.1516770369031386
deviation-center-line_min0.06360878320035199
deviation-heading_max2.062783375729445
deviation-heading_mean1.4063853237055244
deviation-heading_median1.4063853237055244
deviation-heading_min0.749987271681604
distance-from-start_max2.379191945798165
distance-from-start_mean2.016097548184084
distance-from-start_median2.016097548184084
distance-from-start_min1.653003150570003
driven_any_max2.4278316601477377
driven_any_mean2.0663070541015616
driven_any_median2.0663070541015616
driven_any_min1.704782448055385
driven_lanedir_consec_max0.2852097053263818
driven_lanedir_consec_mean0.19285877552042777
driven_lanedir_consec_min0.10050784571447367
driven_lanedir_max0.34003445735739213
driven_lanedir_mean0.2202711515359329
driven_lanedir_median0.2202711515359329
driven_lanedir_min0.10050784571447367
in-drivable-lane_max8.449999999999998
in-drivable-lane_mean7.65
in-drivable-lane_min6.850000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.4278316601477377, "survival_time": 9.349999999999998, "driven_lanedir": 0.10050784571447367, "in-drivable-lane": 8.449999999999998, "deviation-heading": 0.749987271681604, "distance-from-start": 2.379191945798165, "deviation-center-line": 0.06360878320035199, "driven_lanedir_consec": 0.10050784571447367}, "loop2-000-ego1": {"driven_any": 1.704782448055385, "survival_time": 9.349999999999998, "driven_lanedir": 0.34003445735739213, "in-drivable-lane": 6.850000000000001, "deviation-heading": 2.062783375729445, "distance-from-start": 1.653003150570003, "deviation-center-line": 0.2397452906059252, "driven_lanedir_consec": 0.2852097053263818}}
simulation-passed1
survival_time_max9.349999999999998
survival_time_mean9.349999999999998
survival_time_min9.349999999999998
No reset possible
7154611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.4499999999999957
in-drivable-lane_median2.5999999999999956
driven_lanedir_consec_median0.07998392333628113
deviation-center-line_median0.04852540506522231


other stats
deviation-center-line_max0.04852540506522231
deviation-center-line_mean0.04852540506522231
deviation-center-line_min0.04852540506522231
deviation-heading_max0.7137801255411704
deviation-heading_mean0.7137801255411704
deviation-heading_median0.7137801255411704
deviation-heading_min0.7137801255411704
distance-from-start_max0.6631285866564519
distance-from-start_mean0.6631285866564519
distance-from-start_median0.6631285866564519
distance-from-start_min0.6631285866564519
driven_any_max0.6648705033450425
driven_any_mean0.6648705033450425
driven_any_median0.6648705033450425
driven_any_min0.6648705033450425
driven_lanedir_consec_max0.07998392333628113
driven_lanedir_consec_mean0.07998392333628113
driven_lanedir_consec_min0.07998392333628113
driven_lanedir_max0.07998392333628113
driven_lanedir_mean0.07998392333628113
driven_lanedir_median0.07998392333628113
driven_lanedir_min0.07998392333628113
in-drivable-lane_max2.5999999999999956
in-drivable-lane_mean2.5999999999999956
in-drivable-lane_min2.5999999999999956
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.6648705033450425, "survival_time": 3.4499999999999957, "driven_lanedir": 0.07998392333628113, "in-drivable-lane": 2.5999999999999956, "deviation-heading": 0.7137801255411704, "distance-from-start": 0.6631285866564519, "deviation-center-line": 0.04852540506522231, "driven_lanedir_consec": 0.07998392333628113}}
simulation-passed1
survival_time_max3.4499999999999957
survival_time_mean3.4499999999999957
survival_time_min3.4499999999999957
No reset possible
7152611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-2of4host-errornogpu-staging-spot-0-040:00:21
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7143614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-040:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.399999999999992
in-drivable-lane_median2.0999999999999956
driven_lanedir_consec_median0.5328802448179605
deviation-center-line_median0.24458761407490331


other stats
deviation-center-line_max0.24458761407490331
deviation-center-line_mean0.24458761407490331
deviation-center-line_min0.24458761407490331
deviation-heading_max1.0479249804639452
deviation-heading_mean1.0479249804639452
deviation-heading_median1.0479249804639452
deviation-heading_min1.0479249804639452
distance-from-start_max0.9638375454857584
distance-from-start_mean0.9638375454857584
distance-from-start_median0.9638375454857584
distance-from-start_min0.9638375454857584
driven_any_max1.0438079974295986
driven_any_mean1.0438079974295986
driven_any_median1.0438079974295986
driven_any_min1.0438079974295986
driven_lanedir_consec_max0.5328802448179605
driven_lanedir_consec_mean0.5328802448179605
driven_lanedir_consec_min0.5328802448179605
driven_lanedir_max0.5462480738533716
driven_lanedir_mean0.5462480738533716
driven_lanedir_median0.5462480738533716
driven_lanedir_min0.5462480738533716
in-drivable-lane_max2.0999999999999956
in-drivable-lane_mean2.0999999999999956
in-drivable-lane_min2.0999999999999956
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0438079974295986, "survival_time": 4.399999999999992, "driven_lanedir": 0.5462480738533716, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 1.0479249804639452, "distance-from-start": 0.9638375454857584, "deviation-center-line": 0.24458761407490331, "driven_lanedir_consec": 0.5328802448179605}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_min4.399999999999992
No reset possible
7139615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-040:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1146820789258738
survival_time_median4.799999999999991
deviation-center-line_median0.0555668683036922
in-drivable-lane_median3.949999999999991


other stats
deviation-center-line_max0.0555668683036922
deviation-center-line_mean0.0555668683036922
deviation-center-line_min0.0555668683036922
deviation-heading_max0.6277518720308497
deviation-heading_mean0.6277518720308497
deviation-heading_median0.6277518720308497
deviation-heading_min0.6277518720308497
distance-from-start_max1.133873071757881
distance-from-start_mean1.133873071757881
distance-from-start_median1.133873071757881
distance-from-start_min1.133873071757881
driven_any_max1.1539158592774423
driven_any_mean1.1539158592774423
driven_any_median1.1539158592774423
driven_any_min1.1539158592774423
driven_lanedir_consec_max0.1146820789258738
driven_lanedir_consec_mean0.1146820789258738
driven_lanedir_consec_min0.1146820789258738
driven_lanedir_max0.1146820789258738
driven_lanedir_mean0.1146820789258738
driven_lanedir_median0.1146820789258738
driven_lanedir_min0.1146820789258738
in-drivable-lane_max3.949999999999991
in-drivable-lane_mean3.949999999999991
in-drivable-lane_min3.949999999999991
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1539158592774423, "survival_time": 4.799999999999991, "driven_lanedir": 0.1146820789258738, "in-drivable-lane": 3.949999999999991, "deviation-heading": 0.6277518720308497, "distance-from-start": 1.133873071757881, "deviation-center-line": 0.0555668683036922, "driven_lanedir_consec": 0.1146820789258738}}
simulation-passed1
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible
7131616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-0of4successnogpu-staging-spot-0-040:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.89999999999998
in-drivable-lane_median6.84999999999998
driven_lanedir_consec_median0.18486465367247884
deviation-center-line_median0.09565884690380408


other stats
deviation-center-line_max0.26004544898622767
deviation-center-line_mean0.1348534752028135
deviation-center-line_min0.08805075801741812
deviation-heading_max0.6376321306603532
deviation-heading_mean0.48415695988355056
deviation-heading_median0.4651554180112734
deviation-heading_min0.3686848728513024
distance-from-start_max1.8940612408713395
distance-from-start_mean1.0268463467275653
distance-from-start_median0.920944055178842
distance-from-start_min0.37143603568123734
driven_any_max1.9376980201706184
driven_any_mean1.0416836023009124
driven_any_median0.9281204780737756
driven_any_min0.3727954328854795
driven_lanedir_consec_max0.6552462252653213
driven_lanedir_consec_mean0.29284762160089345
driven_lanedir_consec_min0.14641495379329483
driven_lanedir_max0.9256046719384337
driven_lanedir_mean0.36043723326917154
driven_lanedir_median0.18486465367247884
driven_lanedir_min0.14641495379329483
in-drivable-lane_max6.99999999999998
in-drivable-lane_mean6.299999999999981
in-drivable-lane_min4.499999999999984
per-episodes
details{"udem-000-ego0": {"driven_any": 1.9376980201706184, "survival_time": 7.89999999999998, "driven_lanedir": 0.20353289869911315, "in-drivable-lane": 6.74999999999998, "deviation-heading": 0.6376321306603532, "distance-from-start": 1.8940612408713395, "deviation-center-line": 0.09317624875242614, "driven_lanedir_consec": 0.20353289869911315}, "udem-000-ego1": {"driven_any": 0.8440314499647921, "survival_time": 7.89999999999998, "driven_lanedir": 0.1661964086458445, "in-drivable-lane": 6.99999999999998, "deviation-heading": 0.3686848728513024, "distance-from-start": 0.8417313070567269, "deviation-center-line": 0.08805075801741812, "driven_lanedir_consec": 0.1661964086458445}, "udem-000-ego2": {"driven_any": 1.0122095061827592, "survival_time": 7.89999999999998, "driven_lanedir": 0.9256046719384337, "in-drivable-lane": 4.499999999999984, "deviation-heading": 0.38925395560676007, "distance-from-start": 1.0001568033009574, "deviation-center-line": 0.26004544898622767, "driven_lanedir_consec": 0.6552462252653213}, "udem-000-ego3": {"driven_any": 0.3727954328854795, "survival_time": 7.89999999999998, "driven_lanedir": 0.14641495379329483, "in-drivable-lane": 6.94999999999998, "deviation-heading": 0.5410568804157868, "distance-from-start": 0.37143603568123734, "deviation-center-line": 0.09814144505518203, "driven_lanedir_consec": 0.14641495379329483}}
simulation-passed1
survival_time_max7.89999999999998
survival_time_mean7.89999999999998
survival_time_min7.89999999999998
No reset possible
7125616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7106621Bea Baselines 🐤baseline-duckietownaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-040:10:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.349999999999927
driven_lanedir_consec_median5.849041139347025
deviation-center-line_median4.956018164313859


other stats
deviation-center-line_max4.956018164313859
deviation-center-line_mean4.956018164313859
deviation-center-line_min4.956018164313859
deviation-heading_max9.627103288759196
deviation-heading_mean9.627103288759196
deviation-heading_median9.627103288759196
deviation-heading_min9.627103288759196
distance-from-start_max2.5606098058774216
distance-from-start_mean2.5606098058774216
distance-from-start_median2.5606098058774216
distance-from-start_min2.5606098058774216
driven_any_max7.914313787688988
driven_any_mean7.914313787688988
driven_any_median7.914313787688988
driven_any_min7.914313787688988
driven_lanedir_consec_max5.849041139347025
driven_lanedir_consec_mean5.849041139347025
driven_lanedir_consec_min5.849041139347025
driven_lanedir_max6.9728570716555565
driven_lanedir_mean6.9728570716555565
driven_lanedir_median6.9728570716555565
driven_lanedir_min6.9728570716555565
in-drivable-lane_max5.349999999999927
in-drivable-lane_mean5.349999999999927
in-drivable-lane_min5.349999999999927
per-episodes
details{"4way-000-ego0": {"driven_any": 7.914313787688988, "survival_time": 59.99999999999873, "driven_lanedir": 6.9728570716555565, "in-drivable-lane": 5.349999999999927, "deviation-heading": 9.627103288759196, "distance-from-start": 2.5606098058774216, "deviation-center-line": 4.956018164313859, "driven_lanedir_consec": 5.849041139347025}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7082646Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:18:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.82499999999932
driven_lanedir_consec_median1.3390419988303388
deviation-center-line_median1.4028800699475412


other stats
deviation-center-line_max3.36272541975611
deviation-center-line_mean1.5626965824456194
deviation-center-line_min0.08230077013128466
deviation-heading_max25.32425024775526
deviation-heading_mean17.63537201303008
deviation-heading_median22.291766411521948
deviation-heading_min0.6337049813211568
distance-from-start_max0.9592665780430684
distance-from-start_mean0.5242477851112426
distance-from-start_median0.5079358662984346
distance-from-start_min0.1218528298050332
driven_any_max5.936587429124937
driven_any_mean3.921577232532834
driven_any_median4.464372519738562
driven_any_min0.8209764615292723
driven_lanedir_consec_max1.6585018639746212
driven_lanedir_consec_mean1.1097520691998417
driven_lanedir_consec_min0.10242241516406758
driven_lanedir_max1.6585018639746212
driven_lanedir_mean1.1097520691998417
driven_lanedir_median1.3390419988303388
driven_lanedir_min0.10242241516406758
in-drivable-lane_max59.04999999999873
in-drivable-lane_mean37.27499999999921
in-drivable-lane_min26.399999999999473
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5177843353630527, "survival_time": 59.99999999999873, "driven_lanedir": 1.193491647294403, "in-drivable-lane": 26.399999999999473, "deviation-heading": 25.32425024775526, "distance-from-start": 0.27658828090891074, "deviation-center-line": 1.5925219382783595, "driven_lanedir_consec": 1.193491647294403}, "autolab-000-ego1": {"driven_any": 0.8209764615292723, "survival_time": 59.99999999999873, "driven_lanedir": 0.10242241516406758, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.6337049813211568, "distance-from-start": 0.7392834516879583, "deviation-center-line": 0.08230077013128466, "driven_lanedir_consec": 0.10242241516406758}, "autolab-000-ego2": {"driven_any": 5.410960704114073, "survival_time": 59.99999999999873, "driven_lanedir": 1.6585018639746212, "in-drivable-lane": 31.49999999999931, "deviation-heading": 22.959340177352484, "distance-from-start": 0.1218528298050332, "deviation-center-line": 3.36272541975611, "driven_lanedir_consec": 1.6585018639746212}, "autolab-000-ego3": {"driven_any": 5.936587429124937, "survival_time": 59.99999999999873, "driven_lanedir": 1.4845923503662748, "in-drivable-lane": 32.14999999999933, "deviation-heading": 21.62419264569141, "distance-from-start": 0.9592665780430684, "deviation-center-line": 1.213238201616723, "driven_lanedir_consec": 1.4845923503662748}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7071647Bea Baselines 🐤template-pytorchaido-LFP-sim-validationsim-0of4successnogpu-staging-spot-0-040:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.19999999999919
driven_lanedir_consec_median0.6346891094625253
deviation-center-line_median2.315432300536989


other stats
deviation-center-line_max2.315432300536989
deviation-center-line_mean2.315432300536989
deviation-center-line_min2.315432300536989
deviation-heading_max19.393934738730145
deviation-heading_mean19.393934738730145
deviation-heading_median19.393934738730145
deviation-heading_min19.393934738730145
distance-from-start_max0.530487642494692
distance-from-start_mean0.530487642494692
distance-from-start_median0.530487642494692
distance-from-start_min0.530487642494692
driven_any_max5.6071210103105615
driven_any_mean5.6071210103105615
driven_any_median5.6071210103105615
driven_any_min5.6071210103105615
driven_lanedir_consec_max0.6346891094625253
driven_lanedir_consec_mean0.6346891094625253
driven_lanedir_consec_min0.6346891094625253
driven_lanedir_max1.1624468941816484
driven_lanedir_mean1.1624468941816484
driven_lanedir_median1.1624468941816484
driven_lanedir_min1.1624468941816484
in-drivable-lane_max37.19999999999919
in-drivable-lane_mean37.19999999999919
in-drivable-lane_min37.19999999999919
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.6071210103105615, "survival_time": 59.99999999999873, "driven_lanedir": 1.1624468941816484, "in-drivable-lane": 37.19999999999919, "deviation-heading": 19.393934738730145, "distance-from-start": 0.530487642494692, "deviation-center-line": 2.315432300536989, "driven_lanedir_consec": 0.6346891094625253}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7061648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:06:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.14999999999907
driven_lanedir_consec_median1.9189928742784188
deviation-center-line_median2.0507344780653134


other stats
deviation-center-line_max2.0507344780653134
deviation-center-line_mean2.0507344780653134
deviation-center-line_min2.0507344780653134
deviation-heading_max16.01796232504459
deviation-heading_mean16.01796232504459
deviation-heading_median16.01796232504459
deviation-heading_min16.01796232504459
distance-from-start_max0.8402138802148751
distance-from-start_mean0.8402138802148751
distance-from-start_median0.8402138802148751
distance-from-start_min0.8402138802148751
driven_any_max8.21140533517894
driven_any_mean8.21140533517894
driven_any_median8.21140533517894
driven_any_min8.21140533517894
driven_lanedir_consec_max1.9189928742784188
driven_lanedir_consec_mean1.9189928742784188
driven_lanedir_consec_min1.9189928742784188
driven_lanedir_max2.107770995824585
driven_lanedir_mean2.107770995824585
driven_lanedir_median2.107770995824585
driven_lanedir_min2.107770995824585
in-drivable-lane_max37.14999999999907
in-drivable-lane_mean37.14999999999907
in-drivable-lane_min37.14999999999907
per-episodes
details{"loop2-000-ego0": {"driven_any": 8.21140533517894, "survival_time": 59.99999999999873, "driven_lanedir": 2.107770995824585, "in-drivable-lane": 37.14999999999907, "deviation-heading": 16.01796232504459, "distance-from-start": 0.8402138802148751, "deviation-center-line": 2.0507344780653134, "driven_lanedir_consec": 1.9189928742784188}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7051650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-040:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median31.89999999999923
driven_lanedir_consec_median2.5784364604866252
deviation-center-line_median2.703291659456323


other stats
deviation-center-line_max2.703291659456323
deviation-center-line_mean2.703291659456323
deviation-center-line_min2.703291659456323
deviation-heading_max21.6802224177989
deviation-heading_mean21.6802224177989
deviation-heading_median21.6802224177989
deviation-heading_min21.6802224177989
distance-from-start_max0.23978805849917256
distance-from-start_mean0.23978805849917256
distance-from-start_median0.23978805849917256
distance-from-start_min0.23978805849917256
driven_any_max8.123154031080142
driven_any_mean8.123154031080142
driven_any_median8.123154031080142
driven_any_min8.123154031080142
driven_lanedir_consec_max2.5784364604866252
driven_lanedir_consec_mean2.5784364604866252
driven_lanedir_consec_min2.5784364604866252
driven_lanedir_max2.5784364604866252
driven_lanedir_mean2.5784364604866252
driven_lanedir_median2.5784364604866252
driven_lanedir_min2.5784364604866252
in-drivable-lane_max31.89999999999923
in-drivable-lane_mean31.89999999999923
in-drivable-lane_min31.89999999999923
per-episodes
details{"udem1-000-ego0": {"driven_any": 8.123154031080142, "survival_time": 59.99999999999873, "driven_lanedir": 2.5784364604866252, "in-drivable-lane": 31.89999999999923, "deviation-heading": 21.6802224177989, "distance-from-start": 0.23978805849917256, "deviation-center-line": 2.703291659456323, "driven_lanedir_consec": 2.5784364604866252}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7047650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7044650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4host-errornogpu-staging-spot-0-040:01:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/788208555f83c454b7e074c086c6dec0277809a71f55963d64a73db50eae3845/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/788208555f83c454b7e074c086c6dec0277809a71f55963d64a73db50eae3845/json: Not Found ("No such container: 788208555f83c454b7e074c086c6dec0277809a71f55963d64a73db50eae3845")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7020653Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:16:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median16.274999999999665
driven_lanedir_consec_median0.22603542425903544
deviation-center-line_median2.4662641767531976


other stats
deviation-center-line_max9.394563556145687
deviation-center-line_mean3.69711150165644
deviation-center-line_min0.46135409697367946
deviation-heading_max75.23031951534976
deviation-heading_mean35.35266226950359
deviation-heading_median31.357672129335775
deviation-heading_min3.4649853039930454
distance-from-start_max0.6782178461254579
distance-from-start_mean0.31696907617300374
distance-from-start_median0.2859293223295097
distance-from-start_min0.017799813907537612
driven_any_max5.507438489118549
driven_any_mean2.708241305518741
driven_any_median2.6538629171718915
driven_any_min0.017800898612632666
driven_lanedir_consec_max1.4278393480464002
driven_lanedir_consec_mean0.4734404367457399
driven_lanedir_consec_min0.0138515504184884
driven_lanedir_max1.4278393480464002
driven_lanedir_mean0.4734404367457399
driven_lanedir_median0.22603542425903544
driven_lanedir_min0.0138515504184884
in-drivable-lane_max54.79999999999872
in-drivable-lane_mean21.837499999999512
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.507438489118549, "survival_time": 59.99999999999873, "driven_lanedir": 0.3640226896986816, "in-drivable-lane": 54.79999999999872, "deviation-heading": 3.4649853039930454, "distance-from-start": 0.6782178461254579, "deviation-center-line": 0.46135409697367946, "driven_lanedir_consec": 0.3640226896986816}, "zigzag-000-ego1": {"driven_any": 0.23571358499148656, "survival_time": 59.99999999999873, "driven_lanedir": 0.08804815881938932, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 75.23031951534976, "distance-from-start": 0.11865203263973324, "deviation-center-line": 9.394563556145687, "driven_lanedir_consec": 0.08804815881938932}, "zigzag-000-ego2": {"driven_any": 5.072012249352296, "survival_time": 59.99999999999873, "driven_lanedir": 1.4278393480464002, "in-drivable-lane": 31.84999999999933, "deviation-heading": 22.306180608533136, "distance-from-start": 0.45320661201928614, "deviation-center-line": 1.0618167568871797, "driven_lanedir_consec": 1.4278393480464002}, "zigzag-000-ego3": {"driven_any": 0.017800898612632666, "survival_time": 59.99999999999873, "driven_lanedir": 0.0138515504184884, "in-drivable-lane": 0.0, "deviation-heading": 40.40916365013841, "distance-from-start": 0.017799813907537612, "deviation-center-line": 3.870711596619216, "driven_lanedir_consec": 0.0138515504184884}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7008654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-040:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.49999999999913
driven_lanedir_consec_median1.2546375936480831
deviation-center-line_median2.861189758949101


other stats
deviation-center-line_max2.861189758949101
deviation-center-line_mean2.861189758949101
deviation-center-line_min2.861189758949101
deviation-heading_max20.842799955719435
deviation-heading_mean20.842799955719435
deviation-heading_median20.842799955719435
deviation-heading_min20.842799955719435
distance-from-start_max0.3158115984342156
distance-from-start_mean0.3158115984342156
distance-from-start_median0.3158115984342156
distance-from-start_min0.3158115984342156
driven_any_max5.866548151669116
driven_any_mean5.866548151669116
driven_any_median5.866548151669116
driven_any_min5.866548151669116
driven_lanedir_consec_max1.2546375936480831
driven_lanedir_consec_mean1.2546375936480831
driven_lanedir_consec_min1.2546375936480831
driven_lanedir_max1.2546375936480831
driven_lanedir_mean1.2546375936480831
driven_lanedir_median1.2546375936480831
driven_lanedir_min1.2546375936480831
in-drivable-lane_max35.49999999999913
in-drivable-lane_mean35.49999999999913
in-drivable-lane_min35.49999999999913
per-episodes
details{"loop-000-ego0": {"driven_any": 5.866548151669116, "survival_time": 59.99999999999873, "driven_lanedir": 1.2546375936480831, "in-drivable-lane": 35.49999999999913, "deviation-heading": 20.842799955719435, "distance-from-start": 0.3158115984342156, "deviation-center-line": 2.861189758949101, "driven_lanedir_consec": 1.2546375936480831}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6961703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:15:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.599999999998715
driven_lanedir_consec_median0.17850006289932396
deviation-center-line_median0.49660205595737594


other stats
deviation-center-line_max0.7655517644258731
deviation-center-line_mean0.550438887644005
deviation-center-line_min0.4429996742353948
deviation-heading_max5.708723015945328
deviation-heading_mean4.314762107049478
deviation-heading_median4.260413639699664
deviation-heading_min3.029498132853256
distance-from-start_max1.4108418329398826
distance-from-start_mean1.1194358824993853
distance-from-start_median1.1354018196019648
distance-from-start_min0.7960980578537286
driven_any_max15.326310847370626
driven_any_mean11.633879106528216
driven_any_median12.316353572892982
driven_any_min6.576498432956271
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.18178573943420095
driven_lanedir_consec_min0.0983081207661829
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.16790489531803093
driven_lanedir_median0.1652120582661244
driven_lanedir_min0.0873654691406669
in-drivable-lane_max54.699999999998695
in-drivable-lane_mean53.33749999999871
in-drivable-lane_min51.44999999999871
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465089, "survival_time": 59.99999999999873, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 51.44999999999871, "deviation-heading": 5.708723015945328, "distance-from-start": 1.0442247976691956, "deviation-center-line": 0.7655517644258731, "driven_lanedir_consec": 0.271834711171973}, "loop-000-ego1": {"driven_any": 6.576498432956271, "survival_time": 59.99999999999873, "driven_lanedir": 0.1969664999784144, "in-drivable-lane": 52.54999999999872, "deviation-heading": 4.716518246290203, "distance-from-start": 0.7960980578537286, "deviation-center-line": 0.5494202135367019, "driven_lanedir_consec": 0.2102948009868546}, "loop-000-ego2": {"driven_any": 13.256645143320878, "survival_time": 59.99999999999873, "driven_lanedir": 0.13345761655383437, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.029498132853256, "distance-from-start": 1.226578841534734, "deviation-center-line": 0.4429996742353948, "driven_lanedir_consec": 0.14670532481179333}, "loop-000-ego3": {"driven_any": 15.326310847370626, "survival_time": 59.99999999999873, "driven_lanedir": 0.0873654691406669, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109124, "distance-from-start": 1.4108418329398826, "deviation-center-line": 0.4437838983780501, "driven_lanedir_consec": 0.0983081207661829}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6958665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-040:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6950666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6945667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-0of4failednogpu-staging-spot-0-040:01:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6940668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failednogpu-staging-spot-0-040:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6937668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-3of4failednogpu-staging-spot-0-040:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6933793Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6927794Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-040:01:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6922670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-1of4failednogpu-staging-spot-0-040:02:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6915671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6911673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6906673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6905673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-040:02:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6893705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-040:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.271834711171973
deviation-center-line_median0.7655520909538922


other stats
deviation-center-line_max0.7655520909538922
deviation-center-line_mean0.7655520909538922
deviation-center-line_min0.7655520909538922
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max1.044224797669198
distance-from-start_mean1.044224797669198
distance-from-start_median1.044224797669198
distance-from-start_min1.044224797669198
driven_any_max11.376062002465094
driven_any_mean11.376062002465094
driven_any_median11.376062002465094
driven_any_min11.376062002465094
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.271834711171973
driven_lanedir_consec_min0.271834711171973
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.25382999559920805
driven_lanedir_median0.25382999559920805
driven_lanedir_min0.25382999559920805
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
6889705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-040:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999994
in-drivable-lane_median1.6499999999999972
driven_lanedir_consec_median0.4413284134549402
deviation-center-line_median0.07863297638595365


other stats
deviation-center-line_max0.07863297638595365
deviation-center-line_mean0.07863297638595365
deviation-center-line_min0.07863297638595365
deviation-heading_max1.38663091368877
deviation-heading_mean1.38663091368877
deviation-heading_median1.38663091368877
deviation-heading_min1.38663091368877
distance-from-start_max0.4891723059495441
distance-from-start_mean0.4891723059495441
distance-from-start_median0.4891723059495441
distance-from-start_min0.4891723059495441
driven_any_max0.5134230938905382
driven_any_mean0.5134230938905382
driven_any_median0.5134230938905382
driven_any_min0.5134230938905382
driven_lanedir_consec_max0.4413284134549402
driven_lanedir_consec_mean0.4413284134549402
driven_lanedir_consec_min0.4413284134549402
driven_lanedir_max0.4413284134549402
driven_lanedir_mean0.4413284134549402
driven_lanedir_median0.4413284134549402
driven_lanedir_min0.4413284134549402
in-drivable-lane_max1.6499999999999972
in-drivable-lane_mean1.6499999999999972
in-drivable-lane_min1.6499999999999972
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5134230938905382, "survival_time": 3.899999999999994, "driven_lanedir": 0.4413284134549402, "in-drivable-lane": 1.6499999999999972, "deviation-heading": 1.38663091368877, "distance-from-start": 0.4891723059495441, "deviation-center-line": 0.07863297638595365, "driven_lanedir_consec": 0.4413284134549402}}
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean3.899999999999994
survival_time_min3.899999999999994
No reset possible
6887706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6883706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6879707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6863710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:14:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median50.54999999999893
driven_lanedir_consec_median0.010547930232535654
deviation-center-line_median0.8332713496515217


other stats
deviation-center-line_max2.7624735124852213
deviation-center-line_mean1.2534966840273465
deviation-center-line_min0.5849705243211205
deviation-heading_max37.85352281193537
deviation-heading_mean13.74892880994846
deviation-heading_median6.255913446760742
deviation-heading_min4.63036553433699
distance-from-start_max1.4108418329398922
distance-from-start_mean0.7664936116527056
distance-from-start_median0.8275663068354648
distance-from-start_min4.965068306494546e-16
driven_any_max15.326310847370552
driven_any_mean7.179006617535183
driven_any_median6.694857811384825
driven_any_min5.328713280502633e-13
driven_lanedir_consec_max0.1383364895771639
driven_lanedir_consec_mean0.03978656193682834
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max0.11398132258212844
driven_lanedir_mean0.031025259247181865
driven_lanedir_median0.00774466889682357
driven_lanedir_min-0.005369623387048134
in-drivable-lane_max53.849999999998694
in-drivable-lane_mean38.73749999999914
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.689235011240985, "survival_time": 59.99999999999873, "driven_lanedir": 0.015775440088569015, "in-drivable-lane": 53.74999999999868, "deviation-heading": 4.775258835818575, "distance-from-start": 0.7727279384518404, "deviation-center-line": 0.5849705243211205, "driven_lanedir_consec": 0.012429097989935078}, "zigzag-000-ego1": {"driven_any": 7.700480611528665, "survival_time": 59.99999999999873, "driven_lanedir": 0.11398132258212844, "in-drivable-lane": 53.849999999998694, "deviation-heading": 4.63036553433699, "distance-from-start": 0.8824046752190894, "deviation-center-line": 0.597954121505881, "driven_lanedir_consec": 0.1383364895771639}, "zigzag-000-ego2": {"driven_any": 15.326310847370552, "survival_time": 59.99999999999873, "driven_lanedir": -0.005369623387048134, "in-drivable-lane": 47.34999999999918, "deviation-heading": 7.736568057702908, "distance-from-start": 1.4108418329398922, "deviation-center-line": 1.0685885777971624, "driven_lanedir_consec": 0.00866676247513623}, "zigzag-000-ego3": {"driven_any": 5.328713280502633e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 37.85352281193537, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 2.7624735124852213, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6841716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-040:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.99999999999935
in-drivable-lane_median38.499999999999304
driven_lanedir_consec_median0.1764110638479598
deviation-center-line_median0.9531427784471488


other stats
deviation-center-line_max2.832529886995349
deviation-center-line_mean1.311943853353024
deviation-center-line_min0.5089599695224504
deviation-heading_max33.1589668039187
deviation-heading_mean12.62594009217387
deviation-heading_median7.392834811631175
deviation-heading_min2.5591239415144273
distance-from-start_max1.1376277719266368
distance-from-start_mean0.654460762413978
distance-from-start_median0.7401076388646376
distance-from-start_min2.220446049250313e-16
driven_any_max12.38395710263782
driven_any_mean5.860243976176914
driven_any_median5.528509401034555
driven_any_min7.240401296455718e-13
driven_lanedir_consec_max0.24555159589762132
driven_lanedir_consec_mean0.14959343089838523
driven_lanedir_consec_min0.0
driven_lanedir_max0.23581644060907703
driven_lanedir_mean0.14279539215489673
driven_lanedir_median0.16768256400525494
driven_lanedir_min0.0
in-drivable-lane_max43.94999999999935
in-drivable-lane_mean30.23749999999949
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 8.61801250372655, "survival_time": 48.99999999999935, "driven_lanedir": 0.23581644060907703, "in-drivable-lane": 34.99999999999926, "deviation-heading": 9.90660072624876, "distance-from-start": 0.9340577697896248, "deviation-center-line": 1.391984666848221, "driven_lanedir_consec": 0.24555159589762132}, "4way-000-ego1": {"driven_any": 7.240401296455718e-13, "survival_time": 48.99999999999935, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 33.1589668039187, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.832529886995349, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 48.99999999999935, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 43.94999999999935, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "4way-000-ego3": {"driven_any": 12.38395710263782, "survival_time": 48.99999999999935, "driven_lanedir": 0.18909778689237045, "in-drivable-lane": 41.99999999999934, "deviation-heading": 4.879068897013592, "distance-from-start": 1.1376277719266368, "deviation-center-line": 0.5089599695224504, "driven_lanedir_consec": 0.19998529621221617}}
simulation-passed1
survival_time_max48.99999999999935
survival_time_mean48.99999999999935
survival_time_min48.99999999999935
No reset possible
6837716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6821734Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-040:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353262


other stats
deviation-center-line_max0.8948975282353262
deviation-center-line_mean0.8948975282353262
deviation-center-line_min0.8948975282353262
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.7755575615628914e-17
distance-from-start_mean2.7755575615628914e-17
distance-from-start_median2.7755575615628914e-17
distance-from-start_min2.7755575615628914e-17
driven_any_max3.3306690738754696e-14
driven_any_mean3.3306690738754696e-14
driven_any_median3.3306690738754696e-14
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6804736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-040:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299468


other stats
deviation-center-line_max0.8949116056299468
deviation-center-line_mean0.8949116056299468
deviation-center-line_min0.8949116056299468
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6788769Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:11:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median7.849999999999793
driven_lanedir_consec_median3.5537221437103383
deviation-center-line_median1.8440447591260096


other stats
deviation-center-line_max2.9235776481162494
deviation-center-line_mean1.9217341226268068
deviation-center-line_min1.0752693241389577
deviation-heading_max12.600274482483208
deviation-heading_mean9.229964757994308
deviation-heading_median10.271881007517452
deviation-heading_min3.775822534459123
distance-from-start_max3.076072715024513
distance-from-start_mean2.221154230844533
distance-from-start_median2.247608056713
distance-from-start_min1.3133280949276196
driven_any_max7.907708494055374
driven_any_mean5.195844858446671
driven_any_median5.006605648168936
driven_any_min2.8624596433934375
driven_lanedir_consec_max4.684740097289544
driven_lanedir_consec_mean3.292105744282691
driven_lanedir_consec_min1.3762385924205425
driven_lanedir_max6.441548414407825
driven_lanedir_mean4.366782701475886
driven_lanedir_median4.1681221564219175
driven_lanedir_min2.6893380786518843
in-drivable-lane_max38.49999999999856
in-drivable-lane_mean13.637499999999536
in-drivable-lane_min0.350000000000005
per-episodes
details{"loop-000-ego0": {"driven_any": 2.8624596433934375, "survival_time": 59.99999999999873, "driven_lanedir": 2.701592065304941, "in-drivable-lane": 38.49999999999856, "deviation-heading": 3.775822534459123, "distance-from-start": 2.0355321342442476, "deviation-center-line": 1.1336071127980238, "driven_lanedir_consec": 2.563599181343555}, "loop-000-ego1": {"driven_any": 2.862528235261764, "survival_time": 59.99999999999873, "driven_lanedir": 2.6893380786518843, "in-drivable-lane": 0.350000000000005, "deviation-heading": 11.223754151202536, "distance-from-start": 1.3133280949276196, "deviation-center-line": 1.0752693241389577, "driven_lanedir_consec": 1.3762385924205425}, "loop-000-ego2": {"driven_any": 7.1506830610761085, "survival_time": 59.99999999999873, "driven_lanedir": 5.634652247538894, "in-drivable-lane": 7.299999999999976, "deviation-heading": 12.600274482483208, "distance-from-start": 3.076072715024513, "deviation-center-line": 2.554482405453996, "driven_lanedir_consec": 4.684740097289544}, "loop-000-ego3": {"driven_any": 7.907708494055374, "survival_time": 59.99999999999873, "driven_lanedir": 6.441548414407825, "in-drivable-lane": 8.39999999999961, "deviation-heading": 9.320007863832368, "distance-from-start": 2.459683979181752, "deviation-center-line": 2.9235776481162494, "driven_lanedir_consec": 4.543845106077122}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6785770Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-2of4successnogpu-staging-spot-0-040:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.399999999999982
in-drivable-lane_median0.0
driven_lanedir_consec_median0.8011147855387097
deviation-center-line_median0.43187783113153033


other stats
deviation-center-line_max0.43187783113153033
deviation-center-line_mean0.43187783113153033
deviation-center-line_min0.43187783113153033
deviation-heading_max1.7158632854282188
deviation-heading_mean1.7158632854282188
deviation-heading_median1.7158632854282188
deviation-heading_min1.7158632854282188
distance-from-start_max0.6396517991602446
distance-from-start_mean0.6396517991602446
distance-from-start_median0.6396517991602446
distance-from-start_min0.6396517991602446
driven_any_max0.8311232314167597
driven_any_mean0.8311232314167597
driven_any_median0.8311232314167597
driven_any_min0.8311232314167597
driven_lanedir_consec_max0.8011147855387097
driven_lanedir_consec_mean0.8011147855387097
driven_lanedir_consec_min0.8011147855387097
driven_lanedir_max0.8011147855387097
driven_lanedir_mean0.8011147855387097
driven_lanedir_median0.8011147855387097
driven_lanedir_min0.8011147855387097
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8311232314167597, "survival_time": 7.399999999999982, "driven_lanedir": 0.8011147855387097, "in-drivable-lane": 0.0, "deviation-heading": 1.7158632854282188, "distance-from-start": 0.6396517991602446, "deviation-center-line": 0.43187783113153033, "driven_lanedir_consec": 0.8011147855387097}}
simulation-passed1
survival_time_max7.399999999999982
survival_time_mean7.399999999999982
survival_time_min7.399999999999982
No reset possible
6772771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-040:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median52.94999999999913
in-drivable-lane_median7.999999999999858
driven_lanedir_consec_median5.524483794413526
deviation-center-line_median3.173562328055389


other stats
deviation-center-line_max3.173562328055389
deviation-center-line_mean3.173562328055389
deviation-center-line_min3.173562328055389
deviation-heading_max9.74928999229582
deviation-heading_mean9.74928999229582
deviation-heading_median9.74928999229582
deviation-heading_min9.74928999229582
distance-from-start_max2.6846937584217487
distance-from-start_mean2.6846937584217487
distance-from-start_median2.6846937584217487
distance-from-start_min2.6846937584217487
driven_any_max6.885278528728327
driven_any_mean6.885278528728327
driven_any_median6.885278528728327
driven_any_min6.885278528728327
driven_lanedir_consec_max5.524483794413526
driven_lanedir_consec_mean5.524483794413526
driven_lanedir_consec_min5.524483794413526
driven_lanedir_max5.524483794413526
driven_lanedir_mean5.524483794413526
driven_lanedir_median5.524483794413526
driven_lanedir_min5.524483794413526
in-drivable-lane_max7.999999999999858
in-drivable-lane_mean7.999999999999858
in-drivable-lane_min7.999999999999858
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.885278528728327, "survival_time": 52.94999999999913, "driven_lanedir": 5.524483794413526, "in-drivable-lane": 7.999999999999858, "deviation-heading": 9.74928999229582, "distance-from-start": 2.6846937584217487, "deviation-center-line": 3.173562328055389, "driven_lanedir_consec": 5.524483794413526}}
simulation-passed1
survival_time_max52.94999999999913
survival_time_mean52.94999999999913
survival_time_min52.94999999999913
No reset possible
6766772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6751775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:10:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median43.79999999999965
in-drivable-lane_median0.37499999999999867
driven_lanedir_consec_median1.6620831047810836
deviation-center-line_median4.027319019602942


other stats
deviation-center-line_max6.305748418236599
deviation-center-line_mean4.456799894698065
deviation-center-line_min3.46681312134978
deviation-heading_max26.96357772745216
deviation-heading_mean12.202752155977969
deviation-heading_median8.499075606376099
deviation-heading_min4.849279683707514
distance-from-start_max2.095441166821902
distance-from-start_mean1.266119698939507
distance-from-start_median1.195624292901631
distance-from-start_min0.577789043132864
driven_any_max5.663730995221682
driven_any_mean2.711401750955724
driven_any_median2.2517298423506604
driven_any_min0.6784163238998944
driven_lanedir_consec_max3.030500509244881
driven_lanedir_consec_mean1.746683746733018
driven_lanedir_consec_min0.6320682681250248
driven_lanedir_max4.715594901945776
driven_lanedir_mean2.3962338576383213
driven_lanedir_median2.102247068830686
driven_lanedir_min0.6648463909461382
in-drivable-lane_max4.599999999999984
in-drivable-lane_mean1.3374999999999952
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.2541478408562794, "survival_time": 43.79999999999965, "driven_lanedir": 3.030536833114901, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 4.849279683707514, "distance-from-start": 2.095441166821902, "deviation-center-line": 3.46681312134978, "driven_lanedir_consec": 3.030500509244881}, "4way-000-ego1": {"driven_any": 5.663730995221682, "survival_time": 43.79999999999965, "driven_lanedir": 4.715594901945776, "in-drivable-lane": 4.599999999999984, "deviation-heading": 10.032474170778826, "distance-from-start": 1.5053148620273158, "deviation-center-line": 3.4806467478594803, "driven_lanedir_consec": 2.1502089050156976}, "4way-000-ego2": {"driven_any": 1.249311843845042, "survival_time": 43.79999999999965, "driven_lanedir": 1.1739573045464695, "in-drivable-lane": 0.0, "deviation-heading": 6.965677041973373, "distance-from-start": 0.8859337237759459, "deviation-center-line": 4.573991291346404, "driven_lanedir_consec": 1.1739573045464695}, "4way-000-ego3": {"driven_any": 0.6784163238998944, "survival_time": 43.79999999999965, "driven_lanedir": 0.6648463909461382, "in-drivable-lane": 0.0, "deviation-heading": 26.96357772745216, "distance-from-start": 0.577789043132864, "deviation-center-line": 6.305748418236599, "driven_lanedir_consec": 0.6320682681250248}}
simulation-passed1
survival_time_max43.79999999999965
survival_time_mean43.79999999999965
survival_time_min43.79999999999965
No reset possible
6742637Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-1of4successnogpu-staging-spot-0-040:13:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.3499999999999
in-drivable-lane_median0.0
driven_lanedir_consec_median1.5095534275439637
deviation-center-line_median2.410297264878744


other stats
deviation-center-line_max3.4691291126896275
deviation-center-line_mean2.301128090928157
deviation-center-line_min0.9147887212655106
deviation-heading_max5.655201626434426
deviation-heading_mean4.27263380508129
deviation-heading_median4.60755455297762
deviation-heading_min2.2202244879354964
distance-from-start_max1.2248575527849868
distance-from-start_mean1.0826855214682096
distance-from-start_median1.1264107889656856
distance-from-start_min0.8530629551564805
driven_any_max2.298586662486221
driven_any_mean1.8875908572890625
driven_any_median1.8260916837184984
driven_any_min1.599593399233031
driven_lanedir_consec_max2.065312159324093
driven_lanedir_consec_mean1.4646616945190911
driven_lanedir_consec_min0.7742277636643444
driven_lanedir_max2.286060528087238
driven_lanedir_mean1.8405617146533453
driven_lanedir_median1.7564369644764024
driven_lanedir_min1.5633124015733388
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean0.5000000000000071
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.298586662486221, "survival_time": 39.3499999999999, "driven_lanedir": 2.286060528087238, "in-drivable-lane": 0.0, "deviation-heading": 2.2202244879354964, "distance-from-start": 1.06505257754208, "deviation-center-line": 0.9147887212655106, "driven_lanedir_consec": 2.065312159324093}, "4way-000-ego1": {"driven_any": 1.5995955062116023, "survival_time": 39.3499999999999, "driven_lanedir": 1.5633124015733388, "in-drivable-lane": 0.0, "deviation-heading": 5.615416992272731, "distance-from-start": 1.187769000389291, "deviation-center-line": 2.829676513086962, "driven_lanedir_consec": 1.5626040844405409}, "4way-000-ego2": {"driven_any": 1.599593399233031, "survival_time": 39.3499999999999, "driven_lanedir": 1.592231390229673, "in-drivable-lane": 0.0, "deviation-heading": 3.599692113682508, "distance-from-start": 1.2248575527849868, "deviation-center-line": 1.9909180166705267, "driven_lanedir_consec": 1.4565027706473868}, "4way-000-ego3": {"driven_any": 2.0525878612253945, "survival_time": 39.3499999999999, "driven_lanedir": 1.920642538723132, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.655201626434426, "distance-from-start": 0.8530629551564805, "deviation-center-line": 3.4691291126896275, "driven_lanedir_consec": 0.7742277636643444}}
simulation-passed1
survival_time_max39.3499999999999
survival_time_mean39.3499999999999
survival_time_min39.3499999999999
No reset possible
6681776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-2of4timeoutnogpu-staging-spot-0-04----No reset possible
6671777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-040:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.1999999999994
in-drivable-lane_median18.699999999999285
driven_lanedir_consec_median2.3341933221228643
deviation-center-line_median2.3807841232720097


other stats
deviation-center-line_max2.3807841232720097
deviation-center-line_mean2.3807841232720097
deviation-center-line_min2.3807841232720097
deviation-heading_max12.205067218291624
deviation-heading_mean12.205067218291624
deviation-heading_median12.205067218291624
deviation-heading_min12.205067218291624
distance-from-start_max1.2267525266150687
distance-from-start_mean1.2267525266150687
distance-from-start_median1.2267525266150687
distance-from-start_min1.2267525266150687
driven_any_max6.241142735077382
driven_any_mean6.241142735077382
driven_any_median6.241142735077382
driven_any_min6.241142735077382
driven_lanedir_consec_max2.3341933221228643
driven_lanedir_consec_mean2.3341933221228643
driven_lanedir_consec_min2.3341933221228643
driven_lanedir_max3.362774236692598
driven_lanedir_mean3.362774236692598
driven_lanedir_median3.362774236692598
driven_lanedir_min3.362774236692598
in-drivable-lane_max18.699999999999285
in-drivable-lane_mean18.699999999999285
in-drivable-lane_min18.699999999999285
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.241142735077382, "survival_time": 48.1999999999994, "driven_lanedir": 3.362774236692598, "in-drivable-lane": 18.699999999999285, "deviation-heading": 12.205067218291624, "distance-from-start": 1.2267525266150687, "deviation-center-line": 2.3807841232720097, "driven_lanedir_consec": 2.3341933221228643}}
simulation-passed1
survival_time_max48.1999999999994
survival_time_mean48.1999999999994
survival_time_min48.1999999999994
No reset possible
6663778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-0of4successnogpu-staging-spot-0-040:05:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.30000000000013
in-drivable-lane_median1.749999999999961
driven_lanedir_consec_median4.198769818229577
deviation-center-line_median3.357977560460891


other stats
deviation-center-line_max3.357977560460891
deviation-center-line_mean3.357977560460891
deviation-center-line_min3.357977560460891
deviation-heading_max5.69491020882545
deviation-heading_mean5.69491020882545
deviation-heading_median5.69491020882545
deviation-heading_min5.69491020882545
distance-from-start_max0.9616229015803024
distance-from-start_mean0.9616229015803024
distance-from-start_median0.9616229015803024
distance-from-start_min0.9616229015803024
driven_any_max4.5354240034273055
driven_any_mean4.5354240034273055
driven_any_median4.5354240034273055
driven_any_min4.5354240034273055
driven_lanedir_consec_max4.198769818229577
driven_lanedir_consec_mean4.198769818229577
driven_lanedir_consec_min4.198769818229577
driven_lanedir_max4.198769818229577
driven_lanedir_mean4.198769818229577
driven_lanedir_median4.198769818229577
driven_lanedir_min4.198769818229577
in-drivable-lane_max1.749999999999961
in-drivable-lane_mean1.749999999999961
in-drivable-lane_min1.749999999999961
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.5354240034273055, "survival_time": 35.30000000000013, "driven_lanedir": 4.198769818229577, "in-drivable-lane": 1.749999999999961, "deviation-heading": 5.69491020882545, "distance-from-start": 0.9616229015803024, "deviation-center-line": 3.357977560460891, "driven_lanedir_consec": 4.198769818229577}}
simulation-passed1
survival_time_max35.30000000000013
survival_time_mean35.30000000000013
survival_time_min35.30000000000013
No reset possible
6639782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-0of4successnogpu-staging-spot-0-040:14:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median18.89999999999927
driven_lanedir_consec_median2.411456565400327
deviation-center-line_median1.1658888386782436


other stats
deviation-center-line_max7.052310929073115
deviation-center-line_mean2.501893807584742
deviation-center-line_min0.6234866239093664
deviation-heading_max22.118407097723804
deviation-heading_mean8.716881153410954
deviation-heading_median4.832224266539525
deviation-heading_min3.0846689828409644
distance-from-start_max2.4724044047593887
distance-from-start_mean1.8848366629285769
distance-from-start_median2.0440992437530667
distance-from-start_min0.9787437594487842
driven_any_max7.905057347964
driven_any_mean4.21274383112043
driven_any_median3.054975384940789
driven_any_min2.835967206636143
driven_lanedir_consec_max2.8071344641064657
driven_lanedir_consec_mean2.285244479795124
driven_lanedir_consec_min1.510930324273378
driven_lanedir_max2.9149545647470236
driven_lanedir_mean2.4154056471735994
driven_lanedir_median2.617868849836998
driven_lanedir_min1.510930324273378
in-drivable-lane_max47.39999999999863
in-drivable-lane_mean21.412499999999294
in-drivable-lane_min0.4500000000000064
per-episodes
details{"udem-000-ego0": {"driven_any": 2.835967206636143, "survival_time": 59.99999999999873, "driven_lanedir": 2.566055841138553, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 22.118407097723804, "distance-from-start": 2.0762249742314096, "deviation-center-line": 7.052310929073115, "driven_lanedir_consec": 2.566055841138553}, "udem-000-ego1": {"driven_any": 2.8359906939731117, "survival_time": 59.99999999999873, "driven_lanedir": 2.669681858535444, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 5.404430795530119, "distance-from-start": 2.4724044047593887, "deviation-center-line": 1.193591762231177, "driven_lanedir_consec": 2.2568572896621006}, "udem-000-ego2": {"driven_any": 3.273960075908466, "survival_time": 59.99999999999873, "driven_lanedir": 1.510930324273378, "in-drivable-lane": 47.39999999999863, "deviation-heading": 3.0846689828409644, "distance-from-start": 2.0119735132747243, "deviation-center-line": 0.6234866239093664, "driven_lanedir_consec": 1.510930324273378}, "udem-000-ego3": {"driven_any": 7.905057347964, "survival_time": 59.99999999999873, "driven_lanedir": 2.9149545647470236, "in-drivable-lane": 36.69999999999853, "deviation-heading": 4.26001773754893, "distance-from-start": 0.9787437594487842, "deviation-center-line": 1.13818591512531, "driven_lanedir_consec": 2.8071344641064657}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6631792Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-040:05:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6553636Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4timeoutnogpu-staging-spot-0-04----No reset possible
6543638Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnogpu-staging-spot-0-040:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.8149940810866236
deviation-center-line_median4.094985063841091


other stats
deviation-center-line_max4.094985063841091
deviation-center-line_mean4.094985063841091
deviation-center-line_min4.094985063841091
deviation-heading_max9.104325322582234
deviation-heading_mean9.104325322582234
deviation-heading_median9.104325322582234
deviation-heading_min9.104325322582234
distance-from-start_max2.645340381315678
distance-from-start_mean2.645340381315678
distance-from-start_median2.645340381315678
distance-from-start_min2.645340381315678
driven_any_max3.486581977234586
driven_any_mean3.486581977234586
driven_any_median3.486581977234586
driven_any_min3.486581977234586
driven_lanedir_consec_max2.8149940810866236
driven_lanedir_consec_mean2.8149940810866236
driven_lanedir_consec_min2.8149940810866236
driven_lanedir_max3.274708374952958
driven_lanedir_mean3.274708374952958
driven_lanedir_median3.274708374952958
driven_lanedir_min3.274708374952958
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"loop-000-ego0": {"driven_any": 3.486581977234586, "survival_time": 59.99999999999873, "driven_lanedir": 3.274708374952958, "in-drivable-lane": 3.099999999999902, "deviation-heading": 9.104325322582234, "distance-from-start": 2.645340381315678, "deviation-center-line": 4.094985063841091, "driven_lanedir_consec": 2.8149940810866236}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6540639Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6515789Andrea Danieletemplate-pytorchaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-040:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5685948372985634
survival_time_median59.99999999999873
deviation-center-line_median1.6087183829210163
in-drivable-lane_median44.099999999999255


other stats
deviation-center-line_max1.6087183829210163
deviation-center-line_mean1.6087183829210163
deviation-center-line_min1.6087183829210163
deviation-heading_max9.64256845857416
deviation-heading_mean9.64256845857416
deviation-heading_median9.64256845857416
deviation-heading_min9.64256845857416
distance-from-start_max1.0228891268734754
distance-from-start_mean1.0228891268734754
distance-from-start_median1.0228891268734754
distance-from-start_min1.0228891268734754
driven_any_max13.056983603129886
driven_any_mean13.056983603129886
driven_any_median13.056983603129886
driven_any_min13.056983603129886
driven_lanedir_consec_max2.5685948372985634
driven_lanedir_consec_mean2.5685948372985634
driven_lanedir_consec_min2.5685948372985634
driven_lanedir_max2.5687070562942007
driven_lanedir_mean2.5687070562942007
driven_lanedir_median2.5687070562942007
driven_lanedir_min2.5687070562942007
in-drivable-lane_max44.099999999999255
in-drivable-lane_mean44.099999999999255
in-drivable-lane_min44.099999999999255
per-episodes
details{"zigzag-000-ego0": {"driven_any": 13.056983603129886, "survival_time": 59.99999999999873, "driven_lanedir": 2.5687070562942007, "in-drivable-lane": 44.099999999999255, "deviation-heading": 9.64256845857416, "distance-from-start": 1.0228891268734754, "deviation-center-line": 1.6087183829210163, "driven_lanedir_consec": 2.5685948372985634}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6499644Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-1of4successnogpu-staging-spot-0-040:13:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.320847663449453
deviation-center-line_median5.509202824089039


other stats
deviation-center-line_max6.756952476930072
deviation-center-line_mean5.338579474021433
deviation-center-line_min3.57895977097758
deviation-heading_max5.165991236119989
deviation-heading_mean3.955233800626404
deviation-heading_median4.636249730116838
deviation-heading_min1.3824445061519497
distance-from-start_max2.6950407308462383
distance-from-start_mean1.8279509363781563
distance-from-start_median1.656487541106691
distance-from-start_min1.3037879324530055
driven_any_max3.4716897005858773
driven_any_mean2.4718702523002105
driven_any_median2.3375972316718254
driven_any_min1.7405968452713143
driven_lanedir_consec_max3.292155930923049
driven_lanedir_consec_mean2.4129950677964196
driven_lanedir_consec_min1.7181290133637237
driven_lanedir_max3.292155930923049
driven_lanedir_mean2.4187239388545523
driven_lanedir_median2.3243071631921324
driven_lanedir_min1.734125498110895
in-drivable-lane_max3.5999999999999623
in-drivable-lane_mean0.8999999999999906
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.9345947247910176, "survival_time": 59.99999999999873, "driven_lanedir": 2.909967111085985, "in-drivable-lane": 0.0, "deviation-heading": 4.334701203563791, "distance-from-start": 1.5738878476280138, "deviation-center-line": 5.185168540477153, "driven_lanedir_consec": 2.9030481116006257}, "4way-000-ego1": {"driven_any": 1.7405997385526328, "survival_time": 59.99999999999873, "driven_lanedir": 1.73864721529828, "in-drivable-lane": 0.0, "deviation-heading": 4.937798256669886, "distance-from-start": 1.7390872345853683, "deviation-center-line": 5.833237107700924, "driven_lanedir_consec": 1.73864721529828}, "4way-000-ego2": {"driven_any": 1.7405968452713143, "survival_time": 59.99999999999873, "driven_lanedir": 1.734125498110895, "in-drivable-lane": 0.0, "deviation-heading": 1.3824445061519497, "distance-from-start": 1.3037879324530055, "deviation-center-line": 3.57895977097758, "driven_lanedir_consec": 1.7181290133637237}, "4way-000-ego3": {"driven_any": 3.4716897005858773, "survival_time": 59.99999999999873, "driven_lanedir": 3.292155930923049, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165991236119989, "distance-from-start": 2.6950407308462383, "deviation-center-line": 6.756952476930072, "driven_lanedir_consec": 3.292155930923049}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6494642Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6476676Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnogpu-staging-spot-0-040:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7226359618167388
deviation-center-line_median0.5300716056782957


other stats
deviation-center-line_max3.450684914636027
deviation-center-line_mean1.1544116353398692
deviation-center-line_min0.10681841536685864
deviation-heading_max26.9052448670844
deviation-heading_mean13.564778629547629
deviation-heading_median13.197767646759738
deviation-heading_min0.958334357586633
distance-from-start_max2.6184795314376466
distance-from-start_mean1.0433272824408664
distance-from-start_median0.7774147991629091
distance-from-start_min4.440892098500626e-16
driven_any_max4.40268670413701
driven_any_mean1.962564046936972
driven_any_median1.7237847418051728
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max4.396263615957334
driven_lanedir_consec_mean1.9603838848977029
driven_lanedir_consec_min0.0
driven_lanedir_max4.396272526695297
driven_lanedir_mean1.960407277995468
driven_lanedir_median1.722678292643288
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.4475694836097963, "survival_time": 59.99999999999873, "driven_lanedir": 3.445356585286576, "in-drivable-lane": 0.0, "deviation-heading": 0.958334357586633, "distance-from-start": 1.5548295983258178, "deviation-center-line": 0.10681841536685864, "driven_lanedir_consec": 3.4452719236334777}, "udem-001-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.9270500462381008, "driven_lanedir_consec": 0.0}, "udem-001-ego2": {"driven_any": 4.40268670413701, "survival_time": 59.99999999999873, "driven_lanedir": 4.396272526695297, "in-drivable-lane": 0.0, "deviation-heading": 1.4677754959606737, "distance-from-start": 2.6184795314376466, "deviation-center-line": 0.13309316511849048, "driven_lanedir_consec": 4.396263615957334}, "udem-001-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.450684914636027, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6470674Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnogpu-staging-spot-0-040:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.833625978773518
deviation-center-line_median0.2109719022502864


other stats
deviation-center-line_max0.2109719022502864
deviation-center-line_mean0.2109719022502864
deviation-center-line_min0.2109719022502864
deviation-heading_max1.8837432004186612
deviation-heading_mean1.8837432004186612
deviation-heading_median1.8837432004186612
deviation-heading_min1.8837432004186612
distance-from-start_max2.0412677228822265
distance-from-start_mean2.0412677228822265
distance-from-start_median2.0412677228822265
distance-from-start_min2.0412677228822265
driven_any_max5.844418063649684
driven_any_mean5.844418063649684
driven_any_median5.844418063649684
driven_any_min5.844418063649684
driven_lanedir_consec_max5.833625978773518
driven_lanedir_consec_mean5.833625978773518
driven_lanedir_consec_min5.833625978773518
driven_lanedir_max5.833625978773518
driven_lanedir_mean5.833625978773518
driven_lanedir_median5.833625978773518
driven_lanedir_min5.833625978773518
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.844418063649684, "survival_time": 59.99999999999873, "driven_lanedir": 5.833625978773518, "in-drivable-lane": 0.0, "deviation-heading": 1.8837432004186612, "distance-from-start": 2.0412677228822265, "deviation-center-line": 0.2109719022502864, "driven_lanedir_consec": 5.833625978773518}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6456677Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-0of4successnogpu-staging-spot-0-040:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.331344237139176
deviation-center-line_median0.14341993721660595


other stats
deviation-center-line_max0.14341993721660595
deviation-center-line_mean0.14341993721660595
deviation-center-line_min0.14341993721660595
deviation-heading_max1.3020944572743824
deviation-heading_mean1.3020944572743824
deviation-heading_median1.3020944572743824
deviation-heading_min1.3020944572743824
distance-from-start_max2.952739272534191
distance-from-start_mean2.952739272534191
distance-from-start_median2.952739272534191
distance-from-start_min2.952739272534191
driven_any_max5.629455349358906
driven_any_mean5.629455349358906
driven_any_median5.629455349358906
driven_any_min5.629455349358906
driven_lanedir_consec_max5.331344237139176
driven_lanedir_consec_mean5.331344237139176
driven_lanedir_consec_min5.331344237139176
driven_lanedir_max5.62600246220405
driven_lanedir_mean5.62600246220405
driven_lanedir_median5.62600246220405
driven_lanedir_min5.62600246220405
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.629455349358906, "survival_time": 59.99999999999873, "driven_lanedir": 5.62600246220405, "in-drivable-lane": 0.0, "deviation-heading": 1.3020944572743824, "distance-from-start": 2.952739272534191, "deviation-center-line": 0.14341993721660595, "driven_lanedir_consec": 5.331344237139176}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6450679Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-3of4successnogpu-staging-spot-0-040:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median33.20000000000025
in-drivable-lane_median0.0
driven_lanedir_consec_median2.8824305480707815
deviation-center-line_median0.24998323712819964


other stats
deviation-center-line_max0.24998323712819964
deviation-center-line_mean0.24998323712819964
deviation-center-line_min0.24998323712819964
deviation-heading_max2.0191141438882525
deviation-heading_mean2.0191141438882525
deviation-heading_median2.0191141438882525
deviation-heading_min2.0191141438882525
distance-from-start_max2.3237448100281095
distance-from-start_mean2.3237448100281095
distance-from-start_median2.3237448100281095
distance-from-start_min2.3237448100281095
driven_any_max2.893646045198969
driven_any_mean2.893646045198969
driven_any_median2.893646045198969
driven_any_min2.893646045198969
driven_lanedir_consec_max2.8824305480707815
driven_lanedir_consec_mean2.8824305480707815
driven_lanedir_consec_min2.8824305480707815
driven_lanedir_max2.8824305480707815
driven_lanedir_mean2.8824305480707815
driven_lanedir_median2.8824305480707815
driven_lanedir_min2.8824305480707815
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.893646045198969, "survival_time": 33.20000000000025, "driven_lanedir": 2.8824305480707815, "in-drivable-lane": 0.0, "deviation-heading": 2.0191141438882525, "distance-from-start": 2.3237448100281095, "deviation-center-line": 0.24998323712819964, "driven_lanedir_consec": 2.8824305480707815}}
simulation-passed1
survival_time_max33.20000000000025
survival_time_mean33.20000000000025
survival_time_min33.20000000000025
No reset possible
6433681Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4successnogpu-staging-spot-0-040:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.8581320544290545
deviation-center-line_median0.4209794622238876


other stats
deviation-center-line_max0.4209794622238876
deviation-center-line_mean0.4209794622238876
deviation-center-line_min0.4209794622238876
deviation-heading_max3.015813483230351
deviation-heading_mean3.015813483230351
deviation-heading_median3.015813483230351
deviation-heading_min3.015813483230351
distance-from-start_max2.4941894584954443
distance-from-start_mean2.4941894584954443
distance-from-start_median2.4941894584954443
distance-from-start_min2.4941894584954443
driven_any_max5.878911569774922
driven_any_mean5.878911569774922
driven_any_median5.878911569774922
driven_any_min5.878911569774922
driven_lanedir_consec_max5.8581320544290545
driven_lanedir_consec_mean5.8581320544290545
driven_lanedir_consec_min5.8581320544290545
driven_lanedir_max5.8581320544290545
driven_lanedir_mean5.8581320544290545
driven_lanedir_median5.8581320544290545
driven_lanedir_min5.8581320544290545
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.878911569774922, "survival_time": 59.99999999999873, "driven_lanedir": 5.8581320544290545, "in-drivable-lane": 0.0, "deviation-heading": 3.015813483230351, "distance-from-start": 2.4941894584954443, "deviation-center-line": 0.4209794622238876, "driven_lanedir_consec": 5.8581320544290545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6432681Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6426681Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-1of4successnogpu-staging-spot-0-040:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median6.008901010886451
deviation-center-line_median0.30597991997662005


other stats
deviation-center-line_max0.30597991997662005
deviation-center-line_mean0.30597991997662005
deviation-center-line_min0.30597991997662005
deviation-heading_max2.2018930022147423
deviation-heading_mean2.2018930022147423
deviation-heading_median2.2018930022147423
deviation-heading_min2.2018930022147423
distance-from-start_max2.7090569978004524
distance-from-start_mean2.7090569978004524
distance-from-start_median2.7090569978004524
distance-from-start_min2.7090569978004524
driven_any_max6.026055195101287
driven_any_mean6.026055195101287
driven_any_median6.026055195101287
driven_any_min6.026055195101287
driven_lanedir_consec_max6.008901010886451
driven_lanedir_consec_mean6.008901010886451
driven_lanedir_consec_min6.008901010886451
driven_lanedir_max6.008901010886451
driven_lanedir_mean6.008901010886451
driven_lanedir_median6.008901010886451
driven_lanedir_min6.008901010886451
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 6.026055195101287, "survival_time": 59.99999999999873, "driven_lanedir": 6.008901010886451, "in-drivable-lane": 0.0, "deviation-heading": 2.2018930022147423, "distance-from-start": 2.7090569978004524, "deviation-center-line": 0.30597991997662005, "driven_lanedir_consec": 6.008901010886451}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6408683Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-2of4timeoutnogpu-staging-spot-0-04----No reset possible
6395686Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-0of4successnogpu-staging-spot-0-040:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.324198327059039
deviation-center-line_median0.5519609227418314


other stats
deviation-center-line_max0.5519609227418314
deviation-center-line_mean0.5519609227418314
deviation-center-line_min0.5519609227418314
deviation-heading_max3.5883206576626248
deviation-heading_mean3.5883206576626248
deviation-heading_median3.5883206576626248
deviation-heading_min3.5883206576626248
distance-from-start_max1.0638230176113956
distance-from-start_mean1.0638230176113956
distance-from-start_median1.0638230176113956
distance-from-start_min1.0638230176113956
driven_any_max5.347239209519233
driven_any_mean5.347239209519233
driven_any_median5.347239209519233
driven_any_min5.347239209519233
driven_lanedir_consec_max5.324198327059039
driven_lanedir_consec_mean5.324198327059039
driven_lanedir_consec_min5.324198327059039
driven_lanedir_max5.324198327059039
driven_lanedir_mean5.324198327059039
driven_lanedir_median5.324198327059039
driven_lanedir_min5.324198327059039
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.347239209519233, "survival_time": 59.99999999999873, "driven_lanedir": 5.324198327059039, "in-drivable-lane": 0.0, "deviation-heading": 3.5883206576626248, "distance-from-start": 1.0638230176113956, "deviation-center-line": 0.5519609227418314, "driven_lanedir_consec": 5.324198327059039}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6386687Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-3of4successnogpu-staging-spot-0-040:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.29999999999939
in-drivable-lane_median0.0
driven_lanedir_consec_median4.5085282514804845
deviation-center-line_median0.28904483256154256


other stats
deviation-center-line_max0.28904483256154256
deviation-center-line_mean0.28904483256154256
deviation-center-line_min0.28904483256154256
deviation-heading_max2.685722516035787
deviation-heading_mean2.685722516035787
deviation-heading_median2.685722516035787
deviation-heading_min2.685722516035787
distance-from-start_max2.3176766365568287
distance-from-start_mean2.3176766365568287
distance-from-start_median2.3176766365568287
distance-from-start_min2.3176766365568287
driven_any_max4.5251448892157695
driven_any_mean4.5251448892157695
driven_any_median4.5251448892157695
driven_any_min4.5251448892157695
driven_lanedir_consec_max4.5085282514804845
driven_lanedir_consec_mean4.5085282514804845
driven_lanedir_consec_min4.5085282514804845
driven_lanedir_max4.5085282514804845
driven_lanedir_mean4.5085282514804845
driven_lanedir_median4.5085282514804845
driven_lanedir_min4.5085282514804845
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.5251448892157695, "survival_time": 48.29999999999939, "driven_lanedir": 4.5085282514804845, "in-drivable-lane": 0.0, "deviation-heading": 2.685722516035787, "distance-from-start": 2.3176766365568287, "deviation-center-line": 0.28904483256154256, "driven_lanedir_consec": 4.5085282514804845}}
simulation-passed1
survival_time_max48.29999999999939
survival_time_mean48.29999999999939
survival_time_min48.29999999999939
No reset possible
6371719Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-3of4successnogpu-staging-spot-0-040:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.9739038922098167
deviation-center-line_median3.987567696169286


other stats
deviation-center-line_max6.355354623012709
deviation-center-line_mean4.250566789511449
deviation-center-line_min2.6717771426945145
deviation-heading_max6.378578140641868
deviation-heading_mean3.8518643265041
deviation-heading_median3.299904356349613
deviation-heading_min2.429070452675305
distance-from-start_max2.622846621458921
distance-from-start_mean1.9359200828336065
distance-from-start_median2.1273822766936967
distance-from-start_min0.8660691564881121
driven_any_max3.5795837364268106
driven_any_mean3.0268033484998975
driven_any_median3.137096506981778
driven_any_min2.2534366436092235
driven_lanedir_consec_max3.4836850218404303
driven_lanedir_consec_mean2.566865745168916
driven_lanedir_consec_min0.8359701744156
driven_lanedir_max3.5606366264507763
driven_lanedir_mean2.9552897573784933
driven_lanedir_median3.077183665318938
driven_lanedir_min2.1061550724253215
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.1499999999999773
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.727596918833126, "survival_time": 59.99999999999873, "driven_lanedir": 2.6706823087974456, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.429070452675305, "distance-from-start": 2.2619366930709424, "deviation-center-line": 4.5111102127801965, "driven_lanedir_consec": 2.6706819709513203}, "4way-001-ego1": {"driven_any": 3.5795837364268106, "survival_time": 59.99999999999873, "driven_lanedir": 3.5606366264507763, "in-drivable-lane": 0.0, "deviation-heading": 3.343516239036243, "distance-from-start": 1.992827860316451, "deviation-center-line": 2.6717771426945145, "driven_lanedir_consec": 3.277125813468313}, "4way-001-ego2": {"driven_any": 3.5465960951304303, "survival_time": 59.99999999999873, "driven_lanedir": 3.4836850218404303, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.2562924736629832, "distance-from-start": 2.622846621458921, "deviation-center-line": 3.4640251795583756, "driven_lanedir_consec": 3.4836850218404303}, "4way-001-ego3": {"driven_any": 2.2534366436092235, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061550724253215, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140641868, "distance-from-start": 0.8660691564881121, "deviation-center-line": 6.355354623012709, "driven_lanedir_consec": 0.8359701744156}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6365721Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation282successyesgpu-staging-spot-0-040:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.6749999999999297
driven_lanedir_consec_median2.3321113195925243
deviation-center-line_median6.13698068030466


other stats
deviation-center-line_max7.3703625029550865
deviation-center-line_mean6.13698068030466
deviation-center-line_min4.903598857654233
deviation-heading_max7.744574522534287
deviation-heading_mean7.106635261644851
deviation-heading_median7.106635261644851
deviation-heading_min6.468696000755416
distance-from-start_max1.648096422950854
distance-from-start_mean1.427048606043876
distance-from-start_median1.427048606043876
distance-from-start_min1.2060007891368982
driven_any_max3.4850840176976017
driven_any_mean3.4693367131671256
driven_any_median3.4693367131671256
driven_any_min3.45358940863665
driven_lanedir_consec_max3.243830720825712
driven_lanedir_consec_mean2.3321113195925243
driven_lanedir_consec_min1.420391918359337
driven_lanedir_max3.2905374079610175
driven_lanedir_mean3.2671840643933647
driven_lanedir_median3.2671840643933647
driven_lanedir_min3.243830720825712
in-drivable-lane_max4.199999999999893
in-drivable-lane_mean3.6749999999999297
in-drivable-lane_min3.1499999999999666
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4850840176976017, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905374079610175, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574522534287, "distance-from-start": 1.2060007891368982, "deviation-center-line": 4.903598857654233, "driven_lanedir_consec": 1.420391918359337}, "loop2-000-ego1": {"driven_any": 3.45358940863665, "survival_time": 59.99999999999873, "driven_lanedir": 3.243830720825712, "in-drivable-lane": 4.199999999999893, "deviation-heading": 6.468696000755416, "distance-from-start": 1.648096422950854, "deviation-center-line": 7.3703625029550865, "driven_lanedir_consec": 3.243830720825712}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6357723Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-2of4successnogpu-staging-spot-0-040:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.9999999999998863
driven_lanedir_consec_median2.47341545852428
deviation-center-line_median4.480730094043885


other stats
deviation-center-line_max4.480730094043885
deviation-center-line_mean4.480730094043885
deviation-center-line_min4.480730094043885
deviation-heading_max5.3925062050984955
deviation-heading_mean5.3925062050984955
deviation-heading_median5.3925062050984955
deviation-heading_min5.3925062050984955
distance-from-start_max2.5607885841805484
distance-from-start_mean2.5607885841805484
distance-from-start_median2.5607885841805484
distance-from-start_min2.5607885841805484
driven_any_max3.5195876711082703
driven_any_mean3.5195876711082703
driven_any_median3.5195876711082703
driven_any_min3.5195876711082703
driven_lanedir_consec_max2.47341545852428
driven_lanedir_consec_mean2.47341545852428
driven_lanedir_consec_min2.47341545852428
driven_lanedir_max3.387731097694833
driven_lanedir_mean3.387731097694833
driven_lanedir_median3.387731097694833
driven_lanedir_min3.387731097694833
in-drivable-lane_max1.9999999999998863
in-drivable-lane_mean1.9999999999998863
in-drivable-lane_min1.9999999999998863
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5195876711082703, "survival_time": 59.99999999999873, "driven_lanedir": 3.387731097694833, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 5.3925062050984955, "distance-from-start": 2.5607885841805484, "deviation-center-line": 4.480730094043885, "driven_lanedir_consec": 2.47341545852428}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6349397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-040:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.379346945681501
survival_time_median59.99999999999873
deviation-center-line_median1.7247995314597129
in-drivable-lane_median34.599999999999184


other stats
deviation-center-line_max1.7247995314597129
deviation-center-line_mean1.7247995314597129
deviation-center-line_min1.7247995314597129
deviation-heading_max22.64764040832693
deviation-heading_mean22.64764040832693
deviation-heading_median22.64764040832693
deviation-heading_min22.64764040832693
distance-from-start_max0.1610793729001445
distance-from-start_mean0.1610793729001445
distance-from-start_median0.1610793729001445
distance-from-start_min0.1610793729001445
driven_any_max11.97525711559728
driven_any_mean11.97525711559728
driven_any_median11.97525711559728
driven_any_min11.97525711559728
driven_lanedir_consec_max-3.379346945681501
driven_lanedir_consec_mean-3.379346945681501
driven_lanedir_consec_min-3.379346945681501
driven_lanedir_max-3.379346945681501
driven_lanedir_mean-3.379346945681501
driven_lanedir_median-3.379346945681501
driven_lanedir_min-3.379346945681501
in-drivable-lane_max34.599999999999184
in-drivable-lane_mean34.599999999999184
in-drivable-lane_min34.599999999999184
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.97525711559728, "survival_time": 59.99999999999873, "driven_lanedir": -3.379346945681501, "in-drivable-lane": 34.599999999999184, "deviation-heading": 22.64764040832693, "distance-from-start": 0.1610793729001445, "deviation-center-line": 1.7247995314597129, "driven_lanedir_consec": -3.379346945681501}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6302397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-2of4timeoutnogpu-staging-spot-0-04----No reset possible
6299526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednogpu-staging-spot-0-040:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6289658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-040:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9450287492464584
survival_time_median23.900000000000205
deviation-center-line_median0.6628810860081455
in-drivable-lane_median15.400000000000157


other stats
deviation-center-line_max0.6628810860081455
deviation-center-line_mean0.6628810860081455
deviation-center-line_min0.6628810860081455
deviation-heading_max6.420239329570285
deviation-heading_mean6.420239329570285
deviation-heading_median6.420239329570285
deviation-heading_min6.420239329570285
distance-from-start_max0.48043871310430714
distance-from-start_mean0.48043871310430714
distance-from-start_median0.48043871310430714
distance-from-start_min0.48043871310430714
driven_any_max3.6764498881581416
driven_any_mean3.6764498881581416
driven_any_median3.6764498881581416
driven_any_min3.6764498881581416
driven_lanedir_consec_max0.9450287492464584
driven_lanedir_consec_mean0.9450287492464584
driven_lanedir_consec_min0.9450287492464584
driven_lanedir_max0.9450287492464584
driven_lanedir_mean0.9450287492464584
driven_lanedir_median0.9450287492464584
driven_lanedir_min0.9450287492464584
in-drivable-lane_max15.400000000000157
in-drivable-lane_mean15.400000000000157
in-drivable-lane_min15.400000000000157
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.6764498881581416, "survival_time": 23.900000000000205, "driven_lanedir": 0.9450287492464584, "in-drivable-lane": 15.400000000000157, "deviation-heading": 6.420239329570285, "distance-from-start": 0.48043871310430714, "deviation-center-line": 0.6628810860081455, "driven_lanedir_consec": 0.9450287492464584}}
simulation-passed1
survival_time_max23.900000000000205
survival_time_mean23.900000000000205
survival_time_min23.900000000000205
No reset possible
6283672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednogpu-staging-spot-0-040:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6271689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.850000000000048
in-drivable-lane_median9.600000000000051
driven_lanedir_consec_median0.395970381094496
deviation-center-line_median0.2727382860816283


other stats
deviation-center-line_max0.3711793675074804
deviation-center-line_mean0.26307006175696934
deviation-center-line_min0.13562430735714032
deviation-heading_max2.5383505748046193
deviation-heading_mean1.5839275146723817
deviation-heading_median1.5305477977075064
deviation-heading_min0.7362638884698938
distance-from-start_max1.9486947141078033
distance-from-start_mean1.6104892935754336
distance-from-start_median1.6878960391209077
distance-from-start_min1.117470381952116
driven_any_max1.9488515657780785
driven_any_mean1.6105973523255763
driven_any_median1.6880059043797089
driven_any_min1.1175260347648104
driven_lanedir_consec_max0.6388965134503066
driven_lanedir_consec_mean0.3976334018683764
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.6388965134503066
driven_lanedir_mean0.3976334018683764
driven_lanedir_median0.395970381094496
driven_lanedir_min0.15969633183420706
in-drivable-lane_max11.400000000000048
in-drivable-lane_mean9.612500000000054
in-drivable-lane_min7.850000000000057
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.9488515657780785, "survival_time": 12.850000000000048, "driven_lanedir": 0.3312247708304017, "in-drivable-lane": 9.550000000000052, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.9486947141078033, "deviation-center-line": 0.26973515872126547, "driven_lanedir_consec": 0.3312247708304017}, "autolab-000-ego1": {"driven_any": 1.1175260347648104, "survival_time": 12.850000000000048, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 11.400000000000048, "deviation-heading": 0.7478094709473367, "distance-from-start": 1.117470381952116, "deviation-center-line": 0.13562430735714032, "driven_lanedir_consec": 0.15969633183420706}, "autolab-000-ego2": {"driven_any": 1.6921542763568478, "survival_time": 12.850000000000048, "driven_lanedir": 0.6388965134503066, "in-drivable-lane": 7.850000000000057, "deviation-heading": 2.313286124467676, "distance-from-start": 1.6920444051025798, "deviation-center-line": 0.3711793675074804, "driven_lanedir_consec": 0.6388965134503066}, "autolab-000-ego3": {"driven_any": 1.68385753240257, "survival_time": 12.850000000000048, "driven_lanedir": 0.4607159913585903, "in-drivable-lane": 9.650000000000052, "deviation-heading": 0.7362638884698938, "distance-from-start": 1.6837476731392351, "deviation-center-line": 0.27574141344199116, "driven_lanedir_consec": 0.4607159913585903}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
6262691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-040:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
6259693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-040:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6235386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-040:07:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median7.799999999999842
driven_lanedir_consec_median-5.671285369942121
deviation-center-line_median5.541775947833975


other stats
deviation-center-line_max5.541775947833975
deviation-center-line_mean5.541775947833975
deviation-center-line_min5.541775947833975
deviation-heading_max33.86388773747412
deviation-heading_mean33.86388773747412
deviation-heading_median33.86388773747412
deviation-heading_min33.86388773747412
distance-from-start_max0.19180419807671836
distance-from-start_mean0.19180419807671836
distance-from-start_median0.19180419807671836
distance-from-start_min0.19180419807671836
driven_any_max15.016960616861407
driven_any_mean15.016960616861407
driven_any_median15.016960616861407
driven_any_min15.016960616861407
driven_lanedir_consec_max-5.671285369942121
driven_lanedir_consec_mean-5.671285369942121
driven_lanedir_consec_min-5.671285369942121
driven_lanedir_max-9.017369588591786
driven_lanedir_mean-9.017369588591786
driven_lanedir_median-9.017369588591786
driven_lanedir_min-9.017369588591786
in-drivable-lane_max7.799999999999842
in-drivable-lane_mean7.799999999999842
in-drivable-lane_min7.799999999999842
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.016960616861407, "survival_time": 59.99999999999873, "driven_lanedir": -9.017369588591786, "in-drivable-lane": 7.799999999999842, "deviation-heading": 33.86388773747412, "distance-from-start": 0.19180419807671836, "deviation-center-line": 5.541775947833975, "driven_lanedir_consec": -5.671285369942121}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6232387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:06:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.69999999999886
driven_lanedir_consec_median-1.5304103076900295
deviation-center-line_median2.373154040491374


other stats
deviation-center-line_max2.373154040491374
deviation-center-line_mean2.373154040491374
deviation-center-line_min2.373154040491374
deviation-heading_max20.743413225860397
deviation-heading_mean20.743413225860397
deviation-heading_median20.743413225860397
deviation-heading_min20.743413225860397
distance-from-start_max0.16516460255391596
distance-from-start_mean0.16516460255391596
distance-from-start_median0.16516460255391596
distance-from-start_min0.16516460255391596
driven_any_max10.52653097796602
driven_any_mean10.52653097796602
driven_any_median10.52653097796602
driven_any_min10.52653097796602
driven_lanedir_consec_max-1.5304103076900295
driven_lanedir_consec_mean-1.5304103076900295
driven_lanedir_consec_min-1.5304103076900295
driven_lanedir_max-1.6254896912967325
driven_lanedir_mean-1.6254896912967325
driven_lanedir_median-1.6254896912967325
driven_lanedir_min-1.6254896912967325
in-drivable-lane_max37.69999999999886
in-drivable-lane_mean37.69999999999886
in-drivable-lane_min37.69999999999886
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.52653097796602, "survival_time": 59.99999999999873, "driven_lanedir": -1.6254896912967325, "in-drivable-lane": 37.69999999999886, "deviation-heading": 20.743413225860397, "distance-from-start": 0.16516460255391596, "deviation-center-line": 2.373154040491374, "driven_lanedir_consec": -1.5304103076900295}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6229388Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-040:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.150000000000023
in-drivable-lane_median3.15000000000002
driven_lanedir_consec_median-0.2331812452589672
deviation-center-line_median0.3905704380493279


other stats
deviation-center-line_max0.3905704380493279
deviation-center-line_mean0.3905704380493279
deviation-center-line_min0.3905704380493279
deviation-heading_max5.915653008795459
deviation-heading_mean5.915653008795459
deviation-heading_median5.915653008795459
deviation-heading_min5.915653008795459
distance-from-start_max0.15966334598320328
distance-from-start_mean0.15966334598320328
distance-from-start_median0.15966334598320328
distance-from-start_min0.15966334598320328
driven_any_max1.8311077769225803
driven_any_mean1.8311077769225803
driven_any_median1.8311077769225803
driven_any_min1.8311077769225803
driven_lanedir_consec_max-0.2331812452589672
driven_lanedir_consec_mean-0.2331812452589672
driven_lanedir_consec_min-0.2331812452589672
driven_lanedir_max-0.2898019161574166
driven_lanedir_mean-0.2898019161574166
driven_lanedir_median-0.2898019161574166
driven_lanedir_min-0.2898019161574166
in-drivable-lane_max3.15000000000002
in-drivable-lane_mean3.15000000000002
in-drivable-lane_min3.15000000000002
per-episodes
details{"4way-000-ego0": {"driven_any": 1.8311077769225803, "survival_time": 11.150000000000023, "driven_lanedir": -0.2898019161574166, "in-drivable-lane": 3.15000000000002, "deviation-heading": 5.915653008795459, "distance-from-start": 0.15966334598320328, "deviation-center-line": 0.3905704380493279, "driven_lanedir_consec": -0.2331812452589672}}
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean11.150000000000023
survival_time_min11.150000000000023
No reset possible
6225389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-040:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.049999999999145
driven_lanedir_consec_median-2.8756429230895675
deviation-center-line_median2.7874520438338486


other stats
deviation-center-line_max2.7874520438338486
deviation-center-line_mean2.7874520438338486
deviation-center-line_min2.7874520438338486
deviation-heading_max26.147175191048564
deviation-heading_mean26.147175191048564
deviation-heading_median26.147175191048564
deviation-heading_min26.147175191048564
distance-from-start_max0.19404814231845977
distance-from-start_mean0.19404814231845977
distance-from-start_median0.19404814231845977
distance-from-start_min0.19404814231845977
driven_any_max11.777838025716266
driven_any_mean11.777838025716266
driven_any_median11.777838025716266
driven_any_min11.777838025716266
driven_lanedir_consec_max-2.8756429230895675
driven_lanedir_consec_mean-2.8756429230895675
driven_lanedir_consec_min-2.8756429230895675
driven_lanedir_max-3.2796528921385875
driven_lanedir_mean-3.2796528921385875
driven_lanedir_median-3.2796528921385875
driven_lanedir_min-3.2796528921385875
in-drivable-lane_max30.049999999999145
in-drivable-lane_mean30.049999999999145
in-drivable-lane_min30.049999999999145
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.777838025716266, "survival_time": 59.99999999999873, "driven_lanedir": -3.2796528921385875, "in-drivable-lane": 30.049999999999145, "deviation-heading": 26.147175191048564, "distance-from-start": 0.19404814231845977, "deviation-center-line": 2.7874520438338486, "driven_lanedir_consec": -2.8756429230895675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6223389Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6218390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-040:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.1130803563393488
survival_time_median59.99999999999873
deviation-center-line_median3.250144265933059
in-drivable-lane_median23.599999999999355


other stats
deviation-center-line_max3.250144265933059
deviation-center-line_mean3.250144265933059
deviation-center-line_min3.250144265933059
deviation-heading_max27.04065180628176
deviation-heading_mean27.04065180628176
deviation-heading_median27.04065180628176
deviation-heading_min27.04065180628176
distance-from-start_max0.260343006126711
distance-from-start_mean0.260343006126711
distance-from-start_median0.260343006126711
distance-from-start_min0.260343006126711
driven_any_max11.44318980705084
driven_any_mean11.44318980705084
driven_any_median11.44318980705084
driven_any_min11.44318980705084
driven_lanedir_consec_max-3.1130803563393488
driven_lanedir_consec_mean-3.1130803563393488
driven_lanedir_consec_min-3.1130803563393488
driven_lanedir_max-3.2082444581752747
driven_lanedir_mean-3.2082444581752747
driven_lanedir_median-3.2082444581752747
driven_lanedir_min-3.2082444581752747
in-drivable-lane_max23.599999999999355
in-drivable-lane_mean23.599999999999355
in-drivable-lane_min23.599999999999355
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.44318980705084, "survival_time": 59.99999999999873, "driven_lanedir": -3.2082444581752747, "in-drivable-lane": 23.599999999999355, "deviation-heading": 27.04065180628176, "distance-from-start": 0.260343006126711, "deviation-center-line": 3.250144265933059, "driven_lanedir_consec": -3.1130803563393488}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6214390Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-040:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.8714850061721384
survival_time_median48.24999999999939
deviation-center-line_median2.619255037416209
in-drivable-lane_median18.649999999999736


other stats
deviation-center-line_max2.619255037416209
deviation-center-line_mean2.619255037416209
deviation-center-line_min2.619255037416209
deviation-heading_max22.22057653098553
deviation-heading_mean22.22057653098553
deviation-heading_median22.22057653098553
deviation-heading_min22.22057653098553
distance-from-start_max0.1508366552431207
distance-from-start_mean0.1508366552431207
distance-from-start_median0.1508366552431207
distance-from-start_min0.1508366552431207
driven_any_max7.973777362646983
driven_any_mean7.973777362646983
driven_any_median7.973777362646983
driven_any_min7.973777362646983
driven_lanedir_consec_max-1.8714850061721384
driven_lanedir_consec_mean-1.8714850061721384
driven_lanedir_consec_min-1.8714850061721384
driven_lanedir_max-1.913549368481669
driven_lanedir_mean-1.913549368481669
driven_lanedir_median-1.913549368481669
driven_lanedir_min-1.913549368481669
in-drivable-lane_max18.649999999999736
in-drivable-lane_mean18.649999999999736
in-drivable-lane_min18.649999999999736
per-episodes
details{"loop-000-ego0": {"driven_any": 7.973777362646983, "survival_time": 48.24999999999939, "driven_lanedir": -1.913549368481669, "in-drivable-lane": 18.649999999999736, "deviation-heading": 22.22057653098553, "distance-from-start": 0.1508366552431207, "deviation-center-line": 2.619255037416209, "driven_lanedir_consec": -1.8714850061721384}}
simulation-passed1
survival_time_max48.24999999999939
survival_time_mean48.24999999999939
survival_time_min48.24999999999939
No reset possible
6213391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6212391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornogpu-staging-spot-0-040:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6211391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornogpu-staging-spot-0-040:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/workspace/solution.py", line 38, in init
              ||     self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/workspace/model.py", line 160, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6210391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6204393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-040:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median41.79999999999909
driven_lanedir_consec_median-1.8389490257180583
deviation-center-line_median1.8506574291347375


other stats
deviation-center-line_max1.8506574291347375
deviation-center-line_mean1.8506574291347375
deviation-center-line_min1.8506574291347375
deviation-heading_max17.63786348303475
deviation-heading_mean17.63786348303475
deviation-heading_median17.63786348303475
deviation-heading_min17.63786348303475
distance-from-start_max0.1671667986608842
distance-from-start_mean0.1671667986608842
distance-from-start_median0.1671667986608842
distance-from-start_min0.1671667986608842
driven_any_max11.788059690492735
driven_any_mean11.788059690492735
driven_any_median11.788059690492735
driven_any_min11.788059690492735
driven_lanedir_consec_max-1.8389490257180583
driven_lanedir_consec_mean-1.8389490257180583
driven_lanedir_consec_min-1.8389490257180583
driven_lanedir_max-1.9690268354355256
driven_lanedir_mean-1.9690268354355256
driven_lanedir_median-1.9690268354355256
driven_lanedir_min-1.9690268354355256
in-drivable-lane_max41.79999999999909
in-drivable-lane_mean41.79999999999909
in-drivable-lane_min41.79999999999909
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.788059690492735, "survival_time": 59.99999999999873, "driven_lanedir": -1.9690268354355256, "in-drivable-lane": 41.79999999999909, "deviation-heading": 17.63786348303475, "distance-from-start": 0.1671667986608842, "deviation-center-line": 1.8506574291347375, "driven_lanedir_consec": -1.8389490257180583}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6189398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-040:21:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.24999999999934
driven_lanedir_consec_median-3.7099310238385312
deviation-center-line_median2.857467553642297


other stats
deviation-center-line_max4.5560824639226185
deviation-center-line_mean3.1398838615125397
deviation-center-line_min2.2885178748429453
deviation-heading_max35.08427368404654
deviation-heading_mean28.447629245974777
deviation-heading_median26.59341292752268
deviation-heading_min25.519417444807186
distance-from-start_max0.25758910175028416
distance-from-start_mean0.1807915446348696
distance-from-start_median0.16343345435887996
distance-from-start_min0.13871016807143435
driven_any_max14.262905941415587
driven_any_mean10.060903421939404
driven_any_median12.640159537181242
driven_any_min0.7003886719795414
driven_lanedir_consec_max-0.09656762079975324
driven_lanedir_consec_mean-2.97190532812106
driven_lanedir_consec_min-4.371191644007425
driven_lanedir_max-0.09656762079975324
driven_lanedir_mean-3.0838810334457007
driven_lanedir_median-3.765336267219413
driven_lanedir_min-4.708283978544225
in-drivable-lane_max29.39999999999933
in-drivable-lane_mean21.737499999999503
in-drivable-lane_min1.0499999999999965
per-episodes
details{"4way-000-ego0": {"driven_any": 12.03793542822439, "survival_time": 59.99999999999873, "driven_lanedir": -3.1594808904313996, "in-drivable-lane": 28.699999999999296, "deviation-heading": 26.047947603662266, "distance-from-start": 0.16066695240969742, "deviation-center-line": 2.7016879985107227, "driven_lanedir_consec": -3.1594808904313996}, "4way-000-ego1": {"driven_any": 0.7003886719795414, "survival_time": 59.99999999999873, "driven_lanedir": -0.09656762079975324, "in-drivable-lane": 1.0499999999999965, "deviation-heading": 35.08427368404654, "distance-from-start": 0.13871016807143435, "deviation-center-line": 4.5560824639226185, "driven_lanedir_consec": -0.09656762079975324}, "4way-000-ego2": {"driven_any": 13.242383646138094, "survival_time": 59.99999999999873, "driven_lanedir": -4.708283978544225, "in-drivable-lane": 29.39999999999933, "deviation-heading": 25.519417444807186, "distance-from-start": 0.16619995630806247, "deviation-center-line": 2.2885178748429453, "driven_lanedir_consec": -4.2603811572456625}, "4way-000-ego3": {"driven_any": 14.262905941415587, "survival_time": 59.99999999999873, "driven_lanedir": -4.371191644007425, "in-drivable-lane": 27.799999999999383, "deviation-heading": 27.138878251383098, "distance-from-start": 0.25758910175028416, "deviation-center-line": 3.0132471087738715, "driven_lanedir_consec": -4.371191644007425}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6183514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failednogpu-staging-spot-0-040:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6176516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6175517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6169518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:27
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6162519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6157521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-3of4failednogpu-staging-spot-0-040:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6153522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-0of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6130528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-040:16:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.4500000000000064
driven_lanedir_consec_median9.03456051020932
deviation-center-line_median3.3099035245263013


other stats
deviation-center-line_max3.684182045417866
deviation-center-line_mean3.247145528243326
deviation-center-line_min2.684593018502835
deviation-heading_max14.400290658235557
deviation-heading_mean13.60752339786278
deviation-heading_median13.6700644609107
deviation-heading_min12.68967401139417
distance-from-start_max4.493749953993669
distance-from-start_mean3.8415897031177177
distance-from-start_median3.811232562200406
distance-from-start_min3.250143734076389
driven_any_max10.166997634193525
driven_any_mean9.530419926899665
driven_any_median9.520442125651584
driven_any_min8.913797822101971
driven_lanedir_consec_max9.680684308200217
driven_lanedir_consec_mean8.96079369363353
driven_lanedir_consec_min8.093369445915265
driven_lanedir_max9.680684308200217
driven_lanedir_mean8.96079369363353
driven_lanedir_median9.03456051020932
driven_lanedir_min8.093369445915265
in-drivable-lane_max2.849999999999838
in-drivable-lane_mean0.9374999999999628
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.166997634193525, "survival_time": 59.99999999999873, "driven_lanedir": 9.680684308200217, "in-drivable-lane": 0.0, "deviation-heading": 14.282625493938609, "distance-from-start": 3.832245101698988, "deviation-center-line": 2.9843319056531725, "driven_lanedir_consec": 9.680684308200217}, "zigzag-000-ego1": {"driven_any": 9.317949610360191, "survival_time": 59.99999999999873, "driven_lanedir": 8.730936954855505, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 14.400290658235557, "distance-from-start": 3.250143734076389, "deviation-center-line": 3.63547514339943, "driven_lanedir_consec": 8.730936954855505}, "zigzag-000-ego2": {"driven_any": 9.722934640942974, "survival_time": 59.99999999999873, "driven_lanedir": 9.338184065563135, "in-drivable-lane": 0.0, "deviation-heading": 12.68967401139417, "distance-from-start": 3.790220022701825, "deviation-center-line": 2.684593018502835, "driven_lanedir_consec": 9.338184065563135}, "zigzag-000-ego3": {"driven_any": 8.913797822101971, "survival_time": 59.99999999999873, "driven_lanedir": 8.093369445915265, "in-drivable-lane": 2.849999999999838, "deviation-heading": 13.057503427882793, "distance-from-start": 4.493749953993669, "deviation-center-line": 3.684182045417866, "driven_lanedir_consec": 8.093369445915265}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6122530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-040:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.14999999999957
in-drivable-lane_median3.2499999999998153
driven_lanedir_consec_median5.878977822583269
deviation-center-line_median2.3162616010838217


other stats
deviation-center-line_max2.3162616010838217
deviation-center-line_mean2.3162616010838217
deviation-center-line_min2.3162616010838217
deviation-heading_max9.79892351741828
deviation-heading_mean9.79892351741828
deviation-heading_median9.79892351741828
deviation-heading_min9.79892351741828
distance-from-start_max2.5887062359920505
distance-from-start_mean2.5887062359920505
distance-from-start_median2.5887062359920505
distance-from-start_min2.5887062359920505
driven_any_max6.686527921282186
driven_any_mean6.686527921282186
driven_any_median6.686527921282186
driven_any_min6.686527921282186
driven_lanedir_consec_max5.878977822583269
driven_lanedir_consec_mean5.878977822583269
driven_lanedir_consec_min5.878977822583269
driven_lanedir_max5.878977822583269
driven_lanedir_mean5.878977822583269
driven_lanedir_median5.878977822583269
driven_lanedir_min5.878977822583269
in-drivable-lane_max3.2499999999998153
in-drivable-lane_mean3.2499999999998153
in-drivable-lane_min3.2499999999998153
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.686527921282186, "survival_time": 45.14999999999957, "driven_lanedir": 5.878977822583269, "in-drivable-lane": 3.2499999999998153, "deviation-heading": 9.79892351741828, "distance-from-start": 2.5887062359920505, "deviation-center-line": 2.3162616010838217, "driven_lanedir_consec": 5.878977822583269}}
simulation-passed1
survival_time_max45.14999999999957
survival_time_mean45.14999999999957
survival_time_min45.14999999999957
No reset possible
6117531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-040:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.349999999999998
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2307058003426894
deviation-center-line_median0.4620010689953805


other stats
deviation-center-line_max0.4620010689953805
deviation-center-line_mean0.4620010689953805
deviation-center-line_min0.4620010689953805
deviation-heading_max3.075212463012747
deviation-heading_mean3.075212463012747
deviation-heading_median3.075212463012747
deviation-heading_min3.075212463012747
distance-from-start_max0.9521557544884254
distance-from-start_mean0.9521557544884254
distance-from-start_median0.9521557544884254
distance-from-start_min0.9521557544884254
driven_any_max1.2923959096486308
driven_any_mean1.2923959096486308
driven_any_median1.2923959096486308
driven_any_min1.2923959096486308
driven_lanedir_consec_max1.2307058003426894
driven_lanedir_consec_mean1.2307058003426894
driven_lanedir_consec_min1.2307058003426894
driven_lanedir_max1.2307061786813869
driven_lanedir_mean1.2307061786813869
driven_lanedir_median1.2307061786813869
driven_lanedir_min1.2307061786813869
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.2923959096486308, "survival_time": 9.349999999999998, "driven_lanedir": 1.2307061786813869, "in-drivable-lane": 0.0, "deviation-heading": 3.075212463012747, "distance-from-start": 0.9521557544884254, "deviation-center-line": 0.4620010689953805, "driven_lanedir_consec": 1.2307058003426894}}
simulation-passed1
survival_time_max9.349999999999998
survival_time_mean9.349999999999998
survival_time_min9.349999999999998
No reset possible
6110533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-040:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.387501816509904
survival_time_median59.99999999999873
deviation-center-line_median3.128581529032145
in-drivable-lane_median0.4000000000000057


other stats
deviation-center-line_max3.128581529032145
deviation-center-line_mean3.128581529032145
deviation-center-line_min3.128581529032145
deviation-heading_max13.562447941253197
deviation-heading_mean13.562447941253197
deviation-heading_median13.562447941253197
deviation-heading_min13.562447941253197
distance-from-start_max3.2899748499050334
distance-from-start_mean3.2899748499050334
distance-from-start_median3.2899748499050334
distance-from-start_min3.2899748499050334
driven_any_max9.938942874584264
driven_any_mean9.938942874584264
driven_any_median9.938942874584264
driven_any_min9.938942874584264
driven_lanedir_consec_max9.387501816509904
driven_lanedir_consec_mean9.387501816509904
driven_lanedir_consec_min9.387501816509904
driven_lanedir_max9.387501816509904
driven_lanedir_mean9.387501816509904
driven_lanedir_median9.387501816509904
driven_lanedir_min9.387501816509904
in-drivable-lane_max0.4000000000000057
in-drivable-lane_mean0.4000000000000057
in-drivable-lane_min0.4000000000000057
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.938942874584264, "survival_time": 59.99999999999873, "driven_lanedir": 9.387501816509904, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 13.562447941253197, "distance-from-start": 3.2899748499050334, "deviation-center-line": 3.128581529032145, "driven_lanedir_consec": 9.387501816509904}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6109533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-040:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6091537Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-testingsim-1of4successnogpu-staging-spot-0-040:12:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.7499999999999574
driven_lanedir_consec_median7.955541589976509
deviation-center-line_median3.855750091376094


other stats
deviation-center-line_max3.855750091376094
deviation-center-line_mean3.855750091376094
deviation-center-line_min3.855750091376094
deviation-heading_max13.535268457366566
deviation-heading_mean13.535268457366566
deviation-heading_median13.535268457366566
deviation-heading_min13.535268457366566
distance-from-start_max3.3044917772347415
distance-from-start_mean3.3044917772347415
distance-from-start_median3.3044917772347415
distance-from-start_min3.3044917772347415
driven_any_max8.450181001769215
driven_any_mean8.450181001769215
driven_any_median8.450181001769215
driven_any_min8.450181001769215
driven_lanedir_consec_max7.955541589976509
driven_lanedir_consec_mean7.955541589976509
driven_lanedir_consec_min7.955541589976509
driven_lanedir_max7.955541589976509
driven_lanedir_mean7.955541589976509
driven_lanedir_median7.955541589976509
driven_lanedir_min7.955541589976509
in-drivable-lane_max0.7499999999999574
in-drivable-lane_mean0.7499999999999574
in-drivable-lane_min0.7499999999999574
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.450181001769215, "survival_time": 59.99999999999873, "driven_lanedir": 7.955541589976509, "in-drivable-lane": 0.7499999999999574, "deviation-heading": 13.535268457366566, "distance-from-start": 3.3044917772347415, "deviation-center-line": 3.855750091376094, "driven_lanedir_consec": 7.955541589976509}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6078539Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-040:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median46.19999999999951
in-drivable-lane_median2.849999999999958
driven_lanedir_consec_median6.393748989185982
deviation-center-line_median2.5237436727077953


other stats
deviation-center-line_max2.5237436727077953
deviation-center-line_mean2.5237436727077953
deviation-center-line_min2.5237436727077953
deviation-heading_max12.30348410107792
deviation-heading_mean12.30348410107792
deviation-heading_median12.30348410107792
deviation-heading_min12.30348410107792
distance-from-start_max2.166318605027874
distance-from-start_mean2.166318605027874
distance-from-start_median2.166318605027874
distance-from-start_min2.166318605027874
driven_any_max7.746053514513971
driven_any_mean7.746053514513971
driven_any_median7.746053514513971
driven_any_min7.746053514513971
driven_lanedir_consec_max6.393748989185982
driven_lanedir_consec_mean6.393748989185982
driven_lanedir_consec_min6.393748989185982
driven_lanedir_max6.82794592792156
driven_lanedir_mean6.82794592792156
driven_lanedir_median6.82794592792156
driven_lanedir_min6.82794592792156
in-drivable-lane_max2.849999999999958
in-drivable-lane_mean2.849999999999958
in-drivable-lane_min2.849999999999958
per-episodes
details{"udem1-000-ego0": {"driven_any": 7.746053514513971, "survival_time": 46.19999999999951, "driven_lanedir": 6.82794592792156, "in-drivable-lane": 2.849999999999958, "deviation-heading": 12.30348410107792, "distance-from-start": 2.166318605027874, "deviation-center-line": 2.5237436727077953, "driven_lanedir_consec": 6.393748989185982}}
simulation-passed1
survival_time_max46.19999999999951
survival_time_mean46.19999999999951
survival_time_min46.19999999999951
No reset possible
6056542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-040:03:19
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6046600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-040:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6034605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-040:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.649999999999988
in-drivable-lane_median3.6999999999999975
driven_lanedir_consec_median1.2666237361822557
deviation-center-line_median0.27850796226607377


other stats
deviation-center-line_max0.27850796226607377
deviation-center-line_mean0.27850796226607377
deviation-center-line_min0.27850796226607377
deviation-heading_max1.2608402961769758
deviation-heading_mean1.2608402961769758
deviation-heading_median1.2608402961769758
deviation-heading_min1.2608402961769758
distance-from-start_max2.2370836329941493
distance-from-start_mean2.2370836329941493
distance-from-start_median2.2370836329941493
distance-from-start_min2.2370836329941493
driven_any_max2.273034295861323
driven_any_mean2.273034295861323
driven_any_median2.273034295861323
driven_any_min2.273034295861323
driven_lanedir_consec_max1.2666237361822557
driven_lanedir_consec_mean1.2666237361822557
driven_lanedir_consec_min1.2666237361822557
driven_lanedir_max1.2666237361822557
driven_lanedir_mean1.2666237361822557
driven_lanedir_median1.2666237361822557
driven_lanedir_min1.2666237361822557
in-drivable-lane_max3.6999999999999975
in-drivable-lane_mean3.6999999999999975
in-drivable-lane_min3.6999999999999975
per-episodes
details{"loop-000-ego0": {"driven_any": 2.273034295861323, "survival_time": 8.649999999999988, "driven_lanedir": 1.2666237361822557, "in-drivable-lane": 3.6999999999999975, "deviation-heading": 1.2608402961769758, "distance-from-start": 2.2370836329941493, "deviation-center-line": 0.27850796226607377, "driven_lanedir_consec": 1.2666237361822557}}
simulation-passed1
survival_time_max8.649999999999988
survival_time_mean8.649999999999988
survival_time_min8.649999999999988
No reset possible
6026607Bea Baselines 🐤template-rosaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6021608Bea Baselines 🐤template-rosaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17180525609381947
survival_time_median8.999999999999993
deviation-center-line_median0.06518376914794194
in-drivable-lane_median7.949999999999993


other stats
deviation-center-line_max0.06518376914794194
deviation-center-line_mean0.06518376914794194
deviation-center-line_min0.06518376914794194
deviation-heading_max0.619859963898988
deviation-heading_mean0.619859963898988
deviation-heading_median0.619859963898988
deviation-heading_min0.619859963898988
distance-from-start_max2.2254935173957775
distance-from-start_mean2.2254935173957775
distance-from-start_median2.2254935173957775
distance-from-start_min2.2254935173957775
driven_any_max2.3249440868336837
driven_any_mean2.3249440868336837
driven_any_median2.3249440868336837
driven_any_min2.3249440868336837
driven_lanedir_consec_max0.17180525609381947
driven_lanedir_consec_mean0.17180525609381947
driven_lanedir_consec_min0.17180525609381947
driven_lanedir_max0.17180525609381947
driven_lanedir_mean0.17180525609381947
driven_lanedir_median0.17180525609381947
driven_lanedir_min0.17180525609381947
in-drivable-lane_max7.949999999999993
in-drivable-lane_mean7.949999999999993
in-drivable-lane_min7.949999999999993
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.3249440868336837, "survival_time": 8.999999999999993, "driven_lanedir": 0.17180525609381947, "in-drivable-lane": 7.949999999999993, "deviation-heading": 0.619859963898988, "distance-from-start": 2.2254935173957775, "deviation-center-line": 0.06518376914794194, "driven_lanedir_consec": 0.17180525609381947}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
6015610Bea Baselines 🐤template-rosaido-LFV_multi-sim-testingsim-0of4successnogpu-staging-spot-0-040:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6999999999999984
in-drivable-lane_median1.649999999999998
driven_lanedir_consec_median0.18824284604026795
deviation-center-line_median0.0910856028917905


other stats
deviation-center-line_max0.12356628222477764
deviation-center-line_mean0.0910856028917905
deviation-center-line_min0.05860492355880336
deviation-heading_max0.614182892276029
deviation-heading_mean0.5025639268794276
deviation-heading_median0.5025639268794276
deviation-heading_min0.39094496148282626
distance-from-start_max0.4919505593056944
distance-from-start_mean0.4863056591655686
distance-from-start_median0.4863056591655686
distance-from-start_min0.4806607590254429
driven_any_max0.492157051037272
driven_any_mean0.4900001927083667
driven_any_median0.4900001927083667
driven_any_min0.4878433343794614
driven_lanedir_consec_max0.23179610916917004
driven_lanedir_consec_mean0.18824284604026795
driven_lanedir_consec_min0.1446895829113659
driven_lanedir_max0.23179610916917004
driven_lanedir_mean0.18824284604026795
driven_lanedir_median0.18824284604026795
driven_lanedir_min0.1446895829113659
in-drivable-lane_max1.7999999999999985
in-drivable-lane_mean1.649999999999998
in-drivable-lane_min1.499999999999998
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.492157051037272, "survival_time": 2.6999999999999984, "driven_lanedir": 0.1446895829113659, "in-drivable-lane": 1.7999999999999985, "deviation-heading": 0.614182892276029, "distance-from-start": 0.4919505593056944, "deviation-center-line": 0.05860492355880336, "driven_lanedir_consec": 0.1446895829113659}, "loop2-000-ego1": {"driven_any": 0.4878433343794614, "survival_time": 2.6999999999999984, "driven_lanedir": 0.23179610916917004, "in-drivable-lane": 1.499999999999998, "deviation-heading": 0.39094496148282626, "distance-from-start": 0.4806607590254429, "deviation-center-line": 0.12356628222477764, "driven_lanedir_consec": 0.23179610916917004}}
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.6999999999999984
survival_time_min2.6999999999999984
No reset possible
6006611Bea Baselines 🐤template-rosaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.149999999999983
in-drivable-lane_median6.349999999999983
driven_lanedir_consec_median0.06847450884588602
deviation-center-line_median0.05408230022551939


other stats
deviation-center-line_max0.05408230022551939
deviation-center-line_mean0.05408230022551939
deviation-center-line_min0.05408230022551939
deviation-heading_max0.7666962214015262
deviation-heading_mean0.7666962214015262
deviation-heading_median0.7666962214015262
deviation-heading_min0.7666962214015262
distance-from-start_max1.6611105559975037
distance-from-start_mean1.6611105559975037
distance-from-start_median1.6611105559975037
distance-from-start_min1.6611105559975037
driven_any_max1.8348454641256164
driven_any_mean1.8348454641256164
driven_any_median1.8348454641256164
driven_any_min1.8348454641256164
driven_lanedir_consec_max0.06847450884588602
driven_lanedir_consec_mean0.06847450884588602
driven_lanedir_consec_min0.06847450884588602
driven_lanedir_max0.07029441481200838
driven_lanedir_mean0.07029441481200838
driven_lanedir_median0.07029441481200838
driven_lanedir_min0.07029441481200838
in-drivable-lane_max6.349999999999983
in-drivable-lane_mean6.349999999999983
in-drivable-lane_min6.349999999999983
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8348454641256164, "survival_time": 7.149999999999983, "driven_lanedir": 0.07029441481200838, "in-drivable-lane": 6.349999999999983, "deviation-heading": 0.7666962214015262, "distance-from-start": 1.6611105559975037, "deviation-center-line": 0.05408230022551939, "driven_lanedir_consec": 0.06847450884588602}}
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean7.149999999999983
survival_time_min7.149999999999983
No reset possible
6004613Bea Baselines 🐤template-rosaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5997614Bea Baselines 🐤template-rosaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5994615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2627456477793806
survival_time_median5.799999999999987
deviation-center-line_median0.1324712433350458
in-drivable-lane_median3.9999999999999902


other stats
deviation-center-line_max0.1324712433350458
deviation-center-line_mean0.1324712433350458
deviation-center-line_min0.1324712433350458
deviation-heading_max1.5274310549118018
deviation-heading_mean1.5274310549118018
deviation-heading_median1.5274310549118018
deviation-heading_min1.5274310549118018
distance-from-start_max1.3898896413162136
distance-from-start_mean1.3898896413162136
distance-from-start_median1.3898896413162136
distance-from-start_min1.3898896413162136
driven_any_max1.4252117770543695
driven_any_mean1.4252117770543695
driven_any_median1.4252117770543695
driven_any_min1.4252117770543695
driven_lanedir_consec_max0.2627456477793806
driven_lanedir_consec_mean0.2627456477793806
driven_lanedir_consec_min0.2627456477793806
driven_lanedir_max0.2627456477793806
driven_lanedir_mean0.2627456477793806
driven_lanedir_median0.2627456477793806
driven_lanedir_min0.2627456477793806
in-drivable-lane_max3.9999999999999902
in-drivable-lane_mean3.9999999999999902
in-drivable-lane_min3.9999999999999902
per-episodes
details{"loop-000-ego0": {"driven_any": 1.4252117770543695, "survival_time": 5.799999999999987, "driven_lanedir": 0.2627456477793806, "in-drivable-lane": 3.9999999999999902, "deviation-heading": 1.5274310549118018, "distance-from-start": 1.3898896413162136, "deviation-center-line": 0.1324712433350458, "driven_lanedir_consec": 0.2627456477793806}}
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean5.799999999999987
survival_time_min5.799999999999987
No reset possible
5990615Bea Baselines 🐤template-rosaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-040:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1208862877806074
survival_time_median7.449999999999981
deviation-center-line_median0.05829686830286973
in-drivable-lane_median6.549999999999981


other stats
deviation-center-line_max0.05829686830286973
deviation-center-line_mean0.05829686830286973
deviation-center-line_min0.05829686830286973
deviation-heading_max0.6494314796630349
deviation-heading_mean0.6494314796630349
deviation-heading_median0.6494314796630349
deviation-heading_min0.6494314796630349
distance-from-start_max1.6993486516769978
distance-from-start_mean1.6993486516769978
distance-from-start_median1.6993486516769978
distance-from-start_min1.6993486516769978
driven_any_max1.862970449802127
driven_any_mean1.862970449802127
driven_any_median1.862970449802127
driven_any_min1.862970449802127
driven_lanedir_consec_max0.1208862877806074
driven_lanedir_consec_mean0.1208862877806074
driven_lanedir_consec_min0.1208862877806074
driven_lanedir_max0.1208862877806074
driven_lanedir_mean0.1208862877806074
driven_lanedir_median0.1208862877806074
driven_lanedir_min0.1208862877806074
in-drivable-lane_max6.549999999999981
in-drivable-lane_mean6.549999999999981
in-drivable-lane_min6.549999999999981
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.862970449802127, "survival_time": 7.449999999999981, "driven_lanedir": 0.1208862877806074, "in-drivable-lane": 6.549999999999981, "deviation-heading": 0.6494314796630349, "distance-from-start": 1.6993486516769978, "deviation-center-line": 0.05829686830286973, "driven_lanedir_consec": 0.1208862877806074}}
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean7.449999999999981
survival_time_min7.449999999999981
No reset possible
5988616Bea Baselines 🐤template-rosaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5985617Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:e107400fd98b91bb7c02b7b24d7be5f5d7623035aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-040:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.05151976324649832
deviation-center-line_median0.006351785567597284


other stats
deviation-center-line_max0.006351785567597284
deviation-center-line_mean0.006351785567597284
deviation-center-line_min0.006351785567597284
deviation-heading_max0.2592398237382915
deviation-heading_mean0.2592398237382915
deviation-heading_median0.2592398237382915
deviation-heading_min0.2592398237382915
distance-from-start_max0.0585784443868757
distance-from-start_mean0.0585784443868757
distance-from-start_median0.0585784443868757
distance-from-start_min0.0585784443868757
driven_any_max0.05858569336288852
driven_any_mean0.05858569336288852
driven_any_median0.05858569336288852
driven_any_min0.05858569336288852
driven_lanedir_consec_max0.05151976324649832
driven_lanedir_consec_mean0.05151976324649832
driven_lanedir_consec_min0.05151976324649832
driven_lanedir_max0.05151976324649832
driven_lanedir_mean0.05151976324649832
driven_lanedir_median0.05151976324649832
driven_lanedir_min0.05151976324649832
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.05858569336288852, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05151976324649832, "in-drivable-lane": 0.0, "deviation-heading": 0.2592398237382915, "distance-from-start": 0.0585784443868757, "deviation-center-line": 0.006351785567597284, "driven_lanedir_consec": 0.05151976324649832}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5977619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-040:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.94999999999936
in-drivable-lane_median9.099999999999746
driven_lanedir_consec_median4.849653026499029
deviation-center-line_median3.3027845459985925


other stats
deviation-center-line_max3.3027845459985925
deviation-center-line_mean3.3027845459985925
deviation-center-line_min3.3027845459985925
deviation-heading_max9.71106896428782
deviation-heading_mean9.71106896428782
deviation-heading_median9.71106896428782
deviation-heading_min9.71106896428782
distance-from-start_max3.0483865417404252
distance-from-start_mean3.0483865417404252
distance-from-start_median3.0483865417404252
distance-from-start_min3.0483865417404252
driven_any_max6.3477544934734675
driven_any_mean6.3477544934734675
driven_any_median6.3477544934734675
driven_any_min6.3477544934734675
driven_lanedir_consec_max4.849653026499029
driven_lanedir_consec_mean4.849653026499029
driven_lanedir_consec_min4.849653026499029
driven_lanedir_max4.849653026499029
driven_lanedir_mean4.849653026499029
driven_lanedir_median4.849653026499029
driven_lanedir_min4.849653026499029
in-drivable-lane_max9.099999999999746
in-drivable-lane_mean9.099999999999746
in-drivable-lane_min9.099999999999746
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.3477544934734675, "survival_time": 48.94999999999936, "driven_lanedir": 4.849653026499029, "in-drivable-lane": 9.099999999999746, "deviation-heading": 9.71106896428782, "distance-from-start": 3.0483865417404252, "deviation-center-line": 3.3027845459985925, "driven_lanedir_consec": 4.849653026499029}}
simulation-passed1
survival_time_max48.94999999999936
survival_time_mean48.94999999999936
survival_time_min48.94999999999936
No reset possible
5974620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.449999999999981
in-drivable-lane_median1.7499999999999938
driven_lanedir_consec_median0.5657797783583671
deviation-center-line_median0.45246317726828394


other stats
deviation-center-line_max0.45246317726828394
deviation-center-line_mean0.45246317726828394
deviation-center-line_min0.45246317726828394
deviation-heading_max1.9667619095526685
deviation-heading_mean1.9667619095526685
deviation-heading_median1.9667619095526685
deviation-heading_min1.9667619095526685
distance-from-start_max0.6667967497209883
distance-from-start_mean0.6667967497209883
distance-from-start_median0.6667967497209883
distance-from-start_min0.6667967497209883
driven_any_max0.844405024503514
driven_any_mean0.844405024503514
driven_any_median0.844405024503514
driven_any_min0.844405024503514
driven_lanedir_consec_max0.5657797783583671
driven_lanedir_consec_mean0.5657797783583671
driven_lanedir_consec_min0.5657797783583671
driven_lanedir_max0.5657797783583671
driven_lanedir_mean0.5657797783583671
driven_lanedir_median0.5657797783583671
driven_lanedir_min0.5657797783583671
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean1.7499999999999938
in-drivable-lane_min1.7499999999999938
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.844405024503514, "survival_time": 7.449999999999981, "driven_lanedir": 0.5657797783583671, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 1.9667619095526685, "distance-from-start": 0.6667967497209883, "deviation-center-line": 0.45246317726828394, "driven_lanedir_consec": 0.5657797783583671}}
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean7.449999999999981
survival_time_min7.449999999999981
No reset possible
5965622Bea Baselines 🐤baseline-duckietownaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-040:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median8.999999999999861
driven_lanedir_consec_median4.823343741837602
deviation-center-line_median3.281480027992869


other stats
deviation-center-line_max3.281480027992869
deviation-center-line_mean3.281480027992869
deviation-center-line_min3.281480027992869
deviation-heading_max11.6942922203655
deviation-heading_mean11.6942922203655
deviation-heading_median11.6942922203655
deviation-heading_min11.6942922203655
distance-from-start_max2.368009429382941
distance-from-start_mean2.368009429382941
distance-from-start_median2.368009429382941
distance-from-start_min2.368009429382941
driven_any_max7.9009473160301456
driven_any_mean7.9009473160301456
driven_any_median7.9009473160301456
driven_any_min7.9009473160301456
driven_lanedir_consec_max4.823343741837602
driven_lanedir_consec_mean4.823343741837602
driven_lanedir_consec_min4.823343741837602
driven_lanedir_max6.306170563156378
driven_lanedir_mean6.306170563156378
driven_lanedir_median6.306170563156378
driven_lanedir_min6.306170563156378
in-drivable-lane_max8.999999999999861
in-drivable-lane_mean8.999999999999861
in-drivable-lane_min8.999999999999861
per-episodes
details{"udem1-000-ego0": {"driven_any": 7.9009473160301456, "survival_time": 59.99999999999873, "driven_lanedir": 6.306170563156378, "in-drivable-lane": 8.999999999999861, "deviation-heading": 11.6942922203655, "distance-from-start": 2.368009429382941, "deviation-center-line": 3.281480027992869, "driven_lanedir_consec": 4.823343741837602}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5964623Bea Baselines 🐤baseline-duckietownaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-040:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.106325779253076
survival_time_median59.99999999999873
deviation-center-line_median2.515931372766471
in-drivable-lane_median3.249999999999826


other stats
deviation-center-line_max2.515931372766471
deviation-center-line_mean2.515931372766471
deviation-center-line_min2.515931372766471
deviation-heading_max9.439629929287747
deviation-heading_mean9.439629929287747
deviation-heading_median9.439629929287747
deviation-heading_min9.439629929287747
distance-from-start_max2.6695822141124035
distance-from-start_mean2.6695822141124035
distance-from-start_median2.6695822141124035
distance-from-start_min2.6695822141124035
driven_any_max7.901070912087293
driven_any_mean7.901070912087293
driven_any_median7.901070912087293
driven_any_min7.901070912087293
driven_lanedir_consec_max5.106325779253076
driven_lanedir_consec_mean5.106325779253076
driven_lanedir_consec_min5.106325779253076
driven_lanedir_max7.188744982421506
driven_lanedir_mean7.188744982421506
driven_lanedir_median7.188744982421506
driven_lanedir_min7.188744982421506
in-drivable-lane_max3.249999999999826
in-drivable-lane_mean3.249999999999826
in-drivable-lane_min3.249999999999826
per-episodes
details{"loop-000-ego0": {"driven_any": 7.901070912087293, "survival_time": 59.99999999999873, "driven_lanedir": 7.188744982421506, "in-drivable-lane": 3.249999999999826, "deviation-heading": 9.439629929287747, "distance-from-start": 2.6695822141124035, "deviation-center-line": 2.515931372766471, "driven_lanedir_consec": 5.106325779253076}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5956646Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-0of4successnogpu-staging-spot-0-040:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median40.074999999998965
driven_lanedir_consec_median2.389288277414521
deviation-center-line_median1.8936575769747224


other stats
deviation-center-line_max2.266913205057027
deviation-center-line_mean1.8936575769747224
deviation-center-line_min1.5204019488924176
deviation-heading_max14.428852562491718
deviation-heading_mean13.606874164628213
deviation-heading_median13.606874164628213
deviation-heading_min12.784895766764706
distance-from-start_max0.7352925750679998
distance-from-start_mean0.548037162033866
distance-from-start_median0.548037162033866
distance-from-start_min0.360781748999732
driven_any_max11.197548922707297
driven_any_mean8.766561143219842
driven_any_median8.766561143219842
driven_any_min6.33557336373239
driven_lanedir_consec_max3.102347478354309
driven_lanedir_consec_mean2.389288277414521
driven_lanedir_consec_min1.6762290764747336
driven_lanedir_max3.102347478354309
driven_lanedir_mean2.389288277414521
driven_lanedir_median2.389288277414521
driven_lanedir_min1.6762290764747336
in-drivable-lane_max42.59999999999867
in-drivable-lane_mean40.074999999998965
in-drivable-lane_min37.549999999999265
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.33557336373239, "survival_time": 59.99999999999873, "driven_lanedir": 1.6762290764747336, "in-drivable-lane": 42.59999999999867, "deviation-heading": 12.784895766764706, "distance-from-start": 0.7352925750679998, "deviation-center-line": 1.5204019488924176, "driven_lanedir_consec": 1.6762290764747336}, "loop2-000-ego1": {"driven_any": 11.197548922707297, "survival_time": 59.99999999999873, "driven_lanedir": 3.102347478354309, "in-drivable-lane": 37.549999999999265, "deviation-heading": 14.428852562491718, "distance-from-start": 0.360781748999732, "deviation-center-line": 2.266913205057027, "driven_lanedir_consec": 3.102347478354309}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5945648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:06:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median34.54999999999907
driven_lanedir_consec_median0.49347915183774327
deviation-center-line_median3.009026451727693


other stats
deviation-center-line_max3.009026451727693
deviation-center-line_mean3.009026451727693
deviation-center-line_min3.009026451727693
deviation-heading_max20.208791808942976
deviation-heading_mean20.208791808942976
deviation-heading_median20.208791808942976
deviation-heading_min20.208791808942976
distance-from-start_max0.27279658541490925
distance-from-start_mean0.27279658541490925
distance-from-start_median0.27279658541490925
distance-from-start_min0.27279658541490925
driven_any_max2.2769810444073126
driven_any_mean2.2769810444073126
driven_any_median2.2769810444073126
driven_any_min2.2769810444073126
driven_lanedir_consec_max0.49347915183774327
driven_lanedir_consec_mean0.49347915183774327
driven_lanedir_consec_min0.49347915183774327
driven_lanedir_max0.7080539210858303
driven_lanedir_mean0.7080539210858303
driven_lanedir_median0.7080539210858303
driven_lanedir_min0.7080539210858303
in-drivable-lane_max34.54999999999907
in-drivable-lane_mean34.54999999999907
in-drivable-lane_min34.54999999999907
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.2769810444073126, "survival_time": 59.99999999999873, "driven_lanedir": 0.7080539210858303, "in-drivable-lane": 34.54999999999907, "deviation-heading": 20.208791808942976, "distance-from-start": 0.27279658541490925, "deviation-center-line": 3.009026451727693, "driven_lanedir_consec": 0.49347915183774327}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5941649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-040:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.5999999999999988
in-drivable-lane_median1.4499999999999984
driven_lanedir_consec_median0.08424401719061225
deviation-center-line_median0.06990057299460198


other stats
deviation-center-line_max0.06990057299460198
deviation-center-line_mean0.06990057299460198
deviation-center-line_min0.06990057299460198
deviation-heading_max0.9689003015377232
deviation-heading_mean0.9689003015377232
deviation-heading_median0.9689003015377232
deviation-heading_min0.9689003015377232
distance-from-start_max0.1963079413116584
distance-from-start_mean0.1963079413116584
distance-from-start_median0.1963079413116584
distance-from-start_min0.1963079413116584
driven_any_max0.2576795593141261
driven_any_mean0.2576795593141261
driven_any_median0.2576795593141261
driven_any_min0.2576795593141261
driven_lanedir_consec_max0.08424401719061225
driven_lanedir_consec_mean0.08424401719061225
driven_lanedir_consec_min0.08424401719061225
driven_lanedir_max0.08424401719061225
driven_lanedir_mean0.08424401719061225
driven_lanedir_median0.08424401719061225
driven_lanedir_min0.08424401719061225
in-drivable-lane_max1.4499999999999984
in-drivable-lane_mean1.4499999999999984
in-drivable-lane_min1.4499999999999984
per-episodes
details{"udem-000-ego0": {"driven_any": 0.2576795593141261, "survival_time": 2.5999999999999988, "driven_lanedir": 0.08424401719061225, "in-drivable-lane": 1.4499999999999984, "deviation-heading": 0.9689003015377232, "distance-from-start": 0.1963079413116584, "deviation-center-line": 0.06990057299460198, "driven_lanedir_consec": 0.08424401719061225}}
simulation-passed1
survival_time_max2.5999999999999988
survival_time_mean2.5999999999999988
survival_time_min2.5999999999999988
No reset possible
5931651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-040:06:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5988334093270895
survival_time_median59.99999999999873
deviation-center-line_median1.2160326538660389
in-drivable-lane_median44.74999999999895


other stats
deviation-center-line_max1.2160326538660389
deviation-center-line_mean1.2160326538660389
deviation-center-line_min1.2160326538660389
deviation-heading_max11.957004853019384
deviation-heading_mean11.957004853019384
deviation-heading_median11.957004853019384
deviation-heading_min11.957004853019384
distance-from-start_max0.5042249495301379
distance-from-start_mean0.5042249495301379
distance-from-start_median0.5042249495301379
distance-from-start_min0.5042249495301379
driven_any_max3.996800390575552
driven_any_mean3.996800390575552
driven_any_median3.996800390575552
driven_any_min3.996800390575552
driven_lanedir_consec_max0.5988334093270895
driven_lanedir_consec_mean0.5988334093270895
driven_lanedir_consec_min0.5988334093270895
driven_lanedir_max0.5988334093270895
driven_lanedir_mean0.5988334093270895
driven_lanedir_median0.5988334093270895
driven_lanedir_min0.5988334093270895
in-drivable-lane_max44.74999999999895
in-drivable-lane_mean44.74999999999895
in-drivable-lane_min44.74999999999895
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.996800390575552, "survival_time": 59.99999999999873, "driven_lanedir": 0.5988334093270895, "in-drivable-lane": 44.74999999999895, "deviation-heading": 11.957004853019384, "distance-from-start": 0.5042249495301379, "deviation-center-line": 1.2160326538660389, "driven_lanedir_consec": 0.5988334093270895}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5928651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-1of4successnogpu-staging-spot-0-040:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14791573204734387
survival_time_median2.8999999999999977
deviation-center-line_median0.07004899994872002
in-drivable-lane_median1.7499999999999971


other stats
deviation-center-line_max0.07004899994872002
deviation-center-line_mean0.07004899994872002
deviation-center-line_min0.07004899994872002
deviation-heading_max0.7419375706702205
deviation-heading_mean0.7419375706702205
deviation-heading_median0.7419375706702205
deviation-heading_min0.7419375706702205
distance-from-start_max0.3231054714452832
distance-from-start_mean0.3231054714452832
distance-from-start_median0.3231054714452832
distance-from-start_min0.3231054714452832
driven_any_max0.3915599730323493
driven_any_mean0.3915599730323493
driven_any_median0.3915599730323493
driven_any_min0.3915599730323493
driven_lanedir_consec_max0.14791573204734387
driven_lanedir_consec_mean0.14791573204734387
driven_lanedir_consec_min0.14791573204734387
driven_lanedir_max0.14791573204734387
driven_lanedir_mean0.14791573204734387
driven_lanedir_median0.14791573204734387
driven_lanedir_min0.14791573204734387
in-drivable-lane_max1.7499999999999971
in-drivable-lane_mean1.7499999999999971
in-drivable-lane_min1.7499999999999971
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.3915599730323493, "survival_time": 2.8999999999999977, "driven_lanedir": 0.14791573204734387, "in-drivable-lane": 1.7499999999999971, "deviation-heading": 0.7419375706702205, "distance-from-start": 0.3231054714452832, "deviation-center-line": 0.07004899994872002, "driven_lanedir_consec": 0.14791573204734387}}
simulation-passed1
survival_time_max2.8999999999999977
survival_time_mean2.8999999999999977
survival_time_min2.8999999999999977
No reset possible
5925651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11861514510383596
survival_time_median2.3
deviation-center-line_median0.08502668134002157
in-drivable-lane_median0.8999999999999992


other stats
deviation-center-line_max0.08502668134002157
deviation-center-line_mean0.08502668134002157
deviation-center-line_min0.08502668134002157
deviation-heading_max1.0271592747716491
deviation-heading_mean1.0271592747716491
deviation-heading_median1.0271592747716491
deviation-heading_min1.0271592747716491
distance-from-start_max0.20791224347187248
distance-from-start_mean0.20791224347187248
distance-from-start_median0.20791224347187248
distance-from-start_min0.20791224347187248
driven_any_max0.22070506625327868
driven_any_mean0.22070506625327868
driven_any_median0.22070506625327868
driven_any_min0.22070506625327868
driven_lanedir_consec_max0.11861514510383596
driven_lanedir_consec_mean0.11861514510383596
driven_lanedir_consec_min0.11861514510383596
driven_lanedir_max0.11861514510383596
driven_lanedir_mean0.11861514510383596
driven_lanedir_median0.11861514510383596
driven_lanedir_min0.11861514510383596
in-drivable-lane_max0.8999999999999992
in-drivable-lane_mean0.8999999999999992
in-drivable-lane_min0.8999999999999992
per-episodes
details{"loop-000-ego0": {"driven_any": 0.22070506625327868, "survival_time": 2.3, "driven_lanedir": 0.11861514510383596, "in-drivable-lane": 0.8999999999999992, "deviation-heading": 1.0271592747716491, "distance-from-start": 0.20791224347187248, "deviation-center-line": 0.08502668134002157, "driven_lanedir_consec": 0.11861514510383596}}
simulation-passed1
survival_time_max2.3
survival_time_mean2.3
survival_time_min2.3
No reset possible
5923652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5920652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornogpu-staging-spot-0-040:01:30
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5918652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-040:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5916652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:31
The container "solut [...]
The container "solution-ego3" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5914653Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-testingsim-0of4host-errornogpu-staging-spot-0-040:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:

error in ego1 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5904654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4host-errornogpu-staging-spot-0-040:06:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/e1e8c18cf877bf03c5872d46218856b4273a62afeab32acca7bc04d46b0efd1e/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/e1e8c18cf877bf03c5872d46218856b4273a62afeab32acca7bc04d46b0efd1e/json: Not Found ("No such container: e1e8c18cf877bf03c5872d46218856b4273a62afeab32acca7bc04d46b0efd1e")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5900655Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-0of4successnogpu-staging-spot-0-040:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.050000000000022
in-drivable-lane_median5.750000000000019
driven_lanedir_consec_median0.15369125922721483
deviation-center-line_median0.18888621693883728


other stats
deviation-center-line_max0.18888621693883728
deviation-center-line_mean0.18888621693883728
deviation-center-line_min0.18888621693883728
deviation-heading_max3.8716119475123745
deviation-heading_mean3.8716119475123745
deviation-heading_median3.8716119475123745
deviation-heading_min3.8716119475123745
distance-from-start_max0.07003281026156681
distance-from-start_mean0.07003281026156681
distance-from-start_median0.07003281026156681
distance-from-start_min0.07003281026156681
driven_any_max0.42148793937643736
driven_any_mean0.42148793937643736
driven_any_median0.42148793937643736
driven_any_min0.42148793937643736
driven_lanedir_consec_max0.15369125922721483
driven_lanedir_consec_mean0.15369125922721483
driven_lanedir_consec_min0.15369125922721483
driven_lanedir_max0.15369125922721483
driven_lanedir_mean0.15369125922721483
driven_lanedir_median0.15369125922721483
driven_lanedir_min0.15369125922721483
in-drivable-lane_max5.750000000000019
in-drivable-lane_mean5.750000000000019
in-drivable-lane_min5.750000000000019
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.42148793937643736, "survival_time": 11.050000000000022, "driven_lanedir": 0.15369125922721483, "in-drivable-lane": 5.750000000000019, "deviation-heading": 3.8716119475123745, "distance-from-start": 0.07003281026156681, "deviation-center-line": 0.18888621693883728, "driven_lanedir_consec": 0.15369125922721483}}
simulation-passed1
survival_time_max11.050000000000022
survival_time_mean11.050000000000022
survival_time_min11.050000000000022
No reset possible
5895656Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5887657Bea Baselines 🐤template-pytorchaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-040:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.4499999999999957
in-drivable-lane_median1.4499999999999948
driven_lanedir_consec_median0.15373474338947135
deviation-center-line_median0.06928201924539433


other stats
deviation-center-line_max0.06928201924539433
deviation-center-line_mean0.06928201924539433
deviation-center-line_min0.06928201924539433
deviation-heading_max1.2801658718742714
deviation-heading_mean1.2801658718742714
deviation-heading_median1.2801658718742714
deviation-heading_min1.2801658718742714
distance-from-start_max0.17493261055483228
distance-from-start_mean0.17493261055483228
distance-from-start_median0.17493261055483228
distance-from-start_min0.17493261055483228
driven_any_max0.2942120681104054
driven_any_mean0.2942120681104054
driven_any_median0.2942120681104054
driven_any_min0.2942120681104054
driven_lanedir_consec_max0.15373474338947135
driven_lanedir_consec_mean0.15373474338947135
driven_lanedir_consec_min0.15373474338947135
driven_lanedir_max0.15373474338947135
driven_lanedir_mean0.15373474338947135
driven_lanedir_median0.15373474338947135
driven_lanedir_min0.15373474338947135
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean1.4499999999999948
in-drivable-lane_min1.4499999999999948
per-episodes
details{"udem1-000-ego0": {"driven_any": 0.2942120681104054, "survival_time": 3.4499999999999957, "driven_lanedir": 0.15373474338947135, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 1.2801658718742714, "distance-from-start": 0.17493261055483228, "deviation-center-line": 0.06928201924539433, "driven_lanedir_consec": 0.15373474338947135}}
simulation-passed1
survival_time_max3.4499999999999957
survival_time_mean3.4499999999999957
survival_time_min3.4499999999999957
No reset possible
5882659Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5876660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-3of4failednogpu-staging-spot-0-040:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5872661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-0of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5867662Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-1of4failednogpu-staging-spot-0-040:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5862663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5857665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-040:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5818703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:14:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.599999999998715
driven_lanedir_consec_median0.17850006289932396
deviation-center-line_median0.49660205595737594


other stats
deviation-center-line_max0.7655517644258731
deviation-center-line_mean0.550438887644005
deviation-center-line_min0.4429996742353948
deviation-heading_max5.708723015945328
deviation-heading_mean4.314762107049478
deviation-heading_median4.260413639699664
deviation-heading_min3.029498132853256
distance-from-start_max1.4108418329398826
distance-from-start_mean1.1194358824993853
distance-from-start_median1.1354018196019648
distance-from-start_min0.7960980578537286
driven_any_max15.326310847370626
driven_any_mean11.633879106528216
driven_any_median12.316353572892982
driven_any_min6.576498432956271
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.18178573943420095
driven_lanedir_consec_min0.0983081207661829
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.16790489531803093
driven_lanedir_median0.1652120582661244
driven_lanedir_min0.0873654691406669
in-drivable-lane_max54.699999999998695
in-drivable-lane_mean53.33749999999871
in-drivable-lane_min51.44999999999871
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465089, "survival_time": 59.99999999999873, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 51.44999999999871, "deviation-heading": 5.708723015945328, "distance-from-start": 1.0442247976691956, "deviation-center-line": 0.7655517644258731, "driven_lanedir_consec": 0.271834711171973}, "loop-000-ego1": {"driven_any": 6.576498432956271, "survival_time": 59.99999999999873, "driven_lanedir": 0.1969664999784144, "in-drivable-lane": 52.54999999999872, "deviation-heading": 4.716518246290203, "distance-from-start": 0.7960980578537286, "deviation-center-line": 0.5494202135367019, "driven_lanedir_consec": 0.2102948009868546}, "loop-000-ego2": {"driven_any": 13.256645143320878, "survival_time": 59.99999999999873, "driven_lanedir": 0.13345761655383437, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.029498132853256, "distance-from-start": 1.226578841534734, "deviation-center-line": 0.4429996742353948, "driven_lanedir_consec": 0.14670532481179333}, "loop-000-ego3": {"driven_any": 15.326310847370626, "survival_time": 59.99999999999873, "driven_lanedir": 0.0873654691406669, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109124, "distance-from-start": 1.4108418329398826, "deviation-center-line": 0.4437838983780501, "driven_lanedir_consec": 0.0983081207661829}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5810705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-040:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.400000000000126
in-drivable-lane_median9.6500000000001
driven_lanedir_consec_median0.2737818968396458
deviation-center-line_median0.799573856657706


other stats
deviation-center-line_max0.799573856657706
deviation-center-line_mean0.799573856657706
deviation-center-line_min0.799573856657706
deviation-heading_max6.366511388189685
deviation-heading_mean6.366511388189685
deviation-heading_median6.366511388189685
deviation-heading_min6.366511388189685
distance-from-start_max0.6736010379604951
distance-from-start_mean0.6736010379604951
distance-from-start_median0.6736010379604951
distance-from-start_min0.6736010379604951
driven_any_max4.170232497072811
driven_any_mean4.170232497072811
driven_any_median4.170232497072811
driven_any_min4.170232497072811
driven_lanedir_consec_max0.2737818968396458
driven_lanedir_consec_mean0.2737818968396458
driven_lanedir_consec_min0.2737818968396458
driven_lanedir_max0.2565970421753513
driven_lanedir_mean0.2565970421753513
driven_lanedir_median0.2565970421753513
driven_lanedir_min0.2565970421753513
in-drivable-lane_max9.6500000000001
in-drivable-lane_mean9.6500000000001
in-drivable-lane_min9.6500000000001
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.170232497072811, "survival_time": 18.400000000000126, "driven_lanedir": 0.2565970421753513, "in-drivable-lane": 9.6500000000001, "deviation-heading": 6.366511388189685, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.799573856657706, "driven_lanedir_consec": 0.2737818968396458}}
simulation-passed1
survival_time_max18.400000000000126
survival_time_mean18.400000000000126
survival_time_min18.400000000000126
No reset possible
5798707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-040:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median45.099999999999575
in-drivable-lane_median36.54999999999956
driven_lanedir_consec_median0.26764888474322424
deviation-center-line_median0.7555295615924859


other stats
deviation-center-line_max0.7555295615924859
deviation-center-line_mean0.7555295615924859
deviation-center-line_min0.7555295615924859
deviation-heading_max5.523298977694424
deviation-heading_mean5.523298977694424
deviation-heading_median5.523298977694424
deviation-heading_min5.523298977694424
distance-from-start_max1.0442247976692045
distance-from-start_mean1.0442247976692045
distance-from-start_median1.0442247976692045
distance-from-start_min1.0442247976692045
driven_any_max11.376062002465131
driven_any_mean11.376062002465131
driven_any_median11.376062002465131
driven_any_min11.376062002465131
driven_lanedir_consec_max0.26764888474322424
driven_lanedir_consec_mean0.26764888474322424
driven_lanedir_consec_min0.26764888474322424
driven_lanedir_max0.2496386855430165
driven_lanedir_mean0.2496386855430165
driven_lanedir_median0.2496386855430165
driven_lanedir_min0.2496386855430165
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"udem1-000-ego0": {"driven_any": 11.376062002465131, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496386855430165, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523298977694424, "distance-from-start": 1.0442247976692045, "deviation-center-line": 0.7555295615924859, "driven_lanedir_consec": 0.26764888474322424}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
5797707Bea Baselines 🐤template-randomaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5794708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-040:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26764947507969805
survival_time_median25.75000000000023
deviation-center-line_median0.7555292890833561
in-drivable-lane_median17.20000000000021


other stats
deviation-center-line_max0.7555292890833561
deviation-center-line_mean0.7555292890833561
deviation-center-line_min0.7555292890833561
deviation-heading_max5.523299123594233
deviation-heading_mean5.523299123594233
deviation-heading_median5.523299123594233
deviation-heading_min5.523299123594233
distance-from-start_max0.7960980578537241
distance-from-start_mean0.7960980578537241
distance-from-start_median0.7960980578537241
distance-from-start_min0.7960980578537241
driven_any_max6.239826156091173
driven_any_mean6.239826156091173
driven_any_median6.239826156091173
driven_any_min6.239826156091173
driven_lanedir_consec_max0.26764947507969805
driven_lanedir_consec_mean0.26764947507969805
driven_lanedir_consec_min0.26764947507969805
driven_lanedir_max0.2496387990426845
driven_lanedir_mean0.2496387990426845
driven_lanedir_median0.2496387990426845
driven_lanedir_min0.2496387990426845
in-drivable-lane_max17.20000000000021
in-drivable-lane_mean17.20000000000021
in-drivable-lane_min17.20000000000021
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.239826156091173, "survival_time": 25.75000000000023, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 17.20000000000021, "deviation-heading": 5.523299123594233, "distance-from-start": 0.7960980578537241, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}}
simulation-passed1
survival_time_max25.75000000000023
survival_time_mean25.75000000000023
survival_time_min25.75000000000023
No reset possible
5777712Bea Baselines 🐤template-randomaido-LFV-sim-testingsim-3of4successnogpu-staging-spot-0-040:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median47.14999999999946
in-drivable-lane_median41.84999999999942
driven_lanedir_consec_median0.02132071110144948
deviation-center-line_median0.43050874852338417


other stats
deviation-center-line_max0.43050874852338417
deviation-center-line_mean0.43050874852338417
deviation-center-line_min0.43050874852338417
deviation-heading_max4.072118820377199
deviation-heading_mean4.072118820377199
deviation-heading_median4.072118820377199
deviation-heading_min4.072118820377199
distance-from-start_max1.0630774515460415
distance-from-start_mean1.0630774515460415
distance-from-start_median1.0630774515460415
distance-from-start_min1.0630774515460415
driven_any_max11.484884891685338
driven_any_mean11.484884891685338
driven_any_median11.484884891685338
driven_any_min11.484884891685338
driven_lanedir_consec_max0.02132071110144948
driven_lanedir_consec_mean0.02132071110144948
driven_lanedir_consec_min0.02132071110144948
driven_lanedir_max0.004356572616899007
driven_lanedir_mean0.004356572616899007
driven_lanedir_median0.004356572616899007
driven_lanedir_min0.004356572616899007
in-drivable-lane_max41.84999999999942
in-drivable-lane_mean41.84999999999942
in-drivable-lane_min41.84999999999942
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.484884891685338, "survival_time": 47.14999999999946, "driven_lanedir": 0.004356572616899007, "in-drivable-lane": 41.84999999999942, "deviation-heading": 4.072118820377199, "distance-from-start": 1.0630774515460415, "deviation-center-line": 0.43050874852338417, "driven_lanedir_consec": 0.02132071110144948}}
simulation-passed1
survival_time_max47.14999999999946
survival_time_mean47.14999999999946
survival_time_min47.14999999999946
No reset possible
5767716Bea Baselines 🐤template-randomaido-LFVI_multi-sim-testingsim-0of4successnogpu-staging-spot-0-040:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.80000000000009
in-drivable-lane_median12.250000000000089
driven_lanedir_consec_median0.1976657309045995
deviation-center-line_median0.30916297118874164


other stats
deviation-center-line_max0.5167734001966479
deviation-center-line_mean0.2904356927295703
deviation-center-line_min0.026643428344150132
deviation-heading_max3.648554139524216
deviation-heading_mean2.1866076734990423
deviation-heading_median1.9856511911894663
deviation-heading_min1.126574172093021
distance-from-start_max0.6297514211539125
distance-from-start_mean0.5152552969251188
distance-from-start_median0.5284445727545999
distance-from-start_min0.3743806210373633
driven_any_max3.5922095903913815
driven_any_mean1.7403199031741243
driven_any_median1.4873198912093584
driven_any_min0.3944302398863988
driven_lanedir_consec_max0.30624803336021755
driven_lanedir_consec_mean0.18098238479843215
driven_lanedir_consec_min0.022350044024312066
driven_lanedir_max0.30624803336021755
driven_lanedir_mean0.17754217371916875
driven_lanedir_median0.1907853087460727
driven_lanedir_min0.022350044024312066
in-drivable-lane_max14.30000000000009
in-drivable-lane_mean11.862500000000091
in-drivable-lane_min8.650000000000095
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5356334840761573, "survival_time": 15.80000000000009, "driven_lanedir": 0.022350044024312066, "in-drivable-lane": 14.30000000000009, "deviation-heading": 1.126574172093021, "distance-from-start": 0.5107316375695493, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350044024312066}, "udem-000-ego1": {"driven_any": 3.5922095903913815, "survival_time": 15.80000000000009, "driven_lanedir": 0.23530327637400592, "in-drivable-lane": 8.650000000000095, "deviation-heading": 3.648554139524216, "distance-from-start": 0.6297514211539125, "deviation-center-line": 0.5167734001966479, "driven_lanedir_consec": 0.24249463032549556}, "udem-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 15.80000000000009, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 10.750000000000083, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "udem-000-ego3": {"driven_any": 0.3944302398863988, "survival_time": 15.80000000000009, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 13.750000000000092, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.3743806210373633, "deviation-center-line": 0.10402505233140706, "driven_lanedir_consec": 0.30624803336021755}}
simulation-passed1
survival_time_max15.80000000000009
survival_time_mean15.80000000000009
survival_time_min15.80000000000009
No reset possible
5760733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-0of4successnogpu-staging-spot-0-040:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948943425963037


other stats
deviation-center-line_max0.8948943425963037
deviation-center-line_mean0.8948943425963037
deviation-center-line_min0.8948943425963037
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.3877787807814454e-16
distance-from-start_mean1.3877787807814454e-16
distance-from-start_median1.3877787807814454e-16
distance-from-start_min1.3877787807814454e-16
driven_any_max1.665334536937735e-13
driven_any_mean1.665334536937735e-13
driven_any_median1.665334536937735e-13
driven_any_min1.665334536937735e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5758733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-040:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median7.688985448339736e-07
deviation-center-line_median0.8948980057926529


other stats
deviation-center-line_max0.8948980057926529
deviation-center-line_mean0.8948980057926529
deviation-center-line_min0.8948980057926529
deviation-heading_max32.249118375031394
deviation-heading_mean32.249118375031394
deviation-heading_median32.249118375031394
deviation-heading_min32.249118375031394
distance-from-start_max4.965068306494546e-16
distance-from-start_mean4.965068306494546e-16
distance-from-start_median4.965068306494546e-16
distance-from-start_min4.965068306494546e-16
driven_any_max5.95808196779335e-13
driven_any_mean5.95808196779335e-13
driven_any_median5.95808196779335e-13
driven_any_min5.95808196779335e-13
driven_lanedir_consec_max7.688985448339736e-07
driven_lanedir_consec_mean7.688985448339736e-07
driven_lanedir_consec_min7.688985448339736e-07
driven_lanedir_max7.688985448339736e-07
driven_lanedir_mean7.688985448339736e-07
driven_lanedir_median7.688985448339736e-07
driven_lanedir_min7.688985448339736e-07
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 7.688985448339736e-07, "in-drivable-lane": 0.0, "deviation-heading": 32.249118375031394, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8948980057926529, "driven_lanedir_consec": 7.688985448339736e-07}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5740738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-040:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.511704717596742


other stats
deviation-center-line_max2.946772659605511
deviation-center-line_mean1.5769817001146265
deviation-center-line_min0.3377447056595108
deviation-heading_max32.249113233675025
deviation-heading_mean22.83949643715976
deviation-heading_median22.59726568012299
deviation-heading_min13.914341154718024
distance-from-start_max4.965068306494546e-16
distance-from-start_mean2.2127122231706483e-16
distance-from-start_median1.6653345369377348e-16
distance-from-start_min5.551115123125783e-17
driven_any_max5.95808196779335e-13
driven_any_mean2.6552546678047523e-13
driven_any_median1.9984014443252818e-13
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8949033835511649, "driven_lanedir_consec": 0.0}, "4way-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.128506051642319, "driven_lanedir_consec": 0.0}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.946772659605511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.3377447056595108, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5738738Bea Baselines 🐤baseline-duckietown-mlaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5725741Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-testingsim-1of4successnogpu-staging-spot-0-040:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134844


other stats
deviation-center-line_max0.4065243130134844
deviation-center-line_mean0.4065243130134844
deviation-center-line_min0.4065243130134844
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065243130134844, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5714743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-040:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065243130134252


other stats
deviation-center-line_max0.4065243130134252
deviation-center-line_mean0.4065243130134252
deviation-center-line_min0.4065243130134252
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.4065243130134252, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5706749Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-0of4failednogpu-staging-spot-0-040:00:58
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5701750Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-3of4failednogpu-staging-spot-0-040:00:54
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5696750Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-0of4failednogpu-staging-spot-0-040:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5687753Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-2of4failednogpu-staging-spot-0-040:02:33
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682754Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-040:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5677755Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4failednogpu-staging-spot-0-040:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5673756Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-0of4failednogpu-staging-spot-0-040:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669757Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-3of4failednogpu-staging-spot-0-040:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5663759Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-1of4failednogpu-staging-spot-0-040:01:13
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5654760Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-0of4failednogpu-staging-spot-0-040:01:15
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5649761Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-1of4failednogpu-staging-spot-0-040:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5643762Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-040:00:59
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5632632Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-validationsim-1of4successnogpu-staging-spot-0-040:06:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median30.200000000000298
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median1.6557496945576338
deviation-center-line_median3.0292371299157934


other stats
deviation-center-line_max3.0292371299157934
deviation-center-line_mean3.0292371299157934
deviation-center-line_min3.0292371299157934
deviation-heading_max2.9200444744909024
deviation-heading_mean2.9200444744909024
deviation-heading_median2.9200444744909024
deviation-heading_min2.9200444744909024
distance-from-start_max1.3121126948157773
distance-from-start_mean1.3121126948157773
distance-from-start_median1.3121126948157773
distance-from-start_min1.3121126948157773
driven_any_max1.7165963269618534
driven_any_mean1.7165963269618534
driven_any_median1.7165963269618534
driven_any_min1.7165963269618534
driven_lanedir_consec_max1.6557496945576338
driven_lanedir_consec_mean1.6557496945576338
driven_lanedir_consec_min1.6557496945576338
driven_lanedir_max1.6557496945576338
driven_lanedir_mean1.6557496945576338
driven_lanedir_median1.6557496945576338
driven_lanedir_min1.6557496945576338
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"4way-000-ego0": {"driven_any": 1.7165963269618534, "survival_time": 30.200000000000298, "driven_lanedir": 1.6557496945576338, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200444744909024, "distance-from-start": 1.3121126948157773, "deviation-center-line": 3.0292371299157934, "driven_lanedir_consec": 1.6557496945576338}}
simulation-passed1
survival_time_max30.200000000000298
survival_time_mean30.200000000000298
survival_time_min30.200000000000298
No reset possible
5616636Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-3of4successnogpu-staging-spot-0-040:14:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.899999999999888
driven_lanedir_consec_median2.577147081404033
deviation-center-line_median6.473819545759991


other stats
deviation-center-line_max6.67414186858749
deviation-center-line_mean6.181505974927821
deviation-center-line_min5.104242939603813
deviation-heading_max10.109778463057898
deviation-heading_mean8.400916955237046
deviation-heading_median8.14470326891814
deviation-heading_min7.204482820054009
distance-from-start_max2.170988126335053
distance-from-start_mean1.563488645703338
distance-from-start_median1.6003159096716135
distance-from-start_min0.8823346371350725
driven_any_max3.4820813210699813
driven_any_mean3.464122337409231
driven_any_median3.4626626970634273
driven_any_min3.449082634440088
driven_lanedir_consec_max3.283655000392273
driven_lanedir_consec_mean2.512031151865401
driven_lanedir_consec_min1.6101754442612652
driven_lanedir_max3.283655000392273
driven_lanedir_mean3.242098610430684
driven_lanedir_median3.2385172829127216
driven_lanedir_min3.2077048755050215
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean3.8499999999999073
in-drivable-lane_min3.249999999999958
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.4715894450565123, "survival_time": 59.99999999999873, "driven_lanedir": 3.283655000392273, "in-drivable-lane": 3.599999999999884, "deviation-heading": 7.204482820054009, "distance-from-start": 1.6768936287564808, "deviation-center-line": 6.67414186858749, "driven_lanedir_consec": 3.283655000392273}, "zigzag-000-ego1": {"driven_any": 3.453735949070342, "survival_time": 59.99999999999873, "driven_lanedir": 3.215991718710423, "in-drivable-lane": 4.199999999999893, "deviation-heading": 8.20099581172048, "distance-from-start": 2.170988126335053, "deviation-center-line": 6.65956544167938, "driven_lanedir_consec": 3.215991718710423}, "zigzag-000-ego2": {"driven_any": 3.4820813210699813, "survival_time": 59.99999999999873, "driven_lanedir": 3.26104284711502, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778463057898, "distance-from-start": 1.5237381905867464, "deviation-center-line": 5.104242939603813, "driven_lanedir_consec": 1.6101754442612652}, "zigzag-000-ego3": {"driven_any": 3.449082634440088, "survival_time": 59.99999999999873, "driven_lanedir": 3.2077048755050215, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.088410726115796, "distance-from-start": 0.8823346371350725, "deviation-center-line": 6.2880736498406025, "driven_lanedir_consec": 1.9383024440976424}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5608638Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-2of4successnogpu-staging-spot-0-040:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.099999999999902
driven_lanedir_consec_median2.8149940810866236
deviation-center-line_median4.094985063841091


other stats
deviation-center-line_max4.094985063841091
deviation-center-line_mean4.094985063841091
deviation-center-line_min4.094985063841091
deviation-heading_max9.104325322582234
deviation-heading_mean9.104325322582234
deviation-heading_median9.104325322582234
deviation-heading_min9.104325322582234
distance-from-start_max2.645340381315678
distance-from-start_mean2.645340381315678
distance-from-start_median2.645340381315678
distance-from-start_min2.645340381315678
driven_any_max3.486581977234586
driven_any_mean3.486581977234586
driven_any_median3.486581977234586
driven_any_min3.486581977234586
driven_lanedir_consec_max2.8149940810866236
driven_lanedir_consec_mean2.8149940810866236
driven_lanedir_consec_min2.8149940810866236
driven_lanedir_max3.274708374952958
driven_lanedir_mean3.274708374952958
driven_lanedir_median3.274708374952958
driven_lanedir_min3.274708374952958
in-drivable-lane_max3.099999999999902
in-drivable-lane_mean3.099999999999902
in-drivable-lane_min3.099999999999902
per-episodes
details{"loop-000-ego0": {"driven_any": 3.486581977234586, "survival_time": 59.99999999999873, "driven_lanedir": 3.274708374952958, "in-drivable-lane": 3.099999999999902, "deviation-heading": 9.104325322582234, "distance-from-start": 2.645340381315678, "deviation-center-line": 4.094985063841091, "driven_lanedir_consec": 2.8149940810866236}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5603640Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-testingsim-0of4successnogpu-staging-spot-0-040:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.949999999999186
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median2.780669378492081
deviation-center-line_median5.9832374225219125


other stats
deviation-center-line_max5.9832374225219125
deviation-center-line_mean5.9832374225219125
deviation-center-line_min5.9832374225219125
deviation-heading_max5.351741767067895
deviation-heading_mean5.351741767067895
deviation-heading_median5.351741767067895
deviation-heading_min5.351741767067895
distance-from-start_max1.6305272648718805
distance-from-start_mean1.6305272648718805
distance-from-start_median1.6305272648718805
distance-from-start_min1.6305272648718805
driven_any_max2.951091089513758
driven_any_mean2.951091089513758
driven_any_median2.951091089513758
driven_any_min2.951091089513758
driven_lanedir_consec_max2.780669378492081
driven_lanedir_consec_mean2.780669378492081
driven_lanedir_consec_min2.780669378492081
driven_lanedir_max2.780669378492081
driven_lanedir_mean2.780669378492081
driven_lanedir_median2.780669378492081
driven_lanedir_min2.780669378492081
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.951091089513758, "survival_time": 51.949999999999186, "driven_lanedir": 2.780669378492081, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067895, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.9832374225219125, "driven_lanedir_consec": 2.780669378492081}}
simulation-passed1
survival_time_max51.949999999999186
survival_time_mean51.949999999999186
survival_time_min51.949999999999186
No reset possible
5595641Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-0of4successnogpu-staging-spot-0-040:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.091626784820886
deviation-center-line_median5.917240573756968


other stats
deviation-center-line_max5.917240573756968
deviation-center-line_mean5.917240573756968
deviation-center-line_min5.917240573756968
deviation-heading_max8.389433025698892
deviation-heading_mean8.389433025698892
deviation-heading_median8.389433025698892
deviation-heading_min8.389433025698892
distance-from-start_max1.0307831250305386
distance-from-start_mean1.0307831250305386
distance-from-start_median1.0307831250305386
distance-from-start_min1.0307831250305386
driven_any_max3.4490819837243656
driven_any_mean3.4490819837243656
driven_any_median3.4490819837243656
driven_any_min3.4490819837243656
driven_lanedir_consec_max2.091626784820886
driven_lanedir_consec_mean2.091626784820886
driven_lanedir_consec_min2.091626784820886
driven_lanedir_max3.203992280226659
driven_lanedir_mean3.203992280226659
driven_lanedir_median3.203992280226659
driven_lanedir_min3.203992280226659
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4490819837243656, "survival_time": 59.99999999999873, "driven_lanedir": 3.203992280226659, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389433025698892, "distance-from-start": 1.0307831250305386, "deviation-center-line": 5.917240573756968, "driven_lanedir_consec": 2.091626784820886}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5580676Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-0of4successnogpu-staging-spot-0-040:09:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7226359618167388
deviation-center-line_median0.5300716056782957


other stats
deviation-center-line_max3.450684914636027
deviation-center-line_mean1.1544116353398692
deviation-center-line_min0.10681841536685864
deviation-heading_max26.9052448670844
deviation-heading_mean13.564778629547629
deviation-heading_median13.197767646759738
deviation-heading_min0.958334357586633
distance-from-start_max2.6184795314376466
distance-from-start_mean1.0433272824408664
distance-from-start_median0.7774147991629091
distance-from-start_min4.440892098500626e-16
driven_any_max4.40268670413701
driven_any_mean1.962564046936972
driven_any_median1.7237847418051728
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max4.396263615957334
driven_lanedir_consec_mean1.9603838848977029
driven_lanedir_consec_min0.0
driven_lanedir_max4.396272526695297
driven_lanedir_mean1.960407277995468
driven_lanedir_median1.722678292643288
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 3.4475694836097963, "survival_time": 59.99999999999873, "driven_lanedir": 3.445356585286576, "in-drivable-lane": 0.0, "deviation-heading": 0.958334357586633, "distance-from-start": 1.5548295983258178, "deviation-center-line": 0.10681841536685864, "driven_lanedir_consec": 3.4452719236334777}, "udem-001-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.9270500462381008, "driven_lanedir_consec": 0.0}, "udem-001-ego2": {"driven_any": 4.40268670413701, "survival_time": 59.99999999999873, "driven_lanedir": 4.396272526695297, "in-drivable-lane": 0.0, "deviation-heading": 1.4677754959606737, "distance-from-start": 2.6184795314376466, "deviation-center-line": 0.13309316511849048, "driven_lanedir_consec": 4.396263615957334}, "udem-001-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 3.450684914636027, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5570678Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation276successyesgpu-staging-spot-0-040:08:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.3002634346487274
deviation-center-line_median0.7196587394263382


other stats
deviation-center-line_max2.946747690455274
deviation-center-line_mean1.1476127366277404
deviation-center-line_min0.20438577720301088
deviation-heading_max14.481564596168331
deviation-heading_mean7.741984297971248
deviation-heading_median7.028384188277798
deviation-heading_min2.429604219161062
distance-from-start_max3.2396193091764305
distance-from-start_mean1.334325698944544
distance-from-start_median1.0488417433008723
distance-from-start_min4.47545209131181e-16
driven_any_max5.606562725658094
driven_any_mean2.053995095327341
driven_any_median1.3047088278253671
driven_any_min5.370542509574138e-13
driven_lanedir_consec_max5.594025281629358
driven_lanedir_consec_mean2.048638037731703
driven_lanedir_consec_min0.0
driven_lanedir_max5.594025281629358
driven_lanedir_mean2.048638037731703
driven_lanedir_median1.3002634346487274
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.9556664137081567, "survival_time": 59.99999999999873, "driven_lanedir": 1.9489815249615767, "in-drivable-lane": 0.0, "deviation-heading": 4.451378386780232, "distance-from-start": 1.471444190689407, "deviation-center-line": 0.20438577720301088, "driven_lanedir_consec": 1.9489815249615767}, "loop-000-ego1": {"driven_any": 5.606562725658094, "survival_time": 59.99999999999873, "driven_lanedir": 5.594025281629358, "in-drivable-lane": 0.0, "deviation-heading": 2.429604219161062, "distance-from-start": 3.2396193091764305, "deviation-center-line": 0.3255000542191074, "driven_lanedir_consec": 5.594025281629358}, "loop-000-ego2": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 2.946747690455274, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.6537512419425775, "survival_time": 59.99999999999873, "driven_lanedir": 0.6515453443358781, "in-drivable-lane": 0.0, "deviation-heading": 9.605389989775365, "distance-from-start": 0.6262392959123381, "deviation-center-line": 1.113817424633569, "driven_lanedir_consec": 0.6515453443358781}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5567679Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successnogpu-staging-spot-0-040:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.793469797561154
deviation-center-line_median0.08003747569423085


other stats
deviation-center-line_max0.08003747569423085
deviation-center-line_mean0.08003747569423085
deviation-center-line_min0.08003747569423085
deviation-heading_max0.913163834671925
deviation-heading_mean0.913163834671925
deviation-heading_median0.913163834671925
deviation-heading_min0.913163834671925
distance-from-start_max0.6744700135939992
distance-from-start_mean0.6744700135939992
distance-from-start_median0.6744700135939992
distance-from-start_min0.6744700135939992
driven_any_max0.8000331626182206
driven_any_mean0.8000331626182206
driven_any_median0.8000331626182206
driven_any_min0.8000331626182206
driven_lanedir_consec_max0.793469797561154
driven_lanedir_consec_mean0.793469797561154
driven_lanedir_consec_min0.793469797561154
driven_lanedir_max0.793469797561154
driven_lanedir_mean0.793469797561154
driven_lanedir_median0.793469797561154
driven_lanedir_min0.793469797561154
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8000331626182206, "survival_time": 8.999999999999993, "driven_lanedir": 0.793469797561154, "in-drivable-lane": 0.0, "deviation-heading": 0.913163834671925, "distance-from-start": 0.6744700135939992, "deviation-center-line": 0.08003747569423085, "driven_lanedir_consec": 0.793469797561154}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
5560681Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-0of4successnogpu-staging-spot-0-040:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.8581320544290545
deviation-center-line_median0.4209794622238876


other stats
deviation-center-line_max0.4209794622238876
deviation-center-line_mean0.4209794622238876
deviation-center-line_min0.4209794622238876
deviation-heading_max3.015813483230351
deviation-heading_mean3.015813483230351
deviation-heading_median3.015813483230351
deviation-heading_min3.015813483230351
distance-from-start_max2.4941894584954443
distance-from-start_mean2.4941894584954443
distance-from-start_median2.4941894584954443
distance-from-start_min2.4941894584954443
driven_any_max5.878911569774922
driven_any_mean5.878911569774922
driven_any_median5.878911569774922
driven_any_min5.878911569774922
driven_lanedir_consec_max5.8581320544290545
driven_lanedir_consec_mean5.8581320544290545
driven_lanedir_consec_min5.8581320544290545
driven_lanedir_max5.8581320544290545
driven_lanedir_mean5.8581320544290545
driven_lanedir_median5.8581320544290545
driven_lanedir_min5.8581320544290545
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.878911569774922, "survival_time": 59.99999999999873, "driven_lanedir": 5.8581320544290545, "in-drivable-lane": 0.0, "deviation-heading": 3.015813483230351, "distance-from-start": 2.4941894584954443, "deviation-center-line": 0.4209794622238876, "driven_lanedir_consec": 5.8581320544290545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5558681Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5548658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-3of4successnogpu-staging-spot-0-040:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.239639467333716
survival_time_median59.39999999999876
deviation-center-line_median2.9301181558415053
in-drivable-lane_median28.549999999999336


other stats
deviation-center-line_max2.9301181558415053
deviation-center-line_mean2.9301181558415053
deviation-center-line_min2.9301181558415053
deviation-heading_max17.653347662542327
deviation-heading_mean17.653347662542327
deviation-heading_median17.653347662542327
deviation-heading_min17.653347662542327
distance-from-start_max0.4636292462543851
distance-from-start_mean0.4636292462543851
distance-from-start_median0.4636292462543851
distance-from-start_min0.4636292462543851
driven_any_max10.616534436717636
driven_any_mean10.616534436717636
driven_any_median10.616534436717636
driven_any_min10.616534436717636
driven_lanedir_consec_max4.239639467333716
driven_lanedir_consec_mean4.239639467333716
driven_lanedir_consec_min4.239639467333716
driven_lanedir_max4.239639467333716
driven_lanedir_mean4.239639467333716
driven_lanedir_median4.239639467333716
driven_lanedir_min4.239639467333716
in-drivable-lane_max28.549999999999336
in-drivable-lane_mean28.549999999999336
in-drivable-lane_min28.549999999999336
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.616534436717636, "survival_time": 59.39999999999876, "driven_lanedir": 4.239639467333716, "in-drivable-lane": 28.549999999999336, "deviation-heading": 17.653347662542327, "distance-from-start": 0.4636292462543851, "deviation-center-line": 2.9301181558415053, "driven_lanedir_consec": 4.239639467333716}}
simulation-passed1
survival_time_max59.39999999999876
survival_time_mean59.39999999999876
survival_time_min59.39999999999876
No reset possible
5538672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednogpu-staging-spot-0-040:04:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5529683Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-1of4successnogpu-staging-spot-0-040:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.619340458553207
deviation-center-line_median0.29362362810082904


other stats
deviation-center-line_max0.29362362810082904
deviation-center-line_mean0.29362362810082904
deviation-center-line_min0.29362362810082904
deviation-heading_max2.404267084079743
deviation-heading_mean2.404267084079743
deviation-heading_median2.404267084079743
deviation-heading_min2.404267084079743
distance-from-start_max2.3421142281734313
distance-from-start_mean2.3421142281734313
distance-from-start_median2.3421142281734313
distance-from-start_min2.3421142281734313
driven_any_max4.634748572927819
driven_any_mean4.634748572927819
driven_any_median4.634748572927819
driven_any_min4.634748572927819
driven_lanedir_consec_max4.619340458553207
driven_lanedir_consec_mean4.619340458553207
driven_lanedir_consec_min4.619340458553207
driven_lanedir_max4.6193404722652875
driven_lanedir_mean4.6193404722652875
driven_lanedir_median4.6193404722652875
driven_lanedir_min4.6193404722652875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 4.634748572927819, "survival_time": 59.99999999999873, "driven_lanedir": 4.6193404722652875, "in-drivable-lane": 0.0, "deviation-heading": 2.404267084079743, "distance-from-start": 2.3421142281734313, "deviation-center-line": 0.29362362810082904, "driven_lanedir_consec": 4.619340458553207}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5524685Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-validationsim-3of4successnogpu-staging-spot-0-040:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.35000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median1.116943263707006
deviation-center-line_median0.11371523984155717


other stats
deviation-center-line_max0.11371523984155717
deviation-center-line_mean0.11371523984155717
deviation-center-line_min0.11371523984155717
deviation-heading_max1.1964666868192868
deviation-heading_mean1.1964666868192868
deviation-heading_median1.1964666868192868
deviation-heading_min1.1964666868192868
distance-from-start_max0.9553119406629068
distance-from-start_mean0.9553119406629068
distance-from-start_median0.9553119406629068
distance-from-start_min0.9553119406629068
driven_any_max1.1261312214304977
driven_any_mean1.1261312214304977
driven_any_median1.1261312214304977
driven_any_min1.1261312214304977
driven_lanedir_consec_max1.116943263707006
driven_lanedir_consec_mean1.116943263707006
driven_lanedir_consec_min1.116943263707006
driven_lanedir_max1.116943263707006
driven_lanedir_mean1.116943263707006
driven_lanedir_median1.116943263707006
driven_lanedir_min1.116943263707006
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1261312214304977, "survival_time": 12.35000000000004, "driven_lanedir": 1.116943263707006, "in-drivable-lane": 0.0, "deviation-heading": 1.1964666868192868, "distance-from-start": 0.9553119406629068, "deviation-center-line": 0.11371523984155717, "driven_lanedir_consec": 1.116943263707006}}
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean12.35000000000004
survival_time_min12.35000000000004
No reset possible
5515687Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-3of4successnogpu-staging-spot-0-040:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.29999999999939
in-drivable-lane_median0.0
driven_lanedir_consec_median4.5085282514804845
deviation-center-line_median0.28904483256154256


other stats
deviation-center-line_max0.28904483256154256
deviation-center-line_mean0.28904483256154256
deviation-center-line_min0.28904483256154256
deviation-heading_max2.685722516035787
deviation-heading_mean2.685722516035787
deviation-heading_median2.685722516035787
deviation-heading_min2.685722516035787
distance-from-start_max2.3176766365568287
distance-from-start_mean2.3176766365568287
distance-from-start_median2.3176766365568287
distance-from-start_min2.3176766365568287
driven_any_max4.5251448892157695
driven_any_mean4.5251448892157695
driven_any_median4.5251448892157695
driven_any_min4.5251448892157695
driven_lanedir_consec_max4.5085282514804845
driven_lanedir_consec_mean4.5085282514804845
driven_lanedir_consec_min4.5085282514804845
driven_lanedir_max4.5085282514804845
driven_lanedir_mean4.5085282514804845
driven_lanedir_median4.5085282514804845
driven_lanedir_min4.5085282514804845
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.5251448892157695, "survival_time": 48.29999999999939, "driven_lanedir": 4.5085282514804845, "in-drivable-lane": 0.0, "deviation-heading": 2.685722516035787, "distance-from-start": 2.3176766365568287, "deviation-center-line": 0.28904483256154256, "driven_lanedir_consec": 4.5085282514804845}}
simulation-passed1
survival_time_max48.29999999999939
survival_time_mean48.29999999999939
survival_time_min48.29999999999939
No reset possible
5503719Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnogpu-staging-spot-0-040:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median2.7045955609117347
deviation-center-line_median5.298353292175556


other stats
deviation-center-line_max6.7415423051179255
deviation-center-line_mean5.28094688646254
deviation-center-line_min3.785538656381124
deviation-heading_max13.312014280207482
deviation-heading_mean6.591214978958582
deviation-heading_median4.957876569877463
deviation-heading_min3.137092495871918
distance-from-start_max2.2873183363783496
distance-from-start_mean1.7377713014167755
distance-from-start_median1.9053628015189592
distance-from-start_min0.8530412662508342
driven_any_max3.579587180103618
driven_any_mean2.867838687646443
driven_any_median2.919589855341645
driven_any_min2.052587859798864
driven_lanedir_consec_max3.384490798043468
driven_lanedir_consec_mean2.391979057772581
driven_lanedir_consec_min0.7742343112233858
driven_lanedir_max3.5625563105123215
driven_lanedir_mean2.790015327019447
driven_lanedir_median2.838407939721475
driven_lanedir_min1.9206891181225152
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean1.1249999999999716
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.259597875697513, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590471343353, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280207482, "distance-from-start": 1.740927094321447, "deviation-center-line": 6.213697824668821, "driven_lanedir_consec": 2.0736045752466756}, "4way-000-ego1": {"driven_any": 3.5795818349857766, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625563105123215, "in-drivable-lane": 0.0, "deviation-heading": 3.137092495871918, "distance-from-start": 2.069798508716472, "deviation-center-line": 3.785538656381124, "driven_lanedir_consec": 3.3355865465767938}, "4way-000-ego2": {"driven_any": 3.579587180103618, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589568323086147, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646358412, "distance-from-start": 2.2873183363783496, "deviation-center-line": 4.3830087596822915, "driven_lanedir_consec": 3.384490798043468}, "4way-000-ego3": {"driven_any": 2.052587859798864, "survival_time": 59.99999999999873, "driven_lanedir": 1.9206891181225152, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545204933965145, "distance-from-start": 0.8530412662508342, "deviation-center-line": 6.7415423051179255, "driven_lanedir_consec": 0.7742343112233858}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5497720Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-validationsim-1of4successnogpu-staging-spot-0-040:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.449999999999985
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4398565700031045
deviation-center-line_median0.2725613901951368


other stats
deviation-center-line_max0.2725613901951368
deviation-center-line_mean0.2725613901951368
deviation-center-line_min0.2725613901951368
deviation-heading_max0.7151184294493084
deviation-heading_mean0.7151184294493084
deviation-heading_median0.7151184294493084
deviation-heading_min0.7151184294493084
distance-from-start_max0.44094173644960993
distance-from-start_mean0.44094173644960993
distance-from-start_median0.44094173644960993
distance-from-start_min0.44094173644960993
driven_any_max0.4445992768886744
driven_any_mean0.4445992768886744
driven_any_median0.4445992768886744
driven_any_min0.4445992768886744
driven_lanedir_consec_max0.4398565700031045
driven_lanedir_consec_mean0.4398565700031045
driven_lanedir_consec_min0.4398565700031045
driven_lanedir_max0.4398565700031045
driven_lanedir_mean0.4398565700031045
driven_lanedir_median0.4398565700031045
driven_lanedir_min0.4398565700031045
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4445992768886744, "survival_time": 8.449999999999985, "driven_lanedir": 0.4398565700031045, "in-drivable-lane": 0.0, "deviation-heading": 0.7151184294493084, "distance-from-start": 0.44094173644960993, "deviation-center-line": 0.2725613901951368, "driven_lanedir_consec": 0.4398565700031045}}
simulation-passed1
survival_time_max8.449999999999985
survival_time_mean8.449999999999985
survival_time_min8.449999999999985
No reset possible
5488722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-3of4successnogpu-staging-spot-0-040:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median58.999999999998785
in-drivable-lane_median5.099999999999877
driven_lanedir_consec_median2.8920792929900845
deviation-center-line_median5.6806740116942835


other stats
deviation-center-line_max5.6806740116942835
deviation-center-line_mean5.6806740116942835
deviation-center-line_min5.6806740116942835
deviation-heading_max11.30344108488696
deviation-heading_mean11.30344108488696
deviation-heading_median11.30344108488696
deviation-heading_min11.30344108488696
distance-from-start_max2.5229792435928395
distance-from-start_mean2.5229792435928395
distance-from-start_median2.5229792435928395
distance-from-start_min2.5229792435928395
driven_any_max3.3245754522163784
driven_any_mean3.3245754522163784
driven_any_median3.3245754522163784
driven_any_min3.3245754522163784
driven_lanedir_consec_max2.8920792929900845
driven_lanedir_consec_mean2.8920792929900845
driven_lanedir_consec_min2.8920792929900845
driven_lanedir_max2.9981420562404173
driven_lanedir_mean2.9981420562404173
driven_lanedir_median2.9981420562404173
driven_lanedir_min2.9981420562404173
in-drivable-lane_max5.099999999999877
in-drivable-lane_mean5.099999999999877
in-drivable-lane_min5.099999999999877
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3245754522163784, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420562404173, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.30344108488696, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.6806740116942835, "driven_lanedir_consec": 2.8920792929900845}}
simulation-passed1
survival_time_max58.999999999998785
survival_time_mean58.999999999998785
survival_time_min58.999999999998785
No reset possible
5482724Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-1of4successnogpu-staging-spot-0-040:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1500000000000163
driven_lanedir_consec_median3.1664224879101597
deviation-center-line_median4.250268254472467


other stats
deviation-center-line_max4.250268254472467
deviation-center-line_mean4.250268254472467
deviation-center-line_min4.250268254472467
deviation-heading_max6.786712714590221
deviation-heading_mean6.786712714590221
deviation-heading_median6.786712714590221
deviation-heading_min6.786712714590221
distance-from-start_max2.581801799408845
distance-from-start_mean2.581801799408845
distance-from-start_median2.581801799408845
distance-from-start_min2.581801799408845
driven_any_max3.5450774401287584
driven_any_mean3.5450774401287584
driven_any_median3.5450774401287584
driven_any_min3.5450774401287584
driven_lanedir_consec_max3.1664224879101597
driven_lanedir_consec_mean3.1664224879101597
driven_lanedir_consec_min3.1664224879101597
driven_lanedir_max3.428172822833071
driven_lanedir_mean3.428172822833071
driven_lanedir_median3.428172822833071
driven_lanedir_min3.428172822833071
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean1.1500000000000163
in-drivable-lane_min1.1500000000000163
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5450774401287584, "survival_time": 59.99999999999873, "driven_lanedir": 3.428172822833071, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 6.786712714590221, "distance-from-start": 2.581801799408845, "deviation-center-line": 4.250268254472467, "driven_lanedir_consec": 3.1664224879101597}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5474726Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-0of4successnogpu-staging-spot-0-040:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.999999999999865
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median2.2478265130959194
deviation-center-line_median5.152132780323252


other stats
deviation-center-line_max5.152132780323252
deviation-center-line_mean5.152132780323252
deviation-center-line_min5.152132780323252
deviation-heading_max2.495559265059334
deviation-heading_mean2.495559265059334
deviation-heading_median2.495559265059334
deviation-heading_min2.495559265059334
distance-from-start_max1.7870695980437394
distance-from-start_mean1.7870695980437394
distance-from-start_median1.7870695980437394
distance-from-start_min1.7870695980437394
driven_any_max2.3045969519229774
driven_any_mean2.3045969519229774
driven_any_median2.3045969519229774
driven_any_min2.3045969519229774
driven_lanedir_consec_max2.2478265130959194
driven_lanedir_consec_mean2.2478265130959194
driven_lanedir_consec_min2.2478265130959194
driven_lanedir_max2.2478265130959194
driven_lanedir_mean2.2478265130959194
driven_lanedir_median2.2478265130959194
driven_lanedir_min2.2478265130959194
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"udem-001-ego0": {"driven_any": 2.3045969519229774, "survival_time": 39.999999999999865, "driven_lanedir": 2.2478265130959194, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.495559265059334, "distance-from-start": 1.7870695980437394, "deviation-center-line": 5.152132780323252, "driven_lanedir_consec": 2.2478265130959194}}
simulation-passed1
survival_time_max39.999999999999865
survival_time_mean39.999999999999865
survival_time_min39.999999999999865
No reset possible
5462728Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-1of4successnogpu-staging-spot-0-040:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.4856553091076994
deviation-center-line_median7.514935466498128


other stats
deviation-center-line_max7.514935466498128
deviation-center-line_mean7.514935466498128
deviation-center-line_min7.514935466498128
deviation-heading_max2.919831926025915
deviation-heading_mean2.919831926025915
deviation-heading_median2.919831926025915
deviation-heading_min2.919831926025915
distance-from-start_max2.8766441843618256
distance-from-start_mean2.8766441843618256
distance-from-start_median2.8766441843618256
distance-from-start_min2.8766441843618256
driven_any_max3.5465963271067142
driven_any_mean3.5465963271067142
driven_any_median3.5465963271067142
driven_any_min3.5465963271067142
driven_lanedir_consec_max3.4856553091076994
driven_lanedir_consec_mean3.4856553091076994
driven_lanedir_consec_min3.4856553091076994
driven_lanedir_max3.4856553091076994
driven_lanedir_mean3.4856553091076994
driven_lanedir_median3.4856553091076994
driven_lanedir_min3.4856553091076994
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5465963271067142, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553091076994, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831926025915, "distance-from-start": 2.8766441843618256, "deviation-center-line": 7.514935466498128, "driven_lanedir_consec": 3.4856553091076994}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5453689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-040:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.699999999999989
in-drivable-lane_median5.124999999999994
driven_lanedir_consec_median0.3534980472911704
deviation-center-line_median0.31473998602704023


other stats
deviation-center-line_max1.1167880744707592
deviation-center-line_mean0.4679858397779584
deviation-center-line_min0.1256753125869936
deviation-heading_max2.483401077481458
deviation-heading_mean1.59686418028581
deviation-heading_median1.5781230863572229
deviation-heading_min0.7478094709473372
distance-from-start_max1.2661028531770575
distance-from-start_mean0.9500582944506836
distance-from-start_median1.0055183306038733
distance-from-start_min0.5230936634179303
driven_any_max1.2661876874339428
driven_any_mean0.9501035001353118
driven_any_median1.0055609346511667
driven_any_min0.5231044438049705
driven_lanedir_consec_max0.7375228777305465
driven_lanedir_consec_mean0.4010538260367736
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.7375228777305465
driven_lanedir_mean0.4010538260367736
driven_lanedir_median0.3534980472911704
driven_lanedir_min0.15969633183420706
in-drivable-lane_max7.2499999999999885
in-drivable-lane_mean4.374999999999994
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.9347451682894408, "survival_time": 8.699999999999989, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 6.949999999999988, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.9347143740566112, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955005044754337}, "loop-000-ego1": {"driven_any": 1.2661876874339428, "survival_time": 8.699999999999989, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 7.2499999999999885, "deviation-heading": 0.7478094709473372, "distance-from-start": 1.2661028531770575, "deviation-center-line": 0.1356249107782691, "driven_lanedir_consec": 0.15969633183420706}, "loop-000-ego2": {"driven_any": 0.5231044438049705, "survival_time": 8.699999999999989, "driven_lanedir": 0.5074460441347974, "in-drivable-lane": 0.0, "deviation-heading": 2.483401077481458, "distance-from-start": 0.5230936634179303, "deviation-center-line": 1.1167880744707592, "driven_lanedir_consec": 0.5074460441347974}, "loop-000-ego3": {"driven_any": 1.0763767010128928, "survival_time": 8.699999999999989, "driven_lanedir": 0.7375228777305465, "in-drivable-lane": 3.3, "deviation-heading": 2.207424217156399, "distance-from-start": 1.0763222871511355, "deviation-center-line": 0.4938550612758114, "driven_lanedir_consec": 0.7375228777305465}}
simulation-passed1
survival_time_max8.699999999999989
survival_time_mean8.699999999999989
survival_time_min8.699999999999989
No reset possible
5443691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-040:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.1999999999999895
in-drivable-lane_median3.4499999999999886
driven_lanedir_consec_median0.19955005044754337
deviation-center-line_median0.12567516126913286


other stats
deviation-center-line_max0.12567516126913286
deviation-center-line_mean0.12567516126913286
deviation-center-line_min0.12567516126913286
deviation-heading_max0.9488219555580458
deviation-heading_mean0.9488219555580458
deviation-heading_median0.9488219555580458
deviation-heading_min0.9488219555580458
distance-from-start_max0.689742337316815
distance-from-start_mean0.689742337316815
distance-from-start_median0.689742337316815
distance-from-start_min0.689742337316815
driven_any_max0.6897540728183593
driven_any_mean0.6897540728183593
driven_any_median0.6897540728183593
driven_any_min0.6897540728183593
driven_lanedir_consec_max0.19955005044754337
driven_lanedir_consec_mean0.19955005044754337
driven_lanedir_consec_min0.19955005044754337
driven_lanedir_max0.19955005044754337
driven_lanedir_mean0.19955005044754337
driven_lanedir_median0.19955005044754337
driven_lanedir_min0.19955005044754337
in-drivable-lane_max3.4499999999999886
in-drivable-lane_mean3.4499999999999886
in-drivable-lane_min3.4499999999999886
per-episodes
details{"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean5.1999999999999895
survival_time_min5.1999999999999895
No reset possible
5436693Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-040:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2999999999999963
in-drivable-lane_median1.5499999999999954
driven_lanedir_consec_median0.1995526730519679
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.3731007861754622
distance-from-start_mean0.3731007861754622
distance-from-start_median0.3731007861754622
distance-from-start_min0.3731007861754622
driven_any_max0.3731074338181184
driven_any_mean0.3731074338181184
driven_any_median0.3731074338181184
driven_any_min0.3731074338181184
driven_lanedir_consec_max0.1995526730519679
driven_lanedir_consec_mean0.1995526730519679
driven_lanedir_consec_min0.1995526730519679
driven_lanedir_max0.1995526730519679
driven_lanedir_mean0.1995526730519679
driven_lanedir_median0.1995526730519679
driven_lanedir_min0.1995526730519679
in-drivable-lane_max1.5499999999999954
in-drivable-lane_mean1.5499999999999954
in-drivable-lane_min1.5499999999999954
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3731074338181184, "survival_time": 3.2999999999999963, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 1.5499999999999954, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.3731007861754622, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.1995526730519679}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
5431694Bea Baselines 🐤minimal-agentaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31872588830254256
survival_time_median12.40000000000004
deviation-center-line_median0.2634614200814006
in-drivable-lane_median9.150000000000045


other stats
deviation-center-line_max0.2634614200814006
deviation-center-line_mean0.2634614200814006
deviation-center-line_min0.2634614200814006
deviation-heading_max2.539741615834614
deviation-heading_mean2.539741615834614
deviation-heading_median2.539741615834614
deviation-heading_min2.539741615834614
distance-from-start_max1.8751243016635992
distance-from-start_mean1.8751243016635992
distance-from-start_median1.8751243016635992
distance-from-start_min1.8751243016635992
driven_any_max1.8759780200120315
driven_any_mean1.8759780200120315
driven_any_median1.8759780200120315
driven_any_min1.8759780200120315
driven_lanedir_consec_max0.31872588830254256
driven_lanedir_consec_mean0.31872588830254256
driven_lanedir_consec_min0.31872588830254256
driven_lanedir_max0.31872588830254256
driven_lanedir_mean0.31872588830254256
driven_lanedir_median0.31872588830254256
driven_lanedir_min0.31872588830254256
in-drivable-lane_max9.150000000000045
in-drivable-lane_mean9.150000000000045
in-drivable-lane_min9.150000000000045
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.8759780200120315, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872588830254256, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635992, "deviation-center-line": 0.2634614200814006, "driven_lanedir_consec": 0.31872588830254256}}
simulation-passed1
survival_time_max12.40000000000004
survival_time_mean12.40000000000004
survival_time_min12.40000000000004
No reset possible
5397643Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-2of4successnogpu-staging-spot-0-040:12:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.9999999999999576
driven_lanedir_consec_median2.9816913027353795
deviation-center-line_median5.999212563454321


other stats
deviation-center-line_max6.279828591515402
deviation-center-line_mean5.898869522988079
deviation-center-line_min5.317224373528271
deviation-heading_max6.908636787901559
deviation-heading_mean5.00526214896848
deviation-heading_median5.3059869154988375
deviation-heading_min2.5004379769746863
distance-from-start_max2.7163807174982693
distance-from-start_mean1.9474863406043583
distance-from-start_median2.133877457590029
distance-from-start_min0.8058097297391079
driven_any_max3.579596890608956
driven_any_mean3.1367153053144774
driven_any_median3.497838330840156
driven_any_min1.971587668968642
driven_lanedir_consec_max3.554363389555085
driven_lanedir_consec_mean2.5612811119723276
driven_lanedir_consec_min0.7273784528634657
driven_lanedir_max3.554363389555085
driven_lanedir_mean3.017264448780624
driven_lanedir_median3.337488631463687
driven_lanedir_min1.839717142640037
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean1.8624999999999492
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.971587668968642, "survival_time": 59.99999999999873, "driven_lanedir": 1.839717142640037, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.390348197280299, "distance-from-start": 0.8058097297391079, "deviation-center-line": 5.7223527739429985, "driven_lanedir_consec": 0.7273784528634657}, "loop-000-ego1": {"driven_any": 3.579596890608956, "survival_time": 59.99999999999873, "driven_lanedir": 3.554363389555085, "in-drivable-lane": 0.0, "deviation-heading": 2.5004379769746863, "distance-from-start": 2.7163807174982693, "deviation-center-line": 6.279828591515402, "driven_lanedir_consec": 3.554363389555085}, "loop-000-ego2": {"driven_any": 3.4760913988195017, "survival_time": 59.99999999999873, "driven_lanedir": 3.307439986272721, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.221625633717376, "distance-from-start": 2.1876553732781443, "deviation-center-line": 6.2760723529656435, "driven_lanedir_consec": 3.307439986272721}, "loop-000-ego3": {"driven_any": 3.51958526286081, "survival_time": 59.99999999999873, "driven_lanedir": 3.3675372766546534, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.908636787901559, "distance-from-start": 2.080099541901913, "deviation-center-line": 5.317224373528271, "driven_lanedir_consec": 2.6559426191980378}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5390645Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-3of4successnogpu-staging-spot-0-040:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.149999999999878
driven_lanedir_consec_median3.364933059128671
deviation-center-line_median5.251516924575099


other stats
deviation-center-line_max5.251516924575099
deviation-center-line_mean5.251516924575099
deviation-center-line_min5.251516924575099
deviation-heading_max8.784883477445916
deviation-heading_mean8.784883477445916
deviation-heading_median8.784883477445916
deviation-heading_min8.784883477445916
distance-from-start_max2.151743265759588
distance-from-start_mean2.151743265759588
distance-from-start_median2.151743265759588
distance-from-start_min2.151743265759588
driven_any_max3.5150892362964212
driven_any_mean3.5150892362964212
driven_any_median3.5150892362964212
driven_any_min3.5150892362964212
driven_lanedir_consec_max3.364933059128671
driven_lanedir_consec_mean3.364933059128671
driven_lanedir_consec_min3.364933059128671
driven_lanedir_max3.364933059128671
driven_lanedir_mean3.364933059128671
driven_lanedir_median3.364933059128671
driven_lanedir_min3.364933059128671
in-drivable-lane_max2.149999999999878
in-drivable-lane_mean2.149999999999878
in-drivable-lane_min2.149999999999878
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.5150892362964212, "survival_time": 59.99999999999873, "driven_lanedir": 3.364933059128671, "in-drivable-lane": 2.149999999999878, "deviation-heading": 8.784883477445916, "distance-from-start": 2.151743265759588, "deviation-center-line": 5.251516924575099, "driven_lanedir_consec": 3.364933059128671}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5385435Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failednogpu-staging-spot-0-040:00:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5382435Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-0of4failednogpu-staging-spot-0-040:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5373436Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-1of4failednogpu-staging-spot-0-040:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5368438Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-1of4failednogpu-staging-spot-0-040:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5359439Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednogpu-staging-spot-0-040:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5351440Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4host-errornogpu-staging-spot-0-040:02:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/08ab6413dde308e79a0eacbb888fcb66c80ee989f6322922313ed65dd56ed79d/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/08ab6413dde308e79a0eacbb888fcb66c80ee989f6322922313ed65dd56ed79d/json: Not Found ("No such container: 08ab6413dde308e79a0eacbb888fcb66c80ee989f6322922313ed65dd56ed79d")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5347496Bea Baselines 🐤minimal-agentaido-LFVI-sim-testingsim-1of4successnogpu-staging-spot-0-040:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.749999999999988
in-drivable-lane_median4.349999999999987
driven_lanedir_consec_median0.13666599700910398
deviation-center-line_median0.10783823581413764


other stats
deviation-center-line_max0.10783823581413764
deviation-center-line_mean0.10783823581413764
deviation-center-line_min0.10783823581413764
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.7799926905395436
distance-from-start_mean0.7799926905395436
distance-from-start_median0.7799926905395436
distance-from-start_min0.7799926905395436
driven_any_max0.7800067434780031
driven_any_mean0.7800067434780031
driven_any_median0.7800067434780031
driven_any_min0.7800067434780031
driven_lanedir_consec_max0.13666599700910398
driven_lanedir_consec_mean0.13666599700910398
driven_lanedir_consec_min0.13666599700910398
driven_lanedir_max0.13666599700910398
driven_lanedir_mean0.13666599700910398
driven_lanedir_median0.13666599700910398
driven_lanedir_min0.13666599700910398
in-drivable-lane_max4.349999999999987
in-drivable-lane_mean4.349999999999987
in-drivable-lane_min4.349999999999987
per-episodes
details{"4way-000-ego0": {"driven_any": 0.7800067434780031, "survival_time": 5.749999999999988, "driven_lanedir": 0.13666599700910398, "in-drivable-lane": 4.349999999999987, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.7799926905395436, "deviation-center-line": 0.10783823581413764, "driven_lanedir_consec": 0.13666599700910398}}
simulation-passed1
survival_time_max5.749999999999988
survival_time_mean5.749999999999988
survival_time_min5.749999999999988
No reset possible
5342499Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-040:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5341499Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5329469Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-2of4successnogpu-staging-spot-0-040:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1000000000000156
driven_lanedir_consec_median3.48568324399197
deviation-center-line_median7.514954227940093


other stats
deviation-center-line_max7.514954227940093
deviation-center-line_mean7.514954227940093
deviation-center-line_min7.514954227940093
deviation-heading_max2.9198322000428
deviation-heading_mean2.9198322000428
deviation-heading_median2.9198322000428
deviation-heading_min2.9198322000428
distance-from-start_max2.8766441683061994
distance-from-start_mean2.8766441683061994
distance-from-start_median2.8766441683061994
distance-from-start_min2.8766441683061994
driven_any_max3.5465963271061254
driven_any_mean3.5465963271061254
driven_any_median3.5465963271061254
driven_any_min3.5465963271061254
driven_lanedir_consec_max3.48568324399197
driven_lanedir_consec_mean3.48568324399197
driven_lanedir_consec_min3.48568324399197
driven_lanedir_max3.48568324399197
driven_lanedir_mean3.48568324399197
driven_lanedir_median3.48568324399197
driven_lanedir_min3.48568324399197
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean1.1000000000000156
in-drivable-lane_min1.1000000000000156
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5465963271061254, "survival_time": 59.99999999999873, "driven_lanedir": 3.48568324399197, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322000428, "distance-from-start": 2.8766441683061994, "deviation-center-line": 7.514954227940093, "driven_lanedir_consec": 3.48568324399197}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5323471Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-2of4successnogpu-staging-spot-0-040:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.561518623717271
deviation-center-line_median5.5310131887516265


other stats
deviation-center-line_max5.5310131887516265
deviation-center-line_mean5.5310131887516265
deviation-center-line_min5.5310131887516265
deviation-heading_max3.085417289396009
deviation-heading_mean3.085417289396009
deviation-heading_median3.085417289396009
deviation-heading_min3.085417289396009
distance-from-start_max2.7108290992307387
distance-from-start_mean2.7108290992307387
distance-from-start_median2.7108290992307387
distance-from-start_min2.7108290992307387
driven_any_max3.5795975772497832
driven_any_mean3.5795975772497832
driven_any_median3.5795975772497832
driven_any_min3.5795975772497832
driven_lanedir_consec_max3.561518623717271
driven_lanedir_consec_mean3.561518623717271
driven_lanedir_consec_min3.561518623717271
driven_lanedir_max3.561518623717271
driven_lanedir_mean3.561518623717271
driven_lanedir_median3.561518623717271
driven_lanedir_min3.561518623717271
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.5795975772497832, "survival_time": 59.99999999999873, "driven_lanedir": 3.561518623717271, "in-drivable-lane": 0.0, "deviation-heading": 3.085417289396009, "distance-from-start": 2.7108290992307387, "deviation-center-line": 5.5310131887516265, "driven_lanedir_consec": 3.561518623717271}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5313485Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-1of4successnogpu-staging-spot-0-040:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median22.20000000000018
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7931242458645529
deviation-center-line_median0.1961591864911841


other stats
deviation-center-line_max0.1961591864911841
deviation-center-line_mean0.1961591864911841
deviation-center-line_min0.1961591864911841
deviation-heading_max1.690974780395429
deviation-heading_mean1.690974780395429
deviation-heading_median1.690974780395429
deviation-heading_min1.690974780395429
distance-from-start_max1.4244240674089024
distance-from-start_mean1.4244240674089024
distance-from-start_median1.4244240674089024
distance-from-start_min1.4244240674089024
driven_any_max1.805900837286754
driven_any_mean1.805900837286754
driven_any_median1.805900837286754
driven_any_min1.805900837286754
driven_lanedir_consec_max1.7931242458645529
driven_lanedir_consec_mean1.7931242458645529
driven_lanedir_consec_min1.7931242458645529
driven_lanedir_max1.7931242458645529
driven_lanedir_mean1.7931242458645529
driven_lanedir_median1.7931242458645529
driven_lanedir_min1.7931242458645529
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.805900837286754, "survival_time": 22.20000000000018, "driven_lanedir": 1.7931242458645529, "in-drivable-lane": 0.0, "deviation-heading": 1.690974780395429, "distance-from-start": 1.4244240674089024, "deviation-center-line": 0.1961591864911841, "driven_lanedir_consec": 1.7931242458645529}}
simulation-passed1
survival_time_max22.20000000000018
survival_time_mean22.20000000000018
survival_time_min22.20000000000018
No reset possible
5305472Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-2of4successnogpu-staging-spot-0-040:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.833625978773518
deviation-center-line_median0.2109719022502864


other stats
deviation-center-line_max0.2109719022502864
deviation-center-line_mean0.2109719022502864
deviation-center-line_min0.2109719022502864
deviation-heading_max1.8837432004186612
deviation-heading_mean1.8837432004186612
deviation-heading_median1.8837432004186612
deviation-heading_min1.8837432004186612
distance-from-start_max2.0412677228822265
distance-from-start_mean2.0412677228822265
distance-from-start_median2.0412677228822265
distance-from-start_min2.0412677228822265
driven_any_max5.844418063649684
driven_any_mean5.844418063649684
driven_any_median5.844418063649684
driven_any_min5.844418063649684
driven_lanedir_consec_max5.833625978773518
driven_lanedir_consec_mean5.833625978773518
driven_lanedir_consec_min5.833625978773518
driven_lanedir_max5.833625978773518
driven_lanedir_mean5.833625978773518
driven_lanedir_median5.833625978773518
driven_lanedir_min5.833625978773518
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.844418063649684, "survival_time": 59.99999999999873, "driven_lanedir": 5.833625978773518, "in-drivable-lane": 0.0, "deviation-heading": 1.8837432004186612, "distance-from-start": 2.0412677228822265, "deviation-center-line": 0.2109719022502864, "driven_lanedir_consec": 5.833625978773518}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5288481Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4successnogpu-staging-spot-0-040:09:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.336853929439388
deviation-center-line_median0.1833290916203121


other stats
deviation-center-line_max0.1833290916203121
deviation-center-line_mean0.1833290916203121
deviation-center-line_min0.1833290916203121
deviation-heading_max1.3122340748484589
deviation-heading_mean1.3122340748484589
deviation-heading_median1.3122340748484589
deviation-heading_min1.3122340748484589
distance-from-start_max3.367405434986393
distance-from-start_mean3.367405434986393
distance-from-start_median3.367405434986393
distance-from-start_min3.367405434986393
driven_any_max5.634085005948749
driven_any_mean5.634085005948749
driven_any_median5.634085005948749
driven_any_min5.634085005948749
driven_lanedir_consec_max5.336853929439388
driven_lanedir_consec_mean5.336853929439388
driven_lanedir_consec_min5.336853929439388
driven_lanedir_max5.629595525675495
driven_lanedir_mean5.629595525675495
driven_lanedir_median5.629595525675495
driven_lanedir_min5.629595525675495
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.634085005948749, "survival_time": 59.99999999999873, "driven_lanedir": 5.629595525675495, "in-drivable-lane": 0.0, "deviation-heading": 1.3122340748484589, "distance-from-start": 3.367405434986393, "deviation-center-line": 0.1833290916203121, "driven_lanedir_consec": 5.336853929439388}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5276493Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-040:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.650000000000116
in-drivable-lane_median11.725000000000108
driven_lanedir_consec_median0.2431458887564345
deviation-center-line_median0.492512294919456


other stats
deviation-center-line_max0.8126244209313231
deviation-center-line_mean0.5002146341831466
deviation-center-line_min0.2032095259623513
deviation-heading_max11.126245949311896
deviation-heading_mean4.236373829435642
deviation-heading_median2.6228060251373986
deviation-heading_min0.5736373181558746
distance-from-start_max2.7459838926308224
distance-from-start_mean1.675681764213373
distance-from-start_median1.978371582111335
distance-from-start_min2.482534153247273e-16
driven_any_max2.746678396584013
driven_any_mean1.6759923664295142
driven_any_median1.9786455345669784
driven_any_min8.763345560962911e-14
driven_lanedir_consec_max1.21073941861612
driven_lanedir_consec_mean0.4242577990322473
driven_lanedir_consec_min0.0
driven_lanedir_max1.21073941861612
driven_lanedir_mean0.4242577990322473
driven_lanedir_median0.2431458887564345
driven_lanedir_min0.0
in-drivable-lane_max15.800000000000114
in-drivable-lane_mean9.812500000000082
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.746678396584013, "survival_time": 17.650000000000116, "driven_lanedir": 0.248711779699744, "in-drivable-lane": 14.200000000000086, "deviation-heading": 3.18255248934304, "distance-from-start": 2.7459838926308224, "deviation-center-line": 0.33528240826838684, "driven_lanedir_consec": 0.248711779699744}, "loop-000-ego1": {"driven_any": 1.7252690192462308, "survival_time": 17.650000000000116, "driven_lanedir": 0.237579997813125, "in-drivable-lane": 15.800000000000114, "deviation-heading": 0.5736373181558746, "distance-from-start": 1.7251591376367583, "deviation-center-line": 0.2032095259623513, "driven_lanedir_consec": 0.237579997813125}, "loop-000-ego2": {"driven_any": 2.2320220498877257, "survival_time": 17.650000000000116, "driven_lanedir": 1.21073941861612, "in-drivable-lane": 9.250000000000131, "deviation-heading": 2.0630595609317575, "distance-from-start": 2.2315840265859115, "deviation-center-line": 0.6497421815705251, "driven_lanedir_consec": 1.21073941861612}, "loop-000-ego3": {"driven_any": 8.763345560962911e-14, "survival_time": 17.650000000000116, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 11.126245949311896, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8126244209313231, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max17.650000000000116
survival_time_mean17.650000000000116
survival_time_min17.650000000000116
No reset possible
5269475Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-2of4successnogpu-staging-spot-0-040:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299468


other stats
deviation-center-line_max0.8949116056299468
deviation-center-line_mean0.8949116056299468
deviation-center-line_min0.8949116056299468
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5255480Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-1of4successnogpu-staging-spot-0-040:10:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.718735763136104
deviation-center-line_median0.3055318569062805


other stats
deviation-center-line_max3.468395721180941
deviation-center-line_mean1.056094724894972
deviation-center-line_min0.14491946458638674
deviation-heading_max18.309428016005143
deviation-heading_mean5.962038133066249
deviation-heading_median2.1016846099383484
deviation-heading_min1.3353552963831563
distance-from-start_max3.3735529930090653
distance-from-start_mean2.2469544876361525
distance-from-start_median2.8071324787677723
distance-from-start_min4.440892098500626e-16
driven_any_max5.809528586384186
driven_any_mean3.815527957610135
driven_any_median4.726291622027912
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max5.79391764651065
driven_lanedir_consec_mean3.8078472931957146
driven_lanedir_consec_min0.0
driven_lanedir_max5.79391764651065
driven_lanedir_mean3.8078491425629943
driven_lanedir_median4.718739461870664
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 3.678536302590251, "survival_time": 59.99999999999873, "driven_lanedir": 3.6670970298429166, "in-drivable-lane": 0.0, "deviation-heading": 2.004432813280444, "distance-from-start": 2.640003754342585, "deviation-center-line": 0.32324970166177724, "driven_lanedir_consec": 3.667089757433403}, "udem-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005143, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.468395721180941, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 5.7740469414655715, "survival_time": 59.99999999999873, "driven_lanedir": 5.770381893898411, "in-drivable-lane": 0.0, "deviation-heading": 1.3353552963831563, "distance-from-start": 3.3735529930090653, "deviation-center-line": 0.14491946458638674, "driven_lanedir_consec": 5.7703817688388055}, "udem-000-ego3": {"driven_any": 5.809528586384186, "survival_time": 59.99999999999873, "driven_lanedir": 5.79391764651065, "in-drivable-lane": 0.0, "deviation-heading": 2.1989364065962533, "distance-from-start": 2.97426120319296, "deviation-center-line": 0.2878140121507838, "driven_lanedir_consec": 5.79391764651065}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5248492Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-validationsim-0of4successnogpu-staging-spot-0-040:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median6.05000000000001
driven_lanedir_consec_median0.30101962152421446
deviation-center-line_median0.33331321378753215


other stats
deviation-center-line_max0.9867208312321796
deviation-center-line_mean0.444755703855315
deviation-center-line_min0.12567555661401583
deviation-heading_max2.548187013405534
deviation-heading_mean1.64877502395785
deviation-heading_median1.6495518057392644
deviation-heading_min0.7478094709473372
distance-from-start_max1.438162383761261
distance-from-start_mean0.7289714152785263
distance-from-start_median0.5564612149057249
distance-from-start_min0.3648008475413942
driven_any_max1.4382693230332029
driven_any_mean0.729004624492714
driven_any_median0.556470991690694
driven_any_min0.3648071915562648
driven_lanedir_consec_max0.7375240370941809
driven_lanedir_consec_mean0.3748149029942042
driven_lanedir_consec_min0.15969633183420706
driven_lanedir_max0.746168337032741
driven_lanedir_mean0.37697597797884425
driven_lanedir_median0.30101962152421446
driven_lanedir_min0.15969633183420706
in-drivable-lane_max8.300000000000004
in-drivable-lane_mean5.100000000000006
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.6981436944804056, "survival_time": 9.750000000000004, "driven_lanedir": 0.199551480959018, "in-drivable-lane": 8.000000000000004, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.6981319454565775, "deviation-center-line": 0.12567555661401583, "driven_lanedir_consec": 0.199551480959018}, "udem-000-ego1": {"driven_any": 0.3648071915562648, "survival_time": 9.750000000000004, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 8.300000000000004, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.3648008475413942, "deviation-center-line": 0.1356249877645468, "driven_lanedir_consec": 0.15969633183420706}, "udem-000-ego2": {"driven_any": 0.4147982889009824, "survival_time": 9.750000000000004, "driven_lanedir": 0.40248776208941095, "in-drivable-lane": 0.0, "deviation-heading": 2.350281655920482, "distance-from-start": 0.41479048435487215, "deviation-center-line": 0.9867208312321796, "driven_lanedir_consec": 0.40248776208941095}, "udem-000-ego3": {"driven_any": 1.4382693230332029, "survival_time": 9.750000000000004, "driven_lanedir": 0.746168337032741, "in-drivable-lane": 4.100000000000016, "deviation-heading": 2.548187013405534, "distance-from-start": 1.438162383761261, "deviation-center-line": 0.5310014398105175, "driven_lanedir_consec": 0.7375240370941809}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
5240488Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-040:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000006
in-drivable-lane_median6.60000000000001
driven_lanedir_consec_median0.33122941999330235
deviation-center-line_median0.2697354465605155


other stats
deviation-center-line_max0.2697354465605155
deviation-center-line_mean0.2697354465605155
deviation-center-line_min0.2697354465605155
deviation-heading_max2.53835057480462
deviation-heading_mean2.53835057480462
deviation-heading_median2.53835057480462
deviation-heading_min2.53835057480462
distance-from-start_max1.4631057991302543
distance-from-start_mean1.4631057991302543
distance-from-start_median1.4631057991302543
distance-from-start_min1.4631057991302543
driven_any_max1.4632129547419284
driven_any_mean1.4632129547419284
driven_any_median1.4632129547419284
driven_any_min1.4632129547419284
driven_lanedir_consec_max0.33122941999330235
driven_lanedir_consec_mean0.33122941999330235
driven_lanedir_consec_min0.33122941999330235
driven_lanedir_max0.33122941999330235
driven_lanedir_mean0.33122941999330235
driven_lanedir_median0.33122941999330235
driven_lanedir_min0.33122941999330235
in-drivable-lane_max6.60000000000001
in-drivable-lane_mean6.60000000000001
in-drivable-lane_min6.60000000000001
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4632129547419284, "survival_time": 9.900000000000006, "driven_lanedir": 0.33122941999330235, "in-drivable-lane": 6.60000000000001, "deviation-heading": 2.53835057480462, "distance-from-start": 1.4631057991302543, "deviation-center-line": 0.2697354465605155, "driven_lanedir_consec": 0.33122941999330235}}
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean9.900000000000006
survival_time_min9.900000000000006
No reset possible
5234478Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-2of4successnogpu-staging-spot-0-040:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.626542990464859
deviation-center-line_median0.3404045717154838


other stats
deviation-center-line_max0.3404045717154838
deviation-center-line_mean0.3404045717154838
deviation-center-line_min0.3404045717154838
deviation-heading_max2.631172234135892
deviation-heading_mean2.631172234135892
deviation-heading_median2.631172234135892
deviation-heading_min2.631172234135892
distance-from-start_max2.518618655205165
distance-from-start_mean2.518618655205165
distance-from-start_median2.518618655205165
distance-from-start_min2.518618655205165
driven_any_max5.644450866720938
driven_any_mean5.644450866720938
driven_any_median5.644450866720938
driven_any_min5.644450866720938
driven_lanedir_consec_max5.626542990464859
driven_lanedir_consec_mean5.626542990464859
driven_lanedir_consec_min5.626542990464859
driven_lanedir_max5.626542990464859
driven_lanedir_mean5.626542990464859
driven_lanedir_median5.626542990464859
driven_lanedir_min5.626542990464859
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.644450866720938, "survival_time": 59.99999999999873, "driven_lanedir": 5.626542990464859, "in-drivable-lane": 0.0, "deviation-heading": 2.631172234135892, "distance-from-start": 2.518618655205165, "deviation-center-line": 0.3404045717154838, "driven_lanedir_consec": 5.626542990464859}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5228495Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-2of4successnogpu-staging-spot-0-040:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median9.45000000000002
driven_lanedir_consec_median0.13666265914899656
deviation-center-line_median0.10783813033632964


other stats
deviation-center-line_max0.10783813033632964
deviation-center-line_mean0.10783813033632964
deviation-center-line_min0.10783813033632964
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575148
distance-from-start_mean1.6182798682575148
distance-from-start_median1.6182798682575148
distance-from-start_min1.6182798682575148
driven_any_max1.6183892771013904
driven_any_mean1.6183892771013904
driven_any_median1.6183892771013904
driven_any_min1.6183892771013904
driven_lanedir_consec_max0.13666265914899656
driven_lanedir_consec_mean0.13666265914899656
driven_lanedir_consec_min0.13666265914899656
driven_lanedir_max0.13666265914899656
driven_lanedir_mean0.13666265914899656
driven_lanedir_median0.13666265914899656
driven_lanedir_min0.13666265914899656
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.6183892771013904, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666265914899656, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575148, "deviation-center-line": 0.10783813033632964, "driven_lanedir_consec": 0.13666265914899656}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
5223477Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnogpu-staging-spot-0-040:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.750000000000117
in-drivable-lane_median0.0
driven_lanedir_consec_median1.53847507295702
deviation-center-line_median0.16257777325206482


other stats
deviation-center-line_max0.16257777325206482
deviation-center-line_mean0.16257777325206482
deviation-center-line_min0.16257777325206482
deviation-heading_max1.4712837581470402
deviation-heading_mean1.4712837581470402
deviation-heading_median1.4712837581470402
deviation-heading_min1.4712837581470402
distance-from-start_max1.0671562227466285
distance-from-start_mean1.0671562227466285
distance-from-start_median1.0671562227466285
distance-from-start_min1.0671562227466285
driven_any_max1.547713297174875
driven_any_mean1.547713297174875
driven_any_median1.547713297174875
driven_any_min1.547713297174875
driven_lanedir_consec_max1.53847507295702
driven_lanedir_consec_mean1.53847507295702
driven_lanedir_consec_min1.53847507295702
driven_lanedir_max1.53847507295702
driven_lanedir_mean1.53847507295702
driven_lanedir_median1.53847507295702
driven_lanedir_min1.53847507295702
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.547713297174875, "survival_time": 17.750000000000117, "driven_lanedir": 1.53847507295702, "in-drivable-lane": 0.0, "deviation-heading": 1.4712837581470402, "distance-from-start": 1.0671562227466285, "deviation-center-line": 0.16257777325206482, "driven_lanedir_consec": 1.53847507295702}}
simulation-passed1
survival_time_max17.750000000000117
survival_time_mean17.750000000000117
survival_time_min17.750000000000117
No reset possible
5215599Liam Paulltemplate-randomaido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-040:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.007457570166591001


other stats
deviation-center-line_max0.007457570166591001
deviation-center-line_mean0.007457570166591001
deviation-center-line_min0.007457570166591001
deviation-heading_max0.1966171946901932
deviation-heading_mean0.1966171946901932
deviation-heading_median0.1966171946901932
deviation-heading_min0.1966171946901932
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max8.413744284337043e-16
driven_any_mean8.413744284337043e-16
driven_any_median8.413744284337043e-16
driven_any_min8.413744284337043e-16
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5201601Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:af1fc014c2aee6db343f310c27ecb68c7f4321edaido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-040:05:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5198583Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:6b837b755a774b87d2aff355275ee4be90f2ab17aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-040:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.03097325558712294
deviation-center-line_median0.005369432463528651


other stats
deviation-center-line_max0.005369432463528651
deviation-center-line_mean0.005369432463528651
deviation-center-line_min0.005369432463528651
deviation-heading_max0.2827357852603485
deviation-heading_mean0.2827357852603485
deviation-heading_median0.2827357852603485
deviation-heading_min0.2827357852603485
distance-from-start_max0.03759066660504082
distance-from-start_mean0.03759066660504082
distance-from-start_median0.03759066660504082
distance-from-start_min0.03759066660504082
driven_any_max0.03763977459722116
driven_any_mean0.03763977459722116
driven_any_median0.03763977459722116
driven_any_min0.03763977459722116
driven_lanedir_consec_max0.03097325558712294
driven_lanedir_consec_mean0.03097325558712294
driven_lanedir_consec_min0.03097325558712294
driven_lanedir_max0.03097325558712294
driven_lanedir_mean0.03097325558712294
driven_lanedir_median0.03097325558712294
driven_lanedir_min0.03097325558712294
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.03763977459722116, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03097325558712294, "in-drivable-lane": 0.0, "deviation-heading": 0.2827357852603485, "distance-from-start": 0.03759066660504082, "deviation-center-line": 0.005369432463528651, "driven_lanedir_consec": 0.03097325558712294}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5194600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-040:05:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible