Duckietown Challenges Home Challenges Submissions

Evaluator 19

ID19
evaluatorgpu-staging-spot-0-05
owneruser1000001
machinegpu-staging-spot-0
processgpu-staging-spot-0-05
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success178 5199
# timeout3 6301
# failed73 5192
# error
# aborted
# host-error4 7021
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)246.2 GB
Disk (MB)969.3 GB
Disk available (MB)892.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7478800Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7471801Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-050:05:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7465385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-050:18:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median27.874999999999368
driven_lanedir_consec_median-4.150896456523238
deviation-center-line_median2.537048654791353


other stats
deviation-center-line_max5.737974403966239
deviation-center-line_mean3.1420874738947253
deviation-center-line_min1.7562781820299564
deviation-heading_max33.52905554828844
deviation-heading_mean28.308448255723665
deviation-heading_median27.139611136244874
deviation-heading_min25.425515202116475
distance-from-start_max0.20500916662786964
distance-from-start_mean0.1785407450744636
distance-from-start_median0.17154109733303227
distance-from-start_min0.16607161900392023
driven_any_max13.706079323851895
driven_any_mean13.230666172692535
driven_any_median13.220262941053887
driven_any_min12.776059484810478
driven_lanedir_consec_max-3.845421981456996
driven_lanedir_consec_mean-4.099046632208901
driven_lanedir_consec_min-4.248971634332133
driven_lanedir_max-3.845421981456996
driven_lanedir_mean-5.275544013834165
driven_lanedir_median-4.588826204302308
driven_lanedir_min-8.079101665275049
in-drivable-lane_max29.099999999999408
in-drivable-lane_mean23.249999999999496
in-drivable-lane_min8.149999999999837
per-episodes
details{"autolab-000-ego0": {"driven_any": 13.32238125944532, "survival_time": 59.99999999999873, "driven_lanedir": -4.600094289899513, "in-drivable-lane": 28.549999999999333, "deviation-heading": 26.61614831477925, "distance-from-start": 0.1704271356575727, "deviation-center-line": 2.2320051495679416, "driven_lanedir_consec": -4.189216727044325}, "autolab-000-ego1": {"driven_any": 12.776059484810478, "survival_time": 59.99999999999873, "driven_lanedir": -3.845421981456996, "in-drivable-lane": 27.19999999999941, "deviation-heading": 27.663073957710495, "distance-from-start": 0.17265505900849185, "deviation-center-line": 2.842092160014765, "driven_lanedir_consec": -3.845421981456996}, "autolab-000-ego2": {"driven_any": 13.706079323851895, "survival_time": 59.99999999999873, "driven_lanedir": -8.079101665275049, "in-drivable-lane": 8.149999999999837, "deviation-heading": 33.52905554828844, "distance-from-start": 0.20500916662786964, "deviation-center-line": 5.737974403966239, "driven_lanedir_consec": -4.248971634332133}, "autolab-000-ego3": {"driven_any": 13.11814462266246, "survival_time": 59.99999999999873, "driven_lanedir": -4.5775581187051015, "in-drivable-lane": 29.099999999999408, "deviation-heading": 25.425515202116475, "distance-from-start": 0.16607161900392023, "deviation-center-line": 1.7562781820299564, "driven_lanedir_consec": -4.11257618600215}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7456391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-050:21:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.449999999999335
driven_lanedir_consec_median-4.290662166475583
deviation-center-line_median2.0668340570081254


other stats
deviation-center-line_max4.17911753233782
deviation-center-line_mean2.499563691279599
deviation-center-line_min1.6854691187643267
deviation-heading_max28.659467455571377
deviation-heading_mean25.046730673641893
deviation-heading_median25.945636532689548
deviation-heading_min19.63618217361711
distance-from-start_max0.23004218055730224
distance-from-start_mean0.1904442957354804
distance-from-start_median0.183534000773199
distance-from-start_min0.16466700083822136
driven_any_max14.957583804943912
driven_any_mean13.309458300673228
driven_any_median13.77746810779125
driven_any_min10.725313182166497
driven_lanedir_consec_max-3.069729613784058
driven_lanedir_consec_mean-4.080162185294574
driven_lanedir_consec_min-4.669594794443076
driven_lanedir_max-3.069729613784058
driven_lanedir_mean-5.05749130800022
driven_lanedir_median-4.840514343437436
driven_lanedir_min-7.479206931341946
in-drivable-lane_max37.04999999999896
in-drivable-lane_mean27.712499999999253
in-drivable-lane_min16.899999999999388
per-episodes
details{"4way-000-ego0": {"driven_any": 14.476861779851744, "survival_time": 59.99999999999873, "driven_lanedir": -4.888439726928637, "in-drivable-lane": 27.599999999999397, "deviation-heading": 27.78075933283635, "distance-from-start": 0.23004218055730224, "deviation-center-line": 2.308264009140415, "driven_lanedir_consec": -4.4745004861691955}, "4way-000-ego1": {"driven_any": 10.725313182166497, "survival_time": 59.99999999999873, "driven_lanedir": -3.069729613784058, "in-drivable-lane": 37.04999999999896, "deviation-heading": 19.63618217361711, "distance-from-start": 0.1963190289080727, "deviation-center-line": 1.6854691187643267, "driven_lanedir_consec": -3.069729613784058}, "4way-000-ego2": {"driven_any": 14.957583804943912, "survival_time": 59.99999999999873, "driven_lanedir": -7.479206931341946, "in-drivable-lane": 16.899999999999388, "deviation-heading": 28.659467455571377, "distance-from-start": 0.1707489726383253, "deviation-center-line": 4.17911753233782, "driven_lanedir_consec": -4.669594794443076}, "4way-000-ego3": {"driven_any": 13.07807443573076, "survival_time": 59.99999999999873, "driven_lanedir": -4.792588959946235, "in-drivable-lane": 29.299999999999272, "deviation-heading": 24.110513732542746, "distance-from-start": 0.16466700083822136, "deviation-center-line": 1.8254041048758356, "driven_lanedir_consec": -4.106823846781969}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7441391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4successnogpu-staging-spot-0-050:18:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median16.624999999999986
driven_lanedir_consec_median-2.683945451988178
deviation-center-line_median4.914631981739962


other stats
deviation-center-line_max5.728532745494415
deviation-center-line_mean4.415580870930085
deviation-center-line_min2.104526774746001
deviation-heading_max29.114472476798117
deviation-heading_mean22.616214648316863
deviation-heading_median21.039737984753213
deviation-heading_min19.270910146962915
distance-from-start_max0.20915041032432424
distance-from-start_mean0.17476578237072535
distance-from-start_median0.16627781361166366
distance-from-start_min0.15735709193524988
driven_any_max12.524055300465118
driven_any_mean8.933098775382051
driven_any_median8.698608651565296
driven_any_min5.811122497932492
driven_lanedir_consec_max-1.679187574941925
driven_lanedir_consec_mean-2.7205954618783696
driven_lanedir_consec_min-3.835303368595198
driven_lanedir_max-2.1862273370865557
driven_lanedir_mean-3.068334793911584
driven_lanedir_median-3.010169077273024
driven_lanedir_min-4.066773684013734
in-drivable-lane_max26.799999999999407
in-drivable-lane_mean17.699999999999875
in-drivable-lane_min10.750000000000115
per-episodes
details{"udem-000-ego0": {"driven_any": 12.524055300465118, "survival_time": 59.99999999999873, "driven_lanedir": -4.066773684013734, "in-drivable-lane": 26.799999999999407, "deviation-heading": 29.114472476798117, "distance-from-start": 0.20915041032432424, "deviation-center-line": 2.104526774746001, "driven_lanedir_consec": -3.835303368595198}, "udem-000-ego1": {"driven_any": 8.792283245207544, "survival_time": 59.99999999999873, "driven_lanedir": -2.674323855196231, "in-drivable-lane": 18.899999999999952, "deviation-heading": 19.270910146962915, "distance-from-start": 0.16431874108717456, "deviation-center-line": 4.9033492137114845, "driven_lanedir_consec": -2.674323855196231}, "udem-000-ego2": {"driven_any": 5.811122497932492, "survival_time": 59.99999999999873, "driven_lanedir": -2.1862273370865557, "in-drivable-lane": 10.750000000000115, "deviation-heading": 21.8469834625926, "distance-from-start": 0.15735709193524988, "deviation-center-line": 4.92591474976844, "driven_lanedir_consec": -1.679187574941925}, "udem-000-ego3": {"driven_any": 8.604934057923048, "survival_time": 59.99999999999873, "driven_lanedir": -3.3460142993498168, "in-drivable-lane": 14.350000000000016, "deviation-heading": 20.232492506913825, "distance-from-start": 0.16823688613615273, "deviation-center-line": 5.728532745494415, "driven_lanedir_consec": -2.693567048780125}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7427392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-1of4successnogpu-staging-spot-0-050:19:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median29.77499999999935
driven_lanedir_consec_median-3.481548522260066
deviation-center-line_median2.406155862945068


other stats
deviation-center-line_max4.832392276200467
deviation-center-line_mean2.9589918491160168
deviation-center-line_min2.1912633943734656
deviation-heading_max27.392891691164294
deviation-heading_mean25.834132615857545
deviation-heading_median25.77489771893672
deviation-heading_min24.393843334392443
distance-from-start_max0.16548075781435817
distance-from-start_mean0.15946176987833618
distance-from-start_median0.1598017356720492
distance-from-start_min0.15276285035488818
driven_any_max12.432592192637012
driven_any_mean11.951491801576932
driven_any_median12.023235665903032
driven_any_min11.326903681864652
driven_lanedir_consec_max-2.6652538642830343
driven_lanedir_consec_mean-3.394800241152849
driven_lanedir_consec_min-3.950850055808229
driven_lanedir_max-2.6652538642830343
driven_lanedir_mean-3.4164759999276586
driven_lanedir_median-3.524900039809685
driven_lanedir_min-3.950850055808229
in-drivable-lane_max32.39999999999921
in-drivable-lane_mean28.274999999999324
in-drivable-lane_min21.149999999999388
per-episodes
details{"autolab-000-ego0": {"driven_any": 12.403462355652673, "survival_time": 59.99999999999873, "driven_lanedir": -3.950850055808229, "in-drivable-lane": 31.549999999999343, "deviation-heading": 24.393843334392443, "distance-from-start": 0.15954955702070447, "deviation-center-line": 2.270351196492881, "driven_lanedir_consec": -3.950850055808229}, "autolab-000-ego1": {"driven_any": 11.326903681864652, "survival_time": 59.99999999999873, "driven_lanedir": -2.6652538642830343, "in-drivable-lane": 21.149999999999388, "deviation-heading": 27.392891691164294, "distance-from-start": 0.16005391432339391, "deviation-center-line": 4.832392276200467, "driven_lanedir_consec": -2.6652538642830343}, "autolab-000-ego2": {"driven_any": 12.432592192637012, "survival_time": 59.99999999999873, "driven_lanedir": -3.7936473415148577, "in-drivable-lane": 27.999999999999353, "deviation-heading": 27.02383757492557, "distance-from-start": 0.16548075781435817, "deviation-center-line": 2.1912633943734656, "driven_lanedir_consec": -3.7069443064156182}, "autolab-000-ego3": {"driven_any": 11.643008976153393, "survival_time": 59.99999999999873, "driven_lanedir": -3.2561527381045132, "in-drivable-lane": 32.39999999999921, "deviation-heading": 24.525957862947873, "distance-from-start": 0.15276285035488818, "deviation-center-line": 2.541960529397255, "driven_lanedir_consec": -3.2561527381045132}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7424393Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-050:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median22.399999999999437
driven_lanedir_consec_median-2.7695703837797336
deviation-center-line_median4.201245169041399


other stats
deviation-center-line_max4.201245169041399
deviation-center-line_mean4.201245169041399
deviation-center-line_min4.201245169041399
deviation-heading_max28.411075768705494
deviation-heading_mean28.411075768705494
deviation-heading_median28.411075768705494
deviation-heading_min28.411075768705494
distance-from-start_max0.16968889145573157
distance-from-start_mean0.16968889145573157
distance-from-start_median0.16968889145573157
distance-from-start_min0.16968889145573157
driven_any_max11.484967399303224
driven_any_mean11.484967399303224
driven_any_median11.484967399303224
driven_any_min11.484967399303224
driven_lanedir_consec_max-2.7695703837797336
driven_lanedir_consec_mean-2.7695703837797336
driven_lanedir_consec_min-2.7695703837797336
driven_lanedir_max-2.7695703837797336
driven_lanedir_mean-2.7695703837797336
driven_lanedir_median-2.7695703837797336
driven_lanedir_min-2.7695703837797336
in-drivable-lane_max22.399999999999437
in-drivable-lane_mean22.399999999999437
in-drivable-lane_min22.399999999999437
per-episodes
details{"loop-000-ego0": {"driven_any": 11.484967399303224, "survival_time": 59.99999999999873, "driven_lanedir": -2.7695703837797336, "in-drivable-lane": 22.399999999999437, "deviation-heading": 28.411075768705494, "distance-from-start": 0.16968889145573157, "deviation-center-line": 4.201245169041399, "driven_lanedir_consec": -2.7695703837797336}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7422395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7418396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-050:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.15000000000028
in-drivable-lane_median17.15000000000016
driven_lanedir_consec_median-1.5792674968146745
deviation-center-line_median0.6749511617483093


other stats
deviation-center-line_max0.6749511617483093
deviation-center-line_mean0.6749511617483093
deviation-center-line_min0.6749511617483093
deviation-heading_max10.295768771738762
deviation-heading_mean10.295768771738762
deviation-heading_median10.295768771738762
deviation-heading_min10.295768771738762
distance-from-start_max0.16272241164154028
distance-from-start_mean0.16272241164154028
distance-from-start_median0.16272241164154028
distance-from-start_min0.16272241164154028
driven_any_max5.409084105597049
driven_any_mean5.409084105597049
driven_any_median5.409084105597049
driven_any_min5.409084105597049
driven_lanedir_consec_max-1.5792674968146745
driven_lanedir_consec_mean-1.5792674968146745
driven_lanedir_consec_min-1.5792674968146745
driven_lanedir_max-1.5792674968146745
driven_lanedir_mean-1.5792674968146745
driven_lanedir_median-1.5792674968146745
driven_lanedir_min-1.5792674968146745
in-drivable-lane_max17.15000000000016
in-drivable-lane_mean17.15000000000016
in-drivable-lane_min17.15000000000016
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.409084105597049, "survival_time": 29.15000000000028, "driven_lanedir": -1.5792674968146745, "in-drivable-lane": 17.15000000000016, "deviation-heading": 10.295768771738762, "distance-from-start": 0.16272241164154028, "deviation-center-line": 0.6749511617483093, "driven_lanedir_consec": -1.5792674968146745}}
simulation-passed1
survival_time_max29.15000000000028
survival_time_mean29.15000000000028
survival_time_min29.15000000000028
No reset possible
7413396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-050:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7410514Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-validationsim-3of4failednogpu-staging-spot-0-050:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7405515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-0of4failednogpu-staging-spot-0-050:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7399516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7393518Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7386520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7383520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7378521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-1of4failednogpu-staging-spot-0-050:01:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7360528Bea Baselines 🐤baseline-dagger-pytorchaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:14:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.800000000000019
driven_lanedir_consec_median8.887705430671874
deviation-center-line_median2.9800200175856086


other stats
deviation-center-line_max3.0461793547882383
deviation-center-line_mean2.875586818594314
deviation-center-line_min2.4961278844178003
deviation-heading_max16.847178860848707
deviation-heading_mean15.474630500401696
deviation-heading_median16.224444151035613
deviation-heading_min12.602454838686848
distance-from-start_max3.286597128837451
distance-from-start_mean2.7810570516991295
distance-from-start_median2.9244110607698817
distance-from-start_min1.988808956419304
driven_any_max10.757970515221997
driven_any_mean10.61470427297525
driven_any_median10.600481600427075
driven_any_min10.499883375824847
driven_lanedir_consec_max10.338679575561962
driven_lanedir_consec_mean9.188655007681522
driven_lanedir_consec_min8.640529593820379
driven_lanedir_max10.338679575561962
driven_lanedir_mean9.188655007681522
driven_lanedir_median8.887705430671874
driven_lanedir_min8.640529593820379
in-drivable-lane_max5.449999999999963
in-drivable-lane_mean3.7625
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.667752458319624, "survival_time": 59.99999999999873, "driven_lanedir": 10.338679575561962, "in-drivable-lane": 0.0, "deviation-heading": 12.602454838686848, "distance-from-start": 1.988808956419304, "deviation-center-line": 2.4961278844178003, "driven_lanedir_consec": 10.338679575561962}, "loop-000-ego1": {"driven_any": 10.499883375824847, "survival_time": 59.99999999999873, "driven_lanedir": 8.934438886715554, "in-drivable-lane": 4.249999999999991, "deviation-heading": 15.969761950351073, "distance-from-start": 3.2276608244161977, "deviation-center-line": 2.969183639603414, "driven_lanedir_consec": 8.934438886715554}, "loop-000-ego2": {"driven_any": 10.757970515221997, "survival_time": 59.99999999999873, "driven_lanedir": 8.840971974628193, "in-drivable-lane": 5.449999999999963, "deviation-heading": 16.847178860848707, "distance-from-start": 3.286597128837451, "deviation-center-line": 2.9908563955678034, "driven_lanedir_consec": 8.840971974628193}, "loop-000-ego3": {"driven_any": 10.533210742534532, "survival_time": 59.99999999999873, "driven_lanedir": 8.640529593820379, "in-drivable-lane": 5.350000000000048, "deviation-heading": 16.479126351720154, "distance-from-start": 2.621161297123566, "deviation-center-line": 3.0461793547882383, "driven_lanedir_consec": 8.640529593820379}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7354530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-050:08:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.1999999999999318
driven_lanedir_consec_median10.32029186495062
deviation-center-line_median2.8841264097376507


other stats
deviation-center-line_max2.8841264097376507
deviation-center-line_mean2.8841264097376507
deviation-center-line_min2.8841264097376507
deviation-heading_max12.633197768169405
deviation-heading_mean12.633197768169405
deviation-heading_median12.633197768169405
deviation-heading_min12.633197768169405
distance-from-start_max1.0787676909156432
distance-from-start_mean1.0787676909156432
distance-from-start_median1.0787676909156432
distance-from-start_min1.0787676909156432
driven_any_max10.955470898987704
driven_any_mean10.955470898987704
driven_any_median10.955470898987704
driven_any_min10.955470898987704
driven_lanedir_consec_max10.32029186495062
driven_lanedir_consec_mean10.32029186495062
driven_lanedir_consec_min10.32029186495062
driven_lanedir_max10.32029186495062
driven_lanedir_mean10.32029186495062
driven_lanedir_median10.32029186495062
driven_lanedir_min10.32029186495062
in-drivable-lane_max1.1999999999999318
in-drivable-lane_mean1.1999999999999318
in-drivable-lane_min1.1999999999999318
per-episodes
details{"loop2-000-ego0": {"driven_any": 10.955470898987704, "survival_time": 59.99999999999873, "driven_lanedir": 10.32029186495062, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 12.633197768169405, "distance-from-start": 1.0787676909156432, "deviation-center-line": 2.8841264097376507, "driven_lanedir_consec": 10.32029186495062}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7348532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-050:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median36.500000000000064
in-drivable-lane_median2.1500000000000306
driven_lanedir_consec_median4.965852275241451
deviation-center-line_median1.6658971037829546


other stats
deviation-center-line_max1.6658971037829546
deviation-center-line_mean1.6658971037829546
deviation-center-line_min1.6658971037829546
deviation-heading_max8.196318070279778
deviation-heading_mean8.196318070279778
deviation-heading_median8.196318070279778
deviation-heading_min8.196318070279778
distance-from-start_max2.2052248231904374
distance-from-start_mean2.2052248231904374
distance-from-start_median2.2052248231904374
distance-from-start_min2.2052248231904374
driven_any_max5.8969408384785105
driven_any_mean5.8969408384785105
driven_any_median5.8969408384785105
driven_any_min5.8969408384785105
driven_lanedir_consec_max4.965852275241451
driven_lanedir_consec_mean4.965852275241451
driven_lanedir_consec_min4.965852275241451
driven_lanedir_max5.272556981447843
driven_lanedir_mean5.272556981447843
driven_lanedir_median5.272556981447843
driven_lanedir_min5.272556981447843
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean2.1500000000000306
in-drivable-lane_min2.1500000000000306
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.8969408384785105, "survival_time": 36.500000000000064, "driven_lanedir": 5.272556981447843, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 8.196318070279778, "distance-from-start": 2.2052248231904374, "deviation-center-line": 1.6658971037829546, "driven_lanedir_consec": 4.965852275241451}}
simulation-passed1
survival_time_max36.500000000000064
survival_time_mean36.500000000000064
survival_time_min36.500000000000064
No reset possible
7342531Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4910025541954939
deviation-center-line_median0.16317234144694157


other stats
deviation-center-line_max0.16317234144694157
deviation-center-line_mean0.16317234144694157
deviation-center-line_min0.16317234144694157
deviation-heading_max1.67244064602263
deviation-heading_mean1.67244064602263
deviation-heading_median1.67244064602263
deviation-heading_min1.67244064602263
distance-from-start_max0.494133877997319
distance-from-start_mean0.494133877997319
distance-from-start_median0.494133877997319
distance-from-start_min0.494133877997319
driven_any_max0.5214768475784584
driven_any_mean0.5214768475784584
driven_any_median0.5214768475784584
driven_any_min0.5214768475784584
driven_lanedir_consec_max0.4910025541954939
driven_lanedir_consec_mean0.4910025541954939
driven_lanedir_consec_min0.4910025541954939
driven_lanedir_max0.4910025541954939
driven_lanedir_mean0.4910025541954939
driven_lanedir_median0.4910025541954939
driven_lanedir_min0.4910025541954939
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.5214768475784584, "survival_time": 4.199999999999993, "driven_lanedir": 0.4910025541954939, "in-drivable-lane": 0.0, "deviation-heading": 1.67244064602263, "distance-from-start": 0.494133877997319, "deviation-center-line": 0.16317234144694157, "driven_lanedir_consec": 0.4910025541954939}}
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
7335532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-3of4host-errornogpu-staging-spot-0-050:00:36
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7319533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-050:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.450392856494611
survival_time_median59.99999999999873
deviation-center-line_median2.7187067180265916
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.7187067180265916
deviation-center-line_mean2.7187067180265916
deviation-center-line_min2.7187067180265916
deviation-heading_max10.520437953723931
deviation-heading_mean10.520437953723931
deviation-heading_median10.520437953723931
deviation-heading_min10.520437953723931
distance-from-start_max2.4574413605808196
distance-from-start_mean2.4574413605808196
distance-from-start_median2.4574413605808196
distance-from-start_min2.4574413605808196
driven_any_max10.697662350974216
driven_any_mean10.697662350974216
driven_any_median10.697662350974216
driven_any_min10.697662350974216
driven_lanedir_consec_max10.450392856494611
driven_lanedir_consec_mean10.450392856494611
driven_lanedir_consec_min10.450392856494611
driven_lanedir_max10.450392856494611
driven_lanedir_mean10.450392856494611
driven_lanedir_median10.450392856494611
driven_lanedir_min10.450392856494611
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.697662350974216, "survival_time": 59.99999999999873, "driven_lanedir": 10.450392856494611, "in-drivable-lane": 0.0, "deviation-heading": 10.520437953723931, "distance-from-start": 2.4574413605808196, "deviation-center-line": 2.7187067180265916, "driven_lanedir_consec": 10.450392856494611}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7315534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:04
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7313534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:11
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7295538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-050:06:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.3000000000003
in-drivable-lane_median1.050000000000015
driven_lanedir_consec_median4.770512023780412
deviation-center-line_median1.6818850447403533


other stats
deviation-center-line_max1.6818850447403533
deviation-center-line_mean1.6818850447403533
deviation-center-line_min1.6818850447403533
deviation-heading_max8.996762460016944
deviation-heading_mean8.996762460016944
deviation-heading_median8.996762460016944
deviation-heading_min8.996762460016944
distance-from-start_max2.923615084049239
distance-from-start_mean2.923615084049239
distance-from-start_median2.923615084049239
distance-from-start_min2.923615084049239
driven_any_max5.333230282840361
driven_any_mean5.333230282840361
driven_any_median5.333230282840361
driven_any_min5.333230282840361
driven_lanedir_consec_max4.770512023780412
driven_lanedir_consec_mean4.770512023780412
driven_lanedir_consec_min4.770512023780412
driven_lanedir_max4.770512023780412
driven_lanedir_mean4.770512023780412
driven_lanedir_median4.770512023780412
driven_lanedir_min4.770512023780412
in-drivable-lane_max1.050000000000015
in-drivable-lane_mean1.050000000000015
in-drivable-lane_min1.050000000000015
per-episodes
details{"udem-000-ego0": {"driven_any": 5.333230282840361, "survival_time": 32.3000000000003, "driven_lanedir": 4.770512023780412, "in-drivable-lane": 1.050000000000015, "deviation-heading": 8.996762460016944, "distance-from-start": 2.923615084049239, "deviation-center-line": 1.6818850447403533, "driven_lanedir_consec": 4.770512023780412}}
simulation-passed1
survival_time_max32.3000000000003
survival_time_mean32.3000000000003
survival_time_min32.3000000000003
No reset possible
7275541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-2of4successnogpu-staging-spot-0-050:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.763519231918854
survival_time_median59.99999999999873
deviation-center-line_median3.07679647479841
in-drivable-lane_median4.099999999999842


other stats
deviation-center-line_max3.07679647479841
deviation-center-line_mean3.07679647479841
deviation-center-line_min3.07679647479841
deviation-heading_max18.109891705256416
deviation-heading_mean18.109891705256416
deviation-heading_median18.109891705256416
deviation-heading_min18.109891705256416
distance-from-start_max2.636035589763406
distance-from-start_mean2.636035589763406
distance-from-start_median2.636035589763406
distance-from-start_min2.636035589763406
driven_any_max10.4499223724544
driven_any_mean10.4499223724544
driven_any_median10.4499223724544
driven_any_min10.4499223724544
driven_lanedir_consec_max8.763519231918854
driven_lanedir_consec_mean8.763519231918854
driven_lanedir_consec_min8.763519231918854
driven_lanedir_max8.763519231918854
driven_lanedir_mean8.763519231918854
driven_lanedir_median8.763519231918854
driven_lanedir_min8.763519231918854
in-drivable-lane_max4.099999999999842
in-drivable-lane_mean4.099999999999842
in-drivable-lane_min4.099999999999842
per-episodes
details{"loop-000-ego0": {"driven_any": 10.4499223724544, "survival_time": 59.99999999999873, "driven_lanedir": 8.763519231918854, "in-drivable-lane": 4.099999999999842, "deviation-heading": 18.109891705256416, "distance-from-start": 2.636035589763406, "deviation-center-line": 3.07679647479841, "driven_lanedir_consec": 8.763519231918854}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7255541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-050:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.550255581517545
survival_time_median59.99999999999873
deviation-center-line_median2.629026682523582
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.629026682523582
deviation-center-line_mean2.629026682523582
deviation-center-line_min2.629026682523582
deviation-heading_max13.136106027670944
deviation-heading_mean13.136106027670944
deviation-heading_median13.136106027670944
deviation-heading_min13.136106027670944
distance-from-start_max4.049457682715073
distance-from-start_mean4.049457682715073
distance-from-start_median4.049457682715073
distance-from-start_min4.049457682715073
driven_any_max8.94572086267216
driven_any_mean8.94572086267216
driven_any_median8.94572086267216
driven_any_min8.94572086267216
driven_lanedir_consec_max8.550255581517545
driven_lanedir_consec_mean8.550255581517545
driven_lanedir_consec_min8.550255581517545
driven_lanedir_max8.550255581517545
driven_lanedir_mean8.550255581517545
driven_lanedir_median8.550255581517545
driven_lanedir_min8.550255581517545
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.94572086267216, "survival_time": 59.99999999999873, "driven_lanedir": 8.550255581517545, "in-drivable-lane": 0.0, "deviation-heading": 13.136106027670944, "distance-from-start": 4.049457682715073, "deviation-center-line": 2.629026682523582, "driven_lanedir_consec": 8.550255581517545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7203620Bea Baselines 🐤baseline-duckietownaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-050:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median5.44999999999969
driven_lanedir_consec_median5.444089758464526
deviation-center-line_median2.3131548299354945


other stats
deviation-center-line_max2.3131548299354945
deviation-center-line_mean2.3131548299354945
deviation-center-line_min2.3131548299354945
deviation-heading_max10.280754438701177
deviation-heading_mean10.280754438701177
deviation-heading_median10.280754438701177
deviation-heading_min10.280754438701177
distance-from-start_max2.6601602259194608
distance-from-start_mean2.6601602259194608
distance-from-start_median2.6601602259194608
distance-from-start_min2.6601602259194608
driven_any_max7.914185273471783
driven_any_mean7.914185273471783
driven_any_median7.914185273471783
driven_any_min7.914185273471783
driven_lanedir_consec_max5.444089758464526
driven_lanedir_consec_mean5.444089758464526
driven_lanedir_consec_min5.444089758464526
driven_lanedir_max6.802383038085873
driven_lanedir_mean6.802383038085873
driven_lanedir_median6.802383038085873
driven_lanedir_min6.802383038085873
in-drivable-lane_max5.44999999999969
in-drivable-lane_mean5.44999999999969
in-drivable-lane_min5.44999999999969
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.914185273471783, "survival_time": 59.99999999999873, "driven_lanedir": 6.802383038085873, "in-drivable-lane": 5.44999999999969, "deviation-heading": 10.280754438701177, "distance-from-start": 2.6601602259194608, "deviation-center-line": 2.3131548299354945, "driven_lanedir_consec": 5.444089758464526}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7188605Bea Baselines 🐤template-rosaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-050:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.349999999999989
in-drivable-lane_median4.299999999999989
driven_lanedir_consec_median0.1840158596676389
deviation-center-line_median0.06714543602397065


other stats
deviation-center-line_max0.06714543602397065
deviation-center-line_mean0.06714543602397065
deviation-center-line_min0.06714543602397065
deviation-heading_max0.6025464963724084
deviation-heading_mean0.6025464963724084
deviation-heading_median0.6025464963724084
deviation-heading_min0.6025464963724084
distance-from-start_max1.2653207540750468
distance-from-start_mean1.2653207540750468
distance-from-start_median1.2653207540750468
distance-from-start_min1.2653207540750468
driven_any_max1.2931987791185344
driven_any_mean1.2931987791185344
driven_any_median1.2931987791185344
driven_any_min1.2931987791185344
driven_lanedir_consec_max0.1840158596676389
driven_lanedir_consec_mean0.1840158596676389
driven_lanedir_consec_min0.1840158596676389
driven_lanedir_max0.1840158596676389
driven_lanedir_mean0.1840158596676389
driven_lanedir_median0.1840158596676389
driven_lanedir_min0.1840158596676389
in-drivable-lane_max4.299999999999989
in-drivable-lane_mean4.299999999999989
in-drivable-lane_min4.299999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2931987791185344, "survival_time": 5.349999999999989, "driven_lanedir": 0.1840158596676389, "in-drivable-lane": 4.299999999999989, "deviation-heading": 0.6025464963724084, "distance-from-start": 1.2653207540750468, "deviation-center-line": 0.06714543602397065, "driven_lanedir_consec": 0.1840158596676389}}
simulation-passed1
survival_time_max5.349999999999989
survival_time_mean5.349999999999989
survival_time_min5.349999999999989
No reset possible
7182606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7172608Bea Baselines 🐤template-rosaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-050:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4690517209880749
survival_time_median7.199999999999982
deviation-center-line_median0.22162391498094888
in-drivable-lane_median4.749999999999985


other stats
deviation-center-line_max0.22162391498094888
deviation-center-line_mean0.22162391498094888
deviation-center-line_min0.22162391498094888
deviation-heading_max1.496260689730377
deviation-heading_mean1.496260689730377
deviation-heading_median1.496260689730377
deviation-heading_min1.496260689730377
distance-from-start_max1.80955341080668
distance-from-start_mean1.80955341080668
distance-from-start_median1.80955341080668
distance-from-start_min1.80955341080668
driven_any_max1.87397698622974
driven_any_mean1.87397698622974
driven_any_median1.87397698622974
driven_any_min1.87397698622974
driven_lanedir_consec_max0.4690517209880749
driven_lanedir_consec_mean0.4690517209880749
driven_lanedir_consec_min0.4690517209880749
driven_lanedir_max0.4690517209880749
driven_lanedir_mean0.4690517209880749
driven_lanedir_median0.4690517209880749
driven_lanedir_min0.4690517209880749
in-drivable-lane_max4.749999999999985
in-drivable-lane_mean4.749999999999985
in-drivable-lane_min4.749999999999985
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.87397698622974, "survival_time": 7.199999999999982, "driven_lanedir": 0.4690517209880749, "in-drivable-lane": 4.749999999999985, "deviation-heading": 1.496260689730377, "distance-from-start": 1.80955341080668, "deviation-center-line": 0.22162391498094888, "driven_lanedir_consec": 0.4690517209880749}}
simulation-passed1
survival_time_max7.199999999999982
survival_time_mean7.199999999999982
survival_time_min7.199999999999982
No reset possible
7164609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-0of4successnogpu-staging-spot-0-050:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median6.899999999999994
driven_lanedir_consec_median0.4645212103534889
deviation-center-line_median0.10116171281115977


other stats
deviation-center-line_max0.28497085883078077
deviation-center-line_mean0.14384266816963132
deviation-center-line_min0.08807638822542496
deviation-heading_max1.273728053529226
deviation-heading_mean0.755785042563103
deviation-heading_median0.6267556110116999
deviation-heading_min0.49590089469978593
distance-from-start_max2.310510199871953
distance-from-start_mean1.1147157551947182
distance-from-start_median0.8902932652402691
distance-from-start_min0.367766290426382
driven_any_max2.4330186662213205
driven_any_mean1.152167482367223
driven_any_median0.9031378256975312
driven_any_min0.36937561185250867
driven_lanedir_consec_max0.7269918095239629
driven_lanedir_consec_mean0.46463484643236475
driven_lanedir_consec_min0.20250515549851825
driven_lanedir_max0.7269918095239629
driven_lanedir_mean0.46463484643236475
driven_lanedir_median0.4645212103534889
driven_lanedir_min0.20250515549851825
in-drivable-lane_max7.899999999999992
in-drivable-lane_mean6.887499999999995
in-drivable-lane_min5.849999999999998
per-episodes
details{"udem-000-ego0": {"driven_any": 0.8191610467828665, "survival_time": 8.999999999999993, "driven_lanedir": 0.20767324198642356, "in-drivable-lane": 7.799999999999993, "deviation-heading": 0.6487258409729985, "distance-from-start": 0.8097927899883046, "deviation-center-line": 0.08807638822542496, "driven_lanedir_consec": 0.20767324198642356}, "udem-000-ego1": {"driven_any": 0.36937561185250867, "survival_time": 8.999999999999993, "driven_lanedir": 0.20250515549851825, "in-drivable-lane": 7.899999999999992, "deviation-heading": 0.49590089469978593, "distance-from-start": 0.367766290426382, "deviation-center-line": 0.102371624931173, "driven_lanedir_consec": 0.20250515549851825}, "udem-000-ego2": {"driven_any": 0.987114604612196, "survival_time": 8.999999999999993, "driven_lanedir": 0.7269918095239629, "in-drivable-lane": 5.999999999999996, "deviation-heading": 0.6047853810504012, "distance-from-start": 0.9707937404922335, "deviation-center-line": 0.09995180069114652, "driven_lanedir_consec": 0.7269918095239629}, "udem-000-ego3": {"driven_any": 2.4330186662213205, "survival_time": 8.999999999999993, "driven_lanedir": 0.7213691787205543, "in-drivable-lane": 5.849999999999998, "deviation-heading": 1.273728053529226, "distance-from-start": 2.310510199871953, "deviation-center-line": 0.28497085883078077, "driven_lanedir_consec": 0.7213691787205543}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
7122618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:12:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.000000000000001
driven_lanedir_consec_median1.245735589319224
deviation-center-line_median3.139803080380831


other stats
deviation-center-line_max7.154665685103163
deviation-center-line_mean3.778581167746081
deviation-center-line_min1.6800528251194988
deviation-heading_max62.914207392381265
deviation-heading_mean23.94445305952631
deviation-heading_median13.680168203742507
deviation-heading_min5.5032684382389565
distance-from-start_max3.0675242707432866
distance-from-start_mean1.5182707055683675
distance-from-start_median1.12406624201577
distance-from-start_min0.757426067498644
driven_any_max7.914344465625506
driven_any_mean3.0798638964199605
driven_any_median1.4949485225369756
driven_any_min1.4152140749803843
driven_lanedir_consec_max3.785357529615665
driven_lanedir_consec_mean1.7701652470702551
driven_lanedir_consec_min0.8038322800269082
driven_lanedir_max7.361059999506997
driven_lanedir_mean2.7717004414641107
driven_lanedir_median1.2638625034038224
driven_lanedir_min1.1980167595418014
in-drivable-lane_max1.7499999999999185
in-drivable-lane_mean1.0624999999999798
in-drivable-lane_min0.4999999999999982
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.4152885538305062, "survival_time": 59.99999999999873, "driven_lanedir": 1.234270587710998, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 5.5032684382389565, "distance-from-start": 0.757426067498644, "deviation-center-line": 1.6800528251194988, "driven_lanedir_consec": 0.8038322800269082}, "zigzag-000-ego1": {"driven_any": 1.4152140749803843, "survival_time": 59.99999999999873, "driven_lanedir": 1.1980167595418014, "in-drivable-lane": 0.7000000000000002, "deviation-heading": 62.914207392381265, "distance-from-start": 0.9744406799985218, "deviation-center-line": 2.435438166348777, "driven_lanedir_consec": 1.1980167595418014}, "zigzag-000-ego2": {"driven_any": 7.914344465625506, "survival_time": 59.99999999999873, "driven_lanedir": 7.361059999506997, "in-drivable-lane": 1.7499999999999185, "deviation-heading": 11.36044296893129, "distance-from-start": 3.0675242707432866, "deviation-center-line": 3.844167994412885, "driven_lanedir_consec": 3.785357529615665}, "zigzag-000-ego3": {"driven_any": 1.574608491243445, "survival_time": 59.99999999999873, "driven_lanedir": 1.2934544190966468, "in-drivable-lane": 1.3000000000000025, "deviation-heading": 15.999893438553723, "distance-from-start": 1.2736918040330183, "deviation-center-line": 7.154665685103163, "driven_lanedir_consec": 1.2934544190966468}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7115619Bea Baselines 🐤baseline-duckietownaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-050:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median36.40000000000007
in-drivable-lane_median10.699999999999823
driven_lanedir_consec_median3.172928666173384
deviation-center-line_median1.9477689970371015


other stats
deviation-center-line_max1.9477689970371015
deviation-center-line_mean1.9477689970371015
deviation-center-line_min1.9477689970371015
deviation-heading_max6.277426458509695
deviation-heading_mean6.277426458509695
deviation-heading_median6.277426458509695
deviation-heading_min6.277426458509695
distance-from-start_max3.041372754573938
distance-from-start_mean3.041372754573938
distance-from-start_median3.041372754573938
distance-from-start_min3.041372754573938
driven_any_max4.681482302198406
driven_any_mean4.681482302198406
driven_any_median4.681482302198406
driven_any_min4.681482302198406
driven_lanedir_consec_max3.172928666173384
driven_lanedir_consec_mean3.172928666173384
driven_lanedir_consec_min3.172928666173384
driven_lanedir_max3.172928666173384
driven_lanedir_mean3.172928666173384
driven_lanedir_median3.172928666173384
driven_lanedir_min3.172928666173384
in-drivable-lane_max10.699999999999823
in-drivable-lane_mean10.699999999999823
in-drivable-lane_min10.699999999999823
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.681482302198406, "survival_time": 36.40000000000007, "driven_lanedir": 3.172928666173384, "in-drivable-lane": 10.699999999999823, "deviation-heading": 6.277426458509695, "distance-from-start": 3.041372754573938, "deviation-center-line": 1.9477689970371015, "driven_lanedir_consec": 3.172928666173384}}
simulation-passed1
survival_time_max36.40000000000007
survival_time_mean36.40000000000007
survival_time_min36.40000000000007
No reset possible
7091624Bea Baselines 🐤baseline-duckietownaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-050:14:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median14.124999999999378
driven_lanedir_consec_median2.137872308093943
deviation-center-line_median3.856465208472094


other stats
deviation-center-line_max5.707156291244408
deviation-center-line_mean3.591620337879168
deviation-center-line_min0.9463946433280774
deviation-heading_max32.04466803391109
deviation-heading_mean16.233198477552577
deviation-heading_median14.55292124910558
deviation-heading_min3.782283378088059
distance-from-start_max2.135824216489251
distance-from-start_mean1.2550956879218755
distance-from-start_median1.1389536377170666
distance-from-start_min0.6066512597641183
driven_any_max7.913402410753937
driven_any_mean4.856686201006531
driven_any_median4.9395428518008515
driven_any_min1.6342566896704838
driven_lanedir_consec_max3.4346990272509412
driven_lanedir_consec_mean2.0972363520239226
driven_lanedir_consec_min0.6785017646568634
driven_lanedir_max6.280035081077646
driven_lanedir_mean3.444411313852411
driven_lanedir_median3.104375980368574
driven_lanedir_min1.2888582135948503
in-drivable-lane_max48.99999999999868
in-drivable-lane_mean19.849999999999355
in-drivable-lane_min2.1499999999999924
per-episodes
details{"4way-000-ego0": {"driven_any": 1.9661326255532603, "survival_time": 59.99999999999873, "driven_lanedir": 1.568469345943695, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 32.04466803391109, "distance-from-start": 1.0322190894137515, "deviation-center-line": 5.707156291244408, "driven_lanedir_consec": 1.4885109935319507}, "4way-000-ego1": {"driven_any": 7.913402410753937, "survival_time": 59.99999999999873, "driven_lanedir": 6.280035081077646, "in-drivable-lane": 7.849999999999689, "deviation-heading": 15.841135252959797, "distance-from-start": 1.2456881860203817, "deviation-center-line": 4.8963243059586725, "driven_lanedir_consec": 2.787233622655936}, "4way-000-ego2": {"driven_any": 1.6342566896704838, "survival_time": 59.99999999999873, "driven_lanedir": 1.2888582135948503, "in-drivable-lane": 48.99999999999868, "deviation-heading": 3.782283378088059, "distance-from-start": 0.6066512597641183, "deviation-center-line": 0.9463946433280774, "driven_lanedir_consec": 0.6785017646568634}, "4way-000-ego3": {"driven_any": 7.912953078048443, "survival_time": 59.99999999999873, "driven_lanedir": 4.640282614793453, "in-drivable-lane": 20.399999999999068, "deviation-heading": 13.264707245251364, "distance-from-start": 2.135824216489251, "deviation-center-line": 2.816606110985515, "driven_lanedir_consec": 3.4346990272509412}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7073646Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:14:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median55.24999999999872
driven_lanedir_consec_median0.46788276710076215
deviation-center-line_median0.3726391156797282


other stats
deviation-center-line_max1.945736961822745
deviation-center-line_mean0.7386573389102368
deviation-center-line_min0.26361416245874547
deviation-heading_max23.461341367925968
deviation-heading_mean8.095189804858226
deviation-heading_median3.4808314733116914
deviation-heading_min1.957754904883553
distance-from-start_max0.8321768633551266
distance-from-start_mean0.42809748475883336
distance-from-start_median0.3659364962035744
distance-from-start_min0.14834008327305792
driven_any_max3.412750665499255
driven_any_mean2.7300888480247947
driven_any_median2.6818617787387424
driven_any_min2.1438811691224395
driven_lanedir_consec_max0.8135203271847189
driven_lanedir_consec_mean0.5282618898898717
driven_lanedir_consec_min0.36376169817324344
driven_lanedir_max0.8135203271847189
driven_lanedir_mean0.5282618898898717
driven_lanedir_median0.46788276710076215
driven_lanedir_min0.36376169817324344
in-drivable-lane_max56.499999999998735
in-drivable-lane_mean49.349999999998886
in-drivable-lane_min30.399999999999338
per-episodes
details{"loop-000-ego0": {"driven_any": 2.9076895840446717, "survival_time": 59.99999999999873, "driven_lanedir": 0.8135203271847189, "in-drivable-lane": 30.399999999999338, "deviation-heading": 23.461341367925968, "distance-from-start": 0.14834008327305792, "deviation-center-line": 1.945736961822745, "driven_lanedir_consec": 0.8135203271847189}, "loop-000-ego1": {"driven_any": 2.456033973432813, "survival_time": 59.99999999999873, "driven_lanedir": 0.36376169817324344, "in-drivable-lane": 55.999999999998735, "deviation-heading": 2.9912459616694984, "distance-from-start": 0.3461687447749229, "deviation-center-line": 0.3800756990335472, "driven_lanedir_consec": 0.36376169817324344}, "loop-000-ego2": {"driven_any": 2.1438811691224395, "survival_time": 59.99999999999873, "driven_lanedir": 0.5121799122153654, "in-drivable-lane": 54.499999999998714, "deviation-heading": 3.970416984953884, "distance-from-start": 0.385704247632226, "deviation-center-line": 0.3652025323259092, "driven_lanedir_consec": 0.5121799122153654}, "loop-000-ego3": {"driven_any": 3.412750665499255, "survival_time": 59.99999999999873, "driven_lanedir": 0.4235856219861589, "in-drivable-lane": 56.499999999998735, "deviation-heading": 1.957754904883553, "distance-from-start": 0.8321768633551266, "deviation-center-line": 0.26361416245874547, "driven_lanedir_consec": 0.4235856219861589}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7057648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-050:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.79999999999874
in-drivable-lane_median31.049999999999347
driven_lanedir_consec_median2.9142738662648657
deviation-center-line_median2.5679008697259804


other stats
deviation-center-line_max2.5679008697259804
deviation-center-line_mean2.5679008697259804
deviation-center-line_min2.5679008697259804
deviation-heading_max20.91755656709889
deviation-heading_mean20.91755656709889
deviation-heading_median20.91755656709889
deviation-heading_min20.91755656709889
distance-from-start_max0.26929267196062473
distance-from-start_mean0.26929267196062473
distance-from-start_median0.26929267196062473
distance-from-start_min0.26929267196062473
driven_any_max8.791005575855426
driven_any_mean8.791005575855426
driven_any_median8.791005575855426
driven_any_min8.791005575855426
driven_lanedir_consec_max2.9142738662648657
driven_lanedir_consec_mean2.9142738662648657
driven_lanedir_consec_min2.9142738662648657
driven_lanedir_max2.9142738662648657
driven_lanedir_mean2.9142738662648657
driven_lanedir_median2.9142738662648657
driven_lanedir_min2.9142738662648657
in-drivable-lane_max31.049999999999347
in-drivable-lane_mean31.049999999999347
in-drivable-lane_min31.049999999999347
per-episodes
details{"loop-000-ego0": {"driven_any": 8.791005575855426, "survival_time": 59.79999999999874, "driven_lanedir": 2.9142738662648657, "in-drivable-lane": 31.049999999999347, "deviation-heading": 20.91755656709889, "distance-from-start": 0.26929267196062473, "deviation-center-line": 2.5679008697259804, "driven_lanedir_consec": 2.9142738662648657}}
simulation-passed1
survival_time_max59.79999999999874
survival_time_mean59.79999999999874
survival_time_min59.79999999999874
No reset possible
7054649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3499999999999996
in-drivable-lane_median1.1999999999999993
driven_lanedir_consec_median0.05070174960374496
deviation-center-line_median0.04445684073171848


other stats
deviation-center-line_max0.04445684073171848
deviation-center-line_mean0.04445684073171848
deviation-center-line_min0.04445684073171848
deviation-heading_max1.01430927624325
deviation-heading_mean1.01430927624325
deviation-heading_median1.01430927624325
deviation-heading_min1.01430927624325
distance-from-start_max0.1579943515251065
distance-from-start_mean0.1579943515251065
distance-from-start_median0.1579943515251065
distance-from-start_min0.1579943515251065
driven_any_max0.1855507130501214
driven_any_mean0.1855507130501214
driven_any_median0.1855507130501214
driven_any_min0.1855507130501214
driven_lanedir_consec_max0.05070174960374496
driven_lanedir_consec_mean0.05070174960374496
driven_lanedir_consec_min0.05070174960374496
driven_lanedir_max0.05070174960374496
driven_lanedir_mean0.05070174960374496
driven_lanedir_median0.05070174960374496
driven_lanedir_min0.05070174960374496
in-drivable-lane_max1.1999999999999993
in-drivable-lane_mean1.1999999999999993
in-drivable-lane_min1.1999999999999993
per-episodes
details{"udem-000-ego0": {"driven_any": 0.1855507130501214, "survival_time": 2.3499999999999996, "driven_lanedir": 0.05070174960374496, "in-drivable-lane": 1.1999999999999993, "deviation-heading": 1.01430927624325, "distance-from-start": 0.1579943515251065, "deviation-center-line": 0.04445684073171848, "driven_lanedir_consec": 0.05070174960374496}}
simulation-passed1
survival_time_max2.3499999999999996
survival_time_mean2.3499999999999996
survival_time_min2.3499999999999996
No reset possible
7052649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7048650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7043650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-0of4host-errornogpu-staging-spot-0-050:02:09
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/51887ca094d257a95c6c4fd5c7059816bb0129e6fd61e85ca5097467f98d8d93/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/51887ca094d257a95c6c4fd5c7059816bb0129e6fd61e85ca5097467f98d8d93/json: Not Found ("No such container: 51887ca094d257a95c6c4fd5c7059816bb0129e6fd61e85ca5097467f98d8d93")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7040650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-050:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.000000000000001
in-drivable-lane_median1.2000000000000008
driven_lanedir_consec_median0.03462770698831563
deviation-center-line_median0.019133779703883053


other stats
deviation-center-line_max0.019133779703883053
deviation-center-line_mean0.019133779703883053
deviation-center-line_min0.019133779703883053
deviation-heading_max0.6740869359405983
deviation-heading_mean0.6740869359405983
deviation-heading_median0.6740869359405983
deviation-heading_min0.6740869359405983
distance-from-start_max0.11543818418549996
distance-from-start_mean0.11543818418549996
distance-from-start_median0.11543818418549996
distance-from-start_min0.11543818418549996
driven_any_max0.14670628067646824
driven_any_mean0.14670628067646824
driven_any_median0.14670628067646824
driven_any_min0.14670628067646824
driven_lanedir_consec_max0.03462770698831563
driven_lanedir_consec_mean0.03462770698831563
driven_lanedir_consec_min0.03462770698831563
driven_lanedir_max0.03462770698831563
driven_lanedir_mean0.03462770698831563
driven_lanedir_median0.03462770698831563
driven_lanedir_min0.03462770698831563
in-drivable-lane_max1.2000000000000008
in-drivable-lane_mean1.2000000000000008
in-drivable-lane_min1.2000000000000008
per-episodes
details{"4way-000-ego0": {"driven_any": 0.14670628067646824, "survival_time": 2.000000000000001, "driven_lanedir": 0.03462770698831563, "in-drivable-lane": 1.2000000000000008, "deviation-heading": 0.6740869359405983, "distance-from-start": 0.11543818418549996, "deviation-center-line": 0.019133779703883053, "driven_lanedir_consec": 0.03462770698831563}}
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean2.000000000000001
survival_time_min2.000000000000001
No reset possible
7030651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-050:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.621652684612262
survival_time_median59.99999999999873
deviation-center-line_median1.5201007593946612
in-drivable-lane_median41.79999999999899


other stats
deviation-center-line_max1.5201007593946612
deviation-center-line_mean1.5201007593946612
deviation-center-line_min1.5201007593946612
deviation-heading_max14.379532370097886
deviation-heading_mean14.379532370097886
deviation-heading_median14.379532370097886
deviation-heading_min14.379532370097886
distance-from-start_max0.4441025867465513
distance-from-start_mean0.4441025867465513
distance-from-start_median0.4441025867465513
distance-from-start_min0.4441025867465513
driven_any_max13.546502348407492
driven_any_mean13.546502348407492
driven_any_median13.546502348407492
driven_any_min13.546502348407492
driven_lanedir_consec_max2.621652684612262
driven_lanedir_consec_mean2.621652684612262
driven_lanedir_consec_min2.621652684612262
driven_lanedir_max2.621652684612262
driven_lanedir_mean2.621652684612262
driven_lanedir_median2.621652684612262
driven_lanedir_min2.621652684612262
in-drivable-lane_max41.79999999999899
in-drivable-lane_mean41.79999999999899
in-drivable-lane_min41.79999999999899
per-episodes
details{"zigzag-000-ego0": {"driven_any": 13.546502348407492, "survival_time": 59.99999999999873, "driven_lanedir": 2.621652684612262, "in-drivable-lane": 41.79999999999899, "deviation-heading": 14.379532370097886, "distance-from-start": 0.4441025867465513, "deviation-center-line": 1.5201007593946612, "driven_lanedir_consec": 2.621652684612262}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7026651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-050:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.073608236687011
survival_time_median2.4499999999999993
deviation-center-line_median0.06287977798409419
in-drivable-lane_median1.349999999999999


other stats
deviation-center-line_max0.06287977798409419
deviation-center-line_mean0.06287977798409419
deviation-center-line_min0.06287977798409419
deviation-heading_max0.9619256914163852
deviation-heading_mean0.9619256914163852
deviation-heading_median0.9619256914163852
deviation-heading_min0.9619256914163852
distance-from-start_max0.232796055287597
distance-from-start_mean0.232796055287597
distance-from-start_median0.232796055287597
distance-from-start_min0.232796055287597
driven_any_max0.2736702325313868
driven_any_mean0.2736702325313868
driven_any_median0.2736702325313868
driven_any_min0.2736702325313868
driven_lanedir_consec_max0.073608236687011
driven_lanedir_consec_mean0.073608236687011
driven_lanedir_consec_min0.073608236687011
driven_lanedir_max0.073608236687011
driven_lanedir_mean0.073608236687011
driven_lanedir_median0.073608236687011
driven_lanedir_min0.073608236687011
in-drivable-lane_max1.349999999999999
in-drivable-lane_mean1.349999999999999
in-drivable-lane_min1.349999999999999
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.2736702325313868, "survival_time": 2.4499999999999993, "driven_lanedir": 0.073608236687011, "in-drivable-lane": 1.349999999999999, "deviation-heading": 0.9619256914163852, "distance-from-start": 0.232796055287597, "deviation-center-line": 0.06287977798409419, "driven_lanedir_consec": 0.073608236687011}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
7024652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-1of4host-errornogpu-staging-spot-0-050:01:23
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7022652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7021652Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-validationsim-0of4host-errornogpu-staging-spot-0-050:01:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
              ||   File "/submission/model.py", line 153, in __init__
              ||     self.actor = ActorCNN(action_dim, max_action).to(device)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
              ||     return self._apply(convert)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
              ||     module._apply(fn)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
              ||     param_applied = fn(param)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
              ||     return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
              || RuntimeError: CUDA error: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6988659Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-050:15:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.474999999998715
driven_lanedir_consec_median0.4805806161803051
deviation-center-line_median0.3876016831501041


other stats
deviation-center-line_max8.308699375180817
deviation-center-line_mean2.3259527554913424
deviation-center-line_min0.21990828048434463
deviation-heading_max45.798795255319426
deviation-heading_mean14.068622857138449
deviation-heading_median4.4645935837547395
deviation-heading_min1.546509005724894
distance-from-start_max0.8857031174268682
distance-from-start_mean0.4981285239155447
distance-from-start_median0.5002764599205223
distance-from-start_min0.10625805839426608
driven_any_max10.850860128635908
driven_any_mean3.712286216854644
driven_any_median1.385220095622918
driven_any_min1.2278445475368338
driven_lanedir_consec_max0.555657963969334
driven_lanedir_consec_mean0.44673197123207975
driven_lanedir_consec_min0.2701086885983748
driven_lanedir_max0.6317123542129728
driven_lanedir_mean0.4755917125371961
driven_lanedir_median0.5002729036687185
driven_lanedir_min0.2701086885983748
in-drivable-lane_max57.499999999998735
in-drivable-lane_mean41.97499999999904
in-drivable-lane_min3.449999999999992
per-episodes
details{"4way-000-ego0": {"driven_any": 1.3122156501579911, "survival_time": 59.99999999999873, "driven_lanedir": 0.44488784336810294, "in-drivable-lane": 52.04999999999869, "deviation-heading": 6.139841547072694, "distance-from-start": 0.10625805839426608, "deviation-center-line": 0.3410199634965726, "driven_lanedir_consec": 0.44488784336810294}, "4way-000-ego1": {"driven_any": 1.4582245410878445, "survival_time": 59.99999999999873, "driven_lanedir": 0.555657963969334, "in-drivable-lane": 3.449999999999992, "deviation-heading": 45.798795255319426, "distance-from-start": 0.8857031174268682, "deviation-center-line": 8.308699375180817, "driven_lanedir_consec": 0.555657963969334}, "4way-000-ego2": {"driven_any": 10.850860128635908, "survival_time": 59.99999999999873, "driven_lanedir": 0.2701086885983748, "in-drivable-lane": 57.499999999998735, "deviation-heading": 1.546509005724894, "distance-from-start": 0.6639490317853866, "deviation-center-line": 0.21990828048434463, "driven_lanedir_consec": 0.2701086885983748}, "4way-000-ego3": {"driven_any": 1.2278445475368338, "survival_time": 59.99999999999873, "driven_lanedir": 0.6317123542129728, "in-drivable-lane": 54.89999999999874, "deviation-heading": 2.7893456204367837, "distance-from-start": 0.33660388805565794, "deviation-center-line": 0.43418340280363565, "driven_lanedir_consec": 0.5162733889925073}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6981660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6978661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6975661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-3of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6969662Bea Baselines 🐤template-tensorflowaido-LFV-sim-validationsim-2of4failednogpu-staging-spot-0-050:01:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6963663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6956664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6953665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-3of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6949666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6946667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-3of4failednogpu-staging-spot-0-050:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6942668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-0of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6936668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-2of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6932793Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6928794Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6910703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median15.50000000000015
driven_lanedir_consec_median0.2523502432780965
deviation-center-line_median0.4270318356067208


other stats
deviation-center-line_max2.4472420705619533
deviation-center-line_mean0.834439744050357
deviation-center-line_min0.03645323442603294
deviation-heading_max5.758343124435709
deviation-heading_mean2.9647842264649227
deviation-heading_median2.4959523963356456
deviation-heading_min1.1088889887526905
distance-from-start_max0.735788357677379
distance-from-start_mean0.4455427430503656
distance-from-start_median0.3918367385500151
distance-from-start_min0.26270913742405294
driven_any_max5.001991003394667
driven_any_mean1.5256410869454424
driven_any_median0.4116848275607308
driven_any_min0.277203689265641
driven_lanedir_consec_max0.2737815745175769
driven_lanedir_consec_mean0.21260926710351993
driven_lanedir_consec_min0.07195500734030984
driven_lanedir_max0.25840198320624896
driven_lanedir_mean0.2081068961174864
driven_lanedir_median0.25103529696169347
driven_lanedir_min0.07195500734030984
in-drivable-lane_max19.05000000000016
in-drivable-lane_mean12.737500000000114
in-drivable-lane_min0.8999999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.001991003394667, "survival_time": 20.70000000000016, "driven_lanedir": 0.25577209057344286, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.758343124435709, "distance-from-start": 0.735788357677379, "deviation-center-line": 0.7687325001714215, "driven_lanedir_consec": 0.2737815745175769}, "zigzag-000-ego1": {"driven_any": 0.27720368926578076, "survival_time": 20.70000000000016, "driven_lanedir": 0.24629850334994408, "in-drivable-lane": 18.85000000000016, "deviation-heading": 1.2379708953066022, "distance-from-start": 0.26270913742405294, "deviation-center-line": 0.08533117104202012, "driven_lanedir_consec": 0.24629850334994408}, "zigzag-000-ego2": {"driven_any": 0.277203689265641, "survival_time": 20.70000000000016, "driven_lanedir": 0.25840198320624896, "in-drivable-lane": 0.8999999999999998, "deviation-heading": 3.7539338973646887, "distance-from-start": 0.262709137424054, "deviation-center-line": 2.4472420705619533, "driven_lanedir_consec": 0.25840198320624896}, "zigzag-000-ego3": {"driven_any": 0.5461659658556808, "survival_time": 20.70000000000016, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 19.05000000000016, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
6907673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-1of4failednogpu-staging-spot-0-050:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6895709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-1of4successnogpu-staging-spot-0-050:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.85000000000026
in-drivable-lane_median23.575000000000244
driven_lanedir_consec_median0.2152178291743677
deviation-center-line_median0.34607680035313926


other stats
deviation-center-line_max0.7555295762526522
deviation-center-line_mean0.3831880038858158
deviation-center-line_min0.0850688385843324
deviation-heading_max5.523299013646982
deviation-heading_mean2.976848653346106
deviation-heading_median2.577175729127456
deviation-heading_min1.229744141482529
distance-from-start_max0.8413577961802242
distance-from-start_mean0.6171534020652945
distance-from-start_median0.6122000908884857
distance-from-start_min0.4028556303039823
driven_any_max6.724613878580574
driven_any_mean3.448516774187835
driven_any_median3.322688383943399
driven_any_min0.4240764502839678
driven_lanedir_consec_max0.3926134494082678
driven_lanedir_consec_mean0.23172102279300744
driven_lanedir_consec_min0.10383498341502671
driven_lanedir_max0.3926134494082678
driven_lanedir_mean0.22283655208020933
driven_lanedir_median0.1995874449338097
driven_lanedir_min0.09955786904495012
in-drivable-lane_max25.750000000000263
in-drivable-lane_mean23.05000000000025
in-drivable-lane_min19.30000000000024
per-episodes
details{"4way-000-ego0": {"driven_any": 6.724613878580574, "survival_time": 27.85000000000026, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 19.30000000000024, "deviation-heading": 5.523299013646982, "distance-from-start": 0.8413577961802242, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}, "4way-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 27.85000000000026, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 25.750000000000263, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "4way-000-ego2": {"driven_any": 4.117732239446978, "survival_time": 27.85000000000026, "driven_lanedir": 0.14953810859089212, "in-drivable-lane": 22.75000000000024, "deviation-heading": 2.8042483888415783, "distance-from-start": 0.6736010379604935, "deviation-center-line": 0.4035531580478341, "driven_lanedir_consec": 0.16278581684885107}, "4way-000-ego3": {"driven_any": 2.527644528439821, "survival_time": 27.85000000000026, "driven_lanedir": 0.09955786904495012, "in-drivable-lane": 24.40000000000025, "deviation-heading": 2.350103069413334, "distance-from-start": 0.5507991438164779, "deviation-center-line": 0.2886004426584445, "driven_lanedir_consec": 0.10383498341502671}}
simulation-passed1
survival_time_max27.85000000000026
survival_time_mean27.85000000000026
survival_time_min27.85000000000026
No reset possible
6892704Bea Baselines 🐤template-randomaido-LFP-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.7499999999999805
in-drivable-lane_median3.74999999999999
driven_lanedir_consec_median0.3176161276974132
deviation-center-line_median0.27533253301389016


other stats
deviation-center-line_max0.27533253301389016
deviation-center-line_mean0.27533253301389016
deviation-center-line_min0.27533253301389016
deviation-heading_max3.128947285557921
deviation-heading_mean3.128947285557921
deviation-heading_median3.128947285557921
deviation-heading_min3.128947285557921
distance-from-start_max0.5223892996766406
distance-from-start_mean0.5223892996766406
distance-from-start_median0.5223892996766406
distance-from-start_min0.5223892996766406
driven_any_max1.4596542667951202
driven_any_mean1.4596542667951202
driven_any_median1.4596542667951202
driven_any_min1.4596542667951202
driven_lanedir_consec_max0.3176161276974132
driven_lanedir_consec_mean0.3176161276974132
driven_lanedir_consec_min0.3176161276974132
driven_lanedir_max0.3176161276974132
driven_lanedir_mean0.3176161276974132
driven_lanedir_median0.3176161276974132
driven_lanedir_min0.3176161276974132
in-drivable-lane_max3.74999999999999
in-drivable-lane_mean3.74999999999999
in-drivable-lane_min3.74999999999999
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.4596542667951202, "survival_time": 7.7499999999999805, "driven_lanedir": 0.3176161276974132, "in-drivable-lane": 3.74999999999999, "deviation-heading": 3.128947285557921, "distance-from-start": 0.5223892996766406, "deviation-center-line": 0.27533253301389016, "driven_lanedir_consec": 0.3176161276974132}}
simulation-passed1
survival_time_max7.7499999999999805
survival_time_mean7.7499999999999805
survival_time_min7.7499999999999805
No reset possible
6874734Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-050:11:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0001430511474609375
deviation-center-line_median0.8949084199909547


other stats
deviation-center-line_max0.8949084199909547
deviation-center-line_mean0.8949084199909547
deviation-center-line_min0.8949084199909547
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max9.714451465470121e-17
distance-from-start_mean9.714451465470121e-17
distance-from-start_median9.714451465470121e-17
distance-from-start_min9.714451465470121e-17
driven_any_max1.1657341758564146e-13
driven_any_mean1.1657341758564146e-13
driven_any_median1.1657341758564146e-13
driven_any_min1.1657341758564146e-13
driven_lanedir_consec_max0.0001430511474609375
driven_lanedir_consec_mean0.0001430511474609375
driven_lanedir_consec_min0.0001430511474609375
driven_lanedir_max0.0001430511474609375
driven_lanedir_mean0.0001430511474609375
driven_lanedir_median0.0001430511474609375
driven_lanedir_min0.0001430511474609375
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.1657341758564146e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 9.714451465470121e-17, "deviation-center-line": 0.8949084199909547, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6871708Bea Baselines 🐤template-randomaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-050:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718431750312411
survival_time_median45.099999999999575
deviation-center-line_median0.765552090953893
in-drivable-lane_median36.54999999999956


other stats
deviation-center-line_max0.765552090953893
deviation-center-line_mean0.765552090953893
deviation-center-line_min0.765552090953893
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max1.0442247976691916
distance-from-start_mean1.0442247976691916
distance-from-start_median1.0442247976691916
distance-from-start_min1.0442247976691916
driven_any_max11.376062002465076
driven_any_mean11.376062002465076
driven_any_median11.376062002465076
driven_any_min11.376062002465076
driven_lanedir_consec_max0.2718431750312411
driven_lanedir_consec_mean0.2718431750312411
driven_lanedir_consec_min0.2718431750312411
driven_lanedir_max0.25383249899423177
driven_lanedir_mean0.25383249899423177
driven_lanedir_median0.25383249899423177
driven_lanedir_min0.25383249899423177
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465076, "survival_time": 45.099999999999575, "driven_lanedir": 0.25383249899423177, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.0442247976691916, "deviation-center-line": 0.765552090953893, "driven_lanedir_consec": 0.2718431750312411}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
6869709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6866709Bea Baselines 🐤template-randomaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6861713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-050:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02948511522371433
deviation-center-line_median0.3268413798803088


other stats
deviation-center-line_max0.3268413798803088
deviation-center-line_mean0.3268413798803088
deviation-center-line_min0.3268413798803088
deviation-heading_max2.54887264951439
deviation-heading_mean2.54887264951439
deviation-heading_median2.54887264951439
deviation-heading_min2.54887264951439
distance-from-start_max0.5461575079396541
distance-from-start_mean0.5461575079396541
distance-from-start_median0.5461575079396541
distance-from-start_min0.5461575079396541
driven_any_max2.2955250818765145
driven_any_mean2.2955250818765145
driven_any_median2.2955250818765145
driven_any_min2.2955250818765145
driven_lanedir_consec_max0.02948511522371433
driven_lanedir_consec_mean0.02948511522371433
driven_lanedir_consec_min0.02948511522371433
driven_lanedir_max0.03283062285727567
driven_lanedir_mean0.03283062285727567
driven_lanedir_median0.03283062285727567
driven_lanedir_min0.03283062285727567
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"udem-000-ego0": {"driven_any": 2.2955250818765145, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283062285727567, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.54887264951439, "distance-from-start": 0.5461575079396541, "deviation-center-line": 0.3268413798803088, "driven_lanedir_consec": 0.02948511522371433}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
6854711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-2of4successnogpu-staging-spot-0-050:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.850000000000104
in-drivable-lane_median12.350000000000078
driven_lanedir_consec_median0.03297699806626109
deviation-center-line_median0.4050305988545377


other stats
deviation-center-line_max0.4050305988545377
deviation-center-line_mean0.4050305988545377
deviation-center-line_min0.4050305988545377
deviation-heading_max3.4318871778555886
deviation-heading_mean3.4318871778555886
deviation-heading_median3.4318871778555886
deviation-heading_min3.4318871778555886
distance-from-start_max0.673601037960496
distance-from-start_mean0.673601037960496
distance-from-start_median0.673601037960496
distance-from-start_min0.673601037960496
driven_any_max4.0578227584594435
driven_any_mean4.0578227584594435
driven_any_median4.0578227584594435
driven_any_min4.0578227584594435
driven_lanedir_consec_max0.03297699806626109
driven_lanedir_consec_mean0.03297699806626109
driven_lanedir_consec_min0.03297699806626109
driven_lanedir_max0.036323340164895024
driven_lanedir_mean0.036323340164895024
driven_lanedir_median0.036323340164895024
driven_lanedir_min0.036323340164895024
in-drivable-lane_max12.350000000000078
in-drivable-lane_mean12.350000000000078
in-drivable-lane_min12.350000000000078
per-episodes
details{"loop-000-ego0": {"driven_any": 4.0578227584594435, "survival_time": 16.850000000000104, "driven_lanedir": 0.036323340164895024, "in-drivable-lane": 12.350000000000078, "deviation-heading": 3.4318871778555886, "distance-from-start": 0.673601037960496, "deviation-center-line": 0.4050305988545377, "driven_lanedir_consec": 0.03297699806626109}}
simulation-passed1
survival_time_max16.850000000000104
survival_time_mean16.850000000000104
survival_time_min16.850000000000104
No reset possible
6834732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-4.299721525491407e-05
deviation-center-line_median1.511718550059415


other stats
deviation-center-line_max2.9467617678498437
deviation-center-line_mean1.5769838576829665
deviation-center-line_min0.33773656276319197
deviation-heading_max32.249113233675025
deviation-heading_mean22.839465954359294
deviation-heading_median22.597238933513907
deviation-heading_min13.91427271673436
distance-from-start_max9.155133597044477e-16
distance-from-start_mean5.3805908476715e-16
distance-from-start_median6.183614896820762e-16
distance-from-start_min0.0
driven_any_max1.0986160316453499e-12
driven_any_mean6.456709017205911e-13
driven_any_median7.420337876185071e-13
driven_any_min0.0
driven_lanedir_consec_max4.4323372971888375e-06
driven_lanedir_consec_mean-9.191609703362856e-05
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max4.4323372971888375e-06
driven_lanedir_mean-9.191609703362856e-05
driven_lanedir_median-4.299721525491407e-05
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.9968028886505635e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 3.3306690738754696e-16, "deviation-center-line": 0.8949424300958599, "driven_lanedir_consec": 0.0}, "zigzag-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -8.599443050982813e-05, "in-drivable-lane": 0.0, "deviation-heading": 30.71291327085948, "distance-from-start": 0.0, "deviation-center-line": 2.1284946700229703, "driven_lanedir_consec": -8.599443050982813e-05}, "zigzag-000-ego2": {"driven_any": 1.084387286371958e-12, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 9.036560719766057e-16, "deviation-center-line": 2.9467617678498437, "driven_lanedir_consec": -0.000286102294921875}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6826733Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-validationsim-1of4successnogpu-staging-spot-0-050:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-0.000286102294921875
deviation-center-line_median0.8948943425962731


other stats
deviation-center-line_max0.8948943425962731
deviation-center-line_mean0.8948943425962731
deviation-center-line_min0.8948943425962731
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max1.1102230246251563e-16
distance-from-start_mean1.1102230246251563e-16
distance-from-start_median1.1102230246251563e-16
distance-from-start_min1.1102230246251563e-16
driven_any_max1.3322676295501878e-13
driven_any_mean1.3322676295501878e-13
driven_any_median1.3322676295501878e-13
driven_any_min1.3322676295501878e-13
driven_lanedir_consec_max-0.000286102294921875
driven_lanedir_consec_mean-0.000286102294921875
driven_lanedir_consec_min-0.000286102294921875
driven_lanedir_max-0.000286102294921875
driven_lanedir_mean-0.000286102294921875
driven_lanedir_median-0.000286102294921875
driven_lanedir_min-0.000286102294921875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 0.8948943425962731, "driven_lanedir_consec": -0.000286102294921875}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6806735Bea Baselines 🐤baseline-duckietown-mlaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-050:13:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949025646750288


other stats
deviation-center-line_max0.8949025646750288
deviation-center-line_mean0.8949025646750288
deviation-center-line_min0.8949025646750288
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949025646750288, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6796766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-050:05:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6794768Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484aido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-050:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.009010755893414046
deviation-center-line_median0.006990485268449422


other stats
deviation-center-line_max0.006990485268449422
deviation-center-line_mean0.006990485268449422
deviation-center-line_min0.006990485268449422
deviation-heading_max0.2680381095512815
deviation-heading_mean0.2680381095512815
deviation-heading_median0.2680381095512815
deviation-heading_min0.2680381095512815
distance-from-start_max0.010496569257424575
distance-from-start_mean0.010496569257424575
distance-from-start_median0.010496569257424575
distance-from-start_min0.010496569257424575
driven_any_max0.010496999549648445
driven_any_mean0.010496999549648445
driven_any_median0.010496999549648445
driven_any_min0.010496999549648445
driven_lanedir_consec_max0.009010755893414046
driven_lanedir_consec_mean0.009010755893414046
driven_lanedir_consec_min0.009010755893414046
driven_lanedir_max0.009010755893414046
driven_lanedir_mean0.009010755893414046
driven_lanedir_median0.009010755893414046
driven_lanedir_min0.009010755893414046
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.010496999549648445, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009010755893414046, "in-drivable-lane": 0.0, "deviation-heading": 0.2680381095512815, "distance-from-start": 0.010496569257424575, "deviation-center-line": 0.006990485268449422, "driven_lanedir_consec": 0.009010755893414046}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
6778771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-050:12:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.44999999999986
driven_lanedir_consec_median4.615504126806485
deviation-center-line_median3.394640305239066


other stats
deviation-center-line_max3.394640305239066
deviation-center-line_mean3.394640305239066
deviation-center-line_min3.394640305239066
deviation-heading_max12.550997609311144
deviation-heading_mean12.550997609311144
deviation-heading_median12.550997609311144
deviation-heading_min12.550997609311144
distance-from-start_max1.7052126198924942
distance-from-start_mean1.7052126198924942
distance-from-start_median1.7052126198924942
distance-from-start_min1.7052126198924942
driven_any_max7.914310160480019
driven_any_mean7.914310160480019
driven_any_median7.914310160480019
driven_any_min7.914310160480019
driven_lanedir_consec_max4.615504126806485
driven_lanedir_consec_mean4.615504126806485
driven_lanedir_consec_min4.615504126806485
driven_lanedir_max6.920352797245563
driven_lanedir_mean6.920352797245563
driven_lanedir_median6.920352797245563
driven_lanedir_min6.920352797245563
in-drivable-lane_max4.44999999999986
in-drivable-lane_mean4.44999999999986
in-drivable-lane_min4.44999999999986
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.914310160480019, "survival_time": 59.99999999999873, "driven_lanedir": 6.920352797245563, "in-drivable-lane": 4.44999999999986, "deviation-heading": 12.550997609311144, "distance-from-start": 1.7052126198924942, "deviation-center-line": 3.394640305239066, "driven_lanedir_consec": 4.615504126806485}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6776771Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.699999999999981
in-drivable-lane_median1.7499999999999938
driven_lanedir_consec_median0.5857465328027669
deviation-center-line_median0.365201599280104


other stats
deviation-center-line_max0.365201599280104
deviation-center-line_mean0.365201599280104
deviation-center-line_min0.365201599280104
deviation-heading_max2.0331470098551425
deviation-heading_mean2.0331470098551425
deviation-heading_median2.0331470098551425
deviation-heading_min2.0331470098551425
distance-from-start_max0.6732378222434715
distance-from-start_mean0.6732378222434715
distance-from-start_median0.6732378222434715
distance-from-start_min0.6732378222434715
driven_any_max0.8776056049778543
driven_any_mean0.8776056049778543
driven_any_median0.8776056049778543
driven_any_min0.8776056049778543
driven_lanedir_consec_max0.5857465328027669
driven_lanedir_consec_mean0.5857465328027669
driven_lanedir_consec_min0.5857465328027669
driven_lanedir_max0.5857465328027669
driven_lanedir_mean0.5857465328027669
driven_lanedir_median0.5857465328027669
driven_lanedir_min0.5857465328027669
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean1.7499999999999938
in-drivable-lane_min1.7499999999999938
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8776056049778543, "survival_time": 7.699999999999981, "driven_lanedir": 0.5857465328027669, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 2.0331470098551425, "distance-from-start": 0.6732378222434715, "deviation-center-line": 0.365201599280104, "driven_lanedir_consec": 0.5857465328027669}}
simulation-passed1
survival_time_max7.699999999999981
survival_time_mean7.699999999999981
survival_time_min7.699999999999981
No reset possible
6768772Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-050:03:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.6
in-drivable-lane_median0.7499999999999973
driven_lanedir_consec_median0.7014772054438514
deviation-center-line_median0.7123280442376968


other stats
deviation-center-line_max0.7123280442376968
deviation-center-line_mean0.7123280442376968
deviation-center-line_min0.7123280442376968
deviation-heading_max4.540856349897717
deviation-heading_mean4.540856349897717
deviation-heading_median4.540856349897717
deviation-heading_min4.540856349897717
distance-from-start_max0.6593301385869229
distance-from-start_mean0.6593301385869229
distance-from-start_median0.6593301385869229
distance-from-start_min0.6593301385869229
driven_any_max1.1297791716671142
driven_any_mean1.1297791716671142
driven_any_median1.1297791716671142
driven_any_min1.1297791716671142
driven_lanedir_consec_max0.7014772054438514
driven_lanedir_consec_mean0.7014772054438514
driven_lanedir_consec_min0.7014772054438514
driven_lanedir_max0.8609067414890313
driven_lanedir_mean0.8609067414890313
driven_lanedir_median0.8609067414890313
driven_lanedir_min0.8609067414890313
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.7499999999999973
per-episodes
details{"udem-000-ego0": {"driven_any": 1.1297791716671142, "survival_time": 9.6, "driven_lanedir": 0.8609067414890313, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 4.540856349897717, "distance-from-start": 0.6593301385869229, "deviation-center-line": 0.7123280442376968, "driven_lanedir_consec": 0.7014772054438514}}
simulation-passed1
survival_time_max9.6
survival_time_mean9.6
survival_time_min9.6
No reset possible
6759773Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-050:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median26.900000000000247
in-drivable-lane_median1.3000000000000185
driven_lanedir_consec_median1.6987797968897576
deviation-center-line_median2.160477839907831


other stats
deviation-center-line_max2.160477839907831
deviation-center-line_mean2.160477839907831
deviation-center-line_min2.160477839907831
deviation-heading_max7.712205850381222
deviation-heading_mean7.712205850381222
deviation-heading_median7.712205850381222
deviation-heading_min7.712205850381222
distance-from-start_max1.8494560625357783
distance-from-start_mean1.8494560625357783
distance-from-start_median1.8494560625357783
distance-from-start_min1.8494560625357783
driven_any_max3.420083558307753
driven_any_mean3.420083558307753
driven_any_median3.420083558307753
driven_any_min3.420083558307753
driven_lanedir_consec_max1.6987797968897576
driven_lanedir_consec_mean1.6987797968897576
driven_lanedir_consec_min1.6987797968897576
driven_lanedir_max2.9847528783079316
driven_lanedir_mean2.9847528783079316
driven_lanedir_median2.9847528783079316
driven_lanedir_min2.9847528783079316
in-drivable-lane_max1.3000000000000185
in-drivable-lane_mean1.3000000000000185
in-drivable-lane_min1.3000000000000185
per-episodes
details{"4way-000-ego0": {"driven_any": 3.420083558307753, "survival_time": 26.900000000000247, "driven_lanedir": 2.9847528783079316, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 7.712205850381222, "distance-from-start": 1.8494560625357783, "deviation-center-line": 2.160477839907831, "driven_lanedir_consec": 1.6987797968897576}}
simulation-passed1
survival_time_max26.900000000000247
survival_time_mean26.900000000000247
survival_time_min26.900000000000247
No reset possible
6755774Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-050:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.651768030349019
survival_time_median59.99999999999873
deviation-center-line_median3.1771818802884915
in-drivable-lane_median19.699999999999836


other stats
deviation-center-line_max3.1771818802884915
deviation-center-line_mean3.1771818802884915
deviation-center-line_min3.1771818802884915
deviation-heading_max10.650406796872408
deviation-heading_mean10.650406796872408
deviation-heading_median10.650406796872408
deviation-heading_min10.650406796872408
distance-from-start_max1.0797210991384416
distance-from-start_mean1.0797210991384416
distance-from-start_median1.0797210991384416
distance-from-start_min1.0797210991384416
driven_any_max7.900878310054819
driven_any_mean7.900878310054819
driven_any_median7.900878310054819
driven_any_min7.900878310054819
driven_lanedir_consec_max3.651768030349019
driven_lanedir_consec_mean3.651768030349019
driven_lanedir_consec_min3.651768030349019
driven_lanedir_max4.9051110162416895
driven_lanedir_mean4.9051110162416895
driven_lanedir_median4.9051110162416895
driven_lanedir_min4.9051110162416895
in-drivable-lane_max19.699999999999836
in-drivable-lane_mean19.699999999999836
in-drivable-lane_min19.699999999999836
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.900878310054819, "survival_time": 59.99999999999873, "driven_lanedir": 4.9051110162416895, "in-drivable-lane": 19.699999999999836, "deviation-heading": 10.650406796872408, "distance-from-start": 1.0797210991384416, "deviation-center-line": 3.1771818802884915, "driven_lanedir_consec": 3.651768030349019}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6752775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6750775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6739776Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-050:12:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.90000000000032
in-drivable-lane_median1.050000000000015
driven_lanedir_consec_median1.3162419724433307
deviation-center-line_median2.0046413081466703


other stats
deviation-center-line_max2.5360616274949193
deviation-center-line_mean1.7042870194781483
deviation-center-line_min0.27180383412433234
deviation-heading_max19.543096692857684
deviation-heading_mean8.116702875804636
deviation-heading_median5.485362202226548
deviation-heading_min1.9529904059077647
distance-from-start_max1.9359363582603917
distance-from-start_mean1.0301738077998692
distance-from-start_median1.0848371100139873
distance-from-start_min0.015084652911110831
driven_any_max4.090377718951975
driven_any_mean2.377712659367176
driven_any_median2.702694024540792
driven_any_min0.015084869435144395
driven_lanedir_consec_max3.4209562818668653
driven_lanedir_consec_mean1.5163810252433194
driven_lanedir_consec_min0.012083874219751324
driven_lanedir_max3.5361596883291444
driven_lanedir_mean1.5451818768588892
driven_lanedir_median1.3162419724433307
driven_lanedir_min0.012083874219751324
in-drivable-lane_max26.100000000000332
in-drivable-lane_mean7.05000000000009
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.3727026701025205, "survival_time": 31.90000000000032, "driven_lanedir": 0.6523764119577261, "in-drivable-lane": 26.100000000000332, "deviation-heading": 1.9529904059077647, "distance-from-start": 0.7266345779247994, "deviation-center-line": 0.27180383412433234, "driven_lanedir_consec": 0.6523764119577261}, "zigzag-000-ego1": {"driven_any": 4.090377718951975, "survival_time": 31.90000000000032, "driven_lanedir": 3.5361596883291444, "in-drivable-lane": 2.10000000000003, "deviation-heading": 7.825780678239999, "distance-from-start": 1.9359363582603917, "deviation-center-line": 2.067122031685426, "driven_lanedir_consec": 3.4209562818668653}, "zigzag-000-ego2": {"driven_any": 2.032685378979063, "survival_time": 31.90000000000032, "driven_lanedir": 1.9801075329289353, "in-drivable-lane": 0.0, "deviation-heading": 3.1449437262130964, "distance-from-start": 1.4430396421031753, "deviation-center-line": 2.5360616274949193, "driven_lanedir_consec": 1.9801075329289353}, "zigzag-000-ego3": {"driven_any": 0.015084869435144395, "survival_time": 31.90000000000032, "driven_lanedir": 0.012083874219751324, "in-drivable-lane": 0.0, "deviation-heading": 19.543096692857684, "distance-from-start": 0.015084652911110831, "deviation-center-line": 1.9421605846079149, "driven_lanedir_consec": 0.012083874219751324}}
simulation-passed1
survival_time_max31.90000000000032
survival_time_mean31.90000000000032
survival_time_min31.90000000000032
No reset possible
6680775Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-0of4timeoutnogpu-staging-spot-0-05----No reset possible
6672777Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-050:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median32.15000000000031
in-drivable-lane_median0.9999999999999964
driven_lanedir_consec_median3.8558268103702193
deviation-center-line_median2.4730974822161462


other stats
deviation-center-line_max2.4730974822161462
deviation-center-line_mean2.4730974822161462
deviation-center-line_min2.4730974822161462
deviation-heading_max5.773639905979879
deviation-heading_mean5.773639905979879
deviation-heading_median5.773639905979879
deviation-heading_min5.773639905979879
distance-from-start_max2.761916029158148
distance-from-start_mean2.761916029158148
distance-from-start_median2.761916029158148
distance-from-start_min2.761916029158148
driven_any_max4.117201622270097
driven_any_mean4.117201622270097
driven_any_median4.117201622270097
driven_any_min4.117201622270097
driven_lanedir_consec_max3.8558268103702193
driven_lanedir_consec_mean3.8558268103702193
driven_lanedir_consec_min3.8558268103702193
driven_lanedir_max3.8558268103702193
driven_lanedir_mean3.8558268103702193
driven_lanedir_median3.8558268103702193
driven_lanedir_min3.8558268103702193
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0.9999999999999964
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.117201622270097, "survival_time": 32.15000000000031, "driven_lanedir": 3.8558268103702193, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 5.773639905979879, "distance-from-start": 2.761916029158148, "deviation-center-line": 2.4730974822161462, "driven_lanedir_consec": 3.8558268103702193}}
simulation-passed1
survival_time_max32.15000000000031
survival_time_mean32.15000000000031
survival_time_min32.15000000000031
No reset possible
6662778Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-3of4successnogpu-staging-spot-0-050:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.550000000000072
in-drivable-lane_median4.000000000000048
driven_lanedir_consec_median1.0405054550569586
deviation-center-line_median0.7135609435622537


other stats
deviation-center-line_max0.7135609435622537
deviation-center-line_mean0.7135609435622537
deviation-center-line_min0.7135609435622537
deviation-heading_max4.471565529464819
deviation-heading_mean4.471565529464819
deviation-heading_median4.471565529464819
deviation-heading_min4.471565529464819
distance-from-start_max0.823490304577722
distance-from-start_mean0.823490304577722
distance-from-start_median0.823490304577722
distance-from-start_min0.823490304577722
driven_any_max1.7869097782332166
driven_any_mean1.7869097782332166
driven_any_median1.7869097782332166
driven_any_min1.7869097782332166
driven_lanedir_consec_max1.0405054550569586
driven_lanedir_consec_mean1.0405054550569586
driven_lanedir_consec_min1.0405054550569586
driven_lanedir_max1.14508256397394
driven_lanedir_mean1.14508256397394
driven_lanedir_median1.14508256397394
driven_lanedir_min1.14508256397394
in-drivable-lane_max4.000000000000048
in-drivable-lane_mean4.000000000000048
in-drivable-lane_min4.000000000000048
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.7869097782332166, "survival_time": 14.550000000000072, "driven_lanedir": 1.14508256397394, "in-drivable-lane": 4.000000000000048, "deviation-heading": 4.471565529464819, "distance-from-start": 0.823490304577722, "deviation-center-line": 0.7135609435622537, "driven_lanedir_consec": 1.0405054550569586}}
simulation-passed1
survival_time_max14.550000000000072
survival_time_mean14.550000000000072
survival_time_min14.550000000000072
No reset possible
6640782Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-050:12:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.649999999999994
driven_lanedir_consec_median0.7488264404513044
deviation-center-line_median6.00870542769128


other stats
deviation-center-line_max9.629946152468154
deviation-center-line_mean6.682825635305575
deviation-center-line_min5.083945533371585
deviation-heading_max44.85172382606952
deviation-heading_mean20.876602609705685
deviation-heading_median15.906217702717033
deviation-heading_min6.842251207319144
distance-from-start_max2.474678080046953
distance-from-start_mean1.1187580687880734
distance-from-start_median0.7311662618175729
distance-from-start_min0.5380216714701948
driven_any_max7.914389135732608
driven_any_mean2.6533563897179517
driven_any_median1.0700397296194768
driven_any_min0.5589569639002437
driven_lanedir_consec_max5.259121455949781
driven_lanedir_consec_mean1.826874011346233
driven_lanedir_consec_min0.5507217085325415
driven_lanedir_max7.307573602659331
driven_lanedir_mean2.353158237254644
driven_lanedir_median0.7771330327959671
driven_lanedir_min0.5507932807673115
in-drivable-lane_max2.5499999999999474
in-drivable-lane_mean1.462499999999984
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 7.914389135732608, "survival_time": 59.99999999999873, "driven_lanedir": 7.307573602659331, "in-drivable-lane": 2.5499999999999474, "deviation-heading": 10.140762708177997, "distance-from-start": 2.474678080046953, "deviation-center-line": 5.083945533371585, "driven_lanedir_consec": 5.259121455949781}, "4way-000-ego1": {"driven_any": 0.5589569639002437, "survival_time": 59.99999999999873, "driven_lanedir": 0.5507932807673115, "in-drivable-lane": 0.0, "deviation-heading": 21.671672697256067, "distance-from-start": 0.5380216714701948, "deviation-center-line": 9.629946152468154, "driven_lanedir_consec": 0.5507217085325415}, "4way-000-ego2": {"driven_any": 0.9637724690001312, "survival_time": 59.99999999999873, "driven_lanedir": 0.6852631373540186, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 44.85172382606952, "distance-from-start": 0.6129687659227671, "deviation-center-line": 5.114295940996062, "driven_lanedir_consec": 0.6286499526646931}, "4way-000-ego3": {"driven_any": 1.1763069902388223, "survival_time": 59.99999999999873, "driven_lanedir": 0.8690029282379157, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 6.842251207319144, "distance-from-start": 0.8493637577123787, "deviation-center-line": 6.903114914386498, "driven_lanedir_consec": 0.8690029282379157}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6633792Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-050:05:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6563635Bea Baselines 🐤minimal-agent-fullaido-LFI-full-sim-validationsim-1of4successnogpu-staging-spot-0-050:05:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.3044807262228515
deviation-center-line_median3.302753458049452


other stats
deviation-center-line_max3.302753458049452
deviation-center-line_mean3.302753458049452
deviation-center-line_min3.302753458049452
deviation-heading_max3.254644240772766
deviation-heading_mean3.254644240772766
deviation-heading_median3.254644240772766
deviation-heading_min3.254644240772766
distance-from-start_max2.0440638909568793
distance-from-start_mean2.0440638909568793
distance-from-start_median2.0440638909568793
distance-from-start_min2.0440638909568793
driven_any_max3.5795815550659253
driven_any_mean3.5795815550659253
driven_any_median3.5795815550659253
driven_any_min3.5795815550659253
driven_lanedir_consec_max3.3044807262228515
driven_lanedir_consec_mean3.3044807262228515
driven_lanedir_consec_min3.3044807262228515
driven_lanedir_max3.561561505552355
driven_lanedir_mean3.561561505552355
driven_lanedir_median3.561561505552355
driven_lanedir_min3.561561505552355
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 3.5795815550659253, "survival_time": 59.99999999999873, "driven_lanedir": 3.561561505552355, "in-drivable-lane": 0.0, "deviation-heading": 3.254644240772766, "distance-from-start": 2.0440638909568793, "deviation-center-line": 3.302753458049452, "driven_lanedir_consec": 3.3044807262228515}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6551638Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-validationsim-3of4successnogpu-staging-spot-0-050:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.249999999999972
driven_lanedir_consec_median1.5873305909427766
deviation-center-line_median5.442861863263418


other stats
deviation-center-line_max5.442861863263418
deviation-center-line_mean5.442861863263418
deviation-center-line_min5.442861863263418
deviation-heading_max11.057314603573452
deviation-heading_mean11.057314603573452
deviation-heading_median11.057314603573452
deviation-heading_min11.057314603573452
distance-from-start_max1.519244551350185
distance-from-start_mean1.519244551350185
distance-from-start_median1.519244551350185
distance-from-start_min1.519244551350185
driven_any_max3.452076592019539
driven_any_mean3.452076592019539
driven_any_median3.452076592019539
driven_any_min3.452076592019539
driven_lanedir_consec_max1.5873305909427766
driven_lanedir_consec_mean1.5873305909427766
driven_lanedir_consec_min1.5873305909427766
driven_lanedir_max3.163920824988357
driven_lanedir_mean3.163920824988357
driven_lanedir_median3.163920824988357
driven_lanedir_min3.163920824988357
in-drivable-lane_max4.249999999999972
in-drivable-lane_mean4.249999999999972
in-drivable-lane_min4.249999999999972
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6547637Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6539783Andrea Danieletemplate-randomaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-050:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2718431750312411
survival_time_median45.099999999999575
deviation-center-line_median0.765552090953893
in-drivable-lane_median36.54999999999956


other stats
deviation-center-line_max0.765552090953893
deviation-center-line_mean0.765552090953893
deviation-center-line_min0.765552090953893
deviation-heading_max5.708723015945327
deviation-heading_mean5.708723015945327
deviation-heading_median5.708723015945327
deviation-heading_min5.708723015945327
distance-from-start_max1.0442247976691916
distance-from-start_mean1.0442247976691916
distance-from-start_median1.0442247976691916
distance-from-start_min1.0442247976691916
driven_any_max11.376062002465076
driven_any_mean11.376062002465076
driven_any_median11.376062002465076
driven_any_min11.376062002465076
driven_lanedir_consec_max0.2718431750312411
driven_lanedir_consec_mean0.2718431750312411
driven_lanedir_consec_min0.2718431750312411
driven_lanedir_max0.25383249899423177
driven_lanedir_mean0.25383249899423177
driven_lanedir_median0.25383249899423177
driven_lanedir_min0.25383249899423177
in-drivable-lane_max36.54999999999956
in-drivable-lane_mean36.54999999999956
in-drivable-lane_min36.54999999999956
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465076, "survival_time": 45.099999999999575, "driven_lanedir": 0.25383249899423177, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.0442247976691916, "deviation-center-line": 0.765552090953893, "driven_lanedir_consec": 0.2718431750312411}}
simulation-passed1
survival_time_max45.099999999999575
survival_time_mean45.099999999999575
survival_time_min45.099999999999575
No reset possible
6528787Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:48
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6523787Andrea Danieletemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6508641Bea Baselines 🐤minimal-agent-fullaido-LFV-full-sim-testingsim-2of4successnogpu-staging-spot-0-050:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.381377707282059
deviation-center-line_median6.627907451366884


other stats
deviation-center-line_max6.627907451366884
deviation-center-line_mean6.627907451366884
deviation-center-line_min6.627907451366884
deviation-heading_max5.432222613492037
deviation-heading_mean5.432222613492037
deviation-heading_median5.432222613492037
deviation-heading_min5.432222613492037
distance-from-start_max1.6316417714987326
distance-from-start_mean1.6316417714987326
distance-from-start_median1.6316417714987326
distance-from-start_min1.6316417714987326
driven_any_max3.509092316575648
driven_any_mean3.509092316575648
driven_any_median3.509092316575648
driven_any_min3.509092316575648
driven_lanedir_consec_max3.381377707282059
driven_lanedir_consec_mean3.381377707282059
driven_lanedir_consec_min3.381377707282059
driven_lanedir_max3.381377707282059
driven_lanedir_mean3.381377707282059
driven_lanedir_median3.381377707282059
driven_lanedir_min3.381377707282059
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"loop-000-ego0": {"driven_any": 3.509092316575648, "survival_time": 59.99999999999873, "driven_lanedir": 3.381377707282059, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.432222613492037, "distance-from-start": 1.6316417714987326, "deviation-center-line": 6.627907451366884, "driven_lanedir_consec": 3.381377707282059}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6491643Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-1of4successnogpu-staging-spot-0-050:13:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.17499999999996
driven_lanedir_consec_median1.885977987821864
deviation-center-line_median5.3420440939969716


other stats
deviation-center-line_max7.275924926736645
deviation-center-line_mean5.706188820851575
deviation-center-line_min4.86474216867571
deviation-heading_max24.381184135059772
deviation-heading_mean11.29955148851905
deviation-heading_median7.478334178737182
deviation-heading_min5.860353461542065
distance-from-start_max2.7566543136035913
distance-from-start_mean1.9175184910035223
distance-from-start_median1.732391267435746
distance-from-start_min1.4486371155390068
driven_any_max3.519592343713626
driven_any_mean2.7625082847871507
driven_any_median2.7621738784712173
driven_any_min2.006093038492542
driven_lanedir_consec_max3.3853872720615663
driven_lanedir_consec_mean2.143156838888662
driven_lanedir_consec_min1.4152841078493523
driven_lanedir_max3.3853872720615663
driven_lanedir_mean2.6342033343012377
driven_lanedir_median2.6339394480283285
driven_lanedir_min1.883547169086726
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean2.18749999999996
in-drivable-lane_min1.9999999999998863
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.016760537304334, "survival_time": 59.99999999999873, "driven_lanedir": 1.904099016664742, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 24.381184135059772, "distance-from-start": 1.967934233485134, "deviation-center-line": 5.25275935214242, "driven_lanedir_consec": 1.8884088065570024}, "autolab-000-ego1": {"driven_any": 3.519592343713626, "survival_time": 59.99999999999873, "driven_lanedir": 3.3853872720615663, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066767019151304, "distance-from-start": 2.7566543136035913, "deviation-center-line": 5.431328835851522, "driven_lanedir_consec": 3.3853872720615663}, "autolab-000-ego2": {"driven_any": 3.5075872196381, "survival_time": 59.99999999999873, "driven_lanedir": 3.363779879391915, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.860353461542065, "distance-from-start": 1.4486371155390068, "deviation-center-line": 4.86474216867571, "driven_lanedir_consec": 1.4152841078493523}, "autolab-000-ego3": {"driven_any": 2.006093038492542, "survival_time": 59.99999999999873, "driven_lanedir": 1.883547169086726, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 7.889901338323059, "distance-from-start": 1.496848301386358, "deviation-center-line": 7.275924926736645, "driven_lanedir_consec": 1.883547169086726}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6477645Bea Baselines 🐤minimal-agent-fullaido-LF-full-sim-testingsim-1of4successnogpu-staging-spot-0-050:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median1.6648897347487026
deviation-center-line_median4.9388161979484995


other stats
deviation-center-line_max4.9388161979484995
deviation-center-line_mean4.9388161979484995
deviation-center-line_min4.9388161979484995
deviation-heading_max7.489030374236871
deviation-heading_mean7.489030374236871
deviation-heading_median7.489030374236871
deviation-heading_min7.489030374236871
distance-from-start_max1.3909655084060193
distance-from-start_mean1.3909655084060193
distance-from-start_median1.3909655084060193
distance-from-start_min1.3909655084060193
driven_any_max3.519584618867418
driven_any_mean3.519584618867418
driven_any_median3.519584618867418
driven_any_min3.519584618867418
driven_lanedir_consec_max1.6648897347487026
driven_lanedir_consec_mean1.6648897347487026
driven_lanedir_consec_min1.6648897347487026
driven_lanedir_max3.362091194105441
driven_lanedir_mean3.362091194105441
driven_lanedir_median3.362091194105441
driven_lanedir_min3.362091194105441
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519584618867418, "survival_time": 59.99999999999873, "driven_lanedir": 3.362091194105441, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 7.489030374236871, "distance-from-start": 1.3909655084060193, "deviation-center-line": 4.9388161979484995, "driven_lanedir_consec": 1.6648897347487026}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6464678Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation283successyesgpu-staging-spot-0-050:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.742328706004615
deviation-center-line_median0.33945456663980716


other stats
deviation-center-line_max0.3908949944505377
deviation-center-line_mean0.32135416680458384
deviation-center-line_min0.2156125394881833
deviation-heading_max3.7646465736418224
deviation-heading_mean2.8850148728120875
deviation-heading_median2.9961830476481808
deviation-heading_min1.783046822310164
distance-from-start_max3.522061458900184
distance-from-start_mean2.7436402553448476
distance-from-start_median2.7369885705970955
distance-from-start_min1.978522421285015
driven_any_max5.190284455707655
driven_any_mean4.751674865015388
driven_any_median4.75306747748424
driven_any_min4.310280049385415
driven_lanedir_consec_max5.178025139788938
driven_lanedir_consec_mean4.740809849192896
driven_lanedir_consec_min4.300556844973417
driven_lanedir_max5.178025139788938
driven_lanedir_mean4.740809849192896
driven_lanedir_median4.742328706004615
driven_lanedir_min4.300556844973417
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.310280049385415, "survival_time": 59.99999999999873, "driven_lanedir": 4.300556844973417, "in-drivable-lane": 0.0, "deviation-heading": 3.7646465736418224, "distance-from-start": 1.978522421285015, "deviation-center-line": 0.3085743240153483, "driven_lanedir_consec": 4.300556844973417}, "autolab-000-ego1": {"driven_any": 4.439412618608211, "survival_time": 59.99999999999873, "driven_lanedir": 4.428719111024556, "in-drivable-lane": 0.0, "deviation-heading": 1.783046822310164, "distance-from-start": 2.152738956720156, "deviation-center-line": 0.2156125394881833, "driven_lanedir_consec": 4.428719111024556}, "autolab-000-ego2": {"driven_any": 5.190284455707655, "survival_time": 59.99999999999873, "driven_lanedir": 5.178025139788938, "in-drivable-lane": 0.0, "deviation-heading": 3.020096037621849, "distance-from-start": 3.522061458900184, "deviation-center-line": 0.3908949944505377, "driven_lanedir_consec": 5.178025139788938}, "autolab-000-ego3": {"driven_any": 5.066722336360269, "survival_time": 59.99999999999873, "driven_lanedir": 5.055938300984675, "in-drivable-lane": 0.0, "deviation-heading": 2.972270057674513, "distance-from-start": 3.3212381844740353, "deviation-center-line": 0.3703348092642661, "driven_lanedir_consec": 5.055938300984675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6449678Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation285successyesgpu-staging-spot-0-050:09:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5649213529050588
deviation-center-line_median0.32197407354104046


other stats
deviation-center-line_max0.8949001904483446
deviation-center-line_mean0.4523845261121684
deviation-center-line_min0.27068976691824803
deviation-heading_max32.24915642112976
deviation-heading_mean12.711557252051277
deviation-heading_median8.147951606871079
deviation-heading_min2.301169373333178
distance-from-start_max3.1060422160938748
distance-from-start_mean1.0193988517697523
distance-from-start_median0.48577659549256713
distance-from-start_min8.881784197001252e-16
driven_any_max4.07828206784938
driven_any_mean1.304428171740143
driven_any_median0.5697153095550628
driven_any_min1.0658141036401505e-12
driven_lanedir_consec_max4.070208187293515
driven_lanedir_consec_mean1.300012820004533
driven_lanedir_consec_min3.869145004387065e-07
driven_lanedir_max4.070208187293515
driven_lanedir_mean1.300012820004533
driven_lanedir_median0.5649213529050588
driven_lanedir_min3.869145004387065e-07
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0658141036401505e-12, "survival_time": 59.99999999999873, "driven_lanedir": 7.578759220194797e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24915642112976, "distance-from-start": 8.881784197001252e-16, "deviation-center-line": 0.8949001904483446, "driven_lanedir_consec": 7.578759220194797e-06}, "zigzag-000-ego1": {"driven_any": 1.1394306191090269, "survival_time": 59.99999999999873, "driven_lanedir": 1.1298351270508975, "in-drivable-lane": 0.0, "deviation-heading": 2.3815687633177767, "distance-from-start": 0.9715531909851334, "deviation-center-line": 0.27068976691824803, "driven_lanedir_consec": 1.1298351270508975}, "zigzag-000-ego2": {"driven_any": 4.07828206784938, "survival_time": 59.99999999999873, "driven_lanedir": 4.070208187293515, "in-drivable-lane": 0.0, "deviation-heading": 2.301169373333178, "distance-from-start": 3.1060422160938748, "deviation-center-line": 0.30621476099086364, "driven_lanedir_consec": 4.070208187293515}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 3.869145004387065e-07, "in-drivable-lane": 0.0, "deviation-heading": 13.91433445042438, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773338609121734, "driven_lanedir_consec": 3.869145004387065e-07}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6439679Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-1of4successnogpu-staging-spot-0-050:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.750000000000117
in-drivable-lane_median0.0
driven_lanedir_consec_median1.53847507295702
deviation-center-line_median0.16257777325206482


other stats
deviation-center-line_max0.16257777325206482
deviation-center-line_mean0.16257777325206482
deviation-center-line_min0.16257777325206482
deviation-heading_max1.4712837581470402
deviation-heading_mean1.4712837581470402
deviation-heading_median1.4712837581470402
deviation-heading_min1.4712837581470402
distance-from-start_max1.0671562227466285
distance-from-start_mean1.0671562227466285
distance-from-start_median1.0671562227466285
distance-from-start_min1.0671562227466285
driven_any_max1.547713297174875
driven_any_mean1.547713297174875
driven_any_median1.547713297174875
driven_any_min1.547713297174875
driven_lanedir_consec_max1.53847507295702
driven_lanedir_consec_mean1.53847507295702
driven_lanedir_consec_min1.53847507295702
driven_lanedir_max1.53847507295702
driven_lanedir_mean1.53847507295702
driven_lanedir_median1.53847507295702
driven_lanedir_min1.53847507295702
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.547713297174875, "survival_time": 17.750000000000117, "driven_lanedir": 1.53847507295702, "in-drivable-lane": 0.0, "deviation-heading": 1.4712837581470402, "distance-from-start": 1.0671562227466285, "deviation-center-line": 0.16257777325206482, "driven_lanedir_consec": 1.53847507295702}}
simulation-passed1
survival_time_max17.750000000000117
survival_time_mean17.750000000000117
survival_time_min17.750000000000117
No reset possible
6429682Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-2of4successnogpu-staging-spot-0-050:12:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.3396682743607817
deviation-center-line_median0.47467850444644666


other stats
deviation-center-line_max2.7624735124851627
deviation-center-line_mean0.9837388055255328
deviation-center-line_min0.22312470072407511
deviation-heading_max37.82293240559152
deviation-heading_mean12.027592251390926
deviation-heading_median4.152980159928612
deviation-heading_min1.9814762801149592
distance-from-start_max2.493583137044009
distance-from-start_mean1.23889774392311
distance-from-start_median1.2310039193242155
distance-from-start_min2.220446049250313e-16
driven_any_max5.800963325947782
driven_any_mean2.6242223629299586
driven_any_median2.3479630628858925
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max5.788647556544016
driven_lanedir_consec_mean2.6169960263163947
driven_lanedir_consec_min0.0
driven_lanedir_max5.788647556544016
driven_lanedir_mean2.6169960263163947
driven_lanedir_median2.3396682743607817
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 4.695926125771519, "survival_time": 59.99999999999873, "driven_lanedir": 4.6793365487215635, "in-drivable-lane": 0.0, "deviation-heading": 3.6538476930540615, "distance-from-start": 2.493583137044009, "deviation-center-line": 0.6128395606196001, "driven_lanedir_consec": 4.6793365487215635}, "4way-000-ego1": {"driven_any": 5.800963325947782, "survival_time": 59.99999999999873, "driven_lanedir": 5.788647556544016, "in-drivable-lane": 0.0, "deviation-heading": 1.9814762801149592, "distance-from-start": 2.462007838648431, "deviation-center-line": 0.3365174482732932, "driven_lanedir_consec": 5.788647556544016}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803163, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.22312470072407511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624735124851627, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6413682Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-testingsim-0of4timeoutnogpu-staging-spot-0-05----No reset possible
6401683Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-0of4successnogpu-staging-spot-0-050:09:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.336853929439388
deviation-center-line_median0.1833290916203121


other stats
deviation-center-line_max0.1833290916203121
deviation-center-line_mean0.1833290916203121
deviation-center-line_min0.1833290916203121
deviation-heading_max1.3122340748484589
deviation-heading_mean1.3122340748484589
deviation-heading_median1.3122340748484589
deviation-heading_min1.3122340748484589
distance-from-start_max3.367405434986393
distance-from-start_mean3.367405434986393
distance-from-start_median3.367405434986393
distance-from-start_min3.367405434986393
driven_any_max5.634085005948749
driven_any_mean5.634085005948749
driven_any_median5.634085005948749
driven_any_min5.634085005948749
driven_lanedir_consec_max5.336853929439388
driven_lanedir_consec_mean5.336853929439388
driven_lanedir_consec_min5.336853929439388
driven_lanedir_max5.629595525675495
driven_lanedir_mean5.629595525675495
driven_lanedir_median5.629595525675495
driven_lanedir_min5.629595525675495
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-001-ego0": {"driven_any": 5.634085005948749, "survival_time": 59.99999999999873, "driven_lanedir": 5.629595525675495, "in-drivable-lane": 0.0, "deviation-heading": 1.3122340748484589, "distance-from-start": 3.367405434986393, "deviation-center-line": 0.1833290916203121, "driven_lanedir_consec": 5.336853929439388}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6396686Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7199000882778759
deviation-center-line_median0.16571411064010536


other stats
deviation-center-line_max0.16571411064010536
deviation-center-line_mean0.16571411064010536
deviation-center-line_min0.16571411064010536
deviation-heading_max1.3921530764896437
deviation-heading_mean1.3921530764896437
deviation-heading_median1.3921530764896437
deviation-heading_min1.3921530764896437
distance-from-start_max0.6832017558427702
distance-from-start_mean0.6832017558427702
distance-from-start_median0.6832017558427702
distance-from-start_min0.6832017558427702
driven_any_max0.7330980289948952
driven_any_mean0.7330980289948952
driven_any_median0.7330980289948952
driven_any_min0.7330980289948952
driven_lanedir_consec_max0.7199000882778759
driven_lanedir_consec_mean0.7199000882778759
driven_lanedir_consec_min0.7199000882778759
driven_lanedir_max0.7199000882778759
driven_lanedir_mean0.7199000882778759
driven_lanedir_median0.7199000882778759
driven_lanedir_min0.7199000882778759
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7330980289948952, "survival_time": 9.750000000000004, "driven_lanedir": 0.7199000882778759, "in-drivable-lane": 0.0, "deviation-heading": 1.3921530764896437, "distance-from-start": 0.6832017558427702, "deviation-center-line": 0.16571411064010536, "driven_lanedir_consec": 0.7199000882778759}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
6382719Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-2of4successnogpu-staging-spot-0-050:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median2.7045955609117347
deviation-center-line_median5.298353292175556


other stats
deviation-center-line_max6.7415423051179255
deviation-center-line_mean5.28094688646254
deviation-center-line_min3.785538656381124
deviation-heading_max13.312014280207482
deviation-heading_mean6.591214978958582
deviation-heading_median4.957876569877463
deviation-heading_min3.137092495871918
distance-from-start_max2.2873183363783496
distance-from-start_mean1.7377713014167755
distance-from-start_median1.9053628015189592
distance-from-start_min0.8530412662508342
driven_any_max3.579587180103618
driven_any_mean2.867838687646443
driven_any_median2.919589855341645
driven_any_min2.052587859798864
driven_lanedir_consec_max3.384490798043468
driven_lanedir_consec_mean2.391979057772581
driven_lanedir_consec_min0.7742343112233858
driven_lanedir_max3.5625563105123215
driven_lanedir_mean2.790015327019447
driven_lanedir_median2.838407939721475
driven_lanedir_min1.9206891181225152
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean1.1249999999999716
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 2.259597875697513, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590471343353, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280207482, "distance-from-start": 1.740927094321447, "deviation-center-line": 6.213697824668821, "driven_lanedir_consec": 2.0736045752466756}, "4way-000-ego1": {"driven_any": 3.5795818349857766, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625563105123215, "in-drivable-lane": 0.0, "deviation-heading": 3.137092495871918, "distance-from-start": 2.069798508716472, "deviation-center-line": 3.785538656381124, "driven_lanedir_consec": 3.3355865465767938}, "4way-000-ego2": {"driven_any": 3.579587180103618, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589568323086147, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646358412, "distance-from-start": 2.2873183363783496, "deviation-center-line": 4.3830087596822915, "driven_lanedir_consec": 3.384490798043468}, "4way-000-ego3": {"driven_any": 2.052587859798864, "survival_time": 59.99999999999873, "driven_lanedir": 1.9206891181225152, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545204933965145, "distance-from-start": 0.8530412662508342, "deviation-center-line": 6.7415423051179255, "driven_lanedir_consec": 0.7742343112233858}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6366721Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-validation284successyesgpu-staging-spot-0-050:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.2749999999998938
driven_lanedir_consec_median2.712004979582506
deviation-center-line_median6.830233669694479


other stats
deviation-center-line_max7.154226688493768
deviation-center-line_mean6.804680157069402
deviation-center-line_min6.404026600394878
deviation-heading_max8.100880505860715
deviation-heading_mean5.973168085503508
deviation-heading_median5.5013083102031874
deviation-heading_min4.7891752157469405
distance-from-start_max2.416015397978839
distance-from-start_mean1.6093143700204056
distance-from-start_median1.566033493936358
distance-from-start_min0.8891750942300684
driven_any_max3.5195878597991426
driven_any_mean3.4828384673828054
driven_any_median3.4813415720692342
driven_any_min3.4490828655936094
driven_lanedir_consec_max3.330338922875351
driven_lanedir_consec_mean2.6711177029407134
driven_lanedir_consec_min1.9301219297224912
driven_lanedir_max3.3876167841121174
driven_lanedir_mean3.308291004109226
driven_lanedir_median3.318066104091547
driven_lanedir_min3.209415024141693
in-drivable-lane_max4.349999999999898
in-drivable-lane_mean3.2249999999999286
in-drivable-lane_min2.0000000000000284
per-episodes
details{"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}, "loop-000-ego1": {"driven_any": 3.486592048337899, "survival_time": 59.99999999999873, "driven_lanedir": 3.330338922875351, "in-drivable-lane": 3.0999999999999055, "deviation-heading": 4.7891752157469405, "distance-from-start": 2.416015397978839, "deviation-center-line": 6.91888991237436, "driven_lanedir_consec": 3.330338922875351}, "loop-000-ego2": {"driven_any": 3.4490828655936094, "survival_time": 59.99999999999873, "driven_lanedir": 3.209415024141693, "in-drivable-lane": 4.349999999999898, "deviation-heading": 8.100880505860715, "distance-from-start": 0.8891750942300684, "deviation-center-line": 6.404026600394878, "driven_lanedir_consec": 1.9301219297224912}, "loop-000-ego3": {"driven_any": 3.5195878597991426, "survival_time": 59.99999999999873, "driven_lanedir": 3.3876167841121174, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654519418770767, "distance-from-start": 1.5016994335658966, "deviation-center-line": 6.741577427014599, "driven_lanedir_consec": 2.118216673857269}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6359723Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-1of4successnogpu-staging-spot-0-050:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.0000000000000284
driven_lanedir_consec_median2.241204615389226
deviation-center-line_median4.759684198968496


other stats
deviation-center-line_max4.759684198968496
deviation-center-line_mean4.759684198968496
deviation-center-line_min4.759684198968496
deviation-heading_max9.18078892152259
deviation-heading_mean9.18078892152259
deviation-heading_median9.18078892152259
deviation-heading_min9.18078892152259
distance-from-start_max1.6296054226673595
distance-from-start_mean1.6296054226673595
distance-from-start_median1.6296054226673595
distance-from-start_min1.6296054226673595
driven_any_max3.519583547683476
driven_any_mean3.519583547683476
driven_any_median3.519583547683476
driven_any_min3.519583547683476
driven_lanedir_consec_max2.241204615389226
driven_lanedir_consec_mean2.241204615389226
driven_lanedir_consec_min2.241204615389226
driven_lanedir_max3.353584317203001
driven_lanedir_mean3.353584317203001
driven_lanedir_median3.353584317203001
driven_lanedir_min3.353584317203001
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean2.0000000000000284
in-drivable-lane_min2.0000000000000284
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6348397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-050:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.383808964803233
survival_time_median59.99999999999873
deviation-center-line_median2.5672252451685273
in-drivable-lane_median27.99999999999938


other stats
deviation-center-line_max2.5672252451685273
deviation-center-line_mean2.5672252451685273
deviation-center-line_min2.5672252451685273
deviation-heading_max28.72689687175698
deviation-heading_mean28.72689687175698
deviation-heading_median28.72689687175698
deviation-heading_min28.72689687175698
distance-from-start_max0.14555890166001362
distance-from-start_mean0.14555890166001362
distance-from-start_median0.14555890166001362
distance-from-start_min0.14555890166001362
driven_any_max11.6938259442379
driven_any_mean11.6938259442379
driven_any_median11.6938259442379
driven_any_min11.6938259442379
driven_lanedir_consec_max-3.383808964803233
driven_lanedir_consec_mean-3.383808964803233
driven_lanedir_consec_min-3.383808964803233
driven_lanedir_max-3.383808964803233
driven_lanedir_mean-3.383808964803233
driven_lanedir_median-3.383808964803233
driven_lanedir_min-3.383808964803233
in-drivable-lane_max27.99999999999938
in-drivable-lane_mean27.99999999999938
in-drivable-lane_min27.99999999999938
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.6938259442379, "survival_time": 59.99999999999873, "driven_lanedir": -3.383808964803233, "in-drivable-lane": 27.99999999999938, "deviation-heading": 28.72689687175698, "distance-from-start": 0.14555890166001362, "deviation-center-line": 2.5672252451685273, "driven_lanedir_consec": -3.383808964803233}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6301397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4timeoutnogpu-staging-spot-0-05----No reset possible
6297526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-2of4failednogpu-staging-spot-0-050:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6287658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-050:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2349373218967008
survival_time_median16.750000000000103
deviation-center-line_median0.07754621318988528
in-drivable-lane_median14.950000000000102


other stats
deviation-center-line_max0.07754621318988528
deviation-center-line_mean0.07754621318988528
deviation-center-line_min0.07754621318988528
deviation-heading_max1.04950936260716
deviation-heading_mean1.04950936260716
deviation-heading_median1.04950936260716
deviation-heading_min1.04950936260716
distance-from-start_max0.7534366204003728
distance-from-start_mean0.7534366204003728
distance-from-start_median0.7534366204003728
distance-from-start_min0.7534366204003728
driven_any_max3.5842682289589343
driven_any_mean3.5842682289589343
driven_any_median3.5842682289589343
driven_any_min3.5842682289589343
driven_lanedir_consec_max0.2349373218967008
driven_lanedir_consec_mean0.2349373218967008
driven_lanedir_consec_min0.2349373218967008
driven_lanedir_max0.2349373218967008
driven_lanedir_mean0.2349373218967008
driven_lanedir_median0.2349373218967008
driven_lanedir_min0.2349373218967008
in-drivable-lane_max14.950000000000102
in-drivable-lane_mean14.950000000000102
in-drivable-lane_min14.950000000000102
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.5842682289589343, "survival_time": 16.750000000000103, "driven_lanedir": 0.2349373218967008, "in-drivable-lane": 14.950000000000102, "deviation-heading": 1.04950936260716, "distance-from-start": 0.7534366204003728, "deviation-center-line": 0.07754621318988528, "driven_lanedir_consec": 0.2349373218967008}}
simulation-passed1
survival_time_max16.750000000000103
survival_time_mean16.750000000000103
survival_time_min16.750000000000103
No reset possible
6275715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-050:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.012426269112546516
survival_time_median51.799999999999194
deviation-center-line_median0.5849700317973118
in-drivable-lane_median45.549999999999145


other stats
deviation-center-line_max0.5849700317973118
deviation-center-line_mean0.5849700317973118
deviation-center-line_min0.5849700317973118
deviation-heading_max4.775258870776366
deviation-heading_mean4.775258870776366
deviation-heading_median4.775258870776366
deviation-heading_min4.775258870776366
distance-from-start_max1.2120262829129234
distance-from-start_mean1.2120262829129234
distance-from-start_median1.2120262829129234
distance-from-start_min1.2120262829129234
driven_any_max12.87870380836428
driven_any_mean12.87870380836428
driven_any_median12.87870380836428
driven_any_min12.87870380836428
driven_lanedir_consec_max0.012426269112546516
driven_lanedir_consec_mean0.012426269112546516
driven_lanedir_consec_min0.012426269112546516
driven_lanedir_max0.015772611211180454
driven_lanedir_mean0.015772611211180454
driven_lanedir_median0.015772611211180454
driven_lanedir_min0.015772611211180454
in-drivable-lane_max45.549999999999145
in-drivable-lane_mean45.549999999999145
in-drivable-lane_min45.549999999999145
per-episodes
details{"loop2-000-ego0": {"driven_any": 12.87870380836428, "survival_time": 51.799999999999194, "driven_lanedir": 0.015772611211180454, "in-drivable-lane": 45.549999999999145, "deviation-heading": 4.775258870776366, "distance-from-start": 1.2120262829129234, "deviation-center-line": 0.5849700317973118, "driven_lanedir_consec": 0.012426269112546516}}
simulation-passed1
survival_time_max51.799999999999194
survival_time_mean51.799999999999194
survival_time_min51.799999999999194
No reset possible
6268690Bea Baselines 🐤minimal-agentaido-LFP-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median0.6999999999999984
driven_lanedir_consec_median0.19955231542409924
deviation-center-line_median0.1256753125869936


other stats
deviation-center-line_max0.1256753125869936
deviation-center-line_mean0.1256753125869936
deviation-center-line_min0.1256753125869936
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.23316122665354827
distance-from-start_mean0.23316122665354827
distance-from-start_median0.23316122665354827
distance-from-start_min0.23316122665354827
driven_any_max0.23316442419546207
driven_any_mean0.23316442419546207
driven_any_median0.23316442419546207
driven_any_min0.23316442419546207
driven_lanedir_consec_max0.19955231542409924
driven_lanedir_consec_mean0.19955231542409924
driven_lanedir_consec_min0.19955231542409924
driven_lanedir_max0.19955231542409924
driven_lanedir_mean0.19955231542409924
driven_lanedir_median0.19955231542409924
driven_lanedir_min0.19955231542409924
in-drivable-lane_max0.6999999999999984
in-drivable-lane_mean0.6999999999999984
in-drivable-lane_min0.6999999999999984
per-episodes
details{"loop-000-ego0": {"driven_any": 0.23316442419546207, "survival_time": 2.4499999999999993, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 0.6999999999999984, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.23316122665354827, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955231542409924}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
6243766Bea Baselines 🐤challenge-aido_LF-template-tensorflow:daffy-staging:38486fc8c2bf41d1f9b206035ae484c5873c8a4baido-hello-sim-validationsanity-checkfailednogpu-staging-spot-0-050:07:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6241385Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:20:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median30.474999999999262
driven_lanedir_consec_median-2.7990084137218547
deviation-center-line_median2.362241222312564


other stats
deviation-center-line_max5.93518168521162
deviation-center-line_mean3.076756323918791
deviation-center-line_min1.6473611658384149
deviation-heading_max34.302651379566754
deviation-heading_mean24.030625105877142
deviation-heading_median23.0770146490734
deviation-heading_min15.665819745795009
distance-from-start_max0.24520199978997312
distance-from-start_mean0.20037693084937075
distance-from-start_median0.19642636957918405
distance-from-start_min0.16345298444914175
driven_any_max15.023596798251438
driven_any_mean13.033747221361253
driven_any_median13.343560290629435
driven_any_min10.424271505934694
driven_lanedir_consec_max-2.320938525331138
driven_lanedir_consec_mean-3.1291808149511264
driven_lanedir_consec_min-4.59776790702966
driven_lanedir_max-2.320938525331138
driven_lanedir_mean-4.455633923284213
driven_lanedir_median-3.2400625474645723
driven_lanedir_min-9.02147207287657
in-drivable-lane_max42.69999999999909
in-drivable-lane_mean27.99999999999936
in-drivable-lane_min8.349999999999824
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.424271505934694, "survival_time": 59.99999999999873, "driven_lanedir": -2.494973123259876, "in-drivable-lane": 26.89999999999937, "deviation-heading": 26.71427234089008, "distance-from-start": 0.24520199978997312, "deviation-center-line": 2.9487267567004047, "driven_lanedir_consec": -2.4546373913366883}, "zigzag-000-ego1": {"driven_any": 12.50184032999926, "survival_time": 59.99999999999873, "driven_lanedir": -2.320938525331138, "in-drivable-lane": 42.69999999999909, "deviation-heading": 15.665819745795009, "distance-from-start": 0.16345298444914175, "deviation-center-line": 1.7757556879247227, "driven_lanedir_consec": -2.320938525331138}, "zigzag-000-ego2": {"driven_any": 15.023596798251438, "survival_time": 59.99999999999873, "driven_lanedir": -9.02147207287657, "in-drivable-lane": 8.349999999999824, "deviation-heading": 34.302651379566754, "distance-from-start": 0.2248904146425633, "deviation-center-line": 5.93518168521162, "driven_lanedir_consec": -4.59776790702966}, "zigzag-000-ego3": {"driven_any": 14.185280251259616, "survival_time": 59.99999999999873, "driven_lanedir": -3.985151971669269, "in-drivable-lane": 34.04999999999915, "deviation-heading": 19.439756957256716, "distance-from-start": 0.16796232451580484, "deviation-center-line": 1.6473611658384149, "driven_lanedir_consec": -3.1433794361070206}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6237386Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFP-sim-validationsim-2of4successnogpu-staging-spot-0-050:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median23.44999999999942
driven_lanedir_consec_median-3.299015185528003
deviation-center-line_median2.048774756314249


other stats
deviation-center-line_max2.048774756314249
deviation-center-line_mean2.048774756314249
deviation-center-line_min2.048774756314249
deviation-heading_max31.001988298390575
deviation-heading_mean31.001988298390575
deviation-heading_median31.001988298390575
deviation-heading_min31.001988298390575
distance-from-start_max0.21339473466246095
distance-from-start_mean0.21339473466246095
distance-from-start_median0.21339473466246095
distance-from-start_min0.21339473466246095
driven_any_max11.830627880295504
driven_any_mean11.830627880295504
driven_any_median11.830627880295504
driven_any_min11.830627880295504
driven_lanedir_consec_max-3.299015185528003
driven_lanedir_consec_mean-3.299015185528003
driven_lanedir_consec_min-3.299015185528003
driven_lanedir_max-3.3972796153913905
driven_lanedir_mean-3.3972796153913905
driven_lanedir_median-3.3972796153913905
driven_lanedir_min-3.3972796153913905
in-drivable-lane_max23.44999999999942
in-drivable-lane_mean23.44999999999942
in-drivable-lane_min23.44999999999942
per-episodes
details{"loop-000-ego0": {"driven_any": 11.830627880295504, "survival_time": 59.99999999999873, "driven_lanedir": -3.3972796153913905, "in-drivable-lane": 23.44999999999942, "deviation-heading": 31.001988298390575, "distance-from-start": 0.21339473466246095, "deviation-center-line": 2.048774756314249, "driven_lanedir_consec": -3.299015185528003}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6233387Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-050:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.050000000000022
in-drivable-lane_median3.650000000000008
driven_lanedir_consec_median-0.6703922314863293
deviation-center-line_median0.6297924356116489


other stats
deviation-center-line_max0.6297924356116489
deviation-center-line_mean0.6297924356116489
deviation-center-line_min0.6297924356116489
deviation-heading_max4.786890845878732
deviation-heading_mean4.786890845878732
deviation-heading_median4.786890845878732
deviation-heading_min4.786890845878732
distance-from-start_max0.1650658995166795
distance-from-start_mean0.1650658995166795
distance-from-start_median0.1650658995166795
distance-from-start_min0.1650658995166795
driven_any_max2.2529820007074823
driven_any_mean2.2529820007074823
driven_any_median2.2529820007074823
driven_any_min2.2529820007074823
driven_lanedir_consec_max-0.6703922314863293
driven_lanedir_consec_mean-0.6703922314863293
driven_lanedir_consec_min-0.6703922314863293
driven_lanedir_max-0.981576890387544
driven_lanedir_mean-0.981576890387544
driven_lanedir_median-0.981576890387544
driven_lanedir_min-0.981576890387544
in-drivable-lane_max3.650000000000008
in-drivable-lane_mean3.650000000000008
in-drivable-lane_min3.650000000000008
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.2529820007074823, "survival_time": 11.050000000000022, "driven_lanedir": -0.981576890387544, "in-drivable-lane": 3.650000000000008, "deviation-heading": 4.786890845878732, "distance-from-start": 0.1650658995166795, "deviation-center-line": 0.6297924356116489, "driven_lanedir_consec": -0.6703922314863293}}
simulation-passed1
survival_time_max11.050000000000022
survival_time_mean11.050000000000022
survival_time_min11.050000000000022
No reset possible
6219391Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-validationsim-0of4successnogpu-staging-spot-0-050:18:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median19.624999999999677
driven_lanedir_consec_median-2.2833573396184095
deviation-center-line_median3.7218629314846554


other stats
deviation-center-line_max5.624440921803863
deviation-center-line_mean3.847531344849058
deviation-center-line_min2.321958594623059
deviation-heading_max26.60223299317475
deviation-heading_mean22.548549318917487
deviation-heading_median23.582974785602737
deviation-heading_min16.42601471128972
distance-from-start_max0.1942774407735677
distance-from-start_mean0.17174583906298285
distance-from-start_median0.16549377093236367
distance-from-start_min0.16171837361363642
driven_any_max13.192555961036796
driven_any_mean8.680771039810347
driven_any_median8.44293571235582
driven_any_min4.64465677349295
driven_lanedir_consec_max-1.350823503209749
driven_lanedir_consec_mean-2.463813949203129
driven_lanedir_consec_min-3.9377176143659463
driven_lanedir_max-1.588045057450512
driven_lanedir_mean-2.6111476607107345
driven_lanedir_median-2.45941398551324
driven_lanedir_min-3.9377176143659463
in-drivable-lane_max31.199999999999164
in-drivable-lane_mean19.874999999999652
in-drivable-lane_min9.050000000000086
per-episodes
details{"udem-000-ego0": {"driven_any": 11.767591721222166, "survival_time": 59.99999999999873, "driven_lanedir": -3.235412439606571, "in-drivable-lane": 31.199999999999164, "deviation-heading": 25.08999659375354, "distance-from-start": 0.16620267144843068, "deviation-center-line": 2.8416834304121505, "driven_lanedir_consec": -2.973277706797285}, "udem-000-ego1": {"driven_any": 13.192555961036796, "survival_time": 59.99999999999873, "driven_lanedir": -3.9377176143659463, "in-drivable-lane": 28.649999999999263, "deviation-heading": 26.60223299317475, "distance-from-start": 0.1942774407735677, "deviation-center-line": 2.321958594623059, "driven_lanedir_consec": -3.9377176143659463}, "udem-000-ego2": {"driven_any": 4.64465677349295, "survival_time": 59.99999999999873, "driven_lanedir": -1.588045057450512, "in-drivable-lane": 9.050000000000086, "deviation-heading": 22.075952977451937, "distance-from-start": 0.16171837361363642, "deviation-center-line": 5.624440921803863, "driven_lanedir_consec": -1.350823503209749}, "udem-000-ego3": {"driven_any": 5.118279703489475, "survival_time": 59.99999999999873, "driven_lanedir": -1.6834155314199093, "in-drivable-lane": 10.600000000000088, "deviation-heading": 16.42601471128972, "distance-from-start": 0.16478487041629664, "deviation-center-line": 4.60204243255716, "driven_lanedir_consec": -1.5934369724395334}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6206392Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-050:18:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median32.649999999999075
driven_lanedir_consec_median-1.9530348010595893
deviation-center-line_median2.273456266407802


other stats
deviation-center-line_max4.487069802055514
deviation-center-line_mean2.614304590620363
deviation-center-line_min1.423236027610333
deviation-heading_max24.77668032357465
deviation-heading_mean16.90980681525949
deviation-heading_median16.89426788226723
deviation-heading_min9.07401117292885
distance-from-start_max0.16824535148358596
distance-from-start_mean0.14211606431862717
distance-from-start_median0.1657367724995466
distance-from-start_min0.06874536079182941
driven_any_max13.875026118123584
driven_any_mean9.062463156063842
driven_any_median11.152170945924237
driven_any_min0.07048461428331204
driven_lanedir_consec_max0.06632886269851967
driven_lanedir_consec_mean-1.6927576127751167
driven_lanedir_consec_min-2.931289711679807
driven_lanedir_max0.06632886269851967
driven_lanedir_mean-2.115774151627362
driven_lanedir_median-1.9530348010595893
driven_lanedir_min-4.623355867088786
in-drivable-lane_max46.94999999999895
in-drivable-lane_mean28.062499999999275
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 11.102730337347646, "survival_time": 59.99999999999873, "driven_lanedir": -2.565263920947652, "in-drivable-lane": 33.499999999999126, "deviation-heading": 24.77668032357465, "distance-from-start": 0.16813179312806123, "deviation-center-line": 2.359983777209587, "driven_lanedir_consec": -2.565263920947652}, "zigzag-000-ego1": {"driven_any": 11.201611554500824, "survival_time": 59.99999999999873, "driven_lanedir": -1.3408056811715263, "in-drivable-lane": 46.94999999999895, "deviation-heading": 13.559629365600603, "distance-from-start": 0.16334175187103198, "deviation-center-line": 1.423236027610333, "driven_lanedir_consec": -1.3408056811715263}, "zigzag-000-ego2": {"driven_any": 13.875026118123584, "survival_time": 59.99999999999873, "driven_lanedir": -4.623355867088786, "in-drivable-lane": 31.799999999999024, "deviation-heading": 20.22890639893385, "distance-from-start": 0.16824535148358596, "deviation-center-line": 2.1869287556060173, "driven_lanedir_consec": -2.931289711679807}, "zigzag-000-ego3": {"driven_any": 0.07048461428331204, "survival_time": 59.99999999999873, "driven_lanedir": 0.06632886269851967, "in-drivable-lane": 0.0, "deviation-heading": 9.07401117292885, "distance-from-start": 0.06874536079182941, "deviation-center-line": 4.487069802055514, "driven_lanedir_consec": 0.06632886269851967}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6198394Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFV-sim-testingsim-3of4successnogpu-staging-spot-0-050:14:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.79999999999908
driven_lanedir_consec_median-3.108773937651079
deviation-center-line_median1.8742255302019744


other stats
deviation-center-line_max1.8742255302019744
deviation-center-line_mean1.8742255302019744
deviation-center-line_min1.8742255302019744
deviation-heading_max18.170900576636345
deviation-heading_mean18.170900576636345
deviation-heading_median18.170900576636345
deviation-heading_min18.170900576636345
distance-from-start_max0.18359078741808416
distance-from-start_mean0.18359078741808416
distance-from-start_median0.18359078741808416
distance-from-start_min0.18359078741808416
driven_any_max13.474802862262546
driven_any_mean13.474802862262546
driven_any_median13.474802862262546
driven_any_min13.474802862262546
driven_lanedir_consec_max-3.108773937651079
driven_lanedir_consec_mean-3.108773937651079
driven_lanedir_consec_min-3.108773937651079
driven_lanedir_max-3.9252172477748175
driven_lanedir_mean-3.9252172477748175
driven_lanedir_median-3.9252172477748175
driven_lanedir_min-3.9252172477748175
in-drivable-lane_max35.79999999999908
in-drivable-lane_mean35.79999999999908
in-drivable-lane_min35.79999999999908
per-episodes
details{"zigzag-000-ego0": {"driven_any": 13.474802862262546, "survival_time": 59.99999999999873, "driven_lanedir": -3.9252172477748175, "in-drivable-lane": 35.79999999999908, "deviation-heading": 18.170900576636345, "distance-from-start": 0.18359078741808416, "deviation-center-line": 1.8742255302019744, "driven_lanedir_consec": -3.108773937651079}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6195395Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6192396Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFI-sim-testingsim-0of4successnogpu-staging-spot-0-050:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.90000000000016
in-drivable-lane_median9.050000000000088
driven_lanedir_consec_median-0.6408631475562054
deviation-center-line_median0.6907240783116083


other stats
deviation-center-line_max0.6907240783116083
deviation-center-line_mean0.6907240783116083
deviation-center-line_min0.6907240783116083
deviation-heading_max10.176469240760143
deviation-heading_mean10.176469240760143
deviation-heading_median10.176469240760143
deviation-heading_min10.176469240760143
distance-from-start_max0.1827035785136131
distance-from-start_mean0.1827035785136131
distance-from-start_median0.1827035785136131
distance-from-start_min0.1827035785136131
driven_any_max3.3956542525455653
driven_any_mean3.3956542525455653
driven_any_median3.3956542525455653
driven_any_min3.3956542525455653
driven_lanedir_consec_max-0.6408631475562054
driven_lanedir_consec_mean-0.6408631475562054
driven_lanedir_consec_min-0.6408631475562054
driven_lanedir_max-0.6408631475562054
driven_lanedir_mean-0.6408631475562054
driven_lanedir_median-0.6408631475562054
driven_lanedir_min-0.6408631475562054
in-drivable-lane_max9.050000000000088
in-drivable-lane_mean9.050000000000088
in-drivable-lane_min9.050000000000088
per-episodes
details{"udem1-000-ego0": {"driven_any": 3.3956542525455653, "survival_time": 20.90000000000016, "driven_lanedir": -0.6408631475562054, "in-drivable-lane": 9.050000000000088, "deviation-heading": 10.176469240760143, "distance-from-start": 0.1827035785136131, "deviation-center-line": 0.6907240783116083, "driven_lanedir_consec": -0.6408631475562054}}
simulation-passed1
survival_time_max20.90000000000016
survival_time_mean20.90000000000016
survival_time_min20.90000000000016
No reset possible
6188398Bea Baselines 🐤baseline-RL-sim-pytorchaido-LFVI_multi-sim-testingsim-3of4successnogpu-staging-spot-0-050:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6184515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-0of4failednogpu-staging-spot-0-050:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6179515Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6171516Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-validationsim-2of4failednogpu-staging-spot-0-050:01:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6170517Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6165519Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-050:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6160520Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6154521Bea Baselines 🐤baseline-behavior-cloningaido-LFV_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6150522Bea Baselines 🐤baseline-behavior-cloningaido-LFP-sim-testingsim-3of4failednogpu-staging-spot-0-050:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6147523Bea Baselines 🐤baseline-behavior-cloningaido-LFV-sim-testingsim-2of4failednogpu-staging-spot-0-050:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6144524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6141524Bea Baselines 🐤baseline-behavior-cloningaido-LFVI-sim-testingsim-1of4failednogpu-staging-spot-0-050:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6139525Bea Baselines 🐤baseline-behavior-cloningaido-LFI-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6137527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-050:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6135527Bea Baselines 🐤baseline-behavior-cloningaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6124530Bea Baselines 🐤baseline-dagger-pytorchaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-050:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.800000000000006
driven_lanedir_consec_median8.466892708382822
deviation-center-line_median2.599306355035794


other stats
deviation-center-line_max2.599306355035794
deviation-center-line_mean2.599306355035794
deviation-center-line_min2.599306355035794
deviation-heading_max13.219704013597276
deviation-heading_mean13.219704013597276
deviation-heading_median13.219704013597276
deviation-heading_min13.219704013597276
distance-from-start_max4.563334038714116
distance-from-start_mean4.563334038714116
distance-from-start_median4.563334038714116
distance-from-start_min4.563334038714116
driven_any_max9.265151738937536
driven_any_mean9.265151738937536
driven_any_median9.265151738937536
driven_any_min9.265151738937536
driven_lanedir_consec_max8.466892708382822
driven_lanedir_consec_mean8.466892708382822
driven_lanedir_consec_min8.466892708382822
driven_lanedir_max8.466892708382822
driven_lanedir_mean8.466892708382822
driven_lanedir_median8.466892708382822
driven_lanedir_min8.466892708382822
in-drivable-lane_max1.800000000000006
in-drivable-lane_mean1.800000000000006
in-drivable-lane_min1.800000000000006
per-episodes
details{"zigzag-000-ego0": {"driven_any": 9.265151738937536, "survival_time": 59.99999999999873, "driven_lanedir": 8.466892708382822, "in-drivable-lane": 1.800000000000006, "deviation-heading": 13.219704013597276, "distance-from-start": 4.563334038714116, "deviation-center-line": 2.599306355035794, "driven_lanedir_consec": 8.466892708382822}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6116532Bea Baselines 🐤baseline-dagger-pytorchaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-050:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.40000000000001
in-drivable-lane_median2.2000000000000313
driven_lanedir_consec_median4.843614181974852
deviation-center-line_median1.7955715260904774


other stats
deviation-center-line_max1.7955715260904774
deviation-center-line_mean1.7955715260904774
deviation-center-line_min1.7955715260904774
deviation-heading_max9.45941095762088
deviation-heading_mean9.45941095762088
deviation-heading_median9.45941095762088
deviation-heading_min9.45941095762088
distance-from-start_max2.2054767464006586
distance-from-start_mean2.2054767464006586
distance-from-start_median2.2054767464006586
distance-from-start_min2.2054767464006586
driven_any_max5.840677873718982
driven_any_mean5.840677873718982
driven_any_median5.840677873718982
driven_any_min5.840677873718982
driven_lanedir_consec_max4.843614181974852
driven_lanedir_consec_mean4.843614181974852
driven_lanedir_consec_min4.843614181974852
driven_lanedir_max5.150986397945422
driven_lanedir_mean5.150986397945422
driven_lanedir_median5.150986397945422
driven_lanedir_min5.150986397945422
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean2.2000000000000313
in-drivable-lane_min2.2000000000000313
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.840677873718982, "survival_time": 37.40000000000001, "driven_lanedir": 5.150986397945422, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 9.45941095762088, "distance-from-start": 2.2054767464006586, "deviation-center-line": 1.7955715260904774, "driven_lanedir_consec": 4.843614181974852}}
simulation-passed1
survival_time_max37.40000000000001
survival_time_mean37.40000000000001
survival_time_min37.40000000000001
No reset possible
6111533Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-validationsim-2of4successnogpu-staging-spot-0-050:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.268548519147192
survival_time_median59.99999999999873
deviation-center-line_median2.351181470609473
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.351181470609473
deviation-center-line_mean2.351181470609473
deviation-center-line_min2.351181470609473
deviation-heading_max11.0253282179071
deviation-heading_mean11.0253282179071
deviation-heading_median11.0253282179071
deviation-heading_min11.0253282179071
distance-from-start_max2.465456682794138
distance-from-start_mean2.465456682794138
distance-from-start_median2.465456682794138
distance-from-start_min2.465456682794138
driven_any_max10.513936735749446
driven_any_mean10.513936735749446
driven_any_median10.513936735749446
driven_any_min10.513936735749446
driven_lanedir_consec_max10.268548519147192
driven_lanedir_consec_mean10.268548519147192
driven_lanedir_consec_min10.268548519147192
driven_lanedir_max10.268548519147192
driven_lanedir_mean10.268548519147192
driven_lanedir_median10.268548519147192
driven_lanedir_min10.268548519147192
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.513936735749446, "survival_time": 59.99999999999873, "driven_lanedir": 10.268548519147192, "in-drivable-lane": 0.0, "deviation-heading": 11.0253282179071, "distance-from-start": 2.465456682794138, "deviation-center-line": 2.351181470609473, "driven_lanedir_consec": 10.268548519147192}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6108534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:17
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6106534Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:05
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6099536Bea Baselines 🐤baseline-dagger-pytorchaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-050:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median46.69999999999949
in-drivable-lane_median4.850000000000069
driven_lanedir_consec_median6.506787147280528
deviation-center-line_median2.4334328920287165


other stats
deviation-center-line_max2.4334328920287165
deviation-center-line_mean2.4334328920287165
deviation-center-line_min2.4334328920287165
deviation-heading_max11.165228710570922
deviation-heading_mean11.165228710570922
deviation-heading_median11.165228710570922
deviation-heading_min11.165228710570922
distance-from-start_max3.691624016702517
distance-from-start_mean3.691624016702517
distance-from-start_median3.691624016702517
distance-from-start_min3.691624016702517
driven_any_max7.853343410209946
driven_any_mean7.853343410209946
driven_any_median7.853343410209946
driven_any_min7.853343410209946
driven_lanedir_consec_max6.506787147280528
driven_lanedir_consec_mean6.506787147280528
driven_lanedir_consec_min6.506787147280528
driven_lanedir_max6.506787147280528
driven_lanedir_mean6.506787147280528
driven_lanedir_median6.506787147280528
driven_lanedir_min6.506787147280528
in-drivable-lane_max4.850000000000069
in-drivable-lane_mean4.850000000000069
in-drivable-lane_min4.850000000000069
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.853343410209946, "survival_time": 46.69999999999949, "driven_lanedir": 6.506787147280528, "in-drivable-lane": 4.850000000000069, "deviation-heading": 11.165228710570922, "distance-from-start": 3.691624016702517, "deviation-center-line": 2.4334328920287165, "driven_lanedir_consec": 6.506787147280528}}
simulation-passed1
survival_time_max46.69999999999949
survival_time_mean46.69999999999949
survival_time_min46.69999999999949
No reset possible
6082538Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-050:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median38.249999999999964
in-drivable-lane_median0.5000000000000071
driven_lanedir_consec_median5.317280975451824
deviation-center-line_median1.7957439081500657


other stats
deviation-center-line_max1.7957439081500657
deviation-center-line_mean1.7957439081500657
deviation-center-line_min1.7957439081500657
deviation-heading_max9.096595633189564
deviation-heading_mean9.096595633189564
deviation-heading_median9.096595633189564
deviation-heading_min9.096595633189564
distance-from-start_max2.9184199448434134
distance-from-start_mean2.9184199448434134
distance-from-start_median2.9184199448434134
distance-from-start_min2.9184199448434134
driven_any_max5.889831298575069
driven_any_mean5.889831298575069
driven_any_median5.889831298575069
driven_any_min5.889831298575069
driven_lanedir_consec_max5.317280975451824
driven_lanedir_consec_mean5.317280975451824
driven_lanedir_consec_min5.317280975451824
driven_lanedir_max5.461456920885775
driven_lanedir_mean5.461456920885775
driven_lanedir_median5.461456920885775
driven_lanedir_min5.461456920885775
in-drivable-lane_max0.5000000000000071
in-drivable-lane_mean0.5000000000000071
in-drivable-lane_min0.5000000000000071
per-episodes
details{"udem-000-ego0": {"driven_any": 5.889831298575069, "survival_time": 38.249999999999964, "driven_lanedir": 5.461456920885775, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 9.096595633189564, "distance-from-start": 2.9184199448434134, "deviation-center-line": 1.7957439081500657, "driven_lanedir_consec": 5.317280975451824}}
simulation-passed1
survival_time_max38.249999999999964
survival_time_mean38.249999999999964
survival_time_min38.249999999999964
No reset possible
6066541Bea Baselines 🐤baseline-dagger-pytorchaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-050:06:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.551930510586148
survival_time_median59.99999999999873
deviation-center-line_median2.788924582962742
in-drivable-lane_median0.8000000000000114


other stats
deviation-center-line_max2.788924582962742
deviation-center-line_mean2.788924582962742
deviation-center-line_min2.788924582962742
deviation-heading_max14.275319134587969
deviation-heading_mean14.275319134587969
deviation-heading_median14.275319134587969
deviation-heading_min14.275319134587969
distance-from-start_max4.056217762545085
distance-from-start_mean4.056217762545085
distance-from-start_median4.056217762545085
distance-from-start_min4.056217762545085
driven_any_max9.189356588756407
driven_any_mean9.189356588756407
driven_any_median9.189356588756407
driven_any_min9.189356588756407
driven_lanedir_consec_max8.551930510586148
driven_lanedir_consec_mean8.551930510586148
driven_lanedir_consec_min8.551930510586148
driven_lanedir_max8.551930510586148
driven_lanedir_mean8.551930510586148
driven_lanedir_median8.551930510586148
driven_lanedir_min8.551930510586148
in-drivable-lane_max0.8000000000000114
in-drivable-lane_mean0.8000000000000114
in-drivable-lane_min0.8000000000000114
per-episodes
details{"autolab-000-ego0": {"driven_any": 9.189356588756407, "survival_time": 59.99999999999873, "driven_lanedir": 8.551930510586148, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 14.275319134587969, "distance-from-start": 4.056217762545085, "deviation-center-line": 2.788924582962742, "driven_lanedir_consec": 8.551930510586148}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6057542Bea Baselines 🐤baseline-dagger-pytorchaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:03:13
The container "solut [...]
The container "solution-ego1" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6043600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-050:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6038604Bea Baselines 🐤template-rosaido-LFP-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.850000000000001
in-drivable-lane_median0.7000000000000006
driven_lanedir_consec_median0.23294188564096552
deviation-center-line_median0.08868497484242467


other stats
deviation-center-line_max0.08868497484242467
deviation-center-line_mean0.08868497484242467
deviation-center-line_min0.08868497484242467
deviation-heading_max0.5758119836537597
deviation-heading_mean0.5758119836537597
deviation-heading_median0.5758119836537597
deviation-heading_min0.5758119836537597
distance-from-start_max0.26360473695000747
distance-from-start_mean0.26360473695000747
distance-from-start_median0.26360473695000747
distance-from-start_min0.26360473695000747
driven_any_max0.26420165859913286
driven_any_mean0.26420165859913286
driven_any_median0.26420165859913286
driven_any_min0.26420165859913286
driven_lanedir_consec_max0.23294188564096552
driven_lanedir_consec_mean0.23294188564096552
driven_lanedir_consec_min0.23294188564096552
driven_lanedir_max0.23294188564096552
driven_lanedir_mean0.23294188564096552
driven_lanedir_median0.23294188564096552
driven_lanedir_min0.23294188564096552
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.7000000000000006
in-drivable-lane_min0.7000000000000006
per-episodes
details{"loop-000-ego0": {"driven_any": 0.26420165859913286, "survival_time": 1.850000000000001, "driven_lanedir": 0.23294188564096552, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 0.5758119836537597, "distance-from-start": 0.26360473695000747, "deviation-center-line": 0.08868497484242467, "driven_lanedir_consec": 0.23294188564096552}}
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.850000000000001
survival_time_min1.850000000000001
No reset possible
6030606Bea Baselines 🐤template-rosaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.800000000000001
in-drivable-lane_median0.8500000000000006
driven_lanedir_consec_median0.1796840334280574
deviation-center-line_median0.055526374979258934


other stats
deviation-center-line_max0.055526374979258934
deviation-center-line_mean0.055526374979258934
deviation-center-line_min0.055526374979258934
deviation-heading_max0.555491129527744
deviation-heading_mean0.555491129527744
deviation-heading_median0.555491129527744
deviation-heading_min0.555491129527744
distance-from-start_max0.27086601593588117
distance-from-start_mean0.27086601593588117
distance-from-start_median0.27086601593588117
distance-from-start_min0.27086601593588117
driven_any_max0.27255864122437246
driven_any_mean0.27255864122437246
driven_any_median0.27255864122437246
driven_any_min0.27255864122437246
driven_lanedir_consec_max0.1796840334280574
driven_lanedir_consec_mean0.1796840334280574
driven_lanedir_consec_min0.1796840334280574
driven_lanedir_max0.1796840334280574
driven_lanedir_mean0.1796840334280574
driven_lanedir_median0.1796840334280574
driven_lanedir_min0.1796840334280574
in-drivable-lane_max0.8500000000000006
in-drivable-lane_mean0.8500000000000006
in-drivable-lane_min0.8500000000000006
per-episodes
details{"udem-000-ego0": {"driven_any": 0.27255864122437246, "survival_time": 1.800000000000001, "driven_lanedir": 0.1796840334280574, "in-drivable-lane": 0.8500000000000006, "deviation-heading": 0.555491129527744, "distance-from-start": 0.27086601593588117, "deviation-center-line": 0.055526374979258934, "driven_lanedir_consec": 0.1796840334280574}}
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.800000000000001
survival_time_min1.800000000000001
No reset possible
6022608Bea Baselines 🐤template-rosaido-LF-sim-validationsim-3of4successnogpu-staging-spot-0-050:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.37818336615580167
survival_time_median14.800000000000075
deviation-center-line_median0.22173960868245185
in-drivable-lane_median12.100000000000067


other stats
deviation-center-line_max0.22173960868245185
deviation-center-line_mean0.22173960868245185
deviation-center-line_min0.22173960868245185
deviation-heading_max2.497420996872106
deviation-heading_mean2.497420996872106
deviation-heading_median2.497420996872106
deviation-heading_min2.497420996872106
distance-from-start_max3.71803367166957
distance-from-start_mean3.71803367166957
distance-from-start_median3.71803367166957
distance-from-start_min3.71803367166957
driven_any_max4.143383353434722
driven_any_mean4.143383353434722
driven_any_median4.143383353434722
driven_any_min4.143383353434722
driven_lanedir_consec_max0.37818336615580167
driven_lanedir_consec_mean0.37818336615580167
driven_lanedir_consec_min0.37818336615580167
driven_lanedir_max0.37818336615580167
driven_lanedir_mean0.37818336615580167
driven_lanedir_median0.37818336615580167
driven_lanedir_min0.37818336615580167
in-drivable-lane_max12.100000000000067
in-drivable-lane_mean12.100000000000067
in-drivable-lane_min12.100000000000067
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.143383353434722, "survival_time": 14.800000000000075, "driven_lanedir": 0.37818336615580167, "in-drivable-lane": 12.100000000000067, "deviation-heading": 2.497420996872106, "distance-from-start": 3.71803367166957, "deviation-center-line": 0.22173960868245185, "driven_lanedir_consec": 0.37818336615580167}}
simulation-passed1
survival_time_max14.800000000000075
survival_time_mean14.800000000000075
survival_time_min14.800000000000075
No reset possible
6017609Bea Baselines 🐤template-rosaido-LFVI_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
6007612Bea Baselines 🐤template-rosaido-LFV-sim-testingsim-3of4successnogpu-staging-spot-0-050:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.799999999999991
in-drivable-lane_median4.049999999999991
driven_lanedir_consec_median0.06959516618969978
deviation-center-line_median0.045567081009981095


other stats
deviation-center-line_max0.045567081009981095
deviation-center-line_mean0.045567081009981095
deviation-center-line_min0.045567081009981095
deviation-heading_max0.6736883682615724
deviation-heading_mean0.6736883682615724
deviation-heading_median0.6736883682615724
deviation-heading_min0.6736883682615724
distance-from-start_max1.0975243350800268
distance-from-start_mean1.0975243350800268
distance-from-start_median1.0975243350800268
distance-from-start_min1.0975243350800268
driven_any_max1.1089987133408683
driven_any_mean1.1089987133408683
driven_any_median1.1089987133408683
driven_any_min1.1089987133408683
driven_lanedir_consec_max0.06959516618969978
driven_lanedir_consec_mean0.06959516618969978
driven_lanedir_consec_min0.06959516618969978
driven_lanedir_max0.06959516618969978
driven_lanedir_mean0.06959516618969978
driven_lanedir_median0.06959516618969978
driven_lanedir_min0.06959516618969978
in-drivable-lane_max4.049999999999991
in-drivable-lane_mean4.049999999999991
in-drivable-lane_min4.049999999999991
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.1089987133408683, "survival_time": 4.799999999999991, "driven_lanedir": 0.06959516618969978, "in-drivable-lane": 4.049999999999991, "deviation-heading": 0.6736883682615724, "distance-from-start": 1.0975243350800268, "deviation-center-line": 0.045567081009981095, "driven_lanedir_consec": 0.06959516618969978}}
simulation-passed1
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible
5982618Bea Baselines 🐤baseline-duckietownaido-LFV_multi-sim-validationsim-1of4successnogpu-staging-spot-0-050:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median6.749999999999954
driven_lanedir_consec_median4.716761365295973
deviation-center-line_median4.078844595964972


other stats
deviation-center-line_max4.695737942954533
deviation-center-line_mean4.090826950089957
deviation-center-line_min3.509880665475351
deviation-heading_max21.931351771374107
deviation-heading_mean17.702044202713907
deviation-heading_median18.65152916921481
deviation-heading_min11.573766701051907
distance-from-start_max3.969649322652636
distance-from-start_mean2.7553624027586556
distance-from-start_median2.4964339006130256
distance-from-start_min2.058932487155935
driven_any_max7.914131458474906
driven_any_mean7.517314002156435
driven_any_median7.515579367557092
driven_any_min7.123965815036648
driven_lanedir_consec_max5.815899647838247
driven_lanedir_consec_mean4.655231881665435
driven_lanedir_consec_min3.371505148231549
driven_lanedir_max6.6384098766271755
driven_lanedir_mean6.111831709640736
driven_lanedir_median6.157879552967602
driven_lanedir_min5.493157856000566
in-drivable-lane_max9.349999999999742
in-drivable-lane_mean6.137499999999912
in-drivable-lane_min1.700000000000001
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.906980508166334, "survival_time": 59.99999999999873, "driven_lanedir": 5.86809372186179, "in-drivable-lane": 9.349999999999742, "deviation-heading": 18.25515279201402, "distance-from-start": 2.1678003306388907, "deviation-center-line": 3.802947473321443, "driven_lanedir_consec": 4.281800492611041}, "autolab-000-ego1": {"driven_any": 7.914131458474906, "survival_time": 59.99999999999873, "driven_lanedir": 6.6384098766271755, "in-drivable-lane": 6.300000000000003, "deviation-heading": 11.573766701051907, "distance-from-start": 3.969649322652636, "deviation-center-line": 3.509880665475351, "driven_lanedir_consec": 5.815899647838247}, "autolab-000-ego2": {"driven_any": 7.12417822694785, "survival_time": 59.99999999999873, "driven_lanedir": 6.447665384073413, "in-drivable-lane": 1.700000000000001, "deviation-heading": 19.0479055464156, "distance-from-start": 2.82506747058716, "deviation-center-line": 4.3547417186085005, "driven_lanedir_consec": 5.151722237980904}, "autolab-000-ego3": {"driven_any": 7.123965815036648, "survival_time": 59.99999999999873, "driven_lanedir": 5.493157856000566, "in-drivable-lane": 7.199999999999905, "deviation-heading": 21.931351771374107, "distance-from-start": 2.058932487155935, "deviation-center-line": 4.695737942954533, "driven_lanedir_consec": 3.371505148231549}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5960646Bea Baselines 🐤template-pytorchaido-LFV_multi-sim-validationsim-2of4successnogpu-staging-spot-0-050:17:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median46.2499999999986
driven_lanedir_consec_median0.7603832206158503
deviation-center-line_median1.062351446571496


other stats
deviation-center-line_max1.998080330694577
deviation-center-line_mean1.2205087484083363
deviation-center-line_min0.7592517697957769
deviation-heading_max20.75853756603181
deviation-heading_mean12.180918043177924
deviation-heading_median9.7364528264296
deviation-heading_min8.492228953820689
distance-from-start_max0.81024850522108
distance-from-start_mean0.48598804502832593
distance-from-start_median0.4178611885669383
distance-from-start_min0.2979812977583471
driven_any_max9.260799101238526
driven_any_mean6.079165479409684
driven_any_median5.740692787259442
driven_any_min3.57447724188133
driven_lanedir_consec_max1.569092018589093
driven_lanedir_consec_mean0.8710239791604111
driven_lanedir_consec_min0.39423745682085065
driven_lanedir_max2.558376502064024
driven_lanedir_mean1.3888485494802163
driven_lanedir_median1.301390119517995
driven_lanedir_min0.39423745682085065
in-drivable-lane_max48.79999999999863
in-drivable-lane_mean43.337499999998826
in-drivable-lane_min32.04999999999946
per-episodes
details{"loop-000-ego0": {"driven_any": 9.260799101238526, "survival_time": 59.99999999999873, "driven_lanedir": 1.569092018589093, "in-drivable-lane": 45.149999999998585, "deviation-heading": 9.31098913061786, "distance-from-start": 0.81024850522108, "deviation-center-line": 1.2735389622669084, "driven_lanedir_consec": 1.569092018589093}, "loop-000-ego1": {"driven_any": 3.856418886834176, "survival_time": 59.99999999999873, "driven_lanedir": 1.0336882204468976, "in-drivable-lane": 47.349999999998616, "deviation-heading": 10.16191652224134, "distance-from-start": 0.2979812977583471, "deviation-center-line": 0.7592517697957769, "driven_lanedir_consec": 1.0336882204468976}, "loop-000-ego2": {"driven_any": 7.624966687684708, "survival_time": 59.99999999999873, "driven_lanedir": 2.558376502064024, "in-drivable-lane": 32.04999999999946, "deviation-heading": 20.75853756603181, "distance-from-start": 0.4800065712051632, "deviation-center-line": 1.998080330694577, "driven_lanedir_consec": 0.487078220784803}, "loop-000-ego3": {"driven_any": 3.57447724188133, "survival_time": 59.99999999999873, "driven_lanedir": 0.39423745682085065, "in-drivable-lane": 48.79999999999863, "deviation-heading": 8.492228953820689, "distance-from-start": 0.35571580592871355, "deviation-center-line": 0.8511639308760836, "driven_lanedir_consec": 0.39423745682085065}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5949648Bea Baselines 🐤template-pytorchaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-050:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median38.79999999999939
driven_lanedir_consec_median0.22067678784381517
deviation-center-line_median1.9205366878098056


other stats
deviation-center-line_max1.9205366878098056
deviation-center-line_mean1.9205366878098056
deviation-center-line_min1.9205366878098056
deviation-heading_max17.618272341401447
deviation-heading_mean17.618272341401447
deviation-heading_median17.618272341401447
deviation-heading_min17.618272341401447
distance-from-start_max0.5131460797516549
distance-from-start_mean0.5131460797516549
distance-from-start_median0.5131460797516549
distance-from-start_min0.5131460797516549
driven_any_max5.462988832432653
driven_any_mean5.462988832432653
driven_any_median5.462988832432653
driven_any_min5.462988832432653
driven_lanedir_consec_max0.22067678784381517
driven_lanedir_consec_mean0.22067678784381517
driven_lanedir_consec_min0.22067678784381517
driven_lanedir_max1.0478792848347604
driven_lanedir_mean1.0478792848347604
driven_lanedir_median1.0478792848347604
driven_lanedir_min1.0478792848347604
in-drivable-lane_max38.79999999999939
in-drivable-lane_mean38.79999999999939
in-drivable-lane_min38.79999999999939
per-episodes
details{"loop-000-ego0": {"driven_any": 5.462988832432653, "survival_time": 59.99999999999873, "driven_lanedir": 1.0478792848347604, "in-drivable-lane": 38.79999999999939, "deviation-heading": 17.618272341401447, "distance-from-start": 0.5131460797516549, "deviation-center-line": 1.9205366878098056, "driven_lanedir_consec": 0.22067678784381517}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5944649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-1of4successnogpu-staging-spot-0-050:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.800000000000001
in-drivable-lane_median0.9500000000000008
driven_lanedir_consec_median0.0491267857550719
deviation-center-line_median0.0294609194837858


other stats
deviation-center-line_max0.0294609194837858
deviation-center-line_mean0.0294609194837858
deviation-center-line_min0.0294609194837858
deviation-heading_max0.7223933705953188
deviation-heading_mean0.7223933705953188
deviation-heading_median0.7223933705953188
deviation-heading_min0.7223933705953188
distance-from-start_max0.11324466370530108
distance-from-start_mean0.11324466370530108
distance-from-start_median0.11324466370530108
distance-from-start_min0.11324466370530108
driven_any_max0.12934594967057303
driven_any_mean0.12934594967057303
driven_any_median0.12934594967057303
driven_any_min0.12934594967057303
driven_lanedir_consec_max0.0491267857550719
driven_lanedir_consec_mean0.0491267857550719
driven_lanedir_consec_min0.0491267857550719
driven_lanedir_max0.0491267857550719
driven_lanedir_mean0.0491267857550719
driven_lanedir_median0.0491267857550719
driven_lanedir_min0.0491267857550719
in-drivable-lane_max0.9500000000000008
in-drivable-lane_mean0.9500000000000008
in-drivable-lane_min0.9500000000000008
per-episodes
details{"4way-000-ego0": {"driven_any": 0.12934594967057303, "survival_time": 1.800000000000001, "driven_lanedir": 0.0491267857550719, "in-drivable-lane": 0.9500000000000008, "deviation-heading": 0.7223933705953188, "distance-from-start": 0.11324466370530108, "deviation-center-line": 0.0294609194837858, "driven_lanedir_consec": 0.0491267857550719}}
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.800000000000001
survival_time_min1.800000000000001
No reset possible
5940649Bea Baselines 🐤template-pytorchaido-LFVI-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5937650Bea Baselines 🐤template-pytorchaido-LFI-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5930651Bea Baselines 🐤template-pytorchaido-LF-sim-validationsim-0of4successnogpu-staging-spot-0-050:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8407225683232395
survival_time_median59.99999999999873
deviation-center-line_median1.3169921035228274
in-drivable-lane_median42.799999999998626


other stats
deviation-center-line_max1.3169921035228274
deviation-center-line_mean1.3169921035228274
deviation-center-line_min1.3169921035228274
deviation-heading_max13.198621232324983
deviation-heading_mean13.198621232324983
deviation-heading_median13.198621232324983
deviation-heading_min13.198621232324983
distance-from-start_max0.2560551376618842
distance-from-start_mean0.2560551376618842
distance-from-start_median0.2560551376618842
distance-from-start_min0.2560551376618842
driven_any_max4.333189855230232
driven_any_mean4.333189855230232
driven_any_median4.333189855230232
driven_any_min4.333189855230232
driven_lanedir_consec_max0.8407225683232395
driven_lanedir_consec_mean0.8407225683232395
driven_lanedir_consec_min0.8407225683232395
driven_lanedir_max0.8407225683232395
driven_lanedir_mean0.8407225683232395
driven_lanedir_median0.8407225683232395
driven_lanedir_min0.8407225683232395
in-drivable-lane_max42.799999999998626
in-drivable-lane_mean42.799999999998626
in-drivable-lane_min42.799999999998626
per-episodes
details{"loop2-000-ego0": {"driven_any": 4.333189855230232, "survival_time": 59.99999999999873, "driven_lanedir": 0.8407225683232395, "in-drivable-lane": 42.799999999998626, "deviation-heading": 13.198621232324983, "distance-from-start": 0.2560551376618842, "deviation-center-line": 1.3169921035228274, "driven_lanedir_consec": 0.8407225683232395}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5917654Bea Baselines 🐤template-pytorchaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-050:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median24.44999999999944
driven_lanedir_consec_median2.697421226546099
deviation-center-line_median1.7016204015785017


other stats
deviation-center-line_max1.7016204015785017
deviation-center-line_mean1.7016204015785017
deviation-center-line_min1.7016204015785017
deviation-heading_max26.91170413751052
deviation-heading_mean26.91170413751052
deviation-heading_median26.91170413751052
deviation-heading_min26.91170413751052
distance-from-start_max0.21719744217278872
distance-from-start_mean0.21719744217278872
distance-from-start_median0.21719744217278872
distance-from-start_min0.21719744217278872
driven_any_max6.986727449571344
driven_any_mean6.986727449571344
driven_any_median6.986727449571344
driven_any_min6.986727449571344
driven_lanedir_consec_max2.697421226546099
driven_lanedir_consec_mean2.697421226546099
driven_lanedir_consec_min2.697421226546099
driven_lanedir_max2.697421226546099
driven_lanedir_mean2.697421226546099
driven_lanedir_median2.697421226546099
driven_lanedir_min2.697421226546099
in-drivable-lane_max24.44999999999944
in-drivable-lane_mean24.44999999999944
in-drivable-lane_min24.44999999999944
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.986727449571344, "survival_time": 59.99999999999873, "driven_lanedir": 2.697421226546099, "in-drivable-lane": 24.44999999999944, "deviation-heading": 26.91170413751052, "distance-from-start": 0.21719744217278872, "deviation-center-line": 1.7016204015785017, "driven_lanedir_consec": 2.697421226546099}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5897655Bea Baselines 🐤template-pytorchaido-LFV-sim-testingsim-3of4successnogpu-staging-spot-0-050:13:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median33.69999999999932
driven_lanedir_consec_median0.2194417260777221
deviation-center-line_median2.236460647340046


other stats
deviation-center-line_max2.236460647340046
deviation-center-line_mean2.236460647340046
deviation-center-line_min2.236460647340046
deviation-heading_max21.277579914799265
deviation-heading_mean21.277579914799265
deviation-heading_median21.277579914799265
deviation-heading_min21.277579914799265
distance-from-start_max0.4135630123835922
distance-from-start_mean0.4135630123835922
distance-from-start_median0.4135630123835922
distance-from-start_min0.4135630123835922
driven_any_max5.645835091105003
driven_any_mean5.645835091105003
driven_any_median5.645835091105003
driven_any_min5.645835091105003
driven_lanedir_consec_max0.2194417260777221
driven_lanedir_consec_mean0.2194417260777221
driven_lanedir_consec_min0.2194417260777221
driven_lanedir_max1.505472323869281
driven_lanedir_mean1.505472323869281
driven_lanedir_median1.505472323869281
driven_lanedir_min1.505472323869281
in-drivable-lane_max33.69999999999932
in-drivable-lane_mean33.69999999999932
in-drivable-lane_min33.69999999999932
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.645835091105003, "survival_time": 59.99999999999873, "driven_lanedir": 1.505472323869281, "in-drivable-lane": 33.69999999999932, "deviation-heading": 21.277579914799265, "distance-from-start": 0.4135630123835922, "deviation-center-line": 2.236460647340046, "driven_lanedir_consec": 0.2194417260777221}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5890656Bea Baselines 🐤template-pytorchaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-050:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.299999999999993
in-drivable-lane_median2.299999999999992
driven_lanedir_consec_median0.35260488064184425
deviation-center-line_median0.09003186526242922


other stats
deviation-center-line_max0.09003186526242922
deviation-center-line_mean0.09003186526242922
deviation-center-line_min0.09003186526242922
deviation-heading_max0.9492124927377468
deviation-heading_mean0.9492124927377468
deviation-heading_median0.9492124927377468
deviation-heading_min0.9492124927377468
distance-from-start_max0.5478381689953259
distance-from-start_mean0.5478381689953259
distance-from-start_median0.5478381689953259
distance-from-start_min0.5478381689953259
driven_any_max0.8465491576582836
driven_any_mean0.8465491576582836
driven_any_median0.8465491576582836
driven_any_min0.8465491576582836
driven_lanedir_consec_max0.35260488064184425
driven_lanedir_consec_mean0.35260488064184425
driven_lanedir_consec_min0.35260488064184425
driven_lanedir_max0.35260488064184425
driven_lanedir_mean0.35260488064184425
driven_lanedir_median0.35260488064184425
driven_lanedir_min0.35260488064184425
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean2.299999999999992
in-drivable-lane_min2.299999999999992
per-episodes
details{"udem-000-ego0": {"driven_any": 0.8465491576582836, "survival_time": 4.299999999999993, "driven_lanedir": 0.35260488064184425, "in-drivable-lane": 2.299999999999992, "deviation-heading": 0.9492124927377468, "distance-from-start": 0.5478381689953259, "deviation-center-line": 0.09003186526242922, "driven_lanedir_consec": 0.35260488064184425}}
simulation-passed1
survival_time_max4.299999999999993
survival_time_mean4.299999999999993
survival_time_min4.299999999999993
No reset possible
5879659Bea Baselines 🐤template-pytorchaido-LFVI_multi-sim-testingsim-1of4successnogpu-staging-spot-0-050:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2999999999999963
in-drivable-lane_median2.149999999999996
driven_lanedir_consec_median0.08583923778452096
deviation-center-line_median0.07300290341016928


other stats
deviation-center-line_max0.10522438465654343
deviation-center-line_mean0.06880369263222624
deviation-center-line_min0.023984579052022944
deviation-heading_max0.8615480785505154
deviation-heading_mean0.687482400867796
deviation-heading_median0.6758540592291427
deviation-heading_min0.5366734064623834
distance-from-start_max0.4162972450010867
distance-from-start_mean0.18864431601637704
distance-from-start_median0.11990044154221972
distance-from-start_min0.09847913597998192
driven_any_max0.4725141210363941
driven_any_mean0.22343808328031708
driven_any_median0.15548198814253444
driven_any_min0.11027423579980536
driven_lanedir_consec_max0.27307692003565975
driven_lanedir_consec_mean0.1178480436473397
driven_lanedir_consec_min0.026636778984657106
driven_lanedir_max0.27307692003565975
driven_lanedir_mean0.1178480436473397
driven_lanedir_median0.08583923778452096
driven_lanedir_min0.026636778984657106
in-drivable-lane_max2.449999999999996
in-drivable-lane_mean2.087499999999996
in-drivable-lane_min1.5999999999999954
per-episodes
details{"4way-000-ego0": {"driven_any": 0.16028827757180347, "survival_time": 3.2999999999999963, "driven_lanedir": 0.08457652159280626, "in-drivable-lane": 1.8999999999999957, "deviation-heading": 0.8615480785505154, "distance-from-start": 0.09847913597998192, "deviation-center-line": 0.023984579052022944, "driven_lanedir_consec": 0.08457652159280626}, "4way-000-ego1": {"driven_any": 0.1506756987132654, "survival_time": 3.2999999999999963, "driven_lanedir": 0.08710195397623566, "in-drivable-lane": 2.399999999999996, "deviation-heading": 0.5366734064623834, "distance-from-start": 0.13923174771107436, "deviation-center-line": 0.08526831187767218, "driven_lanedir_consec": 0.08710195397623566}, "4way-000-ego2": {"driven_any": 0.4725141210363941, "survival_time": 3.2999999999999963, "driven_lanedir": 0.27307692003565975, "in-drivable-lane": 1.5999999999999954, "deviation-heading": 0.5658992239247695, "distance-from-start": 0.4162972450010867, "deviation-center-line": 0.10522438465654343, "driven_lanedir_consec": 0.27307692003565975}, "4way-000-ego3": {"driven_any": 0.11027423579980536, "survival_time": 3.2999999999999963, "driven_lanedir": 0.026636778984657106, "in-drivable-lane": 2.449999999999996, "deviation-heading": 0.7858088945335157, "distance-from-start": 0.10056913537336508, "deviation-center-line": 0.06073749494266638, "driven_lanedir_consec": 0.026636778984657106}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
5875660Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5870661Bea Baselines 🐤template-tensorflowaido-LFP-sim-validationsim-1of4failednogpu-staging-spot-0-050:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5865663Bea Baselines 🐤template-tensorflowaido-LFVI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5860664Bea Baselines 🐤template-tensorflowaido-LFI-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5855665Bea Baselines 🐤template-tensorflowaido-LF-sim-validationsim-1of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5849666Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5844667Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-2of4failednogpu-staging-spot-0-050:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5839668Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failednogpu-staging-spot-0-050:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5834669Bea Baselines 🐤template-tensorflowaido-LFV-sim-testingsim-3of4failednogpu-staging-spot-0-050:01:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5831670Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-1of4failednogpu-staging-spot-0-050:01:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5827671Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5821673Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:02:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5813703Bea Baselines 🐤template-randomaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:05:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median15.50000000000015
driven_lanedir_consec_median0.2523502432780965
deviation-center-line_median0.4270318356067208


other stats
deviation-center-line_max2.4472420705619533
deviation-center-line_mean0.834439744050357
deviation-center-line_min0.03645323442603294
deviation-heading_max5.758343124435709
deviation-heading_mean2.9647842264649227
deviation-heading_median2.4959523963356456
deviation-heading_min1.1088889887526905
distance-from-start_max0.735788357677379
distance-from-start_mean0.4455427430503656
distance-from-start_median0.3918367385500151
distance-from-start_min0.26270913742405294
driven_any_max5.001991003394667
driven_any_mean1.5256410869454424
driven_any_median0.4116848275607308
driven_any_min0.277203689265641
driven_lanedir_consec_max0.2737815745175769
driven_lanedir_consec_mean0.21260926710351993
driven_lanedir_consec_min0.07195500734030984
driven_lanedir_max0.25840198320624896
driven_lanedir_mean0.2081068961174864
driven_lanedir_median0.25103529696169347
driven_lanedir_min0.07195500734030984
in-drivable-lane_max19.05000000000016
in-drivable-lane_mean12.737500000000114
in-drivable-lane_min0.8999999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.001991003394667, "survival_time": 20.70000000000016, "driven_lanedir": 0.25577209057344286, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.758343124435709, "distance-from-start": 0.735788357677379, "deviation-center-line": 0.7687325001714215, "driven_lanedir_consec": 0.2737815745175769}, "zigzag-000-ego1": {"driven_any": 0.27720368926578076, "survival_time": 20.70000000000016, "driven_lanedir": 0.24629850334994408, "in-drivable-lane": 18.85000000000016, "deviation-heading": 1.2379708953066022, "distance-from-start": 0.26270913742405294, "deviation-center-line": 0.08533117104202012, "driven_lanedir_consec": 0.24629850334994408}, "zigzag-000-ego2": {"driven_any": 0.277203689265641, "survival_time": 20.70000000000016, "driven_lanedir": 0.25840198320624896, "in-drivable-lane": 0.8999999999999998, "deviation-heading": 3.7539338973646887, "distance-from-start": 0.262709137424054, "deviation-center-line": 2.4472420705619533, "driven_lanedir_consec": 0.25840198320624896}, "zigzag-000-ego3": {"driven_any": 0.5461659658556808, "survival_time": 20.70000000000016, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 19.05000000000016, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
5807705Bea Baselines 🐤template-randomaido-LFV-sim-validationsim-1of4successnogpu-staging-spot-0-050:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.899999999999994
in-drivable-lane_median1.6499999999999972
driven_lanedir_consec_median0.4413284134549402
deviation-center-line_median0.07863297638595365


other stats
deviation-center-line_max0.07863297638595365
deviation-center-line_mean0.07863297638595365
deviation-center-line_min0.07863297638595365
deviation-heading_max1.38663091368877
deviation-heading_mean1.38663091368877
deviation-heading_median1.38663091368877
deviation-heading_min1.38663091368877
distance-from-start_max0.4891723059495441
distance-from-start_mean0.4891723059495441
distance-from-start_median0.4891723059495441
distance-from-start_min0.4891723059495441
driven_any_max0.5134230938905382
driven_any_mean0.5134230938905382
driven_any_median0.5134230938905382
driven_any_min0.5134230938905382
driven_lanedir_consec_max0.4413284134549402
driven_lanedir_consec_mean0.4413284134549402
driven_lanedir_consec_min0.4413284134549402
driven_lanedir_max0.4413284134549402
driven_lanedir_mean0.4413284134549402
driven_lanedir_median0.4413284134549402
driven_lanedir_min0.4413284134549402
in-drivable-lane_max1.6499999999999972
in-drivable-lane_mean1.6499999999999972
in-drivable-lane_min1.6499999999999972
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.5134230938905382, "survival_time": 3.899999999999994, "driven_lanedir": 0.4413284134549402, "in-drivable-lane": 1.6499999999999972, "deviation-heading": 1.38663091368877, "distance-from-start": 0.4891723059495441, "deviation-center-line": 0.07863297638595365, "driven_lanedir_consec": 0.4413284134549402}}
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean3.899999999999994
survival_time_min3.899999999999994
No reset possible
5802706Bea Baselines 🐤template-randomaido-LFVI-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median0.9
driven_lanedir_consec_median0.39017518658850303
deviation-center-line_median0.1712487257959815


other stats
deviation-center-line_max0.1712487257959815
deviation-center-line_mean0.1712487257959815
deviation-center-line_min0.1712487257959815
deviation-heading_max1.7031418047241604
deviation-heading_mean1.7031418047241604
deviation-heading_median1.7031418047241604
deviation-heading_min1.7031418047241604
distance-from-start_max0.40285563030397936
distance-from-start_mean0.40285563030397936
distance-from-start_median0.40285563030397936
distance-from-start_min0.40285563030397936
driven_any_max0.4240764502839653
driven_any_mean0.4240764502839653
driven_any_median0.4240764502839653
driven_any_min0.4240764502839653
driven_lanedir_consec_max0.39017518658850303
driven_lanedir_consec_mean0.39017518658850303
driven_lanedir_consec_min0.39017518658850303
driven_lanedir_max0.39017518658850303
driven_lanedir_mean0.39017518658850303
driven_lanedir_median0.39017518658850303
driven_lanedir_min0.39017518658850303
in-drivable-lane_max0.9
in-drivable-lane_mean0.9
in-drivable-lane_min0.9
per-episodes
details{"udem-000-ego0": {"driven_any": 0.4240764502839653, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030397936, "deviation-center-line": 0.1712487257959815, "driven_lanedir_consec": 0.39017518658850303}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
5786710Bea Baselines 🐤template-randomaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-050:12:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median46.824999999998994
driven_lanedir_consec_median0.19888958841261967
deviation-center-line_median1.2302307544380242


other stats
deviation-center-line_max2.7624626207296523
deviation-center-line_mean1.4614842694980663
deviation-center-line_min0.6230129483865658
deviation-heading_max37.82293240559152
deviation-heading_mean14.895649917871705
deviation-heading_median8.929445635074492
deviation-heading_min3.900775995746316
distance-from-start_max1.4108418329399008
distance-from-start_mean0.7424833694964633
distance-from-start_median0.7795458225229759
distance-from-start_min2.482534153247273e-16
driven_any_max15.326310847370593
driven_any_mean6.8063963066798205
driven_any_median5.949637189674196
driven_any_min2.9790409838966753e-13
driven_lanedir_consec_max0.29723254612384026
driven_lanedir_consec_mean0.17375293073726988
driven_lanedir_consec_min0.0
driven_lanedir_max0.2967938965440506
driven_lanedir_mean0.16460716406936743
driven_lanedir_median0.1808173798667096
driven_lanedir_min0.0
in-drivable-lane_max53.199999999998695
in-drivable-lane_mean36.71249999999917
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 15.326310847370593, "survival_time": 59.99999999999873, "driven_lanedir": 0.2967938965440506, "in-drivable-lane": 41.699999999999264, "deviation-heading": 13.4239573807347, "distance-from-start": 1.4108418329399008, "deviation-center-line": 1.7741548227320476, "driven_lanedir_consec": 0.29723254612384026}, "loop-000-ego1": {"driven_any": 6.69482709059637, "survival_time": 59.99999999999873, "driven_lanedir": 0.2307195600231423, "in-drivable-lane": 51.94999999999872, "deviation-heading": 4.434933889414283, "distance-from-start": 0.82330328736858, "deviation-center-line": 0.6230129483865658, "driven_lanedir_consec": 0.24485358668177015}, "loop-000-ego2": {"driven_any": 5.204447288752023, "survival_time": 59.99999999999873, "driven_lanedir": 0.13091519971027687, "in-drivable-lane": 53.199999999998695, "deviation-heading": 3.900775995746316, "distance-from-start": 0.7357883576773718, "deviation-center-line": 0.6863066861440009, "driven_lanedir_consec": 0.15292559014346918}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5784711Bea Baselines 🐤template-randomaido-LFP-sim-testingsim-0of4successnogpu-staging-spot-0-050:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.7499999999999942
in-drivable-lane_median2.2499999999999947
driven_lanedir_consec_median0.022350044024311844
deviation-center-line_median0.02664350798512652


other stats
deviation-center-line_max0.02664350798512652
deviation-center-line_mean0.02664350798512652
deviation-center-line_min0.02664350798512652
deviation-heading_max1.126574172093021
deviation-heading_mean1.126574172093021
deviation-heading_median1.126574172093021
deviation-heading_min1.126574172093021
distance-from-start_max0.4028556303039825
distance-from-start_mean0.4028556303039825
distance-from-start_median0.4028556303039825
distance-from-start_min0.4028556303039825
driven_any_max0.4240764502839735
driven_any_mean0.4240764502839735
driven_any_median0.4240764502839735
driven_any_min0.4240764502839735
driven_lanedir_consec_max0.022350044024311844
driven_lanedir_consec_mean0.022350044024311844
driven_lanedir_consec_min0.022350044024311844
driven_lanedir_max0.022350044024311844
driven_lanedir_mean0.022350044024311844
driven_lanedir_median0.022350044024311844
driven_lanedir_min0.022350044024311844
in-drivable-lane_max2.2499999999999947
in-drivable-lane_mean2.2499999999999947
in-drivable-lane_min2.2499999999999947
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.4240764502839735, "survival_time": 3.7499999999999942, "driven_lanedir": 0.022350044024311844, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 1.126574172093021, "distance-from-start": 0.4028556303039825, "deviation-center-line": 0.02664350798512652, "driven_lanedir_consec": 0.022350044024311844}}
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean3.7499999999999942
survival_time_min3.7499999999999942
No reset possible
5778713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-0of4successnogpu-staging-spot-0-050:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.350000000000026
in-drivable-lane_median7.900000000000015
driven_lanedir_consec_median0.02948511522371433
deviation-center-line_median0.3268413798803088


other stats
deviation-center-line_max0.3268413798803088
deviation-center-line_mean0.3268413798803088
deviation-center-line_min0.3268413798803088
deviation-heading_max2.54887264951439
deviation-heading_mean2.54887264951439
deviation-heading_median2.54887264951439
deviation-heading_min2.54887264951439
distance-from-start_max0.5461575079396541
distance-from-start_mean0.5461575079396541
distance-from-start_median0.5461575079396541
distance-from-start_min0.5461575079396541
driven_any_max2.2955250818765145
driven_any_mean2.2955250818765145
driven_any_median2.2955250818765145
driven_any_min2.2955250818765145
driven_lanedir_consec_max0.02948511522371433
driven_lanedir_consec_mean0.02948511522371433
driven_lanedir_consec_min0.02948511522371433
driven_lanedir_max0.03283062285727567
driven_lanedir_mean0.03283062285727567
driven_lanedir_median0.03283062285727567
driven_lanedir_min0.03283062285727567
in-drivable-lane_max7.900000000000015
in-drivable-lane_mean7.900000000000015
in-drivable-lane_min7.900000000000015
per-episodes
details{"udem-000-ego0": {"driven_any": 2.2955250818765145, "survival_time": 11.350000000000026, "driven_lanedir": 0.03283062285727567, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.54887264951439, "distance-from-start": 0.5461575079396541, "deviation-center-line": 0.3268413798803088, "driven_lanedir_consec": 0.02948511522371433}}
simulation-passed1
survival_time_max11.350000000000026
survival_time_mean11.350000000000026
survival_time_min11.350000000000026
No reset possible
5774713Bea Baselines 🐤template-randomaido-LFVI-sim-testingsim-2of4successnogpu-staging-spot-0-050:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5771714Bea Baselines 🐤template-randomaido-LFI-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5761732Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-validationsim-0of4successnogpu-staging-spot-0-050:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5116931584219897


other stats
deviation-center-line_max2.128488788608653
deviation-center-line_mean1.5116931584219897
deviation-center-line_min0.8948975282353262
deviation-heading_max32.249113233675025
deviation-heading_mean31.48103999887634
deviation-heading_median31.48103999887634
deviation-heading_min30.712966764077652
distance-from-start_max4.440892098500626e-16
distance-from-start_mean2.3592239273284576e-16
distance-from-start_median2.3592239273284576e-16
distance-from-start_min2.7755575615628914e-17
driven_any_max5.329070518200751e-13
driven_any_mean2.831068712794149e-13
driven_any_median2.831068712794149e-13
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.128488788608653, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5753734Bea Baselines 🐤baseline-duckietown-mlaido-LFV-sim-validationsim-2of4successnogpu-staging-spot-0-050:08:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949084199908675


other stats
deviation-center-line_max0.8949084199908675
deviation-center-line_mean0.8949084199908675
deviation-center-line_min0.8949084199908675
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max2.220446049250313e-16
distance-from-start_mean2.220446049250313e-16
distance-from-start_median2.220446049250313e-16
distance-from-start_min2.220446049250313e-16
driven_any_max2.6645352591003757e-13
driven_any_mean2.6645352591003757e-13
driven_any_median2.6645352591003757e-13
driven_any_min2.6645352591003757e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.8949084199908675, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5746736Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-050:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8949116056299468


other stats
deviation-center-line_max0.8949116056299468
deviation-center-line_mean0.8949116056299468
deviation-center-line_min0.8949116056299468
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949116056299468, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5734739Bea Baselines 🐤baseline-duckietown-mlaido-LFV_multi-sim-testingsim-2of4successnogpu-staging-spot-0-050:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median1.5844880209937626


other stats
deviation-center-line_max3.468400757620591
deviation-center-line_mean1.715124244963702
deviation-center-line_min0.22312018024669147
deviation-heading_max40.967332753486225
deviation-heading_mean25.437951450471505
deviation-heading_median28.06618021079834
deviation-heading_min4.652112626803105
distance-from-start_max4.965068306494546e-16
distance-from-start_mean3.0415125785996837e-16
distance-from-start_median3.4617131258739496e-16
distance-from-start_min2.7755575615628914e-17
driven_any_max5.95808196779335e-13
driven_any_mean3.649815094319581e-13
driven_any_median4.154055751048713e-13
driven_any_min3.3306690738754696e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.406513421257873, "driven_lanedir_consec": 0.0}, "loop-000-ego1": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 18.309428016005157, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 3.468400757620591, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803105, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.22312018024669147, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5728740Bea Baselines 🐤baseline-duckietown-mlaido-LFP-sim-testingsim-3of4successnogpu-staging-spot-0-050:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median-2.5756543564625645e-06
deviation-center-line_median0.406520962699379


other stats
deviation-center-line_max0.406520962699379
deviation-center-line_mean0.406520962699379
deviation-center-line_min0.406520962699379
deviation-heading_max40.96736494841265
deviation-heading_mean40.96736494841265
deviation-heading_median40.96736494841265
deviation-heading_min40.96736494841265
distance-from-start_max4.440892098500626e-16
distance-from-start_mean4.440892098500626e-16
distance-from-start_median4.440892098500626e-16
distance-from-start_min4.440892098500626e-16
driven_any_max5.329070518200751e-13
driven_any_mean5.329070518200751e-13
driven_any_median5.329070518200751e-13
driven_any_min5.329070518200751e-13
driven_lanedir_consec_max-2.5756543564625645e-06
driven_lanedir_consec_mean-2.5756543564625645e-06
driven_lanedir_consec_min-2.5756543564625645e-06
driven_lanedir_max-2.5756543564625645e-06
driven_lanedir_mean-2.5756543564625645e-06
driven_lanedir_median-2.5756543564625645e-06
driven_lanedir_min-2.5756543564625645e-06
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": -2.5756543564625645e-06, "in-drivable-lane": 0.0, "deviation-heading": 40.96736494841265, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.406520962699379, "driven_lanedir_consec": -2.5756543564625645e-06}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5713743Bea Baselines 🐤baseline-duckietown-mlaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-050:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524565


other stats
deviation-center-line_max0.4065274986524565
deviation-center-line_mean0.4065274986524565
deviation-center-line_min0.4065274986524565
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max0.0
distance-from-start_mean0.0
distance-from-start_median0.0
distance-from-start_min0.0
driven_any_max0.0
driven_any_mean0.0
driven_any_median0.0
driven_any_min0.0
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 0.0, "deviation-center-line": 0.4065274986524565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5710749Bea Baselines 🐤baseline-RPL-rosaido-LFV_multi-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:11
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5704750Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-validationsim-1of4failednogpu-staging-spot-0-050:00:55
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5698751Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-validationsim-1of4failednogpu-staging-spot-0-050:01:15
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5690752Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-validationsim-2of4failednogpu-staging-spot-0-050:02:04
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5685753Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-validationsim-0of4failednogpu-staging-spot-0-050:01:11
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5680754Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-validationsim-2of4failednogpu-staging-spot-0-050:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5675755Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-validationsim-2of4failednogpu-staging-spot-0-050:01:02
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5670757Bea Baselines 🐤baseline-RPL-rosaido-LFP-sim-testingsim-2of4failednogpu-staging-spot-0-050:00:54
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5665758Bea Baselines 🐤baseline-RPL-rosaido-LFV-sim-testingsim-2of4failednogpu-staging-spot-0-050:01:10
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5657759Bea Baselines 🐤baseline-RPL-rosaido-LFVI-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:12
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5651760Bea Baselines 🐤baseline-RPL-rosaido-LFI-sim-testingsim-3of4failednogpu-staging-spot-0-050:01:11
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5644761Bea Baselines 🐤baseline-RPL-rosaido-LF-sim-testingsim-0of4failednogpu-staging-spot-0-050:00:56
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5638762Bea Baselines 🐤baseline-RPL-rosaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:02:37
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5631633Bea Baselines 🐤minimal-agent-fullaido-LFP-full-sim-validationsim-0of4successnogpu-staging-spot-0-050:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median51.949999999999186
in-drivable-lane_median3.449999999999882
driven_lanedir_consec_median2.780669378492081
deviation-center-line_median5.9832374225219125


other stats
deviation-center-line_max5.9832374225219125
deviation-center-line_mean5.9832374225219125
deviation-center-line_min5.9832374225219125
deviation-heading_max5.351741767067895
deviation-heading_mean5.351741767067895
deviation-heading_median5.351741767067895
deviation-heading_min5.351741767067895
distance-from-start_max1.6305272648718805
distance-from-start_mean1.6305272648718805
distance-from-start_median1.6305272648718805
distance-from-start_min1.6305272648718805
driven_any_max2.951091089513758
driven_any_mean2.951091089513758
driven_any_median2.951091089513758
driven_any_min2.951091089513758
driven_lanedir_consec_max2.780669378492081
driven_lanedir_consec_mean2.780669378492081
driven_lanedir_consec_min2.780669378492081
driven_lanedir_max2.780669378492081
driven_lanedir_mean2.780669378492081
driven_lanedir_median2.780669378492081
driven_lanedir_min2.780669378492081
in-drivable-lane_max3.449999999999882
in-drivable-lane_mean3.449999999999882
in-drivable-lane_min3.449999999999882
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.951091089513758, "survival_time": 51.949999999999186, "driven_lanedir": 2.780669378492081, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.351741767067895, "distance-from-start": 1.6305272648718805, "deviation-center-line": 5.9832374225219125, "driven_lanedir_consec": 2.780669378492081}}
simulation-passed1
survival_time_max51.949999999999186
survival_time_mean51.949999999999186
survival_time_min51.949999999999186
No reset possible
5619636Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-validationsim-2of4successnogpu-staging-spot-0-050:12:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.8249999999998965
driven_lanedir_consec_median2.089362646121113
deviation-center-line_median5.1606969042445545


other stats
deviation-center-line_max5.884537088976699
deviation-center-line_mean4.608902728622449
deviation-center-line_min2.229680017023988
deviation-heading_max33.00132974561592
deviation-heading_mean11.086939889451044
deviation-heading_median5.3156324990396016
deviation-heading_min0.7151648141090522
distance-from-start_max2.400773804592291
distance-from-start_mean1.855033439894366
distance-from-start_median1.8031549983915716
distance-from-start_min1.4130499582020293
driven_any_max3.5300951074200313
driven_any_mean2.5187726211552675
driven_any_median2.5310927358554984
driven_any_min1.4828099054900417
driven_lanedir_consec_max3.4375556548524067
driven_lanedir_consec_mean2.243867367124486
driven_lanedir_consec_min1.359188521403314
driven_lanedir_max3.4375556548524067
driven_lanedir_mean2.430771337654275
driven_lanedir_median2.4562457120319685
driven_lanedir_min1.373038271700757
in-drivable-lane_max2.0000000000000284
in-drivable-lane_mean1.4124999999999552
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5425992768883967, "survival_time": 59.99999999999873, "driven_lanedir": 1.537863345389593, "in-drivable-lane": 0.0, "deviation-heading": 0.7151648141090522, "distance-from-start": 1.538166429460106, "deviation-center-line": 2.229680017023988, "driven_lanedir_consec": 1.537863345389593}, "loop-000-ego1": {"driven_any": 3.5195861948226006, "survival_time": 59.99999999999873, "driven_lanedir": 3.3746280786743443, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 6.2883954590350015, "distance-from-start": 2.068143567323037, "deviation-center-line": 5.233752335699729, "driven_lanedir_consec": 2.640861946852633}, "loop-000-ego2": {"driven_any": 3.5300951074200313, "survival_time": 59.99999999999873, "driven_lanedir": 3.4375556548524067, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 4.342869539044202, "distance-from-start": 2.400773804592291, "deviation-center-line": 5.884537088976699, "driven_lanedir_consec": 3.4375556548524067}, "loop-000-ego3": {"driven_any": 1.4828099054900417, "survival_time": 59.99999999999873, "driven_lanedir": 1.373038271700757, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 33.00132974561592, "distance-from-start": 1.4130499582020293, "deviation-center-line": 5.08764147278938, "driven_lanedir_consec": 1.359188521403314}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5605639Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-0of4successnogpu-staging-spot-0-050:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median49.9499999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median2.903013185974951
deviation-center-line_median3.78943987331601


other stats
deviation-center-line_max3.78943987331601
deviation-center-line_mean3.78943987331601
deviation-center-line_min3.78943987331601
deviation-heading_max4.334690003953373
deviation-heading_mean4.334690003953373
deviation-heading_median4.334690003953373
deviation-heading_min4.334690003953373
distance-from-start_max1.5738876609453012
distance-from-start_mean1.5738876609453012
distance-from-start_median1.5738876609453012
distance-from-start_min1.5738876609453012
driven_any_max2.934594724791732
driven_any_mean2.934594724791732
driven_any_median2.934594724791732
driven_any_min2.934594724791732
driven_lanedir_consec_max2.903013185974951
driven_lanedir_consec_mean2.903013185974951
driven_lanedir_consec_min2.903013185974951
driven_lanedir_max2.9099324876731436
driven_lanedir_mean2.9099324876731436
driven_lanedir_median2.9099324876731436
driven_lanedir_min2.9099324876731436
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.934594724791732, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099324876731436, "in-drivable-lane": 0.0, "deviation-heading": 4.334690003953373, "distance-from-start": 1.5738876609453012, "deviation-center-line": 3.78943987331601, "driven_lanedir_consec": 2.903013185974951}}
simulation-passed1
survival_time_max49.9499999999993
survival_time_mean49.9499999999993
survival_time_min49.9499999999993
No reset possible
5602639Bea Baselines 🐤minimal-agent-fullaido-LFVI-full-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5591643Bea Baselines 🐤minimal-agent-fullaido-LFV_multi-full-sim-testingsim-0of4successnogpu-staging-spot-0-050:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.7249999999999304
driven_lanedir_consec_median1.782451327913266
deviation-center-line_median5.7520060807300135


other stats
deviation-center-line_max5.91724099846388
deviation-center-line_mean5.7520060807300135
deviation-center-line_min5.586771162996147
deviation-heading_max8.389432963329451
deviation-heading_mean8.327307052651967
deviation-heading_median8.327307052651967
deviation-heading_min8.265181141974484
distance-from-start_max1.2351380366112437
distance-from-start_mean1.1329605710789614
distance-from-start_median1.1329605710789614
distance-from-start_min1.0307831055466792
driven_any_max3.4865836159248382
driven_any_mean3.467832799824648
driven_any_median3.467832799824648
driven_any_min3.449081983724458
driven_lanedir_consec_max2.091635105125694
driven_lanedir_consec_mean1.782451327913266
driven_lanedir_consec_min1.473267550700838
driven_lanedir_max3.2880107027760648
driven_lanedir_mean3.2460173239276555
driven_lanedir_median3.2460173239276555
driven_lanedir_min3.2040239450792463
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean3.7249999999999304
in-drivable-lane_min3.099999999999966
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.449081983724458, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040239450792463, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432963329451, "distance-from-start": 1.0307831055466792, "deviation-center-line": 5.91724099846388, "driven_lanedir_consec": 2.091635105125694}, "loop2-000-ego1": {"driven_any": 3.4865836159248382, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880107027760648, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181141974484, "distance-from-start": 1.2351380366112437, "deviation-center-line": 5.586771162996147, "driven_lanedir_consec": 1.473267550700838}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5586674Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-validationsim-1of4successnogpu-staging-spot-0-050:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.8948975282353634


other stats
deviation-center-line_max0.8948975282353634
deviation-center-line_mean0.8948975282353634
deviation-center-line_min0.8948975282353634
deviation-heading_max32.249113233675025
deviation-heading_mean32.249113233675025
deviation-heading_median32.249113233675025
deviation-heading_min32.249113233675025
distance-from-start_max6.280369834735102e-16
distance-from-start_mean6.280369834735102e-16
distance-from-start_median6.280369834735102e-16
distance-from-start_min6.280369834735102e-16
driven_any_max7.536443801682175e-13
driven_any_mean7.536443801682175e-13
driven_any_median7.536443801682175e-13
driven_any_min7.536443801682175e-13
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5581675Bea Baselines 🐤baseline-simple-yieldaido-LFI-state-sim-validationsim-3of4successnogpu-staging-spot-0-050:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5573677Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-validationsim-1of4successnogpu-staging-spot-0-050:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3684768253684605
deviation-center-line_median0.26341057846251453


other stats
deviation-center-line_max0.26341057846251453
deviation-center-line_mean0.26341057846251453
deviation-center-line_min0.26341057846251453
deviation-heading_max2.2732184433064777
deviation-heading_mean2.2732184433064777
deviation-heading_median2.2732184433064777
deviation-heading_min2.2732184433064777
distance-from-start_max0.3686479402497791
distance-from-start_mean0.3686479402497791
distance-from-start_median0.3686479402497791
distance-from-start_min0.3686479402497791
driven_any_max0.3741734844735202
driven_any_mean0.3741734844735202
driven_any_median0.3741734844735202
driven_any_min0.3741734844735202
driven_lanedir_consec_max0.3684768253684605
driven_lanedir_consec_mean0.3684768253684605
driven_lanedir_consec_min0.3684768253684605
driven_lanedir_max0.3684768253684605
driven_lanedir_mean0.3684768253684605
driven_lanedir_median0.3684768253684605
driven_lanedir_min0.3684768253684605
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 0.3741734844735202, "survival_time": 59.99999999999873, "driven_lanedir": 0.3684768253684605, "in-drivable-lane": 0.0, "deviation-heading": 2.2732184433064777, "distance-from-start": 0.3686479402497791, "deviation-center-line": 0.26341057846251453, "driven_lanedir_consec": 0.3684768253684605}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5562680Bea Baselines 🐤baseline-simple-yieldaido-LF-state-sim-testingsim-1of4successnogpu-staging-spot-0-050:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.6173794793891885
deviation-center-line_median0.3790863571459804


other stats
deviation-center-line_max0.3790863571459804
deviation-center-line_mean0.3790863571459804
deviation-center-line_min0.3790863571459804
deviation-heading_max2.844192295741865
deviation-heading_mean2.844192295741865
deviation-heading_median2.844192295741865
deviation-heading_min2.844192295741865
distance-from-start_max2.723986924723346
distance-from-start_mean2.723986924723346
distance-from-start_median2.723986924723346
distance-from-start_min2.723986924723346
driven_any_max5.636243490208466
driven_any_mean5.636243490208466
driven_any_median5.636243490208466
driven_any_min5.636243490208466
driven_lanedir_consec_max5.6173794793891885
driven_lanedir_consec_mean5.6173794793891885
driven_lanedir_consec_min5.6173794793891885
driven_lanedir_max5.6173794793891885
driven_lanedir_mean5.6173794793891885
driven_lanedir_median5.6173794793891885
driven_lanedir_min5.6173794793891885
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5557397Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4successnogpu-staging-spot-0-050:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.197171776080493
survival_time_median59.99999999999873
deviation-center-line_median2.0567434034860153
in-drivable-lane_median32.449999999999264


other stats
deviation-center-line_max2.0567434034860153
deviation-center-line_mean2.0567434034860153
deviation-center-line_min2.0567434034860153
deviation-heading_max24.482362324694993
deviation-heading_mean24.482362324694993
deviation-heading_median24.482362324694993
deviation-heading_min24.482362324694993
distance-from-start_max0.1613793628692088
distance-from-start_mean0.1613793628692088
distance-from-start_median0.1613793628692088
distance-from-start_min0.1613793628692088
driven_any_max11.461797364400551
driven_any_mean11.461797364400551
driven_any_median11.461797364400551
driven_any_min11.461797364400551
driven_lanedir_consec_max-3.197171776080493
driven_lanedir_consec_mean-3.197171776080493
driven_lanedir_consec_min-3.197171776080493
driven_lanedir_max-3.197171776080493
driven_lanedir_mean-3.197171776080493
driven_lanedir_median-3.197171776080493
driven_lanedir_min-3.197171776080493
in-drivable-lane_max32.449999999999264
in-drivable-lane_mean32.449999999999264
in-drivable-lane_min32.449999999999264
per-episodes
details{"loop2-000-ego0": {"driven_any": 11.461797364400551, "survival_time": 59.99999999999873, "driven_lanedir": -3.197171776080493, "in-drivable-lane": 32.449999999999264, "deviation-heading": 24.482362324694993, "distance-from-start": 0.1613793628692088, "deviation-center-line": 2.0567434034860153, "driven_lanedir_consec": -3.197171776080493}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5553526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-3of4failednogpu-staging-spot-0-050:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5550526Bea Baselines 🐤baseline-behavior-cloningaido-LF-sim-testingsim-0of4failednogpu-staging-spot-0-050:03:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5544672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-1of4failednogpu-staging-spot-0-050:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5532683Bea Baselines 🐤baseline-simple-yieldaido-LFVI-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:09:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median5.57254251112803
deviation-center-line_median0.3023078005735761


other stats
deviation-center-line_max0.3023078005735761
deviation-center-line_mean0.3023078005735761
deviation-center-line_min0.3023078005735761
deviation-heading_max1.9428208342834787
deviation-heading_mean1.9428208342834787
deviation-heading_median1.9428208342834787
deviation-heading_min1.9428208342834787
distance-from-start_max2.475080487701063
distance-from-start_mean2.475080487701063
distance-from-start_median2.475080487701063
distance-from-start_min2.475080487701063
driven_any_max5.745302788245269
driven_any_mean5.745302788245269
driven_any_median5.745302788245269
driven_any_min5.745302788245269
driven_lanedir_consec_max5.57254251112803
driven_lanedir_consec_mean5.57254251112803
driven_lanedir_consec_min5.57254251112803
driven_lanedir_max5.734875658069805
driven_lanedir_mean5.734875658069805
driven_lanedir_median5.734875658069805
driven_lanedir_min5.734875658069805
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 5.745302788245269, "survival_time": 59.99999999999873, "driven_lanedir": 5.734875658069805, "in-drivable-lane": 0.0, "deviation-heading": 1.9428208342834787, "distance-from-start": 2.475080487701063, "deviation-center-line": 0.3023078005735761, "driven_lanedir_consec": 5.57254251112803}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5521686Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-2of4successnogpu-staging-spot-0-050:07:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.823620228930529
deviation-center-line_median0.3618127573828305


other stats
deviation-center-line_max0.3618127573828305
deviation-center-line_mean0.3618127573828305
deviation-center-line_min0.3618127573828305
deviation-heading_max2.729795565656188
deviation-heading_mean2.729795565656188
deviation-heading_median2.729795565656188
deviation-heading_min2.729795565656188
distance-from-start_max1.9492246701212408
distance-from-start_mean1.9492246701212408
distance-from-start_median1.9492246701212408
distance-from-start_min1.9492246701212408
driven_any_max4.8406264605922145
driven_any_mean4.8406264605922145
driven_any_median4.8406264605922145
driven_any_min4.8406264605922145
driven_lanedir_consec_max4.823620228930529
driven_lanedir_consec_mean4.823620228930529
driven_lanedir_consec_min4.823620228930529
driven_lanedir_max4.823620228930529
driven_lanedir_mean4.823620228930529
driven_lanedir_median4.823620228930529
driven_lanedir_min4.823620228930529
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 4.8406264605922145, "survival_time": 59.99999999999873, "driven_lanedir": 4.823620228930529, "in-drivable-lane": 0.0, "deviation-heading": 2.729795565656188, "distance-from-start": 1.9492246701212408, "deviation-center-line": 0.3618127573828305, "driven_lanedir_consec": 4.823620228930529}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5514687Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-testingsim-0of4successnogpu-staging-spot-0-050:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median0.0
deviation-center-line_median0.4065274986524993


other stats
deviation-center-line_max0.4065274986524993
deviation-center-line_mean0.4065274986524993
deviation-center-line_min0.4065274986524993
deviation-heading_max40.967332753486254
deviation-heading_mean40.967332753486254
deviation-heading_median40.967332753486254
deviation-heading_min40.967332753486254
distance-from-start_max5.551115123125783e-17
distance-from-start_mean5.551115123125783e-17
distance-from-start_median5.551115123125783e-17
distance-from-start_min5.551115123125783e-17
driven_any_max6.661338147750939e-14
driven_any_mean6.661338147750939e-14
driven_any_median6.661338147750939e-14
driven_any_min6.661338147750939e-14
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065274986524993, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5512688Bea Baselines 🐤baseline-simple-yieldaido-hello-sim-state-validationsanity-checksuccessnogpu-staging-spot-0-050:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.01953349439361496
deviation-center-line_median0.005218222768142721


other stats
deviation-center-line_max0.005218222768142721
deviation-center-line_mean0.005218222768142721
deviation-center-line_min0.005218222768142721
deviation-heading_max0.25396491855571535
deviation-heading_mean0.25396491855571535
deviation-heading_median0.25396491855571535
deviation-heading_min0.25396491855571535
distance-from-start_max0.022001508006465737
distance-from-start_mean0.022001508006465737
distance-from-start_median0.022001508006465737
distance-from-start_min0.022001508006465737
driven_any_max0.022014748656342877
driven_any_mean0.022014748656342877
driven_any_median0.022014748656342877
driven_any_min0.022014748656342877
driven_lanedir_consec_max0.01953349439361496
driven_lanedir_consec_mean0.01953349439361496
driven_lanedir_consec_min0.01953349439361496
driven_lanedir_max0.01953349439361496
driven_lanedir_mean0.01953349439361496
driven_lanedir_median0.01953349439361496
driven_lanedir_min0.01953349439361496
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.022014748656342877, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01953349439361496, "in-drivable-lane": 0.0, "deviation-heading": 0.25396491855571535, "distance-from-start": 0.022001508006465737, "deviation-center-line": 0.005218222768142721, "driven_lanedir_consec": 0.01953349439361496}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5501719Bea Baselines 🐤minimal-agent-stateaido-LFVI_multi-state-sim-validationsim-3of4successnogpu-staging-spot-0-050:08:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median1.0999999999999377
driven_lanedir_consec_median2.9739038922098167
deviation-center-line_median3.987567696169286


other stats
deviation-center-line_max6.355354623012709
deviation-center-line_mean4.250566789511449
deviation-center-line_min2.6717771426945145
deviation-heading_max6.378578140641868
deviation-heading_mean3.8518643265041
deviation-heading_median3.299904356349613
deviation-heading_min2.429070452675305
distance-from-start_max2.622846621458921
distance-from-start_mean1.9359200828336065
distance-from-start_median2.1273822766936967
distance-from-start_min0.8660691564881121
driven_any_max3.5795837364268106
driven_any_mean3.0268033484998975
driven_any_median3.137096506981778
driven_any_min2.2534366436092235
driven_lanedir_consec_max3.4836850218404303
driven_lanedir_consec_mean2.566865745168916
driven_lanedir_consec_min0.8359701744156
driven_lanedir_max3.5606366264507763
driven_lanedir_mean2.9552897573784933
driven_lanedir_median3.077183665318938
driven_lanedir_min2.1061550724253215
in-drivable-lane_max2.400000000000034
in-drivable-lane_mean1.1499999999999773
in-drivable-lane_min0.0
per-episodes
details{"4way-001-ego0": {"driven_any": 2.727596918833126, "survival_time": 59.99999999999873, "driven_lanedir": 2.6706823087974456, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.429070452675305, "distance-from-start": 2.2619366930709424, "deviation-center-line": 4.5111102127801965, "driven_lanedir_consec": 2.6706819709513203}, "4way-001-ego1": {"driven_any": 3.5795837364268106, "survival_time": 59.99999999999873, "driven_lanedir": 3.5606366264507763, "in-drivable-lane": 0.0, "deviation-heading": 3.343516239036243, "distance-from-start": 1.992827860316451, "deviation-center-line": 2.6717771426945145, "driven_lanedir_consec": 3.277125813468313}, "4way-001-ego2": {"driven_any": 3.5465960951304303, "survival_time": 59.99999999999873, "driven_lanedir": 3.4836850218404303, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.2562924736629832, "distance-from-start": 2.622846621458921, "deviation-center-line": 3.4640251795583756, "driven_lanedir_consec": 3.4836850218404303}, "4way-001-ego3": {"driven_any": 2.2534366436092235, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061550724253215, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140641868, "distance-from-start": 0.8660691564881121, "deviation-center-line": 6.355354623012709, "driven_lanedir_consec": 0.8359701744156}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5493722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-1of4successnogpu-staging-spot-0-050:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median54.99999999999901
in-drivable-lane_median3.1499999999999666
driven_lanedir_consec_median1.420452979729076
deviation-center-line_median4.299642636408967


other stats
deviation-center-line_max4.299642636408967
deviation-center-line_mean4.299642636408967
deviation-center-line_min4.299642636408967
deviation-heading_max7.737882401817608
deviation-heading_mean7.737882401817608
deviation-heading_median7.737882401817608
deviation-heading_min7.737882401817608
distance-from-start_max1.206000789659136
distance-from-start_mean1.206000789659136
distance-from-start_median1.206000789659136
distance-from-start_min1.206000789659136
driven_any_max3.1430848844498547
driven_any_mean3.1430848844498547
driven_any_median3.1430848844498547
driven_any_min3.1430848844498547
driven_lanedir_consec_max1.420452979729076
driven_lanedir_consec_mean1.420452979729076
driven_lanedir_consec_min1.420452979729076
driven_lanedir_max2.9486964161761877
driven_lanedir_mean2.9486964161761877
driven_lanedir_median2.9486964161761877
driven_lanedir_min2.9486964161761877
in-drivable-lane_max3.1499999999999666
in-drivable-lane_mean3.1499999999999666
in-drivable-lane_min3.1499999999999666
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.1430848844498547, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486964161761877, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.737882401817608, "distance-from-start": 1.206000789659136, "deviation-center-line": 4.299642636408967, "driven_lanedir_consec": 1.420452979729076}}
simulation-passed1
survival_time_max54.99999999999901
survival_time_mean54.99999999999901
survival_time_min54.99999999999901
No reset possible
5489722Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-validationsim-2of4successnogpu-staging-spot-0-050:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.399999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median0.43685686215374986
deviation-center-line_median0.2706641555254041


other stats
deviation-center-line_max0.2706641555254041
deviation-center-line_mean0.2706641555254041
deviation-center-line_min0.2706641555254041
deviation-heading_max0.7151185427551814
deviation-heading_mean0.7151185427551814
deviation-heading_median0.7151185427551814
deviation-heading_min0.7151185427551814
distance-from-start_max0.4379491769930655
distance-from-start_mean0.4379491769930655
distance-from-start_median0.4379491769930655
distance-from-start_min0.4379491769930655
driven_any_max0.44159927688867295
driven_any_mean0.44159927688867295
driven_any_median0.44159927688867295
driven_any_min0.44159927688867295
driven_lanedir_consec_max0.43685686215374986
driven_lanedir_consec_mean0.43685686215374986
driven_lanedir_consec_min0.43685686215374986
driven_lanedir_max0.43685686215374986
driven_lanedir_mean0.43685686215374986
driven_lanedir_median0.43685686215374986
driven_lanedir_min0.43685686215374986
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 0.44159927688867295, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215374986, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551814, "distance-from-start": 0.4379491769930655, "deviation-center-line": 0.2706641555254041, "driven_lanedir_consec": 0.43685686215374986}}
simulation-passed1
survival_time_max8.399999999999984
survival_time_mean8.399999999999984
survival_time_min8.399999999999984
No reset possible
5485723Bea Baselines 🐤minimal-agent-stateaido-LF-state-sim-testingsim-0of4successnogpu-staging-spot-0-050:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median4.349999999999895
driven_lanedir_consec_median2.0528637692162603
deviation-center-line_median5.91176225472802


other stats
deviation-center-line_max5.91176225472802
deviation-center-line_mean5.91176225472802
deviation-center-line_min5.91176225472802
deviation-heading_max8.374149459714971
deviation-heading_mean8.374149459714971
deviation-heading_median8.374149459714971
deviation-heading_min8.374149459714971
distance-from-start_max0.99998148210146
distance-from-start_mean0.99998148210146
distance-from-start_median0.99998148210146
distance-from-start_min0.99998148210146
driven_any_max3.4100819966978593
driven_any_mean3.4100819966978593
driven_any_median3.4100819966978593
driven_any_min3.4100819966978593
driven_lanedir_consec_max2.0528637692162603
driven_lanedir_consec_mean2.0528637692162603
driven_lanedir_consec_min2.0528637692162603
driven_lanedir_max3.1652526226678295
driven_lanedir_mean3.1652526226678295
driven_lanedir_median3.1652526226678295
driven_lanedir_min3.1652526226678295
in-drivable-lane_max4.349999999999895
in-drivable-lane_mean4.349999999999895
in-drivable-lane_min4.349999999999895
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.4100819966978593, "survival_time": 59.99999999999873, "driven_lanedir": 3.1652526226678295, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.374149459714971, "distance-from-start": 0.99998148210146, "deviation-center-line": 5.91176225472802, "driven_lanedir_consec": 2.0528637692162603}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5481724Bea Baselines 🐤minimal-agent-stateaido-LFI-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5472726Bea Baselines 🐤minimal-agent-stateaido-LFVI-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999858
driven_lanedir_consec_median2.0183982038959174
deviation-center-line_median5.116869283415678


other stats
deviation-center-line_max5.116869283415678
deviation-center-line_mean5.116869283415678
deviation-center-line_min5.116869283415678
deviation-heading_max5.091155339747139
deviation-heading_mean5.091155339747139
deviation-heading_median5.091155339747139
deviation-heading_min5.091155339747139
distance-from-start_max1.6832286746350418
distance-from-start_mean1.6832286746350418
distance-from-start_median1.6832286746350418
distance-from-start_min1.6832286746350418
driven_any_max3.5045866946371738
driven_any_mean3.5045866946371738
driven_any_median3.5045866946371738
driven_any_min3.5045866946371738
driven_lanedir_consec_max2.0183982038959174
driven_lanedir_consec_mean2.0183982038959174
driven_lanedir_consec_min2.0183982038959174
driven_lanedir_max3.36042557719213
driven_lanedir_mean3.36042557719213
driven_lanedir_median3.36042557719213
driven_lanedir_min3.36042557719213
in-drivable-lane_max2.499999999999858
in-drivable-lane_mean2.499999999999858
in-drivable-lane_min2.499999999999858
per-episodes
details{"4way-001-ego0": {"driven_any": 3.5045866946371738, "survival_time": 59.99999999999873, "driven_lanedir": 3.36042557719213, "in-drivable-lane": 2.499999999999858, "deviation-heading": 5.091155339747139, "distance-from-start": 1.6832286746350418, "deviation-center-line": 5.116869283415678, "driven_lanedir_consec": 2.0183982038959174}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5463729Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-testingsim-1of4successnogpu-staging-spot-0-050:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median39.54999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2926691878522645
deviation-center-line_median3.961954170796273


other stats
deviation-center-line_max3.961954170796273
deviation-center-line_mean3.961954170796273
deviation-center-line_min3.961954170796273
deviation-heading_max3.0019673934722957
deviation-heading_mean3.0019673934722957
deviation-heading_median3.0019673934722957
deviation-heading_min3.0019673934722957
distance-from-start_max1.8411177593664525
distance-from-start_mean1.8411177593664525
distance-from-start_median1.8411177593664525
distance-from-start_min1.8411177593664525
driven_any_max2.310597586456975
driven_any_mean2.310597586456975
driven_any_median2.310597586456975
driven_any_min2.310597586456975
driven_lanedir_consec_max2.2926691878522645
driven_lanedir_consec_mean2.2926691878522645
driven_lanedir_consec_min2.2926691878522645
driven_lanedir_max2.2926691878522645
driven_lanedir_mean2.2926691878522645
driven_lanedir_median2.2926691878522645
driven_lanedir_min2.2926691878522645
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 2.310597586456975, "survival_time": 39.54999999999989, "driven_lanedir": 2.2926691878522645, "in-drivable-lane": 0.0, "deviation-heading": 3.0019673934722957, "distance-from-start": 1.8411177593664525, "deviation-center-line": 3.961954170796273, "driven_lanedir_consec": 2.2926691878522645}}
simulation-passed1
survival_time_max39.54999999999989
survival_time_mean39.54999999999989
survival_time_min39.54999999999989
No reset possible
5456689Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.20000000000001
in-drivable-lane_median7.550000000000012
driven_lanedir_consec_median0.35100782346733106
deviation-center-line_median0.1875173231178998


other stats
deviation-center-line_max0.2707804718914694
deviation-center-line_mean0.1844412573098622
deviation-center-line_min0.0919499111121796
deviation-heading_max1.1917651798930318
deviation-heading_mean0.9622869363024876
deviation-heading_median0.9361472189771176
deviation-heading_min0.7850881273626832
distance-from-start_max1.5123565388898523
distance-from-start_mean1.065915894504796
distance-from-start_median1.022394956672053
distance-from-start_min0.7065171257852256
driven_any_max1.5124649660017897
driven_any_mean1.065965786863606
driven_any_median1.0224346418929502
driven_any_min0.7065288976667349
driven_lanedir_consec_max0.5392423985110799
driven_lanedir_consec_mean0.3468357242213338
driven_lanedir_consec_min0.14608485143959313
driven_lanedir_max0.5392423985110799
driven_lanedir_mean0.3468357242213338
driven_lanedir_median0.35100782346733106
driven_lanedir_min0.14608485143959313
in-drivable-lane_max8.75000000000001
in-drivable-lane_mean7.587500000000013
in-drivable-lane_min6.500000000000015
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7065288976667349, "survival_time": 10.20000000000001, "driven_lanedir": 0.19955231542409413, "in-drivable-lane": 8.45000000000001, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.7065171257852256, "deviation-center-line": 0.125674622775791, "driven_lanedir_consec": 0.19955231542409413}, "zigzag-000-ego1": {"driven_any": 1.5124649660017897, "survival_time": 10.20000000000001, "driven_lanedir": 0.502463331510568, "in-drivable-lane": 6.650000000000015, "deviation-heading": 1.1917651798930318, "distance-from-start": 1.5123565388898523, "deviation-center-line": 0.2493600234600086, "driven_lanedir_consec": 0.502463331510568}, "zigzag-000-ego2": {"driven_any": 0.8448328173529562, "survival_time": 10.20000000000001, "driven_lanedir": 0.5392423985110799, "in-drivable-lane": 6.500000000000015, "deviation-heading": 0.9234724823961894, "distance-from-start": 0.8448159163231234, "deviation-center-line": 0.2707804718914694, "driven_lanedir_consec": 0.5392423985110799}, "zigzag-000-ego3": {"driven_any": 1.200036466432944, "survival_time": 10.20000000000001, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 8.75000000000001, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean10.20000000000001
survival_time_min10.20000000000001
No reset possible
5442691Bea Baselines 🐤minimal-agentaido-LFV-sim-validationsim-3of4successnogpu-staging-spot-0-050:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.499999999999986
in-drivable-lane_median6.749999999999985
driven_lanedir_consec_median0.19955231542410212
deviation-center-line_median0.1256753337219296


other stats
deviation-center-line_max0.1256753337219296
deviation-center-line_mean0.1256753337219296
deviation-center-line_min0.1256753337219296
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max1.233057068821899
distance-from-start_mean1.233057068821899
distance-from-start_median1.233057068821899
distance-from-start_min1.233057068821899
driven_any_max1.2331286149593297
driven_any_mean1.2331286149593297
driven_any_median1.2331286149593297
driven_any_min1.2331286149593297
driven_lanedir_consec_max0.19955231542410212
driven_lanedir_consec_mean0.19955231542410212
driven_lanedir_consec_min0.19955231542410212
driven_lanedir_max0.19955231542410212
driven_lanedir_mean0.19955231542410212
driven_lanedir_median0.19955231542410212
driven_lanedir_min0.19955231542410212
in-drivable-lane_max6.749999999999985
in-drivable-lane_mean6.749999999999985
in-drivable-lane_min6.749999999999985
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.2331286149593297, "survival_time": 8.499999999999986, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 6.749999999999985, "deviation-heading": 0.9488219555580464, "distance-from-start": 1.233057068821899, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}}
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean8.499999999999986
survival_time_min8.499999999999986
No reset possible
5421696Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-1of4successnogpu-staging-spot-0-050:04:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.10000000000012
in-drivable-lane_median16.475000000000122
driven_lanedir_consec_median0.1871259180387148
deviation-center-line_median0.1597304482463256


other stats
deviation-center-line_max0.8154371900099048
deviation-center-line_mean0.31068410995840445
deviation-center-line_min0.10783835333106186
deviation-heading_max2.6573884073341296
deviation-heading_mean1.2352538722899933
deviation-heading_median0.8549948818349846
deviation-heading_min0.5736373181558745
distance-from-start_max2.8215098408566996
distance-from-start_mean1.6015737965533243
distance-from-start_median1.6717195029471283
distance-from-start_min0.24134633946234108
driven_any_max2.822213654469616
driven_any_mean1.601805379005134
driven_any_median1.6718291481738583
driven_any_min0.24134956520320336
driven_lanedir_consec_max1.2682865358251645
driven_lanedir_consec_mean0.4392278633829686
driven_lanedir_consec_min0.11437308162928028
driven_lanedir_max1.2682865358251645
driven_lanedir_mean0.4392278633829686
driven_lanedir_median0.1871259180387148
driven_lanedir_min0.11437308162928028
in-drivable-lane_max16.900000000000123
in-drivable-lane_mean14.675000000000122
in-drivable-lane_min8.850000000000122
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.6183892771013668, "survival_time": 18.10000000000012, "driven_lanedir": 0.1366712422178442, "in-drivable-lane": 16.700000000000124, "deviation-heading": 0.9508048428349394, "distance-from-start": 1.6182798682575017, "deviation-center-line": 0.10783835333106186, "driven_lanedir_consec": 0.1366712422178442}, "autolab-000-ego1": {"driven_any": 1.7252690192463498, "survival_time": 18.10000000000012, "driven_lanedir": 0.2375805938595854, "in-drivable-lane": 16.25000000000012, "deviation-heading": 0.5736373181558745, "distance-from-start": 1.7251591376367548, "deviation-center-line": 0.2032095259623498, "driven_lanedir_consec": 0.2375805938595854}, "autolab-000-ego2": {"driven_any": 2.822213654469616, "survival_time": 18.10000000000012, "driven_lanedir": 1.2682865358251645, "in-drivable-lane": 8.850000000000122, "deviation-heading": 2.6573884073341296, "distance-from-start": 2.8215098408566996, "deviation-center-line": 0.8154371900099048, "driven_lanedir_consec": 1.2682865358251645}, "autolab-000-ego3": {"driven_any": 0.24134956520320336, "survival_time": 18.10000000000012, "driven_lanedir": 0.11437308162928028, "in-drivable-lane": 16.900000000000123, "deviation-heading": 0.7591849208350299, "distance-from-start": 0.24134633946234108, "deviation-center-line": 0.11625137053030138, "driven_lanedir_consec": 0.11437308162928028}}
simulation-passed1
survival_time_max18.10000000000012
survival_time_mean18.10000000000012
survival_time_min18.10000000000012
No reset possible
5419697Bea Baselines 🐤minimal-agentaido-LFP-sim-testingsim-1of4successnogpu-staging-spot-0-050:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.599999999999995
in-drivable-lane_median2.199999999999995
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783777071755885


other stats
deviation-center-line_max0.10783777071755885
deviation-center-line_mean0.10783777071755885
deviation-center-line_min0.10783777071755885
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max0.4231631948305919
distance-from-start_mean0.4231631948305919
distance-from-start_median0.4231631948305919
distance-from-start_min0.4231631948305919
driven_any_max0.4231710664368234
driven_any_mean0.4231710664368234
driven_any_median0.4231710664368234
driven_any_min0.4231710664368234
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.199999999999995
in-drivable-lane_mean2.199999999999995
in-drivable-lane_min2.199999999999995
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.4231710664368234, "survival_time": 3.599999999999995, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.199999999999995, "deviation-heading": 0.9508048428349386, "distance-from-start": 0.4231631948305919, "deviation-center-line": 0.10783777071755885, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max3.599999999999995
survival_time_mean3.599999999999995
survival_time_min3.599999999999995
No reset possible
5391644Bea Baselines 🐤minimal-agent-fullaido-LFVI_multi-full-sim-testingsim-0of4successnogpu-staging-spot-0-050:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.133472186206734
deviation-center-line_median3.5692749184210433


other stats
deviation-center-line_max5.1851715974128805
deviation-center-line_mean3.738598388104289
deviation-center-line_min2.6306721181621886
deviation-heading_max8.12390911081905
deviation-heading_mean4.904445207680925
deviation-heading_median3.9916054069886826
deviation-heading_min3.5106609059272844
distance-from-start_max2.230934169509707
distance-from-start_mean1.8422550059061231
distance-from-start_median1.83762780726357
distance-from-start_min1.4628302395876456
driven_any_max3.5795876791383257
driven_any_mean3.408211238652514
driven_any_median3.559331275339633
driven_any_min2.934594724792462
driven_lanedir_consec_max3.4288085645898976
driven_lanedir_consec_mean2.8688896370650867
driven_lanedir_consec_min1.779805611256981
driven_lanedir_max3.561567679231453
driven_lanedir_mean3.351579340793875
driven_lanedir_median3.467420167967693
driven_lanedir_min2.909909348008662
in-drivable-lane_max1.3499999999999446
in-drivable-lane_mean0.33749999999998614
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 2.934594724792462, "survival_time": 59.99999999999873, "driven_lanedir": 2.909909348008662, "in-drivable-lane": 0.0, "deviation-heading": 4.334701504286533, "distance-from-start": 1.5738876834742443, "deviation-center-line": 5.1851715974128805, "driven_lanedir_consec": 2.9029908891375724}, "udem-000-ego1": {"driven_any": 3.539079376082114, "survival_time": 59.99999999999873, "driven_lanedir": 3.3772467891566187, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 8.12390911081905, "distance-from-start": 1.4628302395876456, "deviation-center-line": 4.14966050504133, "driven_lanedir_consec": 1.779805611256981}, "udem-000-ego2": {"driven_any": 3.5795876791383257, "survival_time": 59.99999999999873, "driven_lanedir": 3.561567679231453, "in-drivable-lane": 0.0, "deviation-heading": 3.5106609059272844, "distance-from-start": 2.230934169509707, "deviation-center-line": 2.6306721181621886, "driven_lanedir_consec": 3.4288085645898976}, "udem-000-ego3": {"driven_any": 3.5795831745971527, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575935467787665, "in-drivable-lane": 0.0, "deviation-heading": 3.648509309690832, "distance-from-start": 2.101367931052896, "deviation-center-line": 2.988889331800756, "driven_lanedir_consec": 3.3639534832758957}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5386434Bea Baselines 🐤template-tensorflowaido-LFV_multi-sim-testingsim-1of4failednogpu-staging-spot-0-050:01:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5380435Bea Baselines 🐤template-tensorflowaido-LFP-sim-testingsim-1of4failednogpu-staging-spot-0-050:00:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5377437Bea Baselines 🐤template-tensorflowaido-LFVI-sim-testingsim-3of4successnogpu-staging-spot-0-050:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5372438Bea Baselines 🐤template-tensorflowaido-LFI-sim-testingsim-0of4failednogpu-staging-spot-0-050:01:36
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5363440Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-0of4failednogpu-staging-spot-0-050:02:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5350440Bea Baselines 🐤template-tensorflowaido-LFVI_multi-sim-testingsim-2of4successnogpu-staging-spot-0-050:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5343499Bea Baselines 🐤minimal-agentaido-LFVI_multi-sim-testingsim-0of4successnogpu-staging-spot-0-050:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.85000000000002
in-drivable-lane_median8.475000000000021
driven_lanedir_consec_median0.2593084475741141
deviation-center-line_median0.2403440978566299


other stats
deviation-center-line_max1.082984557473667
deviation-center-line_mean0.4178777766294968
deviation-center-line_min0.1078383533310603
deviation-heading_max2.3391888095272977
deviation-heading_mean1.212353106209787
deviation-heading_median0.968293148577988
deviation-heading_min0.5736373181558745
distance-from-start_max1.6182798682575184
distance-from-start_mean1.227839419895464
distance-from-start_median1.2281617924849124
distance-from-start_min0.8367542263545122
driven_any_max1.6183892771013868
driven_any_mean1.227909433050404
driven_any_median1.2282388605737449
driven_any_min0.8367707339527397
driven_lanedir_consec_max0.6611857977727726
driven_lanedir_consec_mean0.3291168744593093
driven_lanedir_consec_min0.13666480491623645
driven_lanedir_max0.9897803868677432
driven_lanedir_mean0.411265521733052
driven_lanedir_median0.2593084475741141
driven_lanedir_min0.13666480491623645
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean6.600000000000016
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 1.6183892771013868, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.6182798682575184, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}, "udem-000-ego1": {"driven_any": 0.8367707339527397, "survival_time": 10.85000000000002, "driven_lanedir": 0.2375805938595854, "in-drivable-lane": 9.000000000000018, "deviation-heading": 0.5736373181558745, "distance-from-start": 0.8367542263545122, "deviation-center-line": 0.2032093706721213, "driven_lanedir_consec": 0.2375805938595854}, "udem-000-ego2": {"driven_any": 0.9932647664055554, "survival_time": 10.85000000000002, "driven_lanedir": 0.9897803868677432, "in-drivable-lane": 0.0, "deviation-heading": 0.985781454321037, "distance-from-start": 0.9932177858395712, "deviation-center-line": 1.082984557473667, "driven_lanedir_consec": 0.6611857977727726}, "udem-000-ego3": {"driven_any": 1.463212954741934, "survival_time": 10.85000000000002, "driven_lanedir": 0.28103630128864276, "in-drivable-lane": 7.950000000000025, "deviation-heading": 2.3391888095272977, "distance-from-start": 1.4631057991302536, "deviation-center-line": 0.2774788250411385, "driven_lanedir_consec": 0.28103630128864276}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
5332468Bea Baselines 🐤minimal-agent-stateaido-LFV_multi-state-sim-testingsim-2of4successnogpu-staging-spot-0-050:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median3.274999999999924
driven_lanedir_consec_median2.9601189865763886
deviation-center-line_median5.787503619673483


other stats
deviation-center-line_max6.225435220559491
deviation-center-line_mean5.663130447397847
deviation-center-line_min4.852079329684934
deviation-heading_max10.580538307983838
deviation-heading_mean8.264581204111865
deviation-heading_median7.754751325434261
deviation-heading_min6.968283857595098
distance-from-start_max2.654399044738202
distance-from-start_mean2.1218160828483192
distance-from-start_median2.2988549971726475
distance-from-start_min1.2351552923097806
driven_any_max3.476087765832689
driven_any_mean3.2864825052178803
driven_any_median3.2731312027162502
driven_any_min3.1235798496063323
driven_lanedir_consec_max3.276672417637001
driven_lanedir_consec_mean2.6675495945362115
driven_lanedir_consec_min1.473287987355069
driven_lanedir_max3.276672417637001
driven_lanedir_mean3.103994542373825
driven_lanedir_median3.138392083101138
driven_lanedir_min2.862521585656024
in-drivable-lane_max3.8999999999999138
in-drivable-lane_mean2.9249999999999226
in-drivable-lane_min1.249999999999929
per-episodes
details{"loop-000-ego0": {"driven_any": 3.2036786887321167, "survival_time": 59.99999999999873, "driven_lanedir": 3.132204583992982, "in-drivable-lane": 1.249999999999929, "deviation-heading": 6.968283857595098, "distance-from-start": 2.3820708473302497, "deviation-center-line": 6.225435220559491, "driven_lanedir_consec": 3.132204583992982}, "loop-000-ego1": {"driven_any": 3.3425837167003833, "survival_time": 59.99999999999873, "driven_lanedir": 3.1445795822092935, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.452427331971558, "distance-from-start": 1.2351552923097806, "deviation-center-line": 5.558720177405185, "driven_lanedir_consec": 1.473287987355069}, "loop-000-ego2": {"driven_any": 3.476087765832689, "survival_time": 59.99999999999873, "driven_lanedir": 3.276672417637001, "in-drivable-lane": 3.449999999999882, "deviation-heading": 7.057075318896964, "distance-from-start": 2.2156391470150454, "deviation-center-line": 6.016287061941781, "driven_lanedir_consec": 3.276672417637001}, "loop-000-ego3": {"driven_any": 3.1235798496063323, "survival_time": 59.99999999999873, "driven_lanedir": 2.862521585656024, "in-drivable-lane": 3.8999999999999138, "deviation-heading": 10.580538307983838, "distance-from-start": 2.654399044738202, "deviation-center-line": 4.852079329684934, "driven_lanedir_consec": 2.7880333891597946}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5327469Bea Baselines 🐤minimal-agent-stateaido-LFV-state-sim-validationsim-3of4successnogpu-staging-spot-0-050:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median21.600000000000172
in-drivable-lane_median1.0000000000000142
driven_lanedir_consec_median1.0990342557162571
deviation-center-line_median1.828958616792992


other stats
deviation-center-line_max1.828958616792992
deviation-center-line_mean1.828958616792992
deviation-center-line_min1.828958616792992
deviation-heading_max5.113647296201552
deviation-heading_mean5.113647296201552
deviation-heading_median5.113647296201552
deviation-heading_min5.113647296201552
distance-from-start_max1.0166726694408912
distance-from-start_mean1.0166726694408912
distance-from-start_median1.0166726694408912
distance-from-start_min1.0166726694408912
driven_any_max1.203590732794828
driven_any_mean1.203590732794828
driven_any_median1.203590732794828
driven_any_min1.203590732794828
driven_lanedir_consec_max1.0990342557162571
driven_lanedir_consec_mean1.0990342557162571
driven_lanedir_consec_min1.0990342557162571
driven_lanedir_max1.0990342557162571
driven_lanedir_mean1.0990342557162571
driven_lanedir_median1.0990342557162571
driven_lanedir_min1.0990342557162571
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean1.0000000000000142
in-drivable-lane_min1.0000000000000142
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.203590732794828, "survival_time": 21.600000000000172, "driven_lanedir": 1.0990342557162571, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296201552, "distance-from-start": 1.0166726694408912, "deviation-center-line": 1.828958616792992, "driven_lanedir_consec": 1.0990342557162571}}
simulation-passed1
survival_time_max21.600000000000172
survival_time_mean21.600000000000172
survival_time_min21.600000000000172
No reset possible
5316471Bea Baselines 🐤minimal-agent-stateaido-LFP-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.3499999999998664
driven_lanedir_consec_median3.348849345562785
deviation-center-line_median5.530773803151009


other stats
deviation-center-line_max5.530773803151009
deviation-center-line_mean5.530773803151009
deviation-center-line_min5.530773803151009
deviation-heading_max8.935875869654826
deviation-heading_mean8.935875869654826
deviation-heading_median8.935875869654826
deviation-heading_min8.935875869654826
distance-from-start_max2.421090353696769
distance-from-start_mean2.421090353696769
distance-from-start_median2.421090353696769
distance-from-start_min2.421090353696769
driven_any_max3.509088402822391
driven_any_mean3.509088402822391
driven_any_median3.509088402822391
driven_any_min3.509088402822391
driven_lanedir_consec_max3.348849345562785
driven_lanedir_consec_mean3.348849345562785
driven_lanedir_consec_min3.348849345562785
driven_lanedir_max3.348849345562785
driven_lanedir_mean3.348849345562785
driven_lanedir_median3.348849345562785
driven_lanedir_min3.348849345562785
in-drivable-lane_max2.3499999999998664
in-drivable-lane_mean2.3499999999998664
in-drivable-lane_min2.3499999999998664
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.509088402822391, "survival_time": 59.99999999999873, "driven_lanedir": 3.348849345562785, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 8.935875869654826, "distance-from-start": 2.421090353696769, "deviation-center-line": 5.530773803151009, "driven_lanedir_consec": 3.348849345562785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5309486Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-validationsim-3of4successnogpu-staging-spot-0-050:03:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.20000000000001
in-drivable-lane_median7.550000000000012
driven_lanedir_consec_median0.35100782346733106
deviation-center-line_median0.1875173231178998


other stats
deviation-center-line_max0.2707804718914694
deviation-center-line_mean0.1844412573098622
deviation-center-line_min0.0919499111121796
deviation-heading_max1.1917651798930318
deviation-heading_mean0.9622869363024876
deviation-heading_median0.9361472189771176
deviation-heading_min0.7850881273626832
distance-from-start_max1.5123565388898523
distance-from-start_mean1.065915894504796
distance-from-start_median1.022394956672053
distance-from-start_min0.7065171257852256
driven_any_max1.5124649660017897
driven_any_mean1.065965786863606
driven_any_median1.0224346418929502
driven_any_min0.7065288976667349
driven_lanedir_consec_max0.5392423985110799
driven_lanedir_consec_mean0.3468357242213338
driven_lanedir_consec_min0.14608485143959313
driven_lanedir_max0.5392423985110799
driven_lanedir_mean0.3468357242213338
driven_lanedir_median0.35100782346733106
driven_lanedir_min0.14608485143959313
in-drivable-lane_max8.75000000000001
in-drivable-lane_mean7.587500000000013
in-drivable-lane_min6.500000000000015
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7065288976667349, "survival_time": 10.20000000000001, "driven_lanedir": 0.19955231542409413, "in-drivable-lane": 8.45000000000001, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.7065171257852256, "deviation-center-line": 0.125674622775791, "driven_lanedir_consec": 0.19955231542409413}, "zigzag-000-ego1": {"driven_any": 1.5124649660017897, "survival_time": 10.20000000000001, "driven_lanedir": 0.502463331510568, "in-drivable-lane": 6.650000000000015, "deviation-heading": 1.1917651798930318, "distance-from-start": 1.5123565388898523, "deviation-center-line": 0.2493600234600086, "driven_lanedir_consec": 0.502463331510568}, "zigzag-000-ego2": {"driven_any": 0.8448328173529562, "survival_time": 10.20000000000001, "driven_lanedir": 0.5392423985110799, "in-drivable-lane": 6.500000000000015, "deviation-heading": 0.9234724823961894, "distance-from-start": 0.8448159163231234, "deviation-center-line": 0.2707804718914694, "driven_lanedir_consec": 0.5392423985110799}, "zigzag-000-ego3": {"driven_any": 1.200036466432944, "survival_time": 10.20000000000001, "driven_lanedir": 0.14608485143959313, "in-drivable-lane": 8.75000000000001, "deviation-heading": 0.7850881273626832, "distance-from-start": 1.1999739970209826, "deviation-center-line": 0.0919499111121796, "driven_lanedir_consec": 0.14608485143959313}}
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean10.20000000000001
survival_time_min10.20000000000001
No reset possible
5289474Bea Baselines 🐤baseline-simple-yieldaido-LFVI_multi-state-sim-validationsim-2of4successnogpu-staging-spot-0-050:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median1.9345733957247475
deviation-center-line_median0.1495255122147401


other stats
deviation-center-line_max1.0816161636507569
deviation-center-line_mean0.3677032911639634
deviation-center-line_min0.09014597657561622
deviation-heading_max7.662512790853319
deviation-heading_mean2.8003090495633742
deviation-heading_median1.3383485799995245
deviation-heading_min0.8620262474011284
distance-from-start_max2.328675391154607
distance-from-start_mean1.768545897067653
distance-from-start_median1.8943393617573885
distance-from-start_min0.9568294736012292
driven_any_max5.743174255101718
driven_any_mean2.8303400578667937
driven_any_median2.141544029418139
driven_any_min1.2950979175291768
driven_lanedir_consec_max5.737782330849534
driven_lanedir_consec_mean2.72368023429597
driven_lanedir_consec_min1.2877918148848522
driven_lanedir_max5.737782401111865
driven_lanedir_mean2.8244219785143843
driven_lanedir_median2.1360568490304095
driven_lanedir_min1.2877918148848522
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.2950979175291768, "survival_time": 59.99999999999873, "driven_lanedir": 1.2877918148848522, "in-drivable-lane": 0.0, "deviation-heading": 1.3173151367489415, "distance-from-start": 0.9568294736012292, "deviation-center-line": 0.1343792570180741, "driven_lanedir_consec": 1.2877918148848522}, "4way-000-ego1": {"driven_any": 1.793822470316908, "survival_time": 59.99999999999873, "driven_lanedir": 1.785553264636787, "in-drivable-lane": 0.0, "deviation-heading": 7.662512790853319, "distance-from-start": 1.7715478688511692, "deviation-center-line": 1.0816161636507569, "driven_lanedir_consec": 1.382586358025463}, "4way-000-ego2": {"driven_any": 5.743174255101718, "survival_time": 59.99999999999873, "driven_lanedir": 5.737782401111865, "in-drivable-lane": 0.0, "deviation-heading": 1.3593820232501066, "distance-from-start": 2.328675391154607, "deviation-center-line": 0.16467176741140607, "driven_lanedir_consec": 5.737782330849534}, "4way-000-ego3": {"driven_any": 2.48926558851937, "survival_time": 59.99999999999873, "driven_lanedir": 2.486560433424032, "in-drivable-lane": 0.0, "deviation-heading": 0.8620262474011284, "distance-from-start": 2.0171308546636073, "deviation-center-line": 0.09014597657561622, "driven_lanedir_consec": 2.486560433424032}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5285498Bea Baselines 🐤minimal-agentaido-LF-sim-testingsim-1of4successnogpu-staging-spot-0-050:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666552017194578
survival_time_median7.349999999999982
deviation-center-line_median0.10783809919009717
in-drivable-lane_median5.9499999999999815


other stats
deviation-center-line_max0.10783809919009717
deviation-center-line_mean0.10783809919009717
deviation-center-line_min0.10783809919009717
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.0431443246128234
distance-from-start_mean1.0431443246128234
distance-from-start_median1.0431443246128234
distance-from-start_min1.0431443246128234
driven_any_max1.0431971841733938
driven_any_mean1.0431971841733938
driven_any_median1.0431971841733938
driven_any_min1.0431971841733938
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max5.9499999999999815
in-drivable-lane_mean5.9499999999999815
in-drivable-lane_min5.9499999999999815
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.0431971841733938, "survival_time": 7.349999999999982, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 5.9499999999999815, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128234, "deviation-center-line": 0.10783809919009717, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean7.349999999999982
survival_time_min7.349999999999982
No reset possible
5280490Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-1of4successnogpu-staging-spot-0-050:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2999999999999963
in-drivable-lane_median1.5499999999999954
driven_lanedir_consec_median0.1995526730519679
deviation-center-line_median0.12567511082985278


other stats
deviation-center-line_max0.12567511082985278
deviation-center-line_mean0.12567511082985278
deviation-center-line_min0.12567511082985278
deviation-heading_max0.9488219555580464
deviation-heading_mean0.9488219555580464
deviation-heading_median0.9488219555580464
deviation-heading_min0.9488219555580464
distance-from-start_max0.3731007861754622
distance-from-start_mean0.3731007861754622
distance-from-start_median0.3731007861754622
distance-from-start_min0.3731007861754622
driven_any_max0.3731074338181184
driven_any_mean0.3731074338181184
driven_any_median0.3731074338181184
driven_any_min0.3731074338181184
driven_lanedir_consec_max0.1995526730519679
driven_lanedir_consec_mean0.1995526730519679
driven_lanedir_consec_min0.1995526730519679
driven_lanedir_max0.1995526730519679
driven_lanedir_mean0.1995526730519679
driven_lanedir_median0.1995526730519679
driven_lanedir_min0.1995526730519679
in-drivable-lane_max1.5499999999999954
in-drivable-lane_mean1.5499999999999954
in-drivable-lane_min1.5499999999999954
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3731074338181184, "survival_time": 3.2999999999999963, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 1.5499999999999954, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.3731007861754622, "deviation-center-line": 0.12567511082985278, "driven_lanedir_consec": 0.1995526730519679}}
simulation-passed1
survival_time_max3.2999999999999963
survival_time_mean3.2999999999999963
survival_time_min3.2999999999999963
No reset possible
5274493Bea Baselines 🐤minimal-agentaido-LFV_multi-sim-testingsim-3of4successnogpu-staging-spot-0-050:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.149999999999997
in-drivable-lane_median4.875000000000003
driven_lanedir_consec_median0.289311911126539
deviation-center-line_median0.2854350669429092


other stats
deviation-center-line_max0.5369848152426562
deviation-center-line_mean0.3039233256148837
deviation-center-line_min0.1078383533310603
deviation-heading_max5.746819505209112
deviation-heading_mean2.661183275455421
deviation-heading_median1.9735543768888169
deviation-heading_min0.9508048428349388
distance-from-start_max1.3401007240645948
distance-from-start_mean0.9011390649924692
distance-from-start_median1.125732066497545
distance-from-start_min0.012991402910192814
driven_any_max1.340203809047782
driven_any_mean0.9011927842307196
driven_any_median1.125787961003098
driven_any_min0.012991405868901164
driven_lanedir_consec_max0.6682567041605503
driven_lanedir_consec_mean0.3143327960153308
driven_lanedir_consec_min0.01045065764769504
driven_lanedir_max0.6682567041605503
driven_lanedir_mean0.3143327960153308
driven_lanedir_median0.289311911126539
driven_lanedir_min0.01045065764769504
in-drivable-lane_max7.749999999999995
in-drivable-lane_mean4.375
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.340203809047782, "survival_time": 9.149999999999997, "driven_lanedir": 0.13666480491623645, "in-drivable-lane": 7.749999999999995, "deviation-heading": 0.9508048428349388, "distance-from-start": 1.3401007240645948, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491623645}, "zigzag-000-ego1": {"driven_any": 1.1340498872413602, "survival_time": 9.149999999999997, "driven_lanedir": 0.6682567041605503, "in-drivable-lane": 4.400000000000004, "deviation-heading": 1.6760451832462109, "distance-from-start": 1.1339937510429776, "deviation-center-line": 0.2787126927513582, "driven_lanedir_consec": 0.6682567041605503}, "zigzag-000-ego2": {"driven_any": 1.1175260347648353, "survival_time": 9.149999999999997, "driven_lanedir": 0.4419590173368415, "in-drivable-lane": 5.350000000000001, "deviation-heading": 2.271063570531423, "distance-from-start": 1.1174703819521123, "deviation-center-line": 0.2921574411344602, "driven_lanedir_consec": 0.4419590173368415}, "zigzag-000-ego3": {"driven_any": 0.012991405868901164, "survival_time": 9.149999999999997, "driven_lanedir": 0.01045065764769504, "in-drivable-lane": 0.0, "deviation-heading": 5.746819505209112, "distance-from-start": 0.012991402910192814, "deviation-center-line": 0.5369848152426562, "driven_lanedir_consec": 0.01045065764769504}}
simulation-passed1
survival_time_max9.149999999999997
survival_time_mean9.149999999999997
survival_time_min9.149999999999997
No reset possible
5273490Bea Baselines 🐤minimal-agentaido-LFI-sim-validationsim-0of4successnogpu-staging-spot-0-050:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.15000000000001
in-drivable-lane_median6.850000000000014
driven_lanedir_consec_median0.3312273934354333
deviation-center-line_median0.26973531317092336


other stats
deviation-center-line_max0.26973531317092336
deviation-center-line_mean0.26973531317092336
deviation-center-line_min0.26973531317092336
deviation-heading_max2.5383505748046193
deviation-heading_mean2.5383505748046193
deviation-heading_median2.5383505748046193
deviation-heading_min2.5383505748046193
distance-from-start_max1.5040665006803442
distance-from-start_mean1.5040665006803442
distance-from-start_median1.5040665006803442
distance-from-start_min1.5040665006803442
driven_any_max1.5041747780934231
driven_any_mean1.5041747780934231
driven_any_median1.5041747780934231
driven_any_min1.5041747780934231
driven_lanedir_consec_max0.3312273934354333
driven_lanedir_consec_mean0.3312273934354333
driven_lanedir_consec_min0.3312273934354333
driven_lanedir_max0.3312273934354333
driven_lanedir_mean0.3312273934354333
driven_lanedir_median0.3312273934354333
driven_lanedir_min0.3312273934354333
in-drivable-lane_max6.850000000000014
in-drivable-lane_mean6.850000000000014
in-drivable-lane_min6.850000000000014
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.5041747780934231, "survival_time": 10.15000000000001, "driven_lanedir": 0.3312273934354333, "in-drivable-lane": 6.850000000000014, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.5040665006803442, "deviation-center-line": 0.26973531317092336, "driven_lanedir_consec": 0.3312273934354333}}
simulation-passed1
survival_time_max10.15000000000001
survival_time_mean10.15000000000001
survival_time_min10.15000000000001
No reset possible
5263476Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-validation275successyesgpu-staging-spot-0-050:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median4.742328706004615
deviation-center-line_median0.33945456663980716


other stats
deviation-center-line_max0.3908949944505377
deviation-center-line_mean0.32135416680458384
deviation-center-line_min0.2156125394881833
deviation-heading_max3.7646465736418224
deviation-heading_mean2.8850148728120875
deviation-heading_median2.9961830476481808
deviation-heading_min1.783046822310164
distance-from-start_max3.522061458900184
distance-from-start_mean2.7436402553448476
distance-from-start_median2.7369885705970955
distance-from-start_min1.978522421285015
driven_any_max5.190284455707655
driven_any_mean4.751674865015388
driven_any_median4.75306747748424
driven_any_min4.310280049385415
driven_lanedir_consec_max5.178025139788938
driven_lanedir_consec_mean4.740809849192896
driven_lanedir_consec_min4.300556844973417
driven_lanedir_max5.178025139788938
driven_lanedir_mean4.740809849192896
driven_lanedir_median4.742328706004615
driven_lanedir_min4.300556844973417
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.310280049385415, "survival_time": 59.99999999999873, "driven_lanedir": 4.300556844973417, "in-drivable-lane": 0.0, "deviation-heading": 3.7646465736418224, "distance-from-start": 1.978522421285015, "deviation-center-line": 0.3085743240153483, "driven_lanedir_consec": 4.300556844973417}, "autolab-000-ego1": {"driven_any": 4.439412618608211, "survival_time": 59.99999999999873, "driven_lanedir": 4.428719111024556, "in-drivable-lane": 0.0, "deviation-heading": 1.783046822310164, "distance-from-start": 2.152738956720156, "deviation-center-line": 0.2156125394881833, "driven_lanedir_consec": 4.428719111024556}, "autolab-000-ego2": {"driven_any": 5.190284455707655, "survival_time": 59.99999999999873, "driven_lanedir": 5.178025139788938, "in-drivable-lane": 0.0, "deviation-heading": 3.020096037621849, "distance-from-start": 3.522061458900184, "deviation-center-line": 0.3908949944505377, "driven_lanedir_consec": 5.178025139788938}, "autolab-000-ego3": {"driven_any": 5.066722336360269, "survival_time": 59.99999999999873, "driven_lanedir": 5.055938300984675, "in-drivable-lane": 0.0, "deviation-heading": 2.972270057674513, "distance-from-start": 3.3212381844740353, "deviation-center-line": 0.3703348092642661, "driven_lanedir_consec": 5.055938300984675}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5262477Bea Baselines 🐤baseline-simple-yieldaido-LFP-state-sim-validationsim-0of4successnogpu-staging-spot-0-050:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.999999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median0.793469797561154
deviation-center-line_median0.08003747569423085


other stats
deviation-center-line_max0.08003747569423085
deviation-center-line_mean0.08003747569423085
deviation-center-line_min0.08003747569423085
deviation-heading_max0.913163834671925
deviation-heading_mean0.913163834671925
deviation-heading_median0.913163834671925
deviation-heading_min0.913163834671925
distance-from-start_max0.6744700135939992
distance-from-start_mean0.6744700135939992
distance-from-start_median0.6744700135939992
distance-from-start_min0.6744700135939992
driven_any_max0.8000331626182206
driven_any_mean0.8000331626182206
driven_any_median0.8000331626182206
driven_any_min0.8000331626182206
driven_lanedir_consec_max0.793469797561154
driven_lanedir_consec_mean0.793469797561154
driven_lanedir_consec_min0.793469797561154
driven_lanedir_max0.793469797561154
driven_lanedir_mean0.793469797561154
driven_lanedir_median0.793469797561154
driven_lanedir_min0.793469797561154
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 0.8000331626182206, "survival_time": 8.999999999999993, "driven_lanedir": 0.793469797561154, "in-drivable-lane": 0.0, "deviation-heading": 0.913163834671925, "distance-from-start": 0.6744700135939992, "deviation-center-line": 0.08003747569423085, "driven_lanedir_consec": 0.793469797561154}}
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean8.999999999999993
survival_time_min8.999999999999993
No reset possible
5244482Bea Baselines 🐤baseline-simple-yieldaido-LFV_multi-state-sim-testingsim-2of4successnogpu-staging-spot-0-050:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median2.3225169615019583
deviation-center-line_median0.6106323511970384


other stats
deviation-center-line_max2.7624766981243565
deviation-center-line_mean1.0519970062330533
deviation-center-line_min0.22424662441377963
deviation-heading_max37.82293240559152
deviation-heading_mean10.912898130454176
deviation-heading_median2.0831892986732727
deviation-heading_min1.662281518878632
distance-from-start_max2.3178967556009846
distance-from-start_mean1.3561716835463995
distance-from-start_median1.5533949892923062
distance-from-start_min4.577566798522237e-16
driven_any_max5.273775150152415
driven_any_mean2.4826108851577655
driven_any_median2.3283341952390493
driven_any_min5.49308015822675e-13
driven_lanedir_consec_max5.26083024755342
driven_lanedir_consec_mean2.476466042639334
driven_lanedir_consec_min0.0
driven_lanedir_max5.26083024755342
driven_lanedir_mean2.476466042639334
driven_lanedir_median2.3225169615019583
driven_lanedir_min0.0
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 5.273775150152415, "survival_time": 59.99999999999873, "driven_lanedir": 5.26083024755342, "in-drivable-lane": 0.0, "deviation-heading": 2.111513261391546, "distance-from-start": 2.3178967556009846, "deviation-center-line": 0.22424662441377963, "driven_lanedir_consec": 5.26083024755342}, "loop-000-ego1": {"driven_any": 1.5746103029952832, "survival_time": 59.99999999999873, "driven_lanedir": 1.5658385330081717, "in-drivable-lane": 0.0, "deviation-heading": 2.054865335955, "distance-from-start": 1.0292579667018384, "deviation-center-line": 0.5524823741667937, "driven_lanedir_consec": 1.5658385330081717}, "loop-000-ego2": {"driven_any": 3.082058087482815, "survival_time": 59.99999999999873, "driven_lanedir": 3.0791953899957454, "in-drivable-lane": 0.0, "deviation-heading": 1.662281518878632, "distance-from-start": 2.077532011882774, "deviation-center-line": 0.6687823282272832, "driven_lanedir_consec": 3.0791953899957454}, "loop-000-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 2.7624766981243565, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5239497Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-1of4successnogpu-staging-spot-0-050:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.149999999999993
in-drivable-lane_median2.749999999999993
driven_lanedir_consec_median0.13666480491623578
deviation-center-line_median0.10783842766264128


other stats
deviation-center-line_max0.10783842766264128
deviation-center-line_mean0.10783842766264128
deviation-center-line_min0.10783842766264128
deviation-heading_max0.9508048428349388
deviation-heading_mean0.9508048428349388
deviation-heading_median0.9508048428349388
deviation-heading_min0.9508048428349388
distance-from-start_max0.5146479428595216
distance-from-start_mean0.5146479428595216
distance-from-start_median0.5146479428595216
distance-from-start_min0.5146479428595216
driven_any_max0.5146585239872711
driven_any_mean0.5146585239872711
driven_any_median0.5146585239872711
driven_any_min0.5146585239872711
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max2.749999999999993
in-drivable-lane_mean2.749999999999993
in-drivable-lane_min2.749999999999993
per-episodes
details{"4way-000-ego0": {"driven_any": 0.5146585239872711, "survival_time": 4.149999999999993, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.5146479428595216, "deviation-center-line": 0.10783842766264128, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean4.149999999999993
survival_time_min4.149999999999993
No reset possible
5236497Bea Baselines 🐤minimal-agentaido-LFI-sim-testingsim-2of4successnogpu-staging-spot-0-050:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
5232484Bea Baselines 🐤baseline-simple-yieldaido-LFV-state-sim-testingsim-3of4successnogpu-staging-spot-0-050:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.750000000000004
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7199000882778759
deviation-center-line_median0.16571411064010536


other stats
deviation-center-line_max0.16571411064010536
deviation-center-line_mean0.16571411064010536
deviation-center-line_min0.16571411064010536
deviation-heading_max1.3921530764896437
deviation-heading_mean1.3921530764896437
deviation-heading_median1.3921530764896437
deviation-heading_min1.3921530764896437
distance-from-start_max0.6832017558427702
distance-from-start_mean0.6832017558427702
distance-from-start_median0.6832017558427702
distance-from-start_min0.6832017558427702
driven_any_max0.7330980289948952
driven_any_mean0.7330980289948952
driven_any_median0.7330980289948952
driven_any_min0.7330980289948952
driven_lanedir_consec_max0.7199000882778759
driven_lanedir_consec_mean0.7199000882778759
driven_lanedir_consec_min0.7199000882778759
driven_lanedir_max0.7199000882778759
driven_lanedir_mean0.7199000882778759
driven_lanedir_median0.7199000882778759
driven_lanedir_min0.7199000882778759
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7330980289948952, "survival_time": 9.750000000000004, "driven_lanedir": 0.7199000882778759, "in-drivable-lane": 0.0, "deviation-heading": 1.3921530764896437, "distance-from-start": 0.6832017558427702, "deviation-center-line": 0.16571411064010536, "driven_lanedir_consec": 0.7199000882778759}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_min9.750000000000004
No reset possible
5227495Bea Baselines 🐤minimal-agentaido-LFV-sim-testingsim-0of4successnogpu-staging-spot-0-050:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.55
in-drivable-lane_median8.15
driven_lanedir_consec_median0.1366657585905522
deviation-center-line_median0.10783835333106088


other stats
deviation-center-line_max0.10783835333106088
deviation-center-line_mean0.10783835333106088
deviation-center-line_min0.10783835333106088
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max1.4052228942345053
distance-from-start_mean1.4052228942345053
distance-from-start_median1.4052228942345053
distance-from-start_min1.4052228942345053
driven_any_max1.4053294634715037
driven_any_mean1.4053294634715037
driven_any_median1.4053294634715037
driven_any_min1.4053294634715037
driven_lanedir_consec_max0.1366657585905522
driven_lanedir_consec_mean0.1366657585905522
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.1366657585905522
driven_lanedir_mean0.1366657585905522
driven_lanedir_median0.1366657585905522
driven_lanedir_min0.1366657585905522
in-drivable-lane_max8.15
in-drivable-lane_mean8.15
in-drivable-lane_min8.15
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4053294634715037, "survival_time": 9.55, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.15, "deviation-heading": 0.9508048428349394, "distance-from-start": 1.4052228942345053, "deviation-center-line": 0.10783835333106088, "driven_lanedir_consec": 0.1366657585905522}}
simulation-passed1
survival_time_max9.55
survival_time_mean9.55
survival_time_min9.55
No reset possible
5199591Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:d3a8a709865eeb123391edb5edec2679039af58faido-hello-sim-validationsanity-checksuccessnogpu-staging-spot-0-050:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.03450788353419165
deviation-center-line_median0.0062628156632261785


other stats
deviation-center-line_max0.0062628156632261785
deviation-center-line_mean0.0062628156632261785
deviation-center-line_min0.0062628156632261785
deviation-heading_max0.30111042352483697
deviation-heading_mean0.30111042352483697
deviation-heading_median0.30111042352483697
deviation-heading_min0.30111042352483697
distance-from-start_max0.04443592833714231
distance-from-start_mean0.04443592833714231
distance-from-start_median0.04443592833714231
distance-from-start_min0.04443592833714231
driven_any_max0.04456117717485936
driven_any_mean0.04456117717485936
driven_any_median0.04456117717485936
driven_any_min0.04456117717485936
driven_lanedir_consec_max0.03450788353419165
driven_lanedir_consec_mean0.03450788353419165
driven_lanedir_consec_min0.03450788353419165
driven_lanedir_max0.03450788353419165
driven_lanedir_mean0.03450788353419165
driven_lanedir_median0.03450788353419165
driven_lanedir_min0.03450788353419165
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.04456117717485936, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03450788353419165, "in-drivable-lane": 0.0, "deviation-heading": 0.30111042352483697, "distance-from-start": 0.04443592833714231, "deviation-center-line": 0.0062628156632261785, "driven_lanedir_consec": 0.03450788353419165}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
5192600Liam Paulltemplate-tensorflowaido-LF-sim-validationsim-0of4failednogpu-staging-spot-0-050:05:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible