Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 7482802Bea Baselines challenge-aido_LF-template-pytorch:daffy-staging:3ee0deff6949110710f97b6d814764f4be1d4551 aido-hello-sim-validationsanity-check timeout no gpu-staging-spot-0-032021-11-04 02:37:44+00:00 - - - - No reset possible 7479795Bea Baselines challenge-aido_LF-template-pytorch:daffy-staging:c5eb3df1f1017464ea091cbc60ac41b043b03a95 aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-032021-11-03 15:38:14+00:00 2021-11-03 15:41:23+00:00 0:03:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.018685875246715833 deviation-center-line_median 0.0053216310858317465
other stats deviation-center-line_max 0.0053216310858317465 deviation-center-line_mean 0.0053216310858317465 deviation-center-line_min 0.0053216310858317465 deviation-heading_max 0.30185291907690603 deviation-heading_mean 0.30185291907690603 deviation-heading_median 0.30185291907690603 deviation-heading_min 0.30185291907690603 distance-from-start_max 0.024170292500305123 distance-from-start_mean 0.024170292500305123 distance-from-start_median 0.024170292500305123 distance-from-start_min 0.024170292500305123 driven_any_max 0.024248908747562907 driven_any_mean 0.024248908747562907 driven_any_median 0.024248908747562907 driven_any_min 0.024248908747562907 driven_lanedir_consec_max 0.018685875246715833 driven_lanedir_consec_mean 0.018685875246715833 driven_lanedir_consec_min 0.018685875246715833 driven_lanedir_max 0.018685875246715833 driven_lanedir_mean 0.018685875246715833 driven_lanedir_median 0.018685875246715833 driven_lanedir_min 0.018685875246715833 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.024248908747562907, "survival_time": 0.49999999999999994, "driven_lanedir": 0.018685875246715833, "in-drivable-lane": 0.0, "deviation-heading": 0.30185291907690603, "distance-from-start": 0.024170292500305123, "deviation-center-line": 0.0053216310858317465, "driven_lanedir_consec": 0.018685875246715833}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 7470800Andrea Daniele template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-03 15:31:32+00:00 2021-11-03 15:37:49+00:00 0:06:17 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7460385Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 08:43:53+00:00 2021-11-03 09:03:44+00:00 0:19:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 21.899999999999466 driven_lanedir_consec_median -2.7870405571934964 deviation-center-line_median 3.69259771015276
other stats deviation-center-line_max 5.747748716145139 deviation-center-line_mean 3.7444955493006624 deviation-center-line_min 1.8450380607519905 deviation-heading_max 32.65133827952764 deviation-heading_mean 25.972272063663578 deviation-heading_median 27.077989882294133 deviation-heading_min 17.081770210538373 distance-from-start_max 0.2497682936907984 distance-from-start_mean 0.18623055565452615 distance-from-start_median 0.17696759680981888 distance-from-start_min 0.14121873530766849 driven_any_max 14.503555695702028 driven_any_mean 12.707721269210491 driven_any_median 13.22692481129483 driven_any_min 9.873479758550276 driven_lanedir_consec_max -1.441310461435123 driven_lanedir_consec_mean -2.7189905110659707 driven_lanedir_consec_min -3.860570468441765 driven_lanedir_max -1.441310461435123 driven_lanedir_mean -4.909213916858146 driven_lanedir_median -4.99181419130647 driven_lanedir_min -8.211916823384518 in-drivable-lane_max 41.599999999999085 in-drivable-lane_mean 23.662499999999444 in-drivable-lane_min 9.249999999999758 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.873479758550276, "survival_time": 59.99999999999873, "driven_lanedir": -1.441310461435123, "in-drivable-lane": 30.54999999999915, "deviation-heading": 25.96606723706279, "distance-from-start": 0.14121873530766849, "deviation-center-line": 2.7702247523630494, "driven_lanedir_consec": -1.441310461435123}, "zigzag-000-ego1": {"driven_any": 12.277872412414682, "survival_time": 59.99999999999873, "driven_lanedir": -2.248053425422704, "in-drivable-lane": 41.599999999999085, "deviation-heading": 17.081770210538373, "distance-from-start": 0.16609069549229957, "deviation-center-line": 1.8450380607519905, "driven_lanedir_consec": -2.206578955129457}, "zigzag-000-ego2": {"driven_any": 14.17597721017498, "survival_time": 59.99999999999873, "driven_lanedir": -8.211916823384518, "in-drivable-lane": 9.249999999999758, "deviation-heading": 32.65133827952764, "distance-from-start": 0.2497682936907984, "deviation-center-line": 5.747748716145139, "driven_lanedir_consec": -3.860570468441765}, "zigzag-000-ego3": {"driven_any": 14.503555695702028, "survival_time": 59.99999999999873, "driven_lanedir": -7.735574957190236, "in-drivable-lane": 13.249999999999776, "deviation-heading": 28.189912527525472, "distance-from-start": 0.18784449812733825, "deviation-center-line": 4.61497066794247, "driven_lanedir_consec": -3.367502159257536}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7457386Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 08:37:28+00:00 2021-11-03 08:43:22+00:00 0:05:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 26.149999999999444 driven_lanedir_consec_median -3.495644579828066 deviation-center-line_median 2.309285596012149
other stats deviation-center-line_max 2.309285596012149 deviation-center-line_mean 2.309285596012149 deviation-center-line_min 2.309285596012149 deviation-heading_max 28.50178428839963 deviation-heading_mean 28.50178428839963 deviation-heading_median 28.50178428839963 deviation-heading_min 28.50178428839963 distance-from-start_max 0.2193299108013506 distance-from-start_mean 0.2193299108013506 distance-from-start_median 0.2193299108013506 distance-from-start_min 0.2193299108013506 driven_any_max 12.119911739923642 driven_any_mean 12.119911739923642 driven_any_median 12.119911739923642 driven_any_min 12.119911739923642 driven_lanedir_consec_max -3.495644579828066 driven_lanedir_consec_mean -3.495644579828066 driven_lanedir_consec_min -3.495644579828066 driven_lanedir_max -3.5948503715389544 driven_lanedir_mean -3.5948503715389544 driven_lanedir_median -3.5948503715389544 driven_lanedir_min -3.5948503715389544 in-drivable-lane_max 26.149999999999444 in-drivable-lane_mean 26.149999999999444 in-drivable-lane_min 26.149999999999444 per-episodes details {"loop-000-ego0": {"driven_any": 12.119911739923642, "survival_time": 59.99999999999873, "driven_lanedir": -3.5948503715389544, "in-drivable-lane": 26.149999999999444, "deviation-heading": 28.50178428839963, "distance-from-start": 0.2193299108013506, "deviation-center-line": 2.309285596012149, "driven_lanedir_consec": -3.495644579828066}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7451387Bea Baselines baseline-RL-sim-pytorch aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 08:27:13+00:00 2021-11-03 08:37:07+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 27.79999999999932 driven_lanedir_consec_median -3.3494740218276475 deviation-center-line_median 2.400486472109026
other stats deviation-center-line_max 2.400486472109026 deviation-center-line_mean 2.400486472109026 deviation-center-line_min 2.400486472109026 deviation-heading_max 27.773493733314364 deviation-heading_mean 27.773493733314364 deviation-heading_median 27.773493733314364 deviation-heading_min 27.773493733314364 distance-from-start_max 0.1635580526066067 distance-from-start_mean 0.1635580526066067 distance-from-start_median 0.1635580526066067 distance-from-start_min 0.1635580526066067 driven_any_max 11.388129979903493 driven_any_mean 11.388129979903493 driven_any_median 11.388129979903493 driven_any_min 11.388129979903493 driven_lanedir_consec_max -3.3494740218276475 driven_lanedir_consec_mean -3.3494740218276475 driven_lanedir_consec_min -3.3494740218276475 driven_lanedir_max -3.5811976238727214 driven_lanedir_mean -3.5811976238727214 driven_lanedir_median -3.5811976238727214 driven_lanedir_min -3.5811976238727214 in-drivable-lane_max 27.79999999999932 in-drivable-lane_mean 27.79999999999932 in-drivable-lane_min 27.79999999999932 per-episodes details {"loop-000-ego0": {"driven_any": 11.388129979903493, "survival_time": 59.99999999999873, "driven_lanedir": -3.5811976238727214, "in-drivable-lane": 27.79999999999932, "deviation-heading": 27.773493733314364, "distance-from-start": 0.1635580526066067, "deviation-center-line": 2.400486472109026, "driven_lanedir_consec": -3.3494740218276475}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7449388Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 08:25:17+00:00 2021-11-03 08:26:58+00:00 0:01:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7447388Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 08:23:30+00:00 2021-11-03 08:25:03+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7446389Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 08:21:31+00:00 2021-11-03 08:23:05+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7442389Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 08:19:25+00:00 2021-11-03 08:21:18+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7431392Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-03 08:03:03+00:00 2021-11-03 08:18:51+00:00 0:15:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.474999999999213 driven_lanedir_consec_median -2.512719138728734 deviation-center-line_median 2.6562002946109375
other stats deviation-center-line_max 3.1844245882939917 deviation-center-line_mean 2.651757022973249 deviation-center-line_min 2.110202914377127 deviation-heading_max 37.82293240559152 deviation-heading_mean 27.2096240826842 deviation-heading_median 25.00490138536337 deviation-heading_min 21.00576115441852 distance-from-start_max 0.18800118701451524 distance-from-start_mean 0.13001410065711938 distance-from-start_median 0.166027607806981 distance-from-start_min 2.482534153247273e-16 driven_any_max 11.698003864182242 driven_any_mean 8.461755797491694 driven_any_median 11.07450966289212 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean -2.0046823242548895 driven_lanedir_consec_min -2.9932910195620903 driven_lanedir_max 0.0 driven_lanedir_mean -2.076619919662029 driven_lanedir_median -2.656594329543014 driven_lanedir_min -2.9932910195620903 in-drivable-lane_max 36.84999999999901 in-drivable-lane_mean 24.449999999999356 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 11.698003864182242, "survival_time": 59.99999999999873, "driven_lanedir": -2.9932910195620903, "in-drivable-lane": 31.249999999999208, "deviation-heading": 25.065697898304137, "distance-from-start": 0.16451795125064422, "deviation-center-line": 2.5499379684922228, "driven_lanedir_consec": -2.9932910195620903}, "loop-000-ego1": {"driven_any": 10.949601911327251, "survival_time": 59.99999999999873, "driven_lanedir": -2.34305146505908, "in-drivable-lane": 29.69999999999922, "deviation-heading": 24.944104872422606, "distance-from-start": 0.18800118701451524, "deviation-center-line": 3.1844245882939917, "driven_lanedir_consec": -2.34305146505908}, "loop-000-ego2": {"driven_any": 11.199417414456986, "survival_time": 59.99999999999873, "driven_lanedir": -2.9701371940269476, "in-drivable-lane": 36.84999999999901, "deviation-heading": 21.00576115441852, "distance-from-start": 0.16753726436331778, "deviation-center-line": 2.110202914377127, "driven_lanedir_consec": -2.6823868123983883}, "loop-000-ego3": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 2.7624626207296523, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7426393Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 07:57:59+00:00 2021-11-03 08:02:49+00:00 0:04:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 22.099999999999444 driven_lanedir_consec_median -2.5806806141277905 deviation-center-line_median 4.080412728210602
other stats deviation-center-line_max 4.080412728210602 deviation-center-line_mean 4.080412728210602 deviation-center-line_min 4.080412728210602 deviation-heading_max 28.080988423028455 deviation-heading_mean 28.080988423028455 deviation-heading_median 28.080988423028455 deviation-heading_min 28.080988423028455 distance-from-start_max 0.1458027863233186 distance-from-start_mean 0.1458027863233186 distance-from-start_median 0.1458027863233186 distance-from-start_min 0.1458027863233186 driven_any_max 10.820252990811442 driven_any_mean 10.820252990811442 driven_any_median 10.820252990811442 driven_any_min 10.820252990811442 driven_lanedir_consec_max -2.5806806141277905 driven_lanedir_consec_mean -2.5806806141277905 driven_lanedir_consec_min -2.5806806141277905 driven_lanedir_max -2.5806806141277905 driven_lanedir_mean -2.5806806141277905 driven_lanedir_median -2.5806806141277905 driven_lanedir_min -2.5806806141277905 in-drivable-lane_max 22.099999999999444 in-drivable-lane_mean 22.099999999999444 in-drivable-lane_min 22.099999999999444 per-episodes details {"loop2-000-ego0": {"driven_any": 10.820252990811442, "survival_time": 59.99999999999873, "driven_lanedir": -2.5806806141277905, "in-drivable-lane": 22.099999999999444, "deviation-heading": 28.080988423028455, "distance-from-start": 0.1458027863233186, "deviation-center-line": 4.080412728210602, "driven_lanedir_consec": -2.5806806141277905}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7423393Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 07:51:25+00:00 2021-11-03 07:57:45+00:00 0:06:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 36.54999999999899 driven_lanedir_consec_median -2.189741249790382 deviation-center-line_median 1.993705144807286
other stats deviation-center-line_max 1.993705144807286 deviation-center-line_mean 1.993705144807286 deviation-center-line_min 1.993705144807286 deviation-heading_max 21.43356356456226 deviation-heading_mean 21.43356356456226 deviation-heading_median 21.43356356456226 deviation-heading_min 21.43356356456226 distance-from-start_max 0.1615395639725433 distance-from-start_mean 0.1615395639725433 distance-from-start_median 0.1615395639725433 distance-from-start_min 0.1615395639725433 driven_any_max 10.593308338471005 driven_any_mean 10.593308338471005 driven_any_median 10.593308338471005 driven_any_min 10.593308338471005 driven_lanedir_consec_max -2.189741249790382 driven_lanedir_consec_mean -2.189741249790382 driven_lanedir_consec_min -2.189741249790382 driven_lanedir_max -2.189741249790382 driven_lanedir_mean -2.189741249790382 driven_lanedir_median -2.189741249790382 driven_lanedir_min -2.189741249790382 in-drivable-lane_max 36.54999999999899 in-drivable-lane_mean 36.54999999999899 in-drivable-lane_min 36.54999999999899 per-episodes details {"autolab-000-ego0": {"driven_any": 10.593308338471005, "survival_time": 59.99999999999873, "driven_lanedir": -2.189741249790382, "in-drivable-lane": 36.54999999999899, "deviation-heading": 21.43356356456226, "distance-from-start": 0.1615395639725433, "deviation-center-line": 1.993705144807286, "driven_lanedir_consec": -2.189741249790382}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7420395Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 07:48:25+00:00 2021-11-03 07:51:06+00:00 0:02:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.749999999999988 in-drivable-lane_median 0.4000000000000003 driven_lanedir_consec_median 0.013423175195313776 deviation-center-line_median 0.17941032924003533
other stats deviation-center-line_max 0.17941032924003533 deviation-center-line_mean 0.17941032924003533 deviation-center-line_min 0.17941032924003533 deviation-heading_max 4.10167544191136 deviation-heading_mean 4.10167544191136 deviation-heading_median 4.10167544191136 deviation-heading_min 4.10167544191136 distance-from-start_max 0.12231195306354914 distance-from-start_mean 0.12231195306354914 distance-from-start_median 0.12231195306354914 distance-from-start_min 0.12231195306354914 driven_any_max 0.7023568632467588 driven_any_mean 0.7023568632467588 driven_any_median 0.7023568632467588 driven_any_min 0.7023568632467588 driven_lanedir_consec_max 0.013423175195313776 driven_lanedir_consec_mean 0.013423175195313776 driven_lanedir_consec_min 0.013423175195313776 driven_lanedir_max 0.013441795916352197 driven_lanedir_mean 0.013441795916352197 driven_lanedir_median 0.013441795916352197 driven_lanedir_min 0.013441795916352197 in-drivable-lane_max 0.4000000000000003 in-drivable-lane_mean 0.4000000000000003 in-drivable-lane_min 0.4000000000000003 per-episodes details {"udem-000-ego0": {"driven_any": 0.7023568632467588, "survival_time": 5.749999999999988, "driven_lanedir": 0.013441795916352197, "in-drivable-lane": 0.4000000000000003, "deviation-heading": 4.10167544191136, "distance-from-start": 0.12231195306354914, "deviation-center-line": 0.17941032924003533, "driven_lanedir_consec": 0.013423175195313776}}simulation-passed 1 survival_time_max 5.749999999999988 survival_time_mean 5.749999999999988 survival_time_min 5.749999999999988
No reset possible 7417396Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 07:45:06+00:00 2021-11-03 07:47:54+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.900000000000048 in-drivable-lane_median 3.3000000000000087 driven_lanedir_consec_median -0.4980778870199707 deviation-center-line_median 0.4411358148562491
other stats deviation-center-line_max 0.4411358148562491 deviation-center-line_mean 0.4411358148562491 deviation-center-line_min 0.4411358148562491 deviation-heading_max 6.745894047204968 deviation-heading_mean 6.745894047204968 deviation-heading_median 6.745894047204968 deviation-heading_min 6.745894047204968 distance-from-start_max 0.15791747007008355 distance-from-start_mean 0.15791747007008355 distance-from-start_median 0.15791747007008355 distance-from-start_min 0.15791747007008355 driven_any_max 2.2493954067625284 driven_any_mean 2.2493954067625284 driven_any_median 2.2493954067625284 driven_any_min 2.2493954067625284 driven_lanedir_consec_max -0.4980778870199707 driven_lanedir_consec_mean -0.4980778870199707 driven_lanedir_consec_min -0.4980778870199707 driven_lanedir_max -0.4918535733484273 driven_lanedir_mean -0.4918535733484273 driven_lanedir_median -0.4918535733484273 driven_lanedir_min -0.4918535733484273 in-drivable-lane_max 3.3000000000000087 in-drivable-lane_mean 3.3000000000000087 in-drivable-lane_min 3.3000000000000087 per-episodes details {"4way-000-ego0": {"driven_any": 2.2493954067625284, "survival_time": 12.900000000000048, "driven_lanedir": -0.4918535733484273, "in-drivable-lane": 3.3000000000000087, "deviation-heading": 6.745894047204968, "distance-from-start": 0.15791747007008355, "deviation-center-line": 0.4411358148562491, "driven_lanedir_consec": -0.4980778870199707}}simulation-passed 1 survival_time_max 12.900000000000048 survival_time_mean 12.900000000000048 survival_time_min 12.900000000000048
No reset possible 7414398Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:41:44+00:00 2021-11-03 07:44:39+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7408514Bea Baselines baseline-behavior-cloning aido-LFV_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-03 07:40:13+00:00 2021-11-03 07:41:24+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7403515Bea Baselines baseline-behavior-cloning aido-LFP-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-03 07:39:10+00:00 2021-11-03 07:40:06+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7400517Bea Baselines baseline-behavior-cloning aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:37:19+00:00 2021-11-03 07:38:50+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7394518Bea Baselines baseline-behavior-cloning aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 07:35:14+00:00 2021-11-03 07:36:46+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7389519Bea Baselines baseline-behavior-cloning aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-03 07:34:15+00:00 2021-11-03 07:35:09+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7385520Bea Baselines baseline-behavior-cloning aido-LFVI_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:32:43+00:00 2021-11-03 07:34:02+00:00 0:01:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7381521Bea Baselines baseline-behavior-cloning aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-032021-11-03 07:31:05+00:00 2021-11-03 07:32:16+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7376522Bea Baselines baseline-behavior-cloning aido-LFP-sim-testingsim-2of4 failed no gpu-staging-spot-0-032021-11-03 07:29:39+00:00 2021-11-03 07:30:39+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7374524Bea Baselines baseline-behavior-cloning aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 07:27:32+00:00 2021-11-03 07:29:08+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7372524Bea Baselines baseline-behavior-cloning aido-LFVI-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-11-03 07:25:30+00:00 2021-11-03 07:27:08+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7370525Bea Baselines baseline-behavior-cloning aido-LFI-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-11-03 07:23:33+00:00 2021-11-03 07:25:12+00:00 0:01:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7368525Bea Baselines baseline-behavior-cloning aido-LFI-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-11-03 07:21:59+00:00 2021-11-03 07:23:27+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7366527Bea Baselines baseline-behavior-cloning aido-LFVI_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 07:20:35+00:00 2021-11-03 07:21:53+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7364527Bea Baselines baseline-behavior-cloning aido-LFVI_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:19:11+00:00 2021-11-03 07:20:29+00:00 0:01:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7358529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 07:12:59+00:00 2021-11-03 07:18:40+00:00 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 9.999324556296513 deviation-center-line_median 3.2421840092402756
other stats deviation-center-line_max 3.2421840092402756 deviation-center-line_mean 3.2421840092402756 deviation-center-line_min 3.2421840092402756 deviation-heading_max 14.594609438718246 deviation-heading_mean 14.594609438718246 deviation-heading_median 14.594609438718246 deviation-heading_min 14.594609438718246 distance-from-start_max 1.0700546161454076 distance-from-start_mean 1.0700546161454076 distance-from-start_median 1.0700546161454076 distance-from-start_min 1.0700546161454076 driven_any_max 10.428566775606258 driven_any_mean 10.428566775606258 driven_any_median 10.428566775606258 driven_any_min 10.428566775606258 driven_lanedir_consec_max 9.999324556296513 driven_lanedir_consec_mean 9.999324556296513 driven_lanedir_consec_min 9.999324556296513 driven_lanedir_max 9.999324556296513 driven_lanedir_mean 9.999324556296513 driven_lanedir_median 9.999324556296513 driven_lanedir_min 9.999324556296513 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 10.428566775606258, "survival_time": 59.99999999999873, "driven_lanedir": 9.999324556296513, "in-drivable-lane": 0.0, "deviation-heading": 14.594609438718246, "distance-from-start": 1.0700546161454076, "deviation-center-line": 3.2421840092402756, "driven_lanedir_consec": 9.999324556296513}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7356529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:11:18+00:00 2021-11-03 07:12:53+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.949999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.9709639655801452 deviation-center-line_median 0.27885641557139856
other stats deviation-center-line_max 0.27885641557139856 deviation-center-line_mean 0.27885641557139856 deviation-center-line_min 0.27885641557139856 deviation-heading_max 1.387101173892331 deviation-heading_mean 1.387101173892331 deviation-heading_median 1.387101173892331 deviation-heading_min 1.387101173892331 distance-from-start_max 0.7764490757856843 distance-from-start_mean 0.7764490757856843 distance-from-start_median 0.7764490757856843 distance-from-start_min 0.7764490757856843 driven_any_max 0.9968307508250084 driven_any_mean 0.9968307508250084 driven_any_median 0.9968307508250084 driven_any_min 0.9968307508250084 driven_lanedir_consec_max 0.9709639655801452 driven_lanedir_consec_mean 0.9709639655801452 driven_lanedir_consec_min 0.9709639655801452 driven_lanedir_max 0.9709639655801452 driven_lanedir_mean 0.9709639655801452 driven_lanedir_median 0.9709639655801452 driven_lanedir_min 0.9709639655801452 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.9968307508250084, "survival_time": 5.949999999999987, "driven_lanedir": 0.9709639655801452, "in-drivable-lane": 0.0, "deviation-heading": 1.387101173892331, "distance-from-start": 0.7764490757856843, "deviation-center-line": 0.27885641557139856, "driven_lanedir_consec": 0.9709639655801452}}simulation-passed 1 survival_time_max 5.949999999999987 survival_time_mean 5.949999999999987 survival_time_min 5.949999999999987
No reset possible 7352530Bea Baselines baseline-dagger-pytorch aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:06:31+00:00 2021-11-03 07:10:52+00:00 0:04:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.10000000000015 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.1592766789749547 deviation-center-line_median 0.8987683834712762
other stats deviation-center-line_max 0.8987683834712762 deviation-center-line_mean 0.8987683834712762 deviation-center-line_min 0.8987683834712762 deviation-heading_max 3.792210718380013 deviation-heading_mean 3.792210718380013 deviation-heading_median 3.792210718380013 deviation-heading_min 3.792210718380013 distance-from-start_max 2.4071892272358797 distance-from-start_mean 2.4071892272358797 distance-from-start_median 2.4071892272358797 distance-from-start_min 2.4071892272358797 driven_any_max 3.240320493980612 driven_any_mean 3.240320493980612 driven_any_median 3.240320493980612 driven_any_min 3.240320493980612 driven_lanedir_consec_max 3.1592766789749547 driven_lanedir_consec_mean 3.1592766789749547 driven_lanedir_consec_min 3.1592766789749547 driven_lanedir_max 3.1592766789749547 driven_lanedir_mean 3.1592766789749547 driven_lanedir_median 3.1592766789749547 driven_lanedir_min 3.1592766789749547 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.240320493980612, "survival_time": 20.10000000000015, "driven_lanedir": 3.1592766789749547, "in-drivable-lane": 0.0, "deviation-heading": 3.792210718380013, "distance-from-start": 2.4071892272358797, "deviation-center-line": 0.8987683834712762, "driven_lanedir_consec": 3.1592766789749547}}simulation-passed 1 survival_time_max 20.10000000000015 survival_time_mean 20.10000000000015 survival_time_min 20.10000000000015
No reset possible 7350531Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 07:04:29+00:00 2021-11-03 07:06:17+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7331533Bea Baselines baseline-dagger-pytorch aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 06:58:24+00:00 2021-11-03 07:03:57+00:00 0:05:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 9.13712130505282 survival_time_median 59.99999999999873 deviation-center-line_median 2.9624589373784085 in-drivable-lane_median 2.4999999999999964
other stats deviation-center-line_max 2.9624589373784085 deviation-center-line_mean 2.9624589373784085 deviation-center-line_min 2.9624589373784085 deviation-heading_max 14.462185392345898 deviation-heading_mean 14.462185392345898 deviation-heading_median 14.462185392345898 deviation-heading_min 14.462185392345898 distance-from-start_max 3.307567970670326 distance-from-start_mean 3.307567970670326 distance-from-start_median 3.307567970670326 distance-from-start_min 3.307567970670326 driven_any_max 10.145747396809202 driven_any_mean 10.145747396809202 driven_any_median 10.145747396809202 driven_any_min 10.145747396809202 driven_lanedir_consec_max 9.13712130505282 driven_lanedir_consec_mean 9.13712130505282 driven_lanedir_consec_min 9.13712130505282 driven_lanedir_max 9.13712130505282 driven_lanedir_mean 9.13712130505282 driven_lanedir_median 9.13712130505282 driven_lanedir_min 9.13712130505282 in-drivable-lane_max 2.4999999999999964 in-drivable-lane_mean 2.4999999999999964 in-drivable-lane_min 2.4999999999999964 per-episodes details {"autolab-000-ego0": {"driven_any": 10.145747396809202, "survival_time": 59.99999999999873, "driven_lanedir": 9.13712130505282, "in-drivable-lane": 2.4999999999999964, "deviation-heading": 14.462185392345898, "distance-from-start": 3.307567970670326, "deviation-center-line": 2.9624589373784085, "driven_lanedir_consec": 9.13712130505282}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7322533Bea Baselines baseline-dagger-pytorch aido-LF-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 06:52:03+00:00 2021-11-03 06:58:18+00:00 0:06:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.552251372265067 survival_time_median 59.99999999999873 deviation-center-line_median 3.2774547778586496 in-drivable-lane_median 0.4500000000000064
other stats deviation-center-line_max 3.2774547778586496 deviation-center-line_mean 3.2774547778586496 deviation-center-line_min 3.2774547778586496 deviation-heading_max 16.023478981114305 deviation-heading_mean 16.023478981114305 deviation-heading_median 16.023478981114305 deviation-heading_min 16.023478981114305 distance-from-start_max 4.511390019552588 distance-from-start_mean 4.511390019552588 distance-from-start_median 4.511390019552588 distance-from-start_min 4.511390019552588 driven_any_max 9.219375418525962 driven_any_mean 9.219375418525962 driven_any_median 9.219375418525962 driven_any_min 9.219375418525962 driven_lanedir_consec_max 8.552251372265067 driven_lanedir_consec_mean 8.552251372265067 driven_lanedir_consec_min 8.552251372265067 driven_lanedir_max 8.552251372265067 driven_lanedir_mean 8.552251372265067 driven_lanedir_median 8.552251372265067 driven_lanedir_min 8.552251372265067 in-drivable-lane_max 0.4500000000000064 in-drivable-lane_mean 0.4500000000000064 in-drivable-lane_min 0.4500000000000064 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.219375418525962, "survival_time": 59.99999999999873, "driven_lanedir": 8.552251372265067, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 16.023478981114305, "distance-from-start": 4.511390019552588, "deviation-center-line": 3.2774547778586496, "driven_lanedir_consec": 8.552251372265067}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7303535Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 06:44:05+00:00 2021-11-03 06:51:46+00:00 0:07:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 16.874999999999197 driven_lanedir_consec_median 7.614034570253506 deviation-center-line_median 2.5983936275636
other stats deviation-center-line_max 3.1504590463270796 deviation-center-line_mean 2.5983936275636 deviation-center-line_min 2.04632820880012 deviation-heading_max 13.196240762056606 deviation-heading_mean 12.443878150844377 deviation-heading_median 12.443878150844377 deviation-heading_min 11.691515539632146 distance-from-start_max 1.5948002089880955 distance-from-start_mean 1.343751863823266 distance-from-start_median 1.343751863823266 distance-from-start_min 1.0927035186584362 driven_any_max 11.362291068346089 driven_any_mean 9.173406747800266 driven_any_median 9.173406747800266 driven_any_min 6.984522427254444 driven_lanedir_consec_max 10.51997655872056 driven_lanedir_consec_mean 7.614034570253506 driven_lanedir_consec_min 4.7080925817864525 driven_lanedir_max 10.51997655872056 driven_lanedir_mean 7.614034570253506 driven_lanedir_median 7.614034570253506 driven_lanedir_min 4.7080925817864525 in-drivable-lane_max 31.74999999999847 in-drivable-lane_mean 16.874999999999197 in-drivable-lane_min 1.9999999999999216 per-episodes details {"loop2-000-ego0": {"driven_any": 6.984522427254444, "survival_time": 59.99999999999873, "driven_lanedir": 4.7080925817864525, "in-drivable-lane": 31.74999999999847, "deviation-heading": 11.691515539632146, "distance-from-start": 1.5948002089880955, "deviation-center-line": 2.04632820880012, "driven_lanedir_consec": 4.7080925817864525}, "loop2-000-ego1": {"driven_any": 11.362291068346089, "survival_time": 59.99999999999873, "driven_lanedir": 10.51997655872056, "in-drivable-lane": 1.9999999999999216, "deviation-heading": 13.196240762056606, "distance-from-start": 1.0927035186584362, "deviation-center-line": 3.1504590463270796, "driven_lanedir_consec": 10.51997655872056}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7294538Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 06:41:09+00:00 2021-11-03 06:43:47+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.792556837925537 deviation-center-line_median 0.34230833673999117
other stats deviation-center-line_max 0.34230833673999117 deviation-center-line_mean 0.34230833673999117 deviation-center-line_min 0.34230833673999117 deviation-heading_max 2.1075244077625457 deviation-heading_mean 2.1075244077625457 deviation-heading_median 2.1075244077625457 deviation-heading_min 2.1075244077625457 distance-from-start_max 0.725136520259575 distance-from-start_mean 0.725136520259575 distance-from-start_median 0.725136520259575 distance-from-start_min 0.725136520259575 driven_any_max 0.8370100774045661 driven_any_mean 0.8370100774045661 driven_any_median 0.8370100774045661 driven_any_min 0.8370100774045661 driven_lanedir_consec_max 0.792556837925537 driven_lanedir_consec_mean 0.792556837925537 driven_lanedir_consec_min 0.792556837925537 driven_lanedir_max 0.792556837925537 driven_lanedir_mean 0.792556837925537 driven_lanedir_median 0.792556837925537 driven_lanedir_min 0.792556837925537 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.8370100774045661, "survival_time": 6.699999999999984, "driven_lanedir": 0.792556837925537, "in-drivable-lane": 0.0, "deviation-heading": 2.1075244077625457, "distance-from-start": 0.725136520259575, "deviation-center-line": 0.34230833673999117, "driven_lanedir_consec": 0.792556837925537}}simulation-passed 1 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 7289539Bea Baselines baseline-dagger-pytorch aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 06:39:26+00:00 2021-11-03 06:40:56+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 7240542Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 06:21:43+00:00 2021-11-03 06:36:58+00:00 0:15:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.525078841033351 deviation-center-line_median 5.152079792257124
other stats deviation-center-line_max 5.683416181994237 deviation-center-line_mean 4.694811803271008 deviation-center-line_min 2.7916714465755454 deviation-heading_max 40.88977256225907 deviation-heading_mean 22.25528933968058 deviation-heading_median 17.940189176669023 deviation-heading_min 12.251006443125206 distance-from-start_max 3.6494639338032977 distance-from-start_mean 1.949348047729584 distance-from-start_median 1.563586934389666 distance-from-start_min 1.0207543883357075 driven_any_max 10.055181244928516 driven_any_mean 4.349573211409028 driven_any_median 2.59691706438122 driven_any_min 2.1492774719451564 driven_lanedir_consec_max 8.913773593163073 driven_lanedir_consec_mean 4.007401285743438 driven_lanedir_consec_min 2.0656738677439725 driven_lanedir_max 9.523887014902096 driven_lanedir_mean 4.159929641178193 driven_lanedir_median 2.525078841033351 driven_lanedir_min 2.0656738677439725 in-drivable-lane_max 0.4999999999999716 in-drivable-lane_mean 0.1249999999999929 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.1492774719451564, "survival_time": 59.99999999999873, "driven_lanedir": 2.0656738677439725, "in-drivable-lane": 0.0, "deviation-heading": 40.88977256225907, "distance-from-start": 1.0486536162490003, "deviation-center-line": 5.683416181994237, "driven_lanedir_consec": 2.0656738677439725}, "udem-000-ego1": {"driven_any": 10.055181244928516, "survival_time": 59.99999999999873, "driven_lanedir": 9.523887014902096, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 12.251006443125206, "distance-from-start": 3.6494639338032977, "deviation-center-line": 2.7916714465755454, "driven_lanedir_consec": 8.913773593163073}, "udem-000-ego2": {"driven_any": 2.59377848748549, "survival_time": 59.99999999999873, "driven_lanedir": 2.552173037015908, "in-drivable-lane": 0.0, "deviation-heading": 12.41513356560604, "distance-from-start": 2.0785202525303315, "deviation-center-line": 4.775321942091455, "driven_lanedir_consec": 2.552173037015908}, "udem-000-ego3": {"driven_any": 2.600055641276949, "survival_time": 59.99999999999873, "driven_lanedir": 2.4979846450507943, "in-drivable-lane": 0.0, "deviation-heading": 23.465244787732, "distance-from-start": 1.0207543883357075, "deviation-center-line": 5.528837642422793, "driven_lanedir_consec": 2.4979846450507943}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7233600Liam Paull template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-03 06:19:50+00:00 2021-11-03 06:21:10+00:00 0:01:20 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7224600Liam Paull template-tensorflow aido-LF-sim-validationsim-2of4 failed no gpu-staging-spot-0-032021-11-03 06:17:19+00:00 2021-11-03 06:19:17+00:00 0:01:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7207603Bea Baselines template-ros aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 06:13:56+00:00 2021-11-03 06:16:46+00:00 0:02:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.599999999999988 in-drivable-lane_median 4.349999999999987 driven_lanedir_consec_median 0.23767314903391656 deviation-center-line_median 0.07275152226451537
other stats deviation-center-line_max 0.18989868829975132 deviation-center-line_mean 0.09862088545995357 deviation-center-line_min 0.05908180901103222 deviation-heading_max 0.7025525210826448 deviation-heading_mean 0.5980984803131555 deviation-heading_median 0.5875743660707865 deviation-heading_min 0.5146926680284044 distance-from-start_max 1.2953293883900825 distance-from-start_mean 0.9765875335103392 distance-from-start_median 1.0461371981669645 distance-from-start_min 0.5187463493173461 driven_any_max 1.310436538815268 driven_any_mean 0.98836120500468 driven_any_median 1.0615196022021145 driven_any_min 0.5199690767992234 driven_lanedir_consec_max 0.7143810346997703 driven_lanedir_consec_mean 0.33857042275274013 driven_lanedir_consec_min 0.16455435824335707 driven_lanedir_max 0.7143810346997703 driven_lanedir_mean 0.33857042275274013 driven_lanedir_median 0.23767314903391656 driven_lanedir_min 0.16455435824335707 in-drivable-lane_max 4.549999999999988 in-drivable-lane_mean 3.974999999999989 in-drivable-lane_min 2.6499999999999906 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.5199690767992234, "survival_time": 5.599999999999988, "driven_lanedir": 0.16455435824335707, "in-drivable-lane": 4.549999999999988, "deviation-heading": 0.638579265565139, "distance-from-start": 0.5187463493173461, "deviation-center-line": 0.05908180901103222, "driven_lanedir_consec": 0.16455435824335707}, "zigzag-000-ego1": {"driven_any": 1.310436538815268, "survival_time": 5.599999999999988, "driven_lanedir": 0.7143810346997703, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.7025525210826448, "distance-from-start": 1.2953293883900825, "deviation-center-line": 0.18989868829975132, "driven_lanedir_consec": 0.7143810346997703}, "zigzag-000-ego2": {"driven_any": 1.3027967245840044, "survival_time": 5.599999999999988, "driven_lanedir": 0.30530848647469355, "in-drivable-lane": 4.199999999999988, "deviation-heading": 0.536569466576434, "distance-from-start": 1.293284207034242, "deviation-center-line": 0.07941284274607863, "driven_lanedir_consec": 0.30530848647469355}, "zigzag-000-ego3": {"driven_any": 0.8202424798202241, "survival_time": 5.599999999999988, "driven_lanedir": 0.1700378115931396, "in-drivable-lane": 4.499999999999988, "deviation-heading": 0.5146926680284044, "distance-from-start": 0.7989901892996867, "deviation-center-line": 0.06609020178295212, "driven_lanedir_consec": 0.1700378115931396}}simulation-passed 1 survival_time_max 5.599999999999988 survival_time_mean 5.599999999999988 survival_time_min 5.599999999999988
No reset possible 7197604Bea Baselines template-ros aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 06:12:27+00:00 2021-11-03 06:13:37+00:00 0:01:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.7500000000000009 in-drivable-lane_median 0.7000000000000006 driven_lanedir_consec_median 0.20530096496125716 deviation-center-line_median 0.0705632176176351
other stats deviation-center-line_max 0.0705632176176351 deviation-center-line_mean 0.0705632176176351 deviation-center-line_min 0.0705632176176351 deviation-heading_max 0.5673034387023544 deviation-heading_mean 0.5673034387023544 deviation-heading_median 0.5673034387023544 deviation-heading_min 0.5673034387023544 distance-from-start_max 0.23931810776603968 distance-from-start_mean 0.23931810776603968 distance-from-start_median 0.23931810776603968 distance-from-start_min 0.23931810776603968 driven_any_max 0.23934141871081344 driven_any_mean 0.23934141871081344 driven_any_median 0.23934141871081344 driven_any_min 0.23934141871081344 driven_lanedir_consec_max 0.20530096496125716 driven_lanedir_consec_mean 0.20530096496125716 driven_lanedir_consec_min 0.20530096496125716 driven_lanedir_max 0.20530096496125716 driven_lanedir_mean 0.20530096496125716 driven_lanedir_median 0.20530096496125716 driven_lanedir_min 0.20530096496125716 in-drivable-lane_max 0.7000000000000006 in-drivable-lane_mean 0.7000000000000006 in-drivable-lane_min 0.7000000000000006 per-episodes details {"loop-000-ego0": {"driven_any": 0.23934141871081344, "survival_time": 1.7500000000000009, "driven_lanedir": 0.20530096496125716, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 0.5673034387023544, "distance-from-start": 0.23931810776603968, "deviation-center-line": 0.0705632176176351, "driven_lanedir_consec": 0.20530096496125716}}simulation-passed 1 survival_time_max 1.7500000000000009 survival_time_mean 1.7500000000000009 survival_time_min 1.7500000000000009
No reset possible 7190608Bea Baselines template-ros aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 06:10:26+00:00 2021-11-03 06:12:15+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24595472854485936 survival_time_median 6.349999999999985 deviation-center-line_median 0.10648431490081042 in-drivable-lane_median 4.999999999999985
other stats deviation-center-line_max 0.10648431490081042 deviation-center-line_mean 0.10648431490081042 deviation-center-line_min 0.10648431490081042 deviation-heading_max 0.652420233223357 deviation-heading_mean 0.652420233223357 deviation-heading_median 0.652420233223357 deviation-heading_min 0.652420233223357 distance-from-start_max 1.477453549849863 distance-from-start_mean 1.477453549849863 distance-from-start_median 1.477453549849863 distance-from-start_min 1.477453549849863 driven_any_max 1.5155573237457316 driven_any_mean 1.5155573237457316 driven_any_median 1.5155573237457316 driven_any_min 1.5155573237457316 driven_lanedir_consec_max 0.24595472854485936 driven_lanedir_consec_mean 0.24595472854485936 driven_lanedir_consec_min 0.24595472854485936 driven_lanedir_max 0.24595472854485936 driven_lanedir_mean 0.24595472854485936 driven_lanedir_median 0.24595472854485936 driven_lanedir_min 0.24595472854485936 in-drivable-lane_max 4.999999999999985 in-drivable-lane_mean 4.999999999999985 in-drivable-lane_min 4.999999999999985 per-episodes details {"autolab-000-ego0": {"driven_any": 1.5155573237457316, "survival_time": 6.349999999999985, "driven_lanedir": 0.24595472854485936, "in-drivable-lane": 4.999999999999985, "deviation-heading": 0.652420233223357, "distance-from-start": 1.477453549849863, "deviation-center-line": 0.10648431490081042, "driven_lanedir_consec": 0.24595472854485936}}simulation-passed 1 survival_time_max 6.349999999999985 survival_time_mean 6.349999999999985 survival_time_min 6.349999999999985
No reset possible 7180607Bea Baselines template-ros aido-LFI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 06:08:07+00:00 2021-11-03 06:09:52+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.25 in-drivable-lane_median 1.1999999999999995 driven_lanedir_consec_median 0.19680250329852944 deviation-center-line_median 0.062212428645818135
other stats deviation-center-line_max 0.062212428645818135 deviation-center-line_mean 0.062212428645818135 deviation-center-line_min 0.062212428645818135 deviation-heading_max 0.5770958585506243 deviation-heading_mean 0.5770958585506243 deviation-heading_median 0.5770958585506243 deviation-heading_min 0.5770958585506243 distance-from-start_max 0.3619419127922161 distance-from-start_mean 0.3619419127922161 distance-from-start_median 0.3619419127922161 distance-from-start_min 0.3619419127922161 driven_any_max 0.36541828492734046 driven_any_mean 0.36541828492734046 driven_any_median 0.36541828492734046 driven_any_min 0.36541828492734046 driven_lanedir_consec_max 0.19680250329852944 driven_lanedir_consec_mean 0.19680250329852944 driven_lanedir_consec_min 0.19680250329852944 driven_lanedir_max 0.19680250329852944 driven_lanedir_mean 0.19680250329852944 driven_lanedir_median 0.19680250329852944 driven_lanedir_min 0.19680250329852944 in-drivable-lane_max 1.1999999999999995 in-drivable-lane_mean 1.1999999999999995 in-drivable-lane_min 1.1999999999999995 per-episodes details {"udem1-000-ego0": {"driven_any": 0.36541828492734046, "survival_time": 2.25, "driven_lanedir": 0.19680250329852944, "in-drivable-lane": 1.1999999999999995, "deviation-heading": 0.5770958585506243, "distance-from-start": 0.3619419127922161, "deviation-center-line": 0.062212428645818135, "driven_lanedir_consec": 0.19680250329852944}}simulation-passed 1 survival_time_max 2.25 survival_time_mean 2.25 survival_time_min 2.25
No reset possible 7155620Bea Baselines baseline-duckietown aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 06:00:27+00:00 2021-11-03 06:07:53+00:00 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.20000000000031 in-drivable-lane_median 5.000000000000045 driven_lanedir_consec_median 1.911419296118723 deviation-center-line_median 1.9112218644427144
other stats deviation-center-line_max 1.9112218644427144 deviation-center-line_mean 1.9112218644427144 deviation-center-line_min 1.9112218644427144 deviation-heading_max 6.3525099747453675 deviation-heading_mean 6.3525099747453675 deviation-heading_median 6.3525099747453675 deviation-heading_min 6.3525099747453675 distance-from-start_max 1.499428039649053 distance-from-start_mean 1.499428039649053 distance-from-start_median 1.499428039649053 distance-from-start_min 1.499428039649053 driven_any_max 4.1303505568556105 driven_any_mean 4.1303505568556105 driven_any_median 4.1303505568556105 driven_any_min 4.1303505568556105 driven_lanedir_consec_max 1.911419296118723 driven_lanedir_consec_mean 1.911419296118723 driven_lanedir_consec_min 1.911419296118723 driven_lanedir_max 3.355412695137282 driven_lanedir_mean 3.355412695137282 driven_lanedir_median 3.355412695137282 driven_lanedir_min 3.355412695137282 in-drivable-lane_max 5.000000000000045 in-drivable-lane_mean 5.000000000000045 in-drivable-lane_min 5.000000000000045 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.1303505568556105, "survival_time": 32.20000000000031, "driven_lanedir": 3.355412695137282, "in-drivable-lane": 5.000000000000045, "deviation-heading": 6.3525099747453675, "distance-from-start": 1.499428039649053, "deviation-center-line": 1.9112218644427144, "driven_lanedir_consec": 1.911419296118723}}simulation-passed 1 survival_time_max 32.20000000000031 survival_time_mean 32.20000000000031 survival_time_min 32.20000000000031
No reset possible 7148613Bea Baselines template-ros aido-LFVI-sim-testingsim-3of4 host-error no gpu-staging-spot-0-032021-11-03 05:59:01+00:00 2021-11-03 06:00:20+00:00 0:01:19 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/1eeb14434b75202bac1921cc9a8a751b115e5b6b468d5fa7cf5000b4c3f13c33/json
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
container = client.containers.get(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
return self._result(
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/1eeb14434b75202bac1921cc9a8a751b115e5b6b468d5fa7cf5000b4c3f13c33/json: Not Found ("No such container: 1eeb14434b75202bac1921cc9a8a751b115e5b6b468d5fa7cf5000b4c3f13c33")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7118618Bea Baselines baseline-duckietown aido-LFV_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 05:47:48+00:00 2021-11-03 05:58:43+00:00 0:10:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 56.64999999999892 in-drivable-lane_median 1.5750000000000224 driven_lanedir_consec_median 5.637269386946116 deviation-center-line_median 3.7587391287578247
other stats deviation-center-line_max 4.955229209702849 deviation-center-line_mean 3.863120222283394 deviation-center-line_min 2.979773421915076 deviation-heading_max 12.575933532923342 deviation-heading_mean 9.631320836275073 deviation-heading_median 9.939748079301111 deviation-heading_min 6.069853653574717 distance-from-start_max 3.2238413599577975 distance-from-start_mean 2.419957914152808 distance-from-start_median 2.231789130292209 distance-from-start_min 1.992412036069015 driven_any_max 7.376875498474796 driven_any_mean 5.929593818369621 driven_any_median 5.886430585492796 driven_any_min 4.568638604018092 driven_lanedir_consec_max 7.1472711597165 driven_lanedir_consec_mean 5.488571735760731 driven_lanedir_consec_min 3.5324770094341886 driven_lanedir_max 7.1472711597165 driven_lanedir_mean 5.627484301437084 driven_lanedir_median 5.637269386946116 driven_lanedir_min 4.088127272139605 in-drivable-lane_max 2.500000000000009 in-drivable-lane_mean 1.4125000000000134 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 7.204142917602491, "survival_time": 56.64999999999892, "driven_lanedir": 6.767537582478325, "in-drivable-lane": 2.10000000000003, "deviation-heading": 8.075357985181682, "distance-from-start": 1.992412036069015, "deviation-center-line": 3.789961462097668, "driven_lanedir_consec": 6.767537582478325}, "loop-000-ego1": {"driven_any": 4.568638604018092, "survival_time": 56.64999999999892, "driven_lanedir": 4.088127272139605, "in-drivable-lane": 2.500000000000009, "deviation-heading": 12.575933532923342, "distance-from-start": 2.3094988779727075, "deviation-center-line": 3.7275167954179818, "driven_lanedir_consec": 3.5324770094341886}, "loop-000-ego2": {"driven_any": 7.376875498474796, "survival_time": 56.64999999999892, "driven_lanedir": 7.1472711597165, "in-drivable-lane": 1.050000000000015, "deviation-heading": 6.069853653574717, "distance-from-start": 3.2238413599577975, "deviation-center-line": 2.979773421915076, "driven_lanedir_consec": 7.1472711597165}, "loop-000-ego3": {"driven_any": 4.568718253383103, "survival_time": 56.64999999999892, "driven_lanedir": 4.507001191413908, "in-drivable-lane": 0.0, "deviation-heading": 11.804138173420542, "distance-from-start": 2.15407938261171, "deviation-center-line": 4.955229209702849, "driven_lanedir_consec": 4.507001191413908}}simulation-passed 1 survival_time_max 56.64999999999892 survival_time_mean 56.64999999999892 survival_time_min 56.64999999999892
No reset possible 7114619Bea Baselines baseline-duckietown aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 05:44:55+00:00 2021-11-03 05:47:22+00:00 0:02:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 21.250000000000167 in-drivable-lane_median 2.650000000000019 driven_lanedir_consec_median 1.5805911479092494 deviation-center-line_median 1.6991609371456091
other stats deviation-center-line_max 1.6991609371456091 deviation-center-line_mean 1.6991609371456091 deviation-center-line_min 1.6991609371456091 deviation-heading_max 5.268413105739659 deviation-heading_mean 5.268413105739659 deviation-heading_median 5.268413105739659 deviation-heading_min 5.268413105739659 distance-from-start_max 1.163259219358431 distance-from-start_mean 1.163259219358431 distance-from-start_median 1.163259219358431 distance-from-start_min 1.163259219358431 driven_any_max 2.6699260737012227 driven_any_mean 2.6699260737012227 driven_any_median 2.6699260737012227 driven_any_min 2.6699260737012227 driven_lanedir_consec_max 1.5805911479092494 driven_lanedir_consec_mean 1.5805911479092494 driven_lanedir_consec_min 1.5805911479092494 driven_lanedir_max 2.1701733561857286 driven_lanedir_mean 2.1701733561857286 driven_lanedir_median 2.1701733561857286 driven_lanedir_min 2.1701733561857286 in-drivable-lane_max 2.650000000000019 in-drivable-lane_mean 2.650000000000019 in-drivable-lane_min 2.650000000000019 per-episodes details {"loop-000-ego0": {"driven_any": 2.6699260737012227, "survival_time": 21.250000000000167, "driven_lanedir": 2.1701733561857286, "in-drivable-lane": 2.650000000000019, "deviation-heading": 5.268413105739659, "distance-from-start": 1.163259219358431, "deviation-center-line": 1.6991609371456091, "driven_lanedir_consec": 1.5805911479092494}}simulation-passed 1 survival_time_max 21.250000000000167 survival_time_mean 21.250000000000167 survival_time_min 21.250000000000167
No reset possible 7110620Bea Baselines baseline-duckietown aido-LFV-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 05:42:39+00:00 2021-11-03 05:44:49+00:00 0:02:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.499999999999981 in-drivable-lane_median 1.949999999999993 driven_lanedir_consec_median 0.543737598392956 deviation-center-line_median 0.6135818063175578
other stats deviation-center-line_max 0.6135818063175578 deviation-center-line_mean 0.6135818063175578 deviation-center-line_min 0.6135818063175578 deviation-heading_max 1.9856207375700268 deviation-heading_mean 1.9856207375700268 deviation-heading_median 1.9856207375700268 deviation-heading_min 1.9856207375700268 distance-from-start_max 0.6637625443299765 distance-from-start_mean 0.6637625443299765 distance-from-start_median 0.6637625443299765 distance-from-start_min 0.6637625443299765 driven_any_max 0.85103186325357 driven_any_mean 0.85103186325357 driven_any_median 0.85103186325357 driven_any_min 0.85103186325357 driven_lanedir_consec_max 0.543737598392956 driven_lanedir_consec_mean 0.543737598392956 driven_lanedir_consec_min 0.543737598392956 driven_lanedir_max 0.543737598392956 driven_lanedir_mean 0.543737598392956 driven_lanedir_median 0.543737598392956 driven_lanedir_min 0.543737598392956 in-drivable-lane_max 1.949999999999993 in-drivable-lane_mean 1.949999999999993 in-drivable-lane_min 1.949999999999993 per-episodes details {"loop2-000-ego0": {"driven_any": 0.85103186325357, "survival_time": 7.499999999999981, "driven_lanedir": 0.543737598392956, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.9856207375700268, "distance-from-start": 0.6637625443299765, "deviation-center-line": 0.6135818063175578, "driven_lanedir_consec": 0.543737598392956}}simulation-passed 1 survival_time_max 7.499999999999981 survival_time_mean 7.499999999999981 survival_time_min 7.499999999999981
No reset possible 7105621Bea Baselines baseline-duckietown aido-LFVI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 05:39:38+00:00 2021-11-03 05:42:32+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.299999999999982 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.800205568744698 deviation-center-line_median 0.6717036866584963
other stats deviation-center-line_max 0.6717036866584963 deviation-center-line_mean 0.6717036866584963 deviation-center-line_min 0.6717036866584963 deviation-heading_max 1.469812787839304 deviation-heading_mean 1.469812787839304 deviation-heading_median 1.469812787839304 deviation-heading_min 1.469812787839304 distance-from-start_max 0.6369476368477924 distance-from-start_mean 0.6369476368477924 distance-from-start_median 0.6369476368477924 distance-from-start_min 0.6369476368477924 driven_any_max 0.8244890976040102 driven_any_mean 0.8244890976040102 driven_any_median 0.8244890976040102 driven_any_min 0.8244890976040102 driven_lanedir_consec_max 0.800205568744698 driven_lanedir_consec_mean 0.800205568744698 driven_lanedir_consec_min 0.800205568744698 driven_lanedir_max 0.8002063415607027 driven_lanedir_mean 0.8002063415607027 driven_lanedir_median 0.8002063415607027 driven_lanedir_min 0.8002063415607027 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.8244890976040102, "survival_time": 7.299999999999982, "driven_lanedir": 0.8002063415607027, "in-drivable-lane": 0.0, "deviation-heading": 1.469812787839304, "distance-from-start": 0.6369476368477924, "deviation-center-line": 0.6717036866584963, "driven_lanedir_consec": 0.800205568744698}}simulation-passed 1 survival_time_max 7.299999999999982 survival_time_mean 7.299999999999982 survival_time_min 7.299999999999982
No reset possible 7093623Bea Baselines baseline-duckietown aido-LF-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 05:34:31+00:00 2021-11-03 05:39:33+00:00 0:05:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 5.196052911439876 survival_time_median 59.99999999999873 deviation-center-line_median 5.117837609513363 in-drivable-lane_median 19.04999999999952
other stats deviation-center-line_max 5.117837609513363 deviation-center-line_mean 5.117837609513363 deviation-center-line_min 5.117837609513363 deviation-heading_max 7.296378333420565 deviation-heading_mean 7.296378333420565 deviation-heading_median 7.296378333420565 deviation-heading_min 7.296378333420565 distance-from-start_max 0.9477734355009112 distance-from-start_mean 0.9477734355009112 distance-from-start_median 0.9477734355009112 distance-from-start_min 0.9477734355009112 driven_any_max 7.900921062812705 driven_any_mean 7.900921062812705 driven_any_median 7.900921062812705 driven_any_min 7.900921062812705 driven_lanedir_consec_max 5.196052911439876 driven_lanedir_consec_mean 5.196052911439876 driven_lanedir_consec_min 5.196052911439876 driven_lanedir_max 5.196052911439876 driven_lanedir_mean 5.196052911439876 driven_lanedir_median 5.196052911439876 driven_lanedir_min 5.196052911439876 in-drivable-lane_max 19.04999999999952 in-drivable-lane_mean 19.04999999999952 in-drivable-lane_min 19.04999999999952 per-episodes details {"loop2-000-ego0": {"driven_any": 7.900921062812705, "survival_time": 59.99999999999873, "driven_lanedir": 5.196052911439876, "in-drivable-lane": 19.04999999999952, "deviation-heading": 7.296378333420565, "distance-from-start": 0.9477734355009112, "deviation-center-line": 5.117837609513363, "driven_lanedir_consec": 5.196052911439876}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7079625Bea Baselines baseline-duckietown aido-LFV_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 05:20:34+00:00 2021-11-03 05:34:24+00:00 0:13:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.475000000000021 driven_lanedir_consec_median 2.9007065396895046 deviation-center-line_median 3.896887233485605
other stats deviation-center-line_max 7.474625237175191 deviation-center-line_mean 4.738265518748848 deviation-center-line_min 3.68466237084899 deviation-heading_max 39.0808596206589 deviation-heading_mean 23.75264225416693 deviation-heading_median 22.38510386292778 deviation-heading_min 11.159501670153254 distance-from-start_max 2.494204832999855 distance-from-start_mean 1.3891894675531762 distance-from-start_median 1.5237341491069278 distance-from-start_min 0.015084738998993076 driven_any_max 7.914357088625483 driven_any_mean 4.367796977143335 driven_any_median 4.770872975270178 driven_any_min 0.01508486940750129 driven_lanedir_consec_max 5.787965091746106 driven_lanedir_consec_mean 2.900289537948792 driven_lanedir_consec_min 0.01177998067005248 driven_lanedir_max 7.204574620456114 driven_lanedir_mean 3.768598034697188 driven_lanedir_median 3.929018768831293 driven_lanedir_min 0.01177998067005248 in-drivable-lane_max 6.449999999999918 in-drivable-lane_mean 2.34999999999999 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.627757933960021, "survival_time": 59.99999999999873, "driven_lanedir": 1.5828123325549128, "in-drivable-lane": 0.0, "deviation-heading": 26.924919863171624, "distance-from-start": 1.023434960576502, "deviation-center-line": 7.474625237175191, "driven_lanedir_consec": 1.5828123325549128}, "zigzag-000-ego1": {"driven_any": 7.913988016580336, "survival_time": 59.99999999999873, "driven_lanedir": 6.275225205107672, "in-drivable-lane": 6.449999999999918, "deviation-heading": 17.84528786268394, "distance-from-start": 2.494204832999855, "deviation-center-line": 3.889178786771314, "driven_lanedir_consec": 4.218600746824096}, "zigzag-000-ego2": {"driven_any": 7.914357088625483, "survival_time": 59.99999999999873, "driven_lanedir": 7.204574620456114, "in-drivable-lane": 2.950000000000042, "deviation-heading": 11.159501670153254, "distance-from-start": 2.0240333376373534, "deviation-center-line": 3.904595680199896, "driven_lanedir_consec": 5.787965091746106}, "zigzag-000-ego3": {"driven_any": 0.01508486940750129, "survival_time": 59.99999999999873, "driven_lanedir": 0.01177998067005248, "in-drivable-lane": 0.0, "deviation-heading": 39.0808596206589, "distance-from-start": 0.015084738998993076, "deviation-center-line": 3.68466237084899, "driven_lanedir_consec": 0.01177998067005248}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7076646Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-1of4 host-error no gpu-staging-spot-0-032021-11-03 05:18:54+00:00 2021-11-03 05:20:21+00:00 0:01:27 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:
error in ego3 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:
error in ego3 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 388, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 37, in init
|| self.model = DDPG(state_dim=self.preprocessor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/submission/model.py", line 153, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7063647Bea Baselines template-pytorch aido-LFP-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 05:11:40+00:00 2021-11-03 05:18:35+00:00 0:06:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 37.99999999999895 driven_lanedir_consec_median 0.953006922514068 deviation-center-line_median 1.0957731227918457
other stats deviation-center-line_max 1.0957731227918457 deviation-center-line_mean 1.0957731227918457 deviation-center-line_min 1.0957731227918457 deviation-heading_max 17.358478137513146 deviation-heading_mean 17.358478137513146 deviation-heading_median 17.358478137513146 deviation-heading_min 17.358478137513146 distance-from-start_max 0.2950635684584563 distance-from-start_mean 0.2950635684584563 distance-from-start_median 0.2950635684584563 distance-from-start_min 0.2950635684584563 driven_any_max 3.824333338624906 driven_any_mean 3.824333338624906 driven_any_median 3.824333338624906 driven_any_min 3.824333338624906 driven_lanedir_consec_max 0.953006922514068 driven_lanedir_consec_mean 0.953006922514068 driven_lanedir_consec_min 0.953006922514068 driven_lanedir_max 0.953006922514068 driven_lanedir_mean 0.953006922514068 driven_lanedir_median 0.953006922514068 driven_lanedir_min 0.953006922514068 in-drivable-lane_max 37.99999999999895 in-drivable-lane_mean 37.99999999999895 in-drivable-lane_min 37.99999999999895 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.824333338624906, "survival_time": 59.99999999999873, "driven_lanedir": 0.953006922514068, "in-drivable-lane": 37.99999999999895, "deviation-heading": 17.358478137513146, "distance-from-start": 0.2950635684584563, "deviation-center-line": 1.0957731227918457, "driven_lanedir_consec": 0.953006922514068}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7041652Bea Baselines template-pytorch aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 04:56:25+00:00 2021-11-03 05:11:12+00:00 0:14:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 54.249999999999055 in-drivable-lane_median 49.64999999999904 driven_lanedir_consec_median 0.2502424328398726 deviation-center-line_median 0.2779479075631442
other stats deviation-center-line_max 1.9868269914364876 deviation-center-line_mean 0.6486771042470061 deviation-center-line_min 0.05198561042524837 deviation-heading_max 14.114595205779876 deviation-heading_mean 5.3583177729977685 deviation-heading_median 3.2773175706670674 deviation-heading_min 0.7640407448770626 distance-from-start_max 0.4398926517250802 distance-from-start_mean 0.26777940208641254 distance-from-start_median 0.26886029155635544 distance-from-start_min 0.09350437350785916 driven_any_max 8.080108803906237 driven_any_mean 2.943466153343706 driven_any_median 1.7976712099270555 driven_any_min 0.09841338961447715 driven_lanedir_consec_max 0.7977618869596861 driven_lanedir_consec_mean 0.33058301267522866 driven_lanedir_consec_min 0.024085298061483407 driven_lanedir_max 0.7977618869596861 driven_lanedir_mean 0.4129276433960013 driven_lanedir_median 0.41493169428141785 driven_lanedir_min 0.024085298061483407 in-drivable-lane_max 53.399999999999054 in-drivable-lane_mean 47.32499999999907 in-drivable-lane_min 36.59999999999917 per-episodes details {"4way-000-ego0": {"driven_any": 0.35108485783195986, "survival_time": 54.249999999999055, "driven_lanedir": 0.0973748405827517, "in-drivable-lane": 53.249999999999055, "deviation-heading": 0.7680753767097003, "distance-from-start": 0.244394467145675, "deviation-center-line": 0.05353071401589727, "driven_lanedir_consec": 0.0973748405827517}, "4way-000-ego1": {"driven_any": 0.09841338961447715, "survival_time": 54.249999999999055, "driven_lanedir": 0.024085298061483407, "in-drivable-lane": 53.399999999999054, "deviation-heading": 0.7640407448770626, "distance-from-start": 0.09350437350785916, "deviation-center-line": 0.05198561042524837, "driven_lanedir_consec": 0.024085298061483407}, "4way-000-ego2": {"driven_any": 3.244257562022151, "survival_time": 54.249999999999055, "driven_lanedir": 0.732488547980084, "in-drivable-lane": 36.59999999999917, "deviation-heading": 14.114595205779876, "distance-from-start": 0.2933261159670359, "deviation-center-line": 1.9868269914364876, "driven_lanedir_consec": 0.40311002509699345}, "4way-000-ego3": {"driven_any": 8.080108803906237, "survival_time": 54.249999999999055, "driven_lanedir": 0.7977618869596861, "in-drivable-lane": 46.04999999999902, "deviation-heading": 5.786559764624434, "distance-from-start": 0.4398926517250802, "deviation-center-line": 0.5023651011103911, "driven_lanedir_consec": 0.7977618869596861}}simulation-passed 1 survival_time_max 54.249999999999055 survival_time_mean 54.249999999999055 survival_time_min 54.249999999999055
No reset possible 7019653Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 04:40:35+00:00 2021-11-03 04:56:12+00:00 0:15:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 52.34999999999869 driven_lanedir_consec_median 0.522016127027596 deviation-center-line_median 0.7470677678371089
other stats deviation-center-line_max 2.123898336314926 deviation-center-line_mean 1.017479117160564 deviation-center-line_min 0.4518825966531117 deviation-heading_max 17.766943001265115 deviation-heading_mean 7.830377510856236 deviation-heading_median 5.737410683596571 deviation-heading_min 2.079745674966686 distance-from-start_max 0.4555489063649487 distance-from-start_mean 0.3126436338772723 distance-from-start_median 0.34958637194242187 distance-from-start_min 0.09585288525929664 driven_any_max 3.0089804502279796 driven_any_mean 2.0825809203331085 driven_any_median 2.34215131120928 driven_any_min 0.6370406086858947 driven_lanedir_consec_max 0.8868899179071685 driven_lanedir_consec_mean 0.5331317464844662 driven_lanedir_consec_min 0.201604813975504 driven_lanedir_max 0.8868899179071685 driven_lanedir_mean 0.5331317464844662 driven_lanedir_median 0.522016127027596 driven_lanedir_min 0.201604813975504 in-drivable-lane_max 56.19999999999872 in-drivable-lane_mean 49.499999999998785 in-drivable-lane_min 37.09999999999903 per-episodes details {"autolab-000-ego0": {"driven_any": 2.4316177330210613, "survival_time": 59.99999999999873, "driven_lanedir": 0.8868899179071685, "in-drivable-lane": 52.34999999999869, "deviation-heading": 5.315535847161433, "distance-from-start": 0.4555489063649487, "deviation-center-line": 0.5038307718047338, "driven_lanedir_consec": 0.8868899179071685}, "autolab-000-ego1": {"driven_any": 3.0089804502279796, "survival_time": 59.99999999999873, "driven_lanedir": 0.6803454332283136, "in-drivable-lane": 37.09999999999903, "deviation-heading": 17.766943001265115, "distance-from-start": 0.41293118023264475, "deviation-center-line": 2.123898336314926, "driven_lanedir_consec": 0.6803454332283136}, "autolab-000-ego2": {"driven_any": 2.252684889397499, "survival_time": 59.99999999999873, "driven_lanedir": 0.3636868208268784, "in-drivable-lane": 56.19999999999872, "deviation-heading": 2.079745674966686, "distance-from-start": 0.286241563652199, "deviation-center-line": 0.4518825966531117, "driven_lanedir_consec": 0.3636868208268784}, "autolab-000-ego3": {"driven_any": 0.6370406086858947, "survival_time": 59.99999999999873, "driven_lanedir": 0.201604813975504, "in-drivable-lane": 52.34999999999869, "deviation-heading": 6.159285520031709, "distance-from-start": 0.09585288525929664, "deviation-center-line": 0.990304763869484, "driven_lanedir_consec": 0.201604813975504}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 7013654Bea Baselines template-pytorch aido-LFP-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 04:37:42+00:00 2021-11-03 04:40:29+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.450000000000127 in-drivable-lane_median 11.650000000000109 driven_lanedir_consec_median 0.8244733190927427 deviation-center-line_median 0.6261543550400294
other stats deviation-center-line_max 0.6261543550400294 deviation-center-line_mean 0.6261543550400294 deviation-center-line_min 0.6261543550400294 deviation-heading_max 5.638438552839995 deviation-heading_mean 5.638438552839995 deviation-heading_median 5.638438552839995 deviation-heading_min 5.638438552839995 distance-from-start_max 0.6444796895908533 distance-from-start_mean 0.6444796895908533 distance-from-start_median 0.6444796895908533 distance-from-start_min 0.6444796895908533 driven_any_max 3.710144485239183 driven_any_mean 3.710144485239183 driven_any_median 3.710144485239183 driven_any_min 3.710144485239183 driven_lanedir_consec_max 0.8244733190927427 driven_lanedir_consec_mean 0.8244733190927427 driven_lanedir_consec_min 0.8244733190927427 driven_lanedir_max 0.8244733190927427 driven_lanedir_mean 0.8244733190927427 driven_lanedir_median 0.8244733190927427 driven_lanedir_min 0.8244733190927427 in-drivable-lane_max 11.650000000000109 in-drivable-lane_mean 11.650000000000109 in-drivable-lane_min 11.650000000000109 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.710144485239183, "survival_time": 18.450000000000127, "driven_lanedir": 0.8244733190927427, "in-drivable-lane": 11.650000000000109, "deviation-heading": 5.638438552839995, "distance-from-start": 0.6444796895908533, "deviation-center-line": 0.6261543550400294, "driven_lanedir_consec": 0.8244733190927427}}simulation-passed 1 survival_time_max 18.450000000000127 survival_time_mean 18.450000000000127 survival_time_min 18.450000000000127
No reset possible 7005656Bea Baselines template-pytorch aido-LFVI-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 04:34:30+00:00 2021-11-03 04:37:22+00:00 0:02:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.699999999999988 in-drivable-lane_median 2.9499999999999895 driven_lanedir_consec_median 0.404932276966798 deviation-center-line_median 0.2729771007531517
other stats deviation-center-line_max 0.2729771007531517 deviation-center-line_mean 0.2729771007531517 deviation-center-line_min 0.2729771007531517 deviation-heading_max 1.5472450669455289 deviation-heading_mean 1.5472450669455289 deviation-heading_median 1.5472450669455289 deviation-heading_min 1.5472450669455289 distance-from-start_max 0.4069745182104605 distance-from-start_mean 0.4069745182104605 distance-from-start_median 0.4069745182104605 distance-from-start_min 0.4069745182104605 driven_any_max 0.9497012228612738 driven_any_mean 0.9497012228612738 driven_any_median 0.9497012228612738 driven_any_min 0.9497012228612738 driven_lanedir_consec_max 0.404932276966798 driven_lanedir_consec_mean 0.404932276966798 driven_lanedir_consec_min 0.404932276966798 driven_lanedir_max 0.404932276966798 driven_lanedir_mean 0.404932276966798 driven_lanedir_median 0.404932276966798 driven_lanedir_min 0.404932276966798 in-drivable-lane_max 2.9499999999999895 in-drivable-lane_mean 2.9499999999999895 in-drivable-lane_min 2.9499999999999895 per-episodes details {"udem-000-ego0": {"driven_any": 0.9497012228612738, "survival_time": 5.699999999999988, "driven_lanedir": 0.404932276966798, "in-drivable-lane": 2.9499999999999895, "deviation-heading": 1.5472450669455289, "distance-from-start": 0.4069745182104605, "deviation-center-line": 0.2729771007531517, "driven_lanedir_consec": 0.404932276966798}}simulation-passed 1 survival_time_max 5.699999999999988 survival_time_mean 5.699999999999988 survival_time_min 5.699999999999988
No reset possible 6999656Bea Baselines template-pytorch aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 04:31:48+00:00 2021-11-03 04:34:10+00:00 0:02:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.649999999999995 in-drivable-lane_median 1.849999999999994 driven_lanedir_consec_median 0.10449072697745576 deviation-center-line_median 0.04962614437850819
other stats deviation-center-line_max 0.04962614437850819 deviation-center-line_mean 0.04962614437850819 deviation-center-line_min 0.04962614437850819 deviation-heading_max 1.1554332676608003 deviation-heading_mean 1.1554332676608003 deviation-heading_median 1.1554332676608003 deviation-heading_min 1.1554332676608003 distance-from-start_max 0.1706655321054872 distance-from-start_mean 0.1706655321054872 distance-from-start_median 0.1706655321054872 distance-from-start_min 0.1706655321054872 driven_any_max 0.3143189489667769 driven_any_mean 0.3143189489667769 driven_any_median 0.3143189489667769 driven_any_min 0.3143189489667769 driven_lanedir_consec_max 0.10449072697745576 driven_lanedir_consec_mean 0.10449072697745576 driven_lanedir_consec_min 0.10449072697745576 driven_lanedir_max 0.10449072697745576 driven_lanedir_mean 0.10449072697745576 driven_lanedir_median 0.10449072697745576 driven_lanedir_min 0.10449072697745576 in-drivable-lane_max 1.849999999999994 in-drivable-lane_mean 1.849999999999994 in-drivable-lane_min 1.849999999999994 per-episodes details {"4way-000-ego0": {"driven_any": 0.3143189489667769, "survival_time": 3.649999999999995, "driven_lanedir": 0.10449072697745576, "in-drivable-lane": 1.849999999999994, "deviation-heading": 1.1554332676608003, "distance-from-start": 0.1706655321054872, "deviation-center-line": 0.04962614437850819, "driven_lanedir_consec": 0.10449072697745576}}simulation-passed 1 survival_time_max 3.649999999999995 survival_time_mean 3.649999999999995 survival_time_min 3.649999999999995
No reset possible 6994657Bea Baselines template-pytorch aido-LFI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 04:29:43+00:00 2021-11-03 04:31:35+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.549999999999999 in-drivable-lane_median 1.1499999999999984 driven_lanedir_consec_median 0.059590392325036934 deviation-center-line_median 0.025742866673394215
other stats deviation-center-line_max 0.025742866673394215 deviation-center-line_mean 0.025742866673394215 deviation-center-line_min 0.025742866673394215 deviation-heading_max 0.950627764784622 deviation-heading_mean 0.950627764784622 deviation-heading_median 0.950627764784622 deviation-heading_min 0.950627764784622 distance-from-start_max 0.11714832922958832 distance-from-start_mean 0.11714832922958832 distance-from-start_median 0.11714832922958832 distance-from-start_min 0.11714832922958832 driven_any_max 0.16255892230614594 driven_any_mean 0.16255892230614594 driven_any_median 0.16255892230614594 driven_any_min 0.16255892230614594 driven_lanedir_consec_max 0.059590392325036934 driven_lanedir_consec_mean 0.059590392325036934 driven_lanedir_consec_min 0.059590392325036934 driven_lanedir_max 0.059590392325036934 driven_lanedir_mean 0.059590392325036934 driven_lanedir_median 0.059590392325036934 driven_lanedir_min 0.059590392325036934 in-drivable-lane_max 1.1499999999999984 in-drivable-lane_mean 1.1499999999999984 in-drivable-lane_min 1.1499999999999984 per-episodes details {"4way-000-ego0": {"driven_any": 0.16255892230614594, "survival_time": 2.549999999999999, "driven_lanedir": 0.059590392325036934, "in-drivable-lane": 1.1499999999999984, "deviation-heading": 0.950627764784622, "distance-from-start": 0.11714832922958832, "deviation-center-line": 0.025742866673394215, "driven_lanedir_consec": 0.059590392325036934}}simulation-passed 1 survival_time_max 2.549999999999999 survival_time_mean 2.549999999999999 survival_time_min 2.549999999999999
No reset possible 6989657Bea Baselines template-pytorch aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 04:28:07+00:00 2021-11-03 04:29:38+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6984660Bea Baselines template-tensorflow aido-LFV_multi-sim-validationsim-2of4 failed no gpu-staging-spot-0-032021-11-03 04:26:35+00:00 2021-11-03 04:27:47+00:00 0:01:12 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6974706Bea Baselines template-random aido-LFVI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 04:23:25+00:00 2021-11-03 04:26:08+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.39017518658850303 deviation-center-line_median 0.1712487257959815
other stats deviation-center-line_max 0.1712487257959815 deviation-center-line_mean 0.1712487257959815 deviation-center-line_min 0.1712487257959815 deviation-heading_max 1.7031418047241604 deviation-heading_mean 1.7031418047241604 deviation-heading_median 1.7031418047241604 deviation-heading_min 1.7031418047241604 distance-from-start_max 0.40285563030397936 distance-from-start_mean 0.40285563030397936 distance-from-start_median 0.40285563030397936 distance-from-start_min 0.40285563030397936 driven_any_max 0.4240764502839653 driven_any_mean 0.4240764502839653 driven_any_median 0.4240764502839653 driven_any_min 0.4240764502839653 driven_lanedir_consec_max 0.39017518658850303 driven_lanedir_consec_mean 0.39017518658850303 driven_lanedir_consec_min 0.39017518658850303 driven_lanedir_max 0.39017518658850303 driven_lanedir_mean 0.39017518658850303 driven_lanedir_median 0.39017518658850303 driven_lanedir_min 0.39017518658850303 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"udem-000-ego0": {"driven_any": 0.4240764502839653, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030397936, "deviation-center-line": 0.1712487257959815, "driven_lanedir_consec": 0.39017518658850303}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 6967662Bea Baselines template-tensorflow aido-LFV-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-03 04:21:38+00:00 2021-11-03 04:23:06+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6965664Bea Baselines template-tensorflow aido-LFI-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-03 04:19:50+00:00 2021-11-03 04:21:30+00:00 0:01:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6957664Bea Baselines template-tensorflow aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 04:17:58+00:00 2021-11-03 04:19:30+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6951665Bea Baselines template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-03 04:16:48+00:00 2021-11-03 04:17:44+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6948666Bea Baselines template-tensorflow aido-LFVI_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 04:15:10+00:00 2021-11-03 04:16:24+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6943667Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-11-03 04:13:47+00:00 2021-11-03 04:14:58+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6938670Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-03 04:11:55+00:00 2021-11-03 04:13:25+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6935794Andrea Daniele template-tensorflow aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-03 04:10:41+00:00 2021-11-03 04:11:35+00:00 0:00:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6931794Andrea Daniele template-tensorflow aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-03 04:09:33+00:00 2021-11-03 04:10:28+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6923670Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-03 04:07:19+00:00 2021-11-03 04:09:28+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6917671Bea Baselines template-tensorflow aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-03 04:05:06+00:00 2021-11-03 04:07:00+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6909671Bea Baselines template-tensorflow aido-LFI-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-11-03 04:02:45+00:00 2021-11-03 04:04:34+00:00 0:01:49 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6904703Bea Baselines template-random aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 03:57:52+00:00 2021-11-03 04:02:18+00:00 0:04:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 29.000000000000277 in-drivable-lane_median 20.025000000000247 driven_lanedir_consec_median 0.23004863869940056 deviation-center-line_median 0.7278799269429306
other stats deviation-center-line_max 0.8194317074657906 deviation-center-line_mean 0.7278799269429306 deviation-center-line_min 0.6363281464200705 deviation-heading_max 6.73261632177244 deviation-heading_mean 6.633830808409963 deviation-heading_median 6.633830808409963 deviation-heading_min 6.535045295047486 distance-from-start_max 0.8626308120701064 distance-from-start_mean 0.8293644349619179 distance-from-start_median 0.8293644349619179 distance-from-start_min 0.7960980578537294 driven_any_max 7.222519405652156 driven_any_mean 6.586737153678611 driven_any_median 6.586737153678611 driven_any_min 5.950954901705066 driven_lanedir_consec_max 0.26576074471389377 driven_lanedir_consec_mean 0.23004863869940056 driven_lanedir_consec_min 0.19433653268490736 driven_lanedir_max 0.24775126076977572 driven_lanedir_mean 0.21437974622313744 driven_lanedir_median 0.21437974622313744 driven_lanedir_min 0.18100823167649915 in-drivable-lane_max 20.30000000000025 in-drivable-lane_mean 20.025000000000247 in-drivable-lane_min 19.750000000000245 per-episodes details {"loop2-000-ego0": {"driven_any": 5.950954901705066, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977572, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537294, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.26576074471389377}, "loop2-000-ego1": {"driven_any": 7.222519405652156, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167649915, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701064, "deviation-center-line": 0.6363281464200705, "driven_lanedir_consec": 0.19433653268490736}}simulation-passed 1 survival_time_max 29.000000000000277 survival_time_mean 29.000000000000277 survival_time_min 29.000000000000277
No reset possible 6897704Bea Baselines template-random aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 03:54:22+00:00 2021-11-03 03:57:31+00:00 0:03:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.4500000000001 in-drivable-lane_median 8.850000000000088 driven_lanedir_consec_median 0.27376192919933695 deviation-center-line_median 0.6226667356941823
other stats deviation-center-line_max 0.6226667356941823 deviation-center-line_mean 0.6226667356941823 deviation-center-line_min 0.6226667356941823 deviation-heading_max 4.977695202648224 deviation-heading_mean 4.977695202648224 deviation-heading_median 4.977695202648224 deviation-heading_min 4.977695202648224 distance-from-start_max 0.6736010379605029 distance-from-start_mean 0.6736010379605029 distance-from-start_median 0.6736010379605029 distance-from-start_min 0.6736010379605029 driven_any_max 3.8273590406355353 driven_any_mean 3.8273590406355353 driven_any_median 3.8273590406355353 driven_any_min 3.8273590406355353 driven_lanedir_consec_max 0.27376192919933695 driven_lanedir_consec_mean 0.27376192919933695 driven_lanedir_consec_min 0.27376192919933695 driven_lanedir_max 0.26276154130140084 driven_lanedir_mean 0.26276154130140084 driven_lanedir_median 0.26276154130140084 driven_lanedir_min 0.26276154130140084 in-drivable-lane_max 8.850000000000088 in-drivable-lane_mean 8.850000000000088 in-drivable-lane_min 8.850000000000088 per-episodes details {"autolab-000-ego0": {"driven_any": 3.8273590406355353, "survival_time": 16.4500000000001, "driven_lanedir": 0.26276154130140084, "in-drivable-lane": 8.850000000000088, "deviation-heading": 4.977695202648224, "distance-from-start": 0.6736010379605029, "deviation-center-line": 0.6226667356941823, "driven_lanedir_consec": 0.27376192919933695}}simulation-passed 1 survival_time_max 16.4500000000001 survival_time_mean 16.4500000000001 survival_time_min 16.4500000000001
No reset possible 6885706Bea Baselines template-random aido-LFVI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 03:45:33+00:00 2021-11-03 03:53:54+00:00 0:08:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 43.24999999999968 in-drivable-lane_median 30.94999999999972 driven_lanedir_consec_median 0.21786067233483597 deviation-center-line_median 1.03377506159595
other stats deviation-center-line_max 1.03377506159595 deviation-center-line_mean 1.03377506159595 deviation-center-line_min 1.03377506159595 deviation-heading_max 10.709657934936162 deviation-heading_mean 10.709657934936162 deviation-heading_median 10.709657934936162 deviation-heading_min 10.709657934936162 distance-from-start_max 1.009340436005919 distance-from-start_mean 1.009340436005919 distance-from-start_median 1.009340436005919 distance-from-start_min 1.009340436005919 driven_any_max 10.497249092993233 driven_any_mean 10.497249092993233 driven_any_median 10.497249092993233 driven_any_min 10.497249092993233 driven_lanedir_consec_max 0.21786067233483597 driven_lanedir_consec_mean 0.21786067233483597 driven_lanedir_consec_min 0.21786067233483597 driven_lanedir_max 0.19985118839069793 driven_lanedir_mean 0.19985118839069793 driven_lanedir_median 0.19985118839069793 driven_lanedir_min 0.19985118839069793 in-drivable-lane_max 30.94999999999972 in-drivable-lane_mean 30.94999999999972 in-drivable-lane_min 30.94999999999972 per-episodes details {"4way-000-ego0": {"driven_any": 10.497249092993233, "survival_time": 43.24999999999968, "driven_lanedir": 0.19985118839069793, "in-drivable-lane": 30.94999999999972, "deviation-heading": 10.709657934936162, "distance-from-start": 1.009340436005919, "deviation-center-line": 1.03377506159595, "driven_lanedir_consec": 0.21786067233483597}}simulation-passed 1 survival_time_max 43.24999999999968 survival_time_mean 43.24999999999968 survival_time_min 43.24999999999968
No reset possible 6880707Bea Baselines template-random aido-LFI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-03 03:43:05+00:00 2021-11-03 03:45:12+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.39017518658850303 deviation-center-line_median 0.17124897035562547
other stats deviation-center-line_max 0.17124897035562547 deviation-center-line_mean 0.17124897035562547 deviation-center-line_min 0.17124897035562547 deviation-heading_max 1.7031418047241604 deviation-heading_mean 1.7031418047241604 deviation-heading_median 1.7031418047241604 deviation-heading_min 1.7031418047241604 distance-from-start_max 0.40285563030398 distance-from-start_mean 0.40285563030398 distance-from-start_median 0.40285563030398 distance-from-start_min 0.40285563030398 driven_any_max 0.4240764502839632 driven_any_mean 0.4240764502839632 driven_any_median 0.4240764502839632 driven_any_min 0.4240764502839632 driven_lanedir_consec_max 0.39017518658850303 driven_lanedir_consec_mean 0.39017518658850303 driven_lanedir_consec_min 0.39017518658850303 driven_lanedir_max 0.39017518658850303 driven_lanedir_mean 0.39017518658850303 driven_lanedir_median 0.39017518658850303 driven_lanedir_min 0.39017518658850303 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.4240764502839632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030398, "deviation-center-line": 0.17124897035562547, "driven_lanedir_consec": 0.39017518658850303}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 6877707Bea Baselines template-random aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 03:40:27+00:00 2021-11-03 03:42:30+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6867709Bea Baselines template-random aido-LFVI_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 03:31:08+00:00 2021-11-03 03:40:03+00:00 0:08:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 33.75000000000022 in-drivable-lane_median 29.825000000000212 driven_lanedir_consec_median 0.21731228142323933 deviation-center-line_median 0.3331807431846997
other stats deviation-center-line_max 0.7655512378412563 deviation-center-line_mean 0.379245390698747 deviation-center-line_min 0.0850688385843324 deviation-heading_max 5.708723015945328 deviation-heading_mean 2.8582267855416443 deviation-heading_median 2.247219992369361 deviation-heading_min 1.229744141482529 distance-from-start_max 0.9340577697896516 distance-from-start_mean 0.6073071039932331 distance-from-start_median 0.5461575079396492 distance-from-start_min 0.4028556303039823 driven_any_max 8.310583890769195 driven_any_mean 3.410525124545609 driven_any_median 2.453720078564638 driven_any_min 0.4240764502839678 driven_lanedir_consec_max 0.3926134494082678 driven_lanedir_consec_mean 0.2327684277313727 driven_lanedir_consec_min 0.10383569867074448 driven_lanedir_max 0.3926134494082678 driven_lanedir_mean 0.2281267458150863 driven_lanedir_median 0.21016777279894416 driven_lanedir_min 0.09955798825418904 in-drivable-lane_max 31.650000000000222 in-drivable-lane_mean 29.125000000000213 in-drivable-lane_min 25.2000000000002 per-episodes details {"udem-000-ego0": {"driven_any": 8.310583890769195, "survival_time": 33.75000000000022, "driven_lanedir": 0.25382856508768814, "in-drivable-lane": 25.2000000000002, "deviation-heading": 5.708723015945328, "distance-from-start": 0.9340577697896516, "deviation-center-line": 0.7655512378412563, "driven_lanedir_consec": 0.2718370953578422}, "udem-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 33.75000000000022, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 31.650000000000222, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "udem-000-ego2": {"driven_any": 2.4390062983425578, "survival_time": 33.75000000000022, "driven_lanedir": 0.1665069805102002, "in-drivable-lane": 29.350000000000215, "deviation-heading": 2.144336915325389, "distance-from-start": 0.5461575079396477, "deviation-center-line": 0.3777614073769809, "driven_lanedir_consec": 0.16278746748863648}, "udem-000-ego3": {"driven_any": 2.4684338587867183, "survival_time": 33.75000000000022, "driven_lanedir": 0.09955798825418904, "in-drivable-lane": 30.30000000000021, "deviation-heading": 2.350103069413333, "distance-from-start": 0.5461575079396509, "deviation-center-line": 0.2886000789924186, "driven_lanedir_consec": 0.10383569867074448}}simulation-passed 1 survival_time_max 33.75000000000022 survival_time_mean 33.75000000000022 survival_time_min 33.75000000000022
No reset possible 6858716Bea Baselines template-random aido-LFVI_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-03 03:25:17+00:00 2021-11-03 03:30:49+00:00 0:05:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.80000000000009 in-drivable-lane_median 12.250000000000089 driven_lanedir_consec_median 0.1976657309045995 deviation-center-line_median 0.30916297118874164
other stats deviation-center-line_max 0.5167734001966479 deviation-center-line_mean 0.2904356927295703 deviation-center-line_min 0.026643428344150132 deviation-heading_max 3.648554139524216 deviation-heading_mean 2.1866076734990423 deviation-heading_median 1.9856511911894663 deviation-heading_min 1.126574172093021 distance-from-start_max 0.6297514211539125 distance-from-start_mean 0.5152552969251188 distance-from-start_median 0.5284445727545999 distance-from-start_min 0.3743806210373633 driven_any_max 3.5922095903913815 driven_any_mean 1.7403199031741243 driven_any_median 1.4873198912093584 driven_any_min 0.3944302398863988 driven_lanedir_consec_max 0.30624803336021755 driven_lanedir_consec_mean 0.18098238479843215 driven_lanedir_consec_min 0.022350044024312066 driven_lanedir_max 0.30624803336021755 driven_lanedir_mean 0.17754217371916875 driven_lanedir_median 0.1907853087460727 driven_lanedir_min 0.022350044024312066 in-drivable-lane_max 14.30000000000009 in-drivable-lane_mean 11.862500000000091 in-drivable-lane_min 8.650000000000095 per-episodes details {"udem-000-ego0": {"driven_any": 0.5356334840761573, "survival_time": 15.80000000000009, "driven_lanedir": 0.022350044024312066, "in-drivable-lane": 14.30000000000009, "deviation-heading": 1.126574172093021, "distance-from-start": 0.5107316375695493, "deviation-center-line": 0.026643428344150132, "driven_lanedir_consec": 0.022350044024312066}, "udem-000-ego1": {"driven_any": 3.5922095903913815, "survival_time": 15.80000000000009, "driven_lanedir": 0.23530327637400592, "in-drivable-lane": 8.650000000000095, "deviation-heading": 3.648554139524216, "distance-from-start": 0.6297514211539125, "deviation-center-line": 0.5167734001966479, "driven_lanedir_consec": 0.24249463032549556}, "udem-000-ego2": {"driven_any": 2.4390062983425596, "survival_time": 15.80000000000009, "driven_lanedir": 0.14626734111813944, "in-drivable-lane": 10.750000000000083, "deviation-heading": 2.5591239415144273, "distance-from-start": 0.5461575079396503, "deviation-center-line": 0.5143008900460763, "driven_lanedir_consec": 0.15283683148370342}, "udem-000-ego3": {"driven_any": 0.3944302398863988, "survival_time": 15.80000000000009, "driven_lanedir": 0.30624803336021755, "in-drivable-lane": 13.750000000000092, "deviation-heading": 1.4121784408645055, "distance-from-start": 0.3743806210373633, "deviation-center-line": 0.10402505233140706, "driven_lanedir_consec": 0.30624803336021755}}simulation-passed 1 survival_time_max 15.80000000000009 survival_time_mean 15.80000000000009 survival_time_min 15.80000000000009
No reset possible 6850713Bea Baselines template-random aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 03:21:32+00:00 2021-11-03 03:25:11+00:00 0:03:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.350000000000026 in-drivable-lane_median 7.900000000000015 driven_lanedir_consec_median 0.02729653158692802 deviation-center-line_median 0.3268218383633572
other stats deviation-center-line_max 0.3268218383633572 deviation-center-line_mean 0.3268218383633572 deviation-center-line_min 0.3268218383633572 deviation-heading_max 2.554024904051201 deviation-heading_mean 2.554024904051201 deviation-heading_median 2.554024904051201 deviation-heading_min 2.554024904051201 distance-from-start_max 0.5461575079396507 distance-from-start_mean 0.5461575079396507 distance-from-start_median 0.5461575079396507 distance-from-start_min 0.5461575079396507 driven_any_max 2.2955250818765167 driven_any_mean 2.2955250818765167 driven_any_median 2.2955250818765167 driven_any_min 2.2955250818765167 driven_lanedir_consec_max 0.02729653158692802 driven_lanedir_consec_mean 0.02729653158692802 driven_lanedir_consec_min 0.02729653158692802 driven_lanedir_max 0.03064203922048936 driven_lanedir_mean 0.03064203922048936 driven_lanedir_median 0.03064203922048936 driven_lanedir_min 0.03064203922048936 in-drivable-lane_max 7.900000000000015 in-drivable-lane_mean 7.900000000000015 in-drivable-lane_min 7.900000000000015 per-episodes details {"4way-000-ego0": {"driven_any": 2.2955250818765167, "survival_time": 11.350000000000026, "driven_lanedir": 0.03064203922048936, "in-drivable-lane": 7.900000000000015, "deviation-heading": 2.554024904051201, "distance-from-start": 0.5461575079396507, "deviation-center-line": 0.3268218383633572, "driven_lanedir_consec": 0.02729653158692802}}simulation-passed 1 survival_time_max 11.350000000000026 survival_time_mean 11.350000000000026 survival_time_min 11.350000000000026
No reset possible 6843732Bea Baselines baseline-duckietown-ml aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 03:15:24+00:00 2021-11-03 03:21:11+00:00 0:05:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5116931584219897
other stats deviation-center-line_max 2.128488788608653 deviation-center-line_mean 1.5116931584219897 deviation-center-line_min 0.8948975282353262 deviation-heading_max 32.249113233675025 deviation-heading_mean 31.48103999887634 deviation-heading_median 31.48103999887634 deviation-heading_min 30.712966764077652 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 2.3592239273284576e-16 distance-from-start_median 2.3592239273284576e-16 distance-from-start_min 2.7755575615628914e-17 driven_any_max 5.329070518200751e-13 driven_any_mean 2.831068712794149e-13 driven_any_median 2.831068712794149e-13 driven_any_min 3.3306690738754696e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.128488788608653, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6832733Bea Baselines baseline-duckietown-ml aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 03:11:13+00:00 2021-11-03 03:15:16+00:00 0:04:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948943425963037
other stats deviation-center-line_max 0.8948943425963037 deviation-center-line_mean 0.8948943425963037 deviation-center-line_min 0.8948943425963037 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 1.3877787807814454e-16 distance-from-start_mean 1.3877787807814454e-16 distance-from-start_median 1.3877787807814454e-16 distance-from-start_min 1.3877787807814454e-16 driven_any_max 1.665334536937735e-13 driven_any_mean 1.665334536937735e-13 driven_any_median 1.665334536937735e-13 driven_any_min 1.665334536937735e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6825733Bea Baselines baseline-duckietown-ml aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 03:06:27+00:00 2021-11-03 03:11:00+00:00 0:04:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948988630736971
other stats deviation-center-line_max 0.8948988630736971 deviation-center-line_mean 0.8948988630736971 deviation-center-line_min 0.8948988630736971 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.965068306494546e-16 distance-from-start_mean 4.965068306494546e-16 distance-from-start_median 4.965068306494546e-16 distance-from-start_min 4.965068306494546e-16 driven_any_max 5.95808196779335e-13 driven_any_mean 5.95808196779335e-13 driven_any_median 5.95808196779335e-13 driven_any_min 5.95808196779335e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6807735Bea Baselines baseline-duckietown-ml aido-LFVI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 02:52:15+00:00 2021-11-03 03:05:56+00:00 0:13:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948943425963037
other stats deviation-center-line_max 0.8948943425963037 deviation-center-line_mean 0.8948943425963037 deviation-center-line_min 0.8948943425963037 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 1.3877787807814454e-16 distance-from-start_mean 1.3877787807814454e-16 distance-from-start_median 1.3877787807814454e-16 distance-from-start_min 1.3877787807814454e-16 driven_any_max 1.665334536937735e-13 driven_any_mean 1.665334536937735e-13 driven_any_median 1.665334536937735e-13 driven_any_min 1.665334536937735e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6797765Bea Baselines challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802 aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-032021-11-03 02:46:55+00:00 2021-11-03 02:52:08+00:00 0:05:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.014121900162133771 deviation-center-line_median 0.005460642242881975
other stats deviation-center-line_max 0.005460642242881975 deviation-center-line_mean 0.005460642242881975 deviation-center-line_min 0.005460642242881975 deviation-heading_max 0.321191951005951 deviation-heading_mean 0.321191951005951 deviation-heading_median 0.321191951005951 deviation-heading_min 0.321191951005951 distance-from-start_max 0.020038518663283263 distance-from-start_mean 0.020038518663283263 distance-from-start_median 0.020038518663283263 distance-from-start_min 0.020038518663283263 driven_any_max 0.020213545706682167 driven_any_mean 0.020213545706682167 driven_any_median 0.020213545706682167 driven_any_min 0.020213545706682167 driven_lanedir_consec_max 0.014121900162133771 driven_lanedir_consec_mean 0.014121900162133771 driven_lanedir_consec_min 0.014121900162133771 driven_lanedir_max 0.014121900162133771 driven_lanedir_mean 0.014121900162133771 driven_lanedir_median 0.014121900162133771 driven_lanedir_min 0.014121900162133771 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.020213545706682167, "survival_time": 0.49999999999999994, "driven_lanedir": 0.014121900162133771, "in-drivable-lane": 0.0, "deviation-heading": 0.321191951005951, "distance-from-start": 0.020038518663283263, "deviation-center-line": 0.005460642242881975, "driven_lanedir_consec": 0.014121900162133771}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 6789769Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 02:40:30+00:00 2021-11-03 02:45:40+00:00 0:05:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 41.84999999999976 in-drivable-lane_median 18.249999999999545 driven_lanedir_consec_median 2.0158056556659556 deviation-center-line_median 1.611519622102847
other stats deviation-center-line_max 1.635898791897749 deviation-center-line_mean 1.611519622102847 deviation-center-line_min 1.5871404523079449 deviation-heading_max 6.333111706044677 deviation-heading_mean 6.09800186962298 deviation-heading_median 6.09800186962298 deviation-heading_min 5.862892033201283 distance-from-start_max 1.4259356505491696 distance-from-start_mean 1.4038096952577157 distance-from-start_median 1.4038096952577157 distance-from-start_min 1.3816837399662618 driven_any_max 5.404743743001237 driven_any_mean 5.175809059280958 driven_any_median 5.175809059280958 driven_any_min 4.946874375560678 driven_lanedir_consec_max 2.517350252536263 driven_lanedir_consec_mean 2.0158056556659556 driven_lanedir_consec_min 1.514261058795647 driven_lanedir_max 3.3247430439919565 driven_lanedir_mean 2.859996313108538 driven_lanedir_median 2.859996313108538 driven_lanedir_min 2.3952495822251194 in-drivable-lane_max 21.549999999999596 in-drivable-lane_mean 18.249999999999545 in-drivable-lane_min 14.949999999999498 per-episodes details {"loop2-000-ego0": {"driven_any": 5.404743743001237, "survival_time": 41.84999999999976, "driven_lanedir": 3.3247430439919565, "in-drivable-lane": 14.949999999999498, "deviation-heading": 5.862892033201283, "distance-from-start": 1.4259356505491696, "deviation-center-line": 1.5871404523079449, "driven_lanedir_consec": 2.517350252536263}, "loop2-000-ego1": {"driven_any": 4.946874375560678, "survival_time": 41.84999999999976, "driven_lanedir": 2.3952495822251194, "in-drivable-lane": 21.549999999999596, "deviation-heading": 6.333111706044677, "distance-from-start": 1.3816837399662618, "deviation-center-line": 1.635898791897749, "driven_lanedir_consec": 1.514261058795647}}simulation-passed 1 survival_time_max 41.84999999999976 survival_time_mean 41.84999999999976 survival_time_min 41.84999999999976
No reset possible 6784770Bea Baselines baseline-RPL-ros aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 02:37:26+00:00 2021-11-03 02:40:23+00:00 0:02:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.900000000000276 in-drivable-lane_median 18.450000000000255 driven_lanedir_consec_median 0.9691085076383072 deviation-center-line_median 0.8521544109578797
other stats deviation-center-line_max 0.8521544109578797 deviation-center-line_mean 0.8521544109578797 deviation-center-line_min 0.8521544109578797 deviation-heading_max 3.554557420451268 deviation-heading_mean 3.554557420451268 deviation-heading_median 3.554557420451268 deviation-heading_min 3.554557420451268 distance-from-start_max 0.9921837734508044 distance-from-start_mean 0.9921837734508044 distance-from-start_median 0.9921837734508044 distance-from-start_min 0.9921837734508044 driven_any_max 3.678862760988328 driven_any_mean 3.678862760988328 driven_any_median 3.678862760988328 driven_any_min 3.678862760988328 driven_lanedir_consec_max 0.9691085076383072 driven_lanedir_consec_mean 0.9691085076383072 driven_lanedir_consec_min 0.9691085076383072 driven_lanedir_max 1.0980852120012847 driven_lanedir_mean 1.0980852120012847 driven_lanedir_median 1.0980852120012847 driven_lanedir_min 1.0980852120012847 in-drivable-lane_max 18.450000000000255 in-drivable-lane_mean 18.450000000000255 in-drivable-lane_min 18.450000000000255 per-episodes details {"loop2-000-ego0": {"driven_any": 3.678862760988328, "survival_time": 28.900000000000276, "driven_lanedir": 1.0980852120012847, "in-drivable-lane": 18.450000000000255, "deviation-heading": 3.554557420451268, "distance-from-start": 0.9921837734508044, "deviation-center-line": 0.8521544109578797, "driven_lanedir_consec": 0.9691085076383072}}simulation-passed 1 survival_time_max 28.900000000000276 survival_time_mean 28.900000000000276 survival_time_min 28.900000000000276
No reset possible 6779770Bea Baselines baseline-RPL-ros aido-LFP-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-03 02:32:00+00:00 2021-11-03 02:37:06+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.299999999999336 in-drivable-lane_median 10.899999999999777 driven_lanedir_consec_median 4.756913907030646 deviation-center-line_median 3.0309654181806507
other stats deviation-center-line_max 3.0309654181806507 deviation-center-line_mean 3.0309654181806507 deviation-center-line_min 3.0309654181806507 deviation-heading_max 9.37707796103529 deviation-heading_mean 9.37707796103529 deviation-heading_median 9.37707796103529 deviation-heading_min 9.37707796103529 distance-from-start_max 3.044711340883156 distance-from-start_mean 3.044711340883156 distance-from-start_median 3.044711340883156 distance-from-start_min 3.044711340883156 driven_any_max 6.387583479109615 driven_any_mean 6.387583479109615 driven_any_median 6.387583479109615 driven_any_min 6.387583479109615 driven_lanedir_consec_max 4.756913907030646 driven_lanedir_consec_mean 4.756913907030646 driven_lanedir_consec_min 4.756913907030646 driven_lanedir_max 4.756913907030646 driven_lanedir_mean 4.756913907030646 driven_lanedir_median 4.756913907030646 driven_lanedir_min 4.756913907030646 in-drivable-lane_max 10.899999999999777 in-drivable-lane_mean 10.899999999999777 in-drivable-lane_min 10.899999999999777 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.387583479109615, "survival_time": 49.299999999999336, "driven_lanedir": 4.756913907030646, "in-drivable-lane": 10.899999999999777, "deviation-heading": 9.37707796103529, "distance-from-start": 3.044711340883156, "deviation-center-line": 3.0309654181806507, "driven_lanedir_consec": 4.756913907030646}}simulation-passed 1 survival_time_max 49.299999999999336 survival_time_mean 49.299999999999336 survival_time_min 49.299999999999336
No reset possible 6771771Bea Baselines baseline-RPL-ros aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 02:26:19+00:00 2021-11-03 02:31:45+00:00 0:05:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.45000000000027 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.5977807677536795 deviation-center-line_median 1.1428796238021477
other stats deviation-center-line_max 1.1428796238021477 deviation-center-line_mean 1.1428796238021477 deviation-center-line_min 1.1428796238021477 deviation-heading_max 2.827727491721415 deviation-heading_mean 2.827727491721415 deviation-heading_median 2.827727491721415 deviation-heading_min 2.827727491721415 distance-from-start_max 2.8106460692552666 distance-from-start_mean 2.8106460692552666 distance-from-start_median 2.8106460692552666 distance-from-start_min 2.8106460692552666 driven_any_max 3.632673810938064 driven_any_mean 3.632673810938064 driven_any_median 3.632673810938064 driven_any_min 3.632673810938064 driven_lanedir_consec_max 3.5977807677536795 driven_lanedir_consec_mean 3.5977807677536795 driven_lanedir_consec_min 3.5977807677536795 driven_lanedir_max 3.5977807677536795 driven_lanedir_mean 3.5977807677536795 driven_lanedir_median 3.5977807677536795 driven_lanedir_min 3.5977807677536795 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 3.632673810938064, "survival_time": 28.45000000000027, "driven_lanedir": 3.5977807677536795, "in-drivable-lane": 0.0, "deviation-heading": 2.827727491721415, "distance-from-start": 2.8106460692552666, "deviation-center-line": 1.1428796238021477, "driven_lanedir_consec": 3.5977807677536795}}simulation-passed 1 survival_time_max 28.45000000000027 survival_time_mean 28.45000000000027 survival_time_min 28.45000000000027
No reset possible 6762773Bea Baselines baseline-RPL-ros aido-LFI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-03 02:22:09+00:00 2021-11-03 02:26:00+00:00 0:03:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 28.50000000000027 in-drivable-lane_median 4.100000000000023 driven_lanedir_consec_median 2.8784710989834985 deviation-center-line_median 1.9985595976298816
other stats deviation-center-line_max 1.9985595976298816 deviation-center-line_mean 1.9985595976298816 deviation-center-line_min 1.9985595976298816 deviation-heading_max 6.8425283218478965 deviation-heading_mean 6.8425283218478965 deviation-heading_median 6.8425283218478965 deviation-heading_min 6.8425283218478965 distance-from-start_max 2.189366490422202 distance-from-start_mean 2.189366490422202 distance-from-start_median 2.189366490422202 distance-from-start_min 2.189366490422202 driven_any_max 3.6326037495811025 driven_any_mean 3.6326037495811025 driven_any_median 3.6326037495811025 driven_any_min 3.6326037495811025 driven_lanedir_consec_max 2.8784710989834985 driven_lanedir_consec_mean 2.8784710989834985 driven_lanedir_consec_min 2.8784710989834985 driven_lanedir_max 2.8784710989834985 driven_lanedir_mean 2.8784710989834985 driven_lanedir_median 2.8784710989834985 driven_lanedir_min 2.8784710989834985 in-drivable-lane_max 4.100000000000023 in-drivable-lane_mean 4.100000000000023 in-drivable-lane_min 4.100000000000023 per-episodes details {"udem1-000-ego0": {"driven_any": 3.6326037495811025, "survival_time": 28.50000000000027, "driven_lanedir": 2.8784710989834985, "in-drivable-lane": 4.100000000000023, "deviation-heading": 6.8425283218478965, "distance-from-start": 2.189366490422202, "deviation-center-line": 1.9985595976298816, "driven_lanedir_consec": 2.8784710989834985}}simulation-passed 1 survival_time_max 28.50000000000027 survival_time_mean 28.50000000000027 survival_time_min 28.50000000000027
No reset possible 6756774Bea Baselines baseline-RPL-ros aido-LF-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-03 02:17:33+00:00 2021-11-03 02:21:56+00:00 0:04:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.8181351384475937 survival_time_median 57.749999999998856 deviation-center-line_median 2.0265845990000955 in-drivable-lane_median 19.449999999999037
other stats deviation-center-line_max 2.0265845990000955 deviation-center-line_mean 2.0265845990000955 deviation-center-line_min 2.0265845990000955 deviation-heading_max 6.788987484816697 deviation-heading_mean 6.788987484816697 deviation-heading_median 6.788987484816697 deviation-heading_min 6.788987484816697 distance-from-start_max 2.6814205186099564 distance-from-start_mean 2.6814205186099564 distance-from-start_median 2.6814205186099564 distance-from-start_min 2.6814205186099564 driven_any_max 7.509206162279352 driven_any_mean 7.509206162279352 driven_any_median 7.509206162279352 driven_any_min 7.509206162279352 driven_lanedir_consec_max 3.8181351384475937 driven_lanedir_consec_mean 3.8181351384475937 driven_lanedir_consec_min 3.8181351384475937 driven_lanedir_max 4.843335098055115 driven_lanedir_mean 4.843335098055115 driven_lanedir_median 4.843335098055115 driven_lanedir_min 4.843335098055115 in-drivable-lane_max 19.449999999999037 in-drivable-lane_mean 19.449999999999037 in-drivable-lane_min 19.449999999999037 per-episodes details {"loop-000-ego0": {"driven_any": 7.509206162279352, "survival_time": 57.749999999998856, "driven_lanedir": 4.843335098055115, "in-drivable-lane": 19.449999999999037, "deviation-heading": 6.788987484816697, "distance-from-start": 2.6814205186099564, "deviation-center-line": 2.0265845990000955, "driven_lanedir_consec": 3.8181351384475937}}simulation-passed 1 survival_time_max 57.749999999998856 survival_time_mean 57.749999999998856 survival_time_min 57.749999999998856
No reset possible 6740776Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-03 01:59:44+00:00 2021-11-03 02:17:16+00:00 0:17:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.899999999998865 driven_lanedir_consec_median 3.546303662899571 deviation-center-line_median 2.241680476929799
other stats deviation-center-line_max 3.4141572755461373 deviation-center-line_mean 2.380769418916638 deviation-center-line_min 1.6255594462608176 deviation-heading_max 11.73031911794969 deviation-heading_mean 8.467086783839841 deviation-heading_median 8.453985398996998 deviation-heading_min 5.230057219415677 distance-from-start_max 3.890289765536408 distance-from-start_mean 2.740739708806342 distance-from-start_median 2.778084609303228 distance-from-start_min 1.516499851082505 driven_any_max 7.91423206954019 driven_any_mean 6.515078195421499 driven_any_median 6.32090822034885 driven_any_min 5.504264271448111 driven_lanedir_consec_max 5.196881271606554 driven_lanedir_consec_mean 3.5769735510896217 driven_lanedir_consec_min 2.0184056069527907 driven_lanedir_max 5.599928141092511 driven_lanedir_mean 3.7833871858189134 driven_lanedir_median 3.6864558006616113 driven_lanedir_min 2.16070900085992 in-drivable-lane_max 41.49999999999859 in-drivable-lane_mean 28.48749999999898 in-drivable-lane_min 14.6499999999996 per-episodes details {"autolab-000-ego0": {"driven_any": 7.91423206954019, "survival_time": 59.99999999999873, "driven_lanedir": 5.599928141092511, "in-drivable-lane": 14.6499999999996, "deviation-heading": 10.873616211575332, "distance-from-start": 3.890289765536408, "deviation-center-line": 3.4141572755461373, "driven_lanedir_consec": 5.196881271606554}, "autolab-000-ego1": {"driven_any": 5.915921636865276, "survival_time": 59.99999999999873, "driven_lanedir": 2.2003070046265045, "in-drivable-lane": 41.44999999999859, "deviation-heading": 5.230057219415677, "distance-from-start": 1.516499851082505, "deviation-center-line": 1.6255594462608176, "driven_lanedir_consec": 2.0184056069527907}, "autolab-000-ego2": {"driven_any": 6.725894803832422, "survival_time": 59.99999999999873, "driven_lanedir": 5.172604596696718, "in-drivable-lane": 16.349999999999135, "deviation-heading": 11.73031911794969, "distance-from-start": 2.3148271196836947, "deviation-center-line": 2.3490657549077816, "driven_lanedir_consec": 4.966874778124946}, "autolab-000-ego3": {"driven_any": 5.504264271448111, "survival_time": 59.99999999999873, "driven_lanedir": 2.16070900085992, "in-drivable-lane": 41.49999999999859, "deviation-heading": 6.034354586418663, "distance-from-start": 3.241342098922762, "deviation-center-line": 2.134295198951816, "driven_lanedir_consec": 2.125732547674197}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6677776Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-3of4 timeout no gpu-staging-spot-0-032021-11-02 23:52:54+00:00 - - - - No reset possible 6665778Bea Baselines baseline-RPL-ros aido-LFV-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-02 23:45:04+00:00 2021-11-02 23:52:47+00:00 0:07:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 34.900000000000155 in-drivable-lane_median 2.5499999999999687 driven_lanedir_consec_median 2.835327137687716 deviation-center-line_median 2.1417554523228888
other stats deviation-center-line_max 2.1417554523228888 deviation-center-line_mean 2.1417554523228888 deviation-center-line_min 2.1417554523228888 deviation-heading_max 5.391323299598804 deviation-heading_mean 5.391323299598804 deviation-heading_median 5.391323299598804 deviation-heading_min 5.391323299598804 distance-from-start_max 1.683160646253809 distance-from-start_mean 1.683160646253809 distance-from-start_median 1.683160646253809 distance-from-start_min 1.683160646253809 driven_any_max 4.488935597483684 driven_any_mean 4.488935597483684 driven_any_median 4.488935597483684 driven_any_min 4.488935597483684 driven_lanedir_consec_max 2.835327137687716 driven_lanedir_consec_mean 2.835327137687716 driven_lanedir_consec_min 2.835327137687716 driven_lanedir_max 4.006398713941143 driven_lanedir_mean 4.006398713941143 driven_lanedir_median 4.006398713941143 driven_lanedir_min 4.006398713941143 in-drivable-lane_max 2.5499999999999687 in-drivable-lane_mean 2.5499999999999687 in-drivable-lane_min 2.5499999999999687 per-episodes details {"autolab-000-ego0": {"driven_any": 4.488935597483684, "survival_time": 34.900000000000155, "driven_lanedir": 4.006398713941143, "in-drivable-lane": 2.5499999999999687, "deviation-heading": 5.391323299598804, "distance-from-start": 1.683160646253809, "deviation-center-line": 2.1417554523228888, "driven_lanedir_consec": 2.835327137687716}}simulation-passed 1 survival_time_max 34.900000000000155 survival_time_mean 34.900000000000155 survival_time_min 34.900000000000155
No reset possible 6661779Bea Baselines baseline-RPL-ros aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-02 23:42:52+00:00 2021-11-02 23:44:49+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6656780Bea Baselines baseline-RPL-ros aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 23:40:41+00:00 2021-11-02 23:42:33+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6651780Bea Baselines baseline-RPL-ros aido-LFI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-02 23:35:49+00:00 2021-11-02 23:40:21+00:00 0:04:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 32.20000000000031 in-drivable-lane_median 1.0000000000000044 driven_lanedir_consec_median 1.6839486990093675 deviation-center-line_median 2.7944950507014403
other stats deviation-center-line_max 2.7944950507014403 deviation-center-line_mean 2.7944950507014403 deviation-center-line_min 2.7944950507014403 deviation-heading_max 6.54782941476605 deviation-heading_mean 6.54782941476605 deviation-heading_median 6.54782941476605 deviation-heading_min 6.54782941476605 distance-from-start_max 1.499775197350086 distance-from-start_mean 1.499775197350086 distance-from-start_median 1.499775197350086 distance-from-start_min 1.499775197350086 driven_any_max 4.123629633732801 driven_any_mean 4.123629633732801 driven_any_median 4.123629633732801 driven_any_min 4.123629633732801 driven_lanedir_consec_max 1.6839486990093675 driven_lanedir_consec_mean 1.6839486990093675 driven_lanedir_consec_min 1.6839486990093675 driven_lanedir_max 3.8588332870722377 driven_lanedir_mean 3.8588332870722377 driven_lanedir_median 3.8588332870722377 driven_lanedir_min 3.8588332870722377 in-drivable-lane_max 1.0000000000000044 in-drivable-lane_mean 1.0000000000000044 in-drivable-lane_min 1.0000000000000044 per-episodes details {"4way-000-ego0": {"driven_any": 4.123629633732801, "survival_time": 32.20000000000031, "driven_lanedir": 3.8588332870722377, "in-drivable-lane": 1.0000000000000044, "deviation-heading": 6.54782941476605, "distance-from-start": 1.499775197350086, "deviation-center-line": 2.7944950507014403, "driven_lanedir_consec": 1.6839486990093675}}simulation-passed 1 survival_time_max 32.20000000000031 survival_time_mean 32.20000000000031 survival_time_min 32.20000000000031
No reset possible 6645781Bea Baselines baseline-RPL-ros aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 23:32:28+00:00 2021-11-02 23:35:42+00:00 0:03:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.2687400621692317 survival_time_median 36.80000000000005 deviation-center-line_median 2.154870072770362 in-drivable-lane_median 11.349999999999888
other stats deviation-center-line_max 2.154870072770362 deviation-center-line_mean 2.154870072770362 deviation-center-line_min 2.154870072770362 deviation-heading_max 7.556478295062907 deviation-heading_mean 7.556478295062907 deviation-heading_median 7.556478295062907 deviation-heading_min 7.556478295062907 distance-from-start_max 1.1405002753334668 distance-from-start_mean 1.1405002753334668 distance-from-start_median 1.1405002753334668 distance-from-start_min 1.1405002753334668 driven_any_max 4.727902111729945 driven_any_mean 4.727902111729945 driven_any_median 4.727902111729945 driven_any_min 4.727902111729945 driven_lanedir_consec_max 2.2687400621692317 driven_lanedir_consec_mean 2.2687400621692317 driven_lanedir_consec_min 2.2687400621692317 driven_lanedir_max 3.020264070938023 driven_lanedir_mean 3.020264070938023 driven_lanedir_median 3.020264070938023 driven_lanedir_min 3.020264070938023 in-drivable-lane_max 11.349999999999888 in-drivable-lane_mean 11.349999999999888 in-drivable-lane_min 11.349999999999888 per-episodes details {"loop-000-ego0": {"driven_any": 4.727902111729945, "survival_time": 36.80000000000005, "driven_lanedir": 3.020264070938023, "in-drivable-lane": 11.349999999999888, "deviation-heading": 7.556478295062907, "distance-from-start": 1.1405002753334668, "deviation-center-line": 2.154870072770362, "driven_lanedir_consec": 2.2687400621692317}}simulation-passed 1 survival_time_max 36.80000000000005 survival_time_mean 36.80000000000005 survival_time_min 36.80000000000005
No reset possible 6641782Bea Baselines baseline-RPL-ros aido-LFVI_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-02 23:30:28+00:00 2021-11-02 23:32:14+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6630792Andrea Daniele template-tensorflow aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-02 23:24:28+00:00 2021-11-02 23:30:15+00:00 0:05:47 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6562636Bea Baselines minimal-agent-full aido-LFV_multi-full-sim-validationsim-3of4 timeout no gpu-staging-spot-0-032021-11-02 21:24:11+00:00 - - - - No reset possible 6560635Bea Baselines minimal-agent-full aido-LFI-full-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-02 21:22:29+00:00 2021-11-02 21:24:03+00:00 0:01:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6542639Bea Baselines minimal-agent-full aido-LFVI-full-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-02 21:14:10+00:00 2021-11-02 21:22:16+00:00 0:08:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9499999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.903013185974951 deviation-center-line_median 3.78943987331601
other stats deviation-center-line_max 3.78943987331601 deviation-center-line_mean 3.78943987331601 deviation-center-line_min 3.78943987331601 deviation-heading_max 4.334690003953373 deviation-heading_mean 4.334690003953373 deviation-heading_median 4.334690003953373 deviation-heading_min 4.334690003953373 distance-from-start_max 1.5738876609453012 distance-from-start_mean 1.5738876609453012 distance-from-start_median 1.5738876609453012 distance-from-start_min 1.5738876609453012 driven_any_max 2.934594724791732 driven_any_mean 2.934594724791732 driven_any_median 2.934594724791732 driven_any_min 2.934594724791732 driven_lanedir_consec_max 2.903013185974951 driven_lanedir_consec_mean 2.903013185974951 driven_lanedir_consec_min 2.903013185974951 driven_lanedir_max 2.9099324876731436 driven_lanedir_mean 2.9099324876731436 driven_lanedir_median 2.9099324876731436 driven_lanedir_min 2.9099324876731436 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.934594724791732, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099324876731436, "in-drivable-lane": 0.0, "deviation-heading": 4.334690003953373, "distance-from-start": 1.5738876609453012, "deviation-center-line": 3.78943987331601, "driven_lanedir_consec": 2.903013185974951}}simulation-passed 1 survival_time_max 49.9499999999993 survival_time_mean 49.9499999999993 survival_time_min 49.9499999999993
No reset possible 6535785Andrea Daniele template-ros aido-LF-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-02 21:11:20+00:00 2021-11-02 21:13:50+00:00 0:02:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.19206810736714575 survival_time_median 11.65000000000003 deviation-center-line_median 0.05479647428668314 in-drivable-lane_median 10.65000000000003
other stats deviation-center-line_max 0.05479647428668314 deviation-center-line_mean 0.05479647428668314 deviation-center-line_min 0.05479647428668314 deviation-heading_max 0.5414394593204175 deviation-heading_mean 0.5414394593204175 deviation-heading_median 0.5414394593204175 deviation-heading_min 0.5414394593204175 distance-from-start_max 2.6456978193203824 distance-from-start_mean 2.6456978193203824 distance-from-start_median 2.6456978193203824 distance-from-start_min 2.6456978193203824 driven_any_max 3.2715794139340124 driven_any_mean 3.2715794139340124 driven_any_median 3.2715794139340124 driven_any_min 3.2715794139340124 driven_lanedir_consec_max 0.19206810736714575 driven_lanedir_consec_mean 0.19206810736714575 driven_lanedir_consec_min 0.19206810736714575 driven_lanedir_max 0.19206810736714575 driven_lanedir_mean 0.19206810736714575 driven_lanedir_median 0.19206810736714575 driven_lanedir_min 0.19206810736714575 in-drivable-lane_max 10.65000000000003 in-drivable-lane_mean 10.65000000000003 in-drivable-lane_min 10.65000000000003 per-episodes details {"autolab-000-ego0": {"driven_any": 3.2715794139340124, "survival_time": 11.65000000000003, "driven_lanedir": 0.19206810736714575, "in-drivable-lane": 10.65000000000003, "deviation-heading": 0.5414394593204175, "distance-from-start": 2.6456978193203824, "deviation-center-line": 0.05479647428668314, "driven_lanedir_consec": 0.19206810736714575}}simulation-passed 1 survival_time_max 11.65000000000003 survival_time_mean 11.65000000000003 survival_time_min 11.65000000000003
No reset possible 6524787Andrea Daniele template-tensorflow aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-02 21:10:07+00:00 2021-11-02 21:11:03+00:00 0:00:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6519787Andrea Daniele template-tensorflow aido-LF-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-02 21:08:08+00:00 2021-11-02 21:09:47+00:00 0:01:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6516789Andrea Daniele template-pytorch aido-LF-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-02 21:05:07+00:00 2021-11-02 21:08:01+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2582514505084268 survival_time_median 8.999999999999993 deviation-center-line_median 0.1235648827393032 in-drivable-lane_median 4.950000000000005
other stats deviation-center-line_max 0.1235648827393032 deviation-center-line_mean 0.1235648827393032 deviation-center-line_min 0.1235648827393032 deviation-heading_max 3.2757183359816273 deviation-heading_mean 3.2757183359816273 deviation-heading_median 3.2757183359816273 deviation-heading_min 3.2757183359816273 distance-from-start_max 0.130783360171796 distance-from-start_mean 0.130783360171796 distance-from-start_median 0.130783360171796 distance-from-start_min 0.130783360171796 driven_any_max 0.8856774801353098 driven_any_mean 0.8856774801353098 driven_any_median 0.8856774801353098 driven_any_min 0.8856774801353098 driven_lanedir_consec_max 0.2582514505084268 driven_lanedir_consec_mean 0.2582514505084268 driven_lanedir_consec_min 0.2582514505084268 driven_lanedir_max 0.2582514505084268 driven_lanedir_mean 0.2582514505084268 driven_lanedir_median 0.2582514505084268 driven_lanedir_min 0.2582514505084268 in-drivable-lane_max 4.950000000000005 in-drivable-lane_mean 4.950000000000005 in-drivable-lane_min 4.950000000000005 per-episodes details {"loop-000-ego0": {"driven_any": 0.8856774801353098, "survival_time": 8.999999999999993, "driven_lanedir": 0.2582514505084268, "in-drivable-lane": 4.950000000000005, "deviation-heading": 3.2757183359816273, "distance-from-start": 0.130783360171796, "deviation-center-line": 0.1235648827393032, "driven_lanedir_consec": 0.2582514505084268}}simulation-passed 1 survival_time_max 8.999999999999993 survival_time_mean 8.999999999999993 survival_time_min 8.999999999999993
No reset possible 6498644Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-02 20:50:50+00:00 2021-11-02 21:04:29+00:00 0:13:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.133472186206734 deviation-center-line_median 3.5692749184210433
other stats deviation-center-line_max 5.1851715974128805 deviation-center-line_mean 3.738598388104289 deviation-center-line_min 2.6306721181621886 deviation-heading_max 8.12390911081905 deviation-heading_mean 4.904445207680925 deviation-heading_median 3.9916054069886826 deviation-heading_min 3.5106609059272844 distance-from-start_max 2.230934169509707 distance-from-start_mean 1.8422550059061231 distance-from-start_median 1.83762780726357 distance-from-start_min 1.4628302395876456 driven_any_max 3.5795876791383257 driven_any_mean 3.408211238652514 driven_any_median 3.559331275339633 driven_any_min 2.934594724792462 driven_lanedir_consec_max 3.4288085645898976 driven_lanedir_consec_mean 2.8688896370650867 driven_lanedir_consec_min 1.779805611256981 driven_lanedir_max 3.561567679231453 driven_lanedir_mean 3.351579340793875 driven_lanedir_median 3.467420167967693 driven_lanedir_min 2.909909348008662 in-drivable-lane_max 1.3499999999999446 in-drivable-lane_mean 0.33749999999998614 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.934594724792462, "survival_time": 59.99999999999873, "driven_lanedir": 2.909909348008662, "in-drivable-lane": 0.0, "deviation-heading": 4.334701504286533, "distance-from-start": 1.5738876834742443, "deviation-center-line": 5.1851715974128805, "driven_lanedir_consec": 2.9029908891375724}, "udem-000-ego1": {"driven_any": 3.539079376082114, "survival_time": 59.99999999999873, "driven_lanedir": 3.3772467891566187, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 8.12390911081905, "distance-from-start": 1.4628302395876456, "deviation-center-line": 4.14966050504133, "driven_lanedir_consec": 1.779805611256981}, "udem-000-ego2": {"driven_any": 3.5795876791383257, "survival_time": 59.99999999999873, "driven_lanedir": 3.561567679231453, "in-drivable-lane": 0.0, "deviation-heading": 3.5106609059272844, "distance-from-start": 2.230934169509707, "deviation-center-line": 2.6306721181621886, "driven_lanedir_consec": 3.4288085645898976}, "udem-000-ego3": {"driven_any": 3.5795831745971527, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575935467787665, "in-drivable-lane": 0.0, "deviation-heading": 3.648509309690832, "distance-from-start": 2.101367931052896, "deviation-center-line": 2.988889331800756, "driven_lanedir_consec": 3.3639534832758957}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6489645Bea Baselines minimal-agent-full aido-LF-full-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-02 20:45:20+00:00 2021-11-02 20:50:38+00:00 0:05:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.149999999999878 driven_lanedir_consec_median 3.364933059128671 deviation-center-line_median 5.251516924575099
other stats deviation-center-line_max 5.251516924575099 deviation-center-line_mean 5.251516924575099 deviation-center-line_min 5.251516924575099 deviation-heading_max 8.784883477445916 deviation-heading_mean 8.784883477445916 deviation-heading_median 8.784883477445916 deviation-heading_min 8.784883477445916 distance-from-start_max 2.151743265759588 distance-from-start_mean 2.151743265759588 distance-from-start_median 2.151743265759588 distance-from-start_min 2.151743265759588 driven_any_max 3.5150892362964212 driven_any_mean 3.5150892362964212 driven_any_median 3.5150892362964212 driven_any_min 3.5150892362964212 driven_lanedir_consec_max 3.364933059128671 driven_lanedir_consec_mean 3.364933059128671 driven_lanedir_consec_min 3.364933059128671 driven_lanedir_max 3.364933059128671 driven_lanedir_mean 3.364933059128671 driven_lanedir_median 3.364933059128671 driven_lanedir_min 3.364933059128671 in-drivable-lane_max 2.149999999999878 in-drivable-lane_mean 2.149999999999878 in-drivable-lane_min 2.149999999999878 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.5150892362964212, "survival_time": 59.99999999999873, "driven_lanedir": 3.364933059128671, "in-drivable-lane": 2.149999999999878, "deviation-heading": 8.784883477445916, "distance-from-start": 2.151743265759588, "deviation-center-line": 5.251516924575099, "driven_lanedir_consec": 3.364933059128671}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6485644Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-02 20:43:54+00:00 2021-11-02 20:45:08+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6475645Bea Baselines minimal-agent-full aido-LF-full-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 20:39:01+00:00 2021-11-02 20:43:28+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 1.690363772759563 deviation-center-line_median 5.303135750931098
other stats deviation-center-line_max 5.303135750931098 deviation-center-line_mean 5.303135750931098 deviation-center-line_min 5.303135750931098 deviation-heading_max 5.395040966687188 deviation-heading_mean 5.395040966687188 deviation-heading_median 5.395040966687188 deviation-heading_min 5.395040966687188 distance-from-start_max 1.3909655252105415 distance-from-start_mean 1.3909655252105415 distance-from-start_median 1.3909655252105415 distance-from-start_min 1.3909655252105415 driven_any_max 3.519587646027775 driven_any_mean 3.519587646027775 driven_any_median 3.519587646027775 driven_any_min 3.519587646027775 driven_lanedir_consec_max 1.690363772759563 driven_lanedir_consec_mean 1.690363772759563 driven_lanedir_consec_min 1.690363772759563 driven_lanedir_max 3.3875021949966126 driven_lanedir_mean 3.3875021949966126 driven_lanedir_median 3.3875021949966126 driven_lanedir_min 3.3875021949966126 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 3.519587646027775, "survival_time": 59.99999999999873, "driven_lanedir": 3.3875021949966126, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.395040966687188, "distance-from-start": 1.3909655252105415, "deviation-center-line": 5.303135750931098, "driven_lanedir_consec": 1.690363772759563}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6468674Bea Baselines baseline-simple-yield aido-LF-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-02 20:34:25+00:00 2021-11-02 20:38:41+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.379280605881083 deviation-center-line_median 0.4086426394863958
other stats deviation-center-line_max 0.4086426394863958 deviation-center-line_mean 0.4086426394863958 deviation-center-line_min 0.4086426394863958 deviation-heading_max 3.257710113460004 deviation-heading_mean 3.257710113460004 deviation-heading_median 3.257710113460004 deviation-heading_min 3.257710113460004 distance-from-start_max 2.710848600829782 distance-from-start_mean 2.710848600829782 distance-from-start_median 2.710848600829782 distance-from-start_min 2.710848600829782 driven_any_max 5.395555302886635 driven_any_mean 5.395555302886635 driven_any_median 5.395555302886635 driven_any_min 5.395555302886635 driven_lanedir_consec_max 5.379280605881083 driven_lanedir_consec_mean 5.379280605881083 driven_lanedir_consec_min 5.379280605881083 driven_lanedir_max 5.379280605881083 driven_lanedir_mean 5.379280605881083 driven_lanedir_median 5.379280605881083 driven_lanedir_min 5.379280605881083 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6457677Bea Baselines baseline-simple-yield aido-LFVI-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-02 20:25:06+00:00 2021-11-02 20:34:05+00:00 0:08:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.68215125613533 deviation-center-line_median 0.07395327503038837
other stats deviation-center-line_max 0.07395327503038837 deviation-center-line_mean 0.07395327503038837 deviation-center-line_min 0.07395327503038837 deviation-heading_max 0.5851001197983932 deviation-heading_mean 0.5851001197983932 deviation-heading_median 0.5851001197983932 deviation-heading_min 0.5851001197983932 distance-from-start_max 2.029871473762164 distance-from-start_mean 2.029871473762164 distance-from-start_median 2.029871473762164 distance-from-start_min 2.029871473762164 driven_any_max 2.684176116815528 driven_any_mean 2.684176116815528 driven_any_median 2.684176116815528 driven_any_min 2.684176116815528 driven_lanedir_consec_max 2.68215125613533 driven_lanedir_consec_mean 2.68215125613533 driven_lanedir_consec_min 2.68215125613533 driven_lanedir_max 2.6821513356789115 driven_lanedir_mean 2.6821513356789115 driven_lanedir_median 2.6821513356789115 driven_lanedir_min 2.6821513356789115 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.684176116815528, "survival_time": 59.99999999999873, "driven_lanedir": 2.6821513356789115, "in-drivable-lane": 0.0, "deviation-heading": 0.5851001197983932, "distance-from-start": 2.029871473762164, "deviation-center-line": 0.07395327503038837, "driven_lanedir_consec": 2.68215125613533}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6451680Bea Baselines baseline-simple-yield aido-LF-state-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 20:21:14+00:00 2021-11-02 20:24:46+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.626542990464859 deviation-center-line_median 0.3404045717154838
other stats deviation-center-line_max 0.3404045717154838 deviation-center-line_mean 0.3404045717154838 deviation-center-line_min 0.3404045717154838 deviation-heading_max 2.631172234135892 deviation-heading_mean 2.631172234135892 deviation-heading_median 2.631172234135892 deviation-heading_min 2.631172234135892 distance-from-start_max 2.518618655205165 distance-from-start_mean 2.518618655205165 distance-from-start_median 2.518618655205165 distance-from-start_min 2.518618655205165 driven_any_max 5.644450866720938 driven_any_mean 5.644450866720938 driven_any_median 5.644450866720938 driven_any_min 5.644450866720938 driven_lanedir_consec_max 5.626542990464859 driven_lanedir_consec_mean 5.626542990464859 driven_lanedir_consec_min 5.626542990464859 driven_lanedir_max 5.626542990464859 driven_lanedir_mean 5.626542990464859 driven_lanedir_median 5.626542990464859 driven_lanedir_min 5.626542990464859 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.644450866720938, "survival_time": 59.99999999999873, "driven_lanedir": 5.626542990464859, "in-drivable-lane": 0.0, "deviation-heading": 2.631172234135892, "distance-from-start": 2.518618655205165, "deviation-center-line": 0.3404045717154838, "driven_lanedir_consec": 5.626542990464859}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6441679Bea Baselines baseline-simple-yield aido-LFP-state-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-02 20:19:31+00:00 2021-11-02 20:20:54+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.999999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4471248824593203 deviation-center-line_median 0.055374444134471366
other stats deviation-center-line_max 0.055374444134471366 deviation-center-line_mean 0.055374444134471366 deviation-center-line_min 0.055374444134471366 deviation-heading_max 0.6902792102151962 deviation-heading_mean 0.6902792102151962 deviation-heading_median 0.6902792102151962 deviation-heading_min 0.6902792102151962 distance-from-start_max 0.4472059249333694 distance-from-start_mean 0.4472059249333694 distance-from-start_median 0.4472059249333694 distance-from-start_min 0.4472059249333694 driven_any_max 0.4526001398092184 driven_any_mean 0.4526001398092184 driven_any_median 0.4526001398092184 driven_any_min 0.4526001398092184 driven_lanedir_consec_max 0.4471248824593203 driven_lanedir_consec_mean 0.4471248824593203 driven_lanedir_consec_min 0.4471248824593203 driven_lanedir_max 0.4471248824593203 driven_lanedir_mean 0.4471248824593203 driven_lanedir_median 0.4471248824593203 driven_lanedir_min 0.4471248824593203 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.4526001398092184, "survival_time": 5.999999999999987, "driven_lanedir": 0.4471248824593203, "in-drivable-lane": 0.0, "deviation-heading": 0.6902792102151962, "distance-from-start": 0.4472059249333694, "deviation-center-line": 0.055374444134471366, "driven_lanedir_consec": 0.4471248824593203}}simulation-passed 1 survival_time_max 5.999999999999987 survival_time_mean 5.999999999999987 survival_time_min 5.999999999999987
No reset possible 6428682Bea Baselines baseline-simple-yield aido-LFVI_multi-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-02 20:05:55+00:00 2021-11-02 20:19:11+00:00 0:13:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.49634916578956 deviation-center-line_median 0.19094046425276645
other stats deviation-center-line_max 0.24986042415305248 deviation-center-line_mean 0.18985217391943776 deviation-center-line_min 0.1276673430191657 deviation-heading_max 1.717963512215023 deviation-heading_mean 1.4545462563339835 deviation-heading_median 1.4664624947252969 deviation-heading_min 1.1672965236703177 distance-from-start_max 3.468692663867372 distance-from-start_mean 3.0052111787863516 distance-from-start_median 3.0986320628962627 distance-from-start_min 2.354887925485507 driven_any_max 5.804604986504682 driven_any_mean 5.267122824628235 driven_any_median 5.648531176262696 driven_any_min 3.966823959482864 driven_lanedir_consec_max 5.799353840314662 driven_lanedir_consec_mean 5.187606175229343 driven_lanedir_consec_min 3.9583725290235874 driven_lanedir_max 5.799353840314662 driven_lanedir_mean 5.261671552684617 driven_lanedir_median 5.644479920700109 driven_lanedir_min 3.9583725290235874 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.53848260532673, "survival_time": 59.99999999999873, "driven_lanedir": 5.53379952227268, "in-drivable-lane": 0.0, "deviation-heading": 1.359126757476075, "distance-from-start": 2.354887925485507, "deviation-center-line": 0.18361566006061136, "driven_lanedir_consec": 5.533799451359386}, "udem-001-ego1": {"driven_any": 5.804604986504682, "survival_time": 59.99999999999873, "driven_lanedir": 5.799353840314662, "in-drivable-lane": 0.0, "deviation-heading": 1.717963512215023, "distance-from-start": 3.468692663867372, "deviation-center-line": 0.1982652684449215, "driven_lanedir_consec": 5.799353840314662}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 3.966823959482864, "survival_time": 59.99999999999873, "driven_lanedir": 3.9583725290235874, "in-drivable-lane": 0.0, "deviation-heading": 1.5737982319745187, "distance-from-start": 3.062983828933523, "deviation-center-line": 0.24986042415305248, "driven_lanedir_consec": 3.9583725290235874}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6415681Bea Baselines baseline-simple-yield aido-LFI-state-sim-testingsim-1of4 timeout no gpu-staging-spot-0-032021-11-02 19:53:19+00:00 - - - - No reset possible 6406719Bea Baselines minimal-agent-state aido-LFVI_multi-state-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-02 19:44:00+00:00 2021-11-02 19:52:59+00:00 0:08:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5500000000000078 driven_lanedir_consec_median 2.71866176324571 deviation-center-line_median 4.5997692946661
other stats deviation-center-line_max 7.514921718660489 deviation-center-line_mean 5.02392012857541 deviation-center-line_min 3.3812202063089525 deviation-heading_max 7.270406502417804 deviation-heading_mean 4.904293629325643 deviation-heading_median 4.713467903390324 deviation-heading_min 2.9198322081041197 distance-from-start_max 2.224084223392078 distance-from-start_mean 1.8277566264239569 distance-from-start_median 1.8250490950229343 distance-from-start_min 1.4368440922578805 driven_any_max 3.5795916194572 driven_any_mean 3.0035907065383096 driven_any_median 3.1970874397950695 driven_any_min 2.0405963271058982 driven_lanedir_consec_max 3.5171204612307574 driven_lanedir_consec_mean 2.5784170438454 driven_lanedir_consec_min 1.3592241876594235 driven_lanedir_max 3.5592470379137566 driven_lanedir_mean 2.9375048569752154 driven_lanedir_median 3.105560153006043 driven_lanedir_min 1.979652083975019 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 0.775000000000011 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.0405963271058982, "survival_time": 59.99999999999873, "driven_lanedir": 1.979652083975019, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322081041197, "distance-from-start": 1.5472498854755887, "deviation-center-line": 7.514921718660489, "driven_lanedir_consec": 1.979652083975019}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 3.5795916194572, "survival_time": 59.99999999999873, "driven_lanedir": 3.528723291693028, "in-drivable-lane": 0.0, "deviation-heading": 7.270406502417804, "distance-from-start": 2.1028483045702804, "deviation-center-line": 3.716804548754915, "driven_lanedir_consec": 3.5171204612307574}, "udem-000-ego3": {"driven_any": 2.814587847286173, "survival_time": 59.99999999999873, "driven_lanedir": 2.6823970143190583, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663418506885731, "distance-from-start": 1.4368440922578805, "deviation-center-line": 5.482734040577284, "driven_lanedir_consec": 1.3592241876594235}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6397720Bea Baselines minimal-agent-state aido-LFVI-state-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-02 19:40:27+00:00 2021-11-02 19:43:40+00:00 0:03:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.449999999999985 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4398565700031045 deviation-center-line_median 0.2725613901951368
other stats deviation-center-line_max 0.2725613901951368 deviation-center-line_mean 0.2725613901951368 deviation-center-line_min 0.2725613901951368 deviation-heading_max 0.7151184294493084 deviation-heading_mean 0.7151184294493084 deviation-heading_median 0.7151184294493084 deviation-heading_min 0.7151184294493084 distance-from-start_max 0.44094173644960993 distance-from-start_mean 0.44094173644960993 distance-from-start_median 0.44094173644960993 distance-from-start_min 0.44094173644960993 driven_any_max 0.4445992768886744 driven_any_mean 0.4445992768886744 driven_any_median 0.4445992768886744 driven_any_min 0.4445992768886744 driven_lanedir_consec_max 0.4398565700031045 driven_lanedir_consec_mean 0.4398565700031045 driven_lanedir_consec_min 0.4398565700031045 driven_lanedir_max 0.4398565700031045 driven_lanedir_mean 0.4398565700031045 driven_lanedir_median 0.4398565700031045 driven_lanedir_min 0.4398565700031045 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.4445992768886744, "survival_time": 8.449999999999985, "driven_lanedir": 0.4398565700031045, "in-drivable-lane": 0.0, "deviation-heading": 0.7151184294493084, "distance-from-start": 0.44094173644960993, "deviation-center-line": 0.2725613901951368, "driven_lanedir_consec": 0.4398565700031045}}simulation-passed 1 survival_time_max 8.449999999999985 survival_time_mean 8.449999999999985 survival_time_min 8.449999999999985
No reset possible 6383719Bea Baselines minimal-agent-state aido-LFVI_multi-state-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-02 19:31:40+00:00 2021-11-02 19:40:07+00:00 0:08:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.5500000000000078 driven_lanedir_consec_median 3.1375523833453323 deviation-center-line_median 5.303403086153199
other stats deviation-center-line_max 5.768512378827251 deviation-center-line_mean 5.317250841410395 deviation-center-line_min 4.8936848145079335 deviation-heading_max 7.241657133894289 deviation-heading_mean 4.871041152307471 deviation-heading_median 4.326444806464443 deviation-heading_min 3.5896178624067088 distance-from-start_max 2.8752332419301623 distance-from-start_mean 2.179559752231285 distance-from-start_median 2.128871896043904 distance-from-start_min 1.58526197490717 driven_any_max 3.5465916471185097 driven_any_mean 3.2177189075870865 driven_any_median 3.215844330234903 driven_any_min 2.8925953227600307 driven_lanedir_consec_max 3.446981475702289 driven_lanedir_consec_mean 3.1459203042368187 driven_lanedir_consec_min 2.86159497455432 driven_lanedir_max 3.446981475702289 driven_lanedir_mean 3.1530896237663053 driven_lanedir_median 3.146203629193863 driven_lanedir_min 2.8729697609752045 in-drivable-lane_max 2.349999999999945 in-drivable-lane_mean 0.86249999999999 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 2.922595524241338, "survival_time": 59.99999999999873, "driven_lanedir": 2.9054993634872437, "in-drivable-lane": 0.0, "deviation-heading": 3.5896178624067088, "distance-from-start": 1.58526197490717, "deviation-center-line": 5.092329076449342, "driven_lanedir_consec": 2.8881969363835927}, "udem-001-ego1": {"driven_any": 2.8925953227600307, "survival_time": 59.99999999999873, "driven_lanedir": 2.8729697609752045, "in-drivable-lane": 0.0, "deviation-heading": 3.9504852000994535, "distance-from-start": 1.5897417389314648, "deviation-center-line": 4.8936848145079335, "driven_lanedir_consec": 2.86159497455432}, "udem-001-ego2": {"driven_any": 3.5090931362284685, "survival_time": 59.99999999999873, "driven_lanedir": 3.3869078949004825, "in-drivable-lane": 2.349999999999945, "deviation-heading": 4.702404412829432, "distance-from-start": 2.6680020531563433, "deviation-center-line": 5.768512378827251, "driven_lanedir_consec": 3.386907830307072}, "udem-001-ego3": {"driven_any": 3.5465916471185097, "survival_time": 59.99999999999873, "driven_lanedir": 3.446981475702289, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.241657133894289, "distance-from-start": 2.8752332419301623, "deviation-center-line": 5.514477095857055, "driven_lanedir_consec": 3.446981475702289}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6370720Bea Baselines minimal-agent-state aido-LFVI-state-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-02 19:26:02+00:00 2021-11-02 19:31:28+00:00 0:05:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 31.30000000000031 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.72552778560125 deviation-center-line_median 2.855857091333994
other stats deviation-center-line_max 2.855857091333994 deviation-center-line_mean 2.855857091333994 deviation-center-line_min 2.855857091333994 deviation-heading_max 2.4300668794999867 deviation-heading_mean 2.4300668794999867 deviation-heading_median 2.4300668794999867 deviation-heading_min 2.4300668794999867 distance-from-start_max 1.366301151018967 distance-from-start_mean 1.366301151018967 distance-from-start_median 1.366301151018967 distance-from-start_min 1.366301151018967 driven_any_max 1.7825969147103222 driven_any_mean 1.7825969147103222 driven_any_median 1.7825969147103222 driven_any_min 1.7825969147103222 driven_lanedir_consec_max 1.72552778560125 driven_lanedir_consec_mean 1.72552778560125 driven_lanedir_consec_min 1.72552778560125 driven_lanedir_max 1.72552778560125 driven_lanedir_mean 1.72552778560125 driven_lanedir_median 1.72552778560125 driven_lanedir_min 1.72552778560125 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"udem-001-ego0": {"driven_any": 1.7825969147103222, "survival_time": 31.30000000000031, "driven_lanedir": 1.72552778560125, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.4300668794999867, "distance-from-start": 1.366301151018967, "deviation-center-line": 2.855857091333994, "driven_lanedir_consec": 1.72552778560125}}simulation-passed 1 survival_time_max 31.30000000000031 survival_time_mean 31.30000000000031 survival_time_min 31.30000000000031
No reset possible 6362722Bea Baselines minimal-agent-state aido-LFP-state-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-02 19:22:12+00:00 2021-11-02 19:25:48+00:00 0:03:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1499999999999666 driven_lanedir_consec_median 1.4204197100811673 deviation-center-line_median 4.903600870629327
other stats deviation-center-line_max 4.903600870629327 deviation-center-line_mean 4.903600870629327 deviation-center-line_min 4.903600870629327 deviation-heading_max 7.744574576193987 deviation-heading_mean 7.744574576193987 deviation-heading_median 7.744574576193987 deviation-heading_min 7.744574576193987 distance-from-start_max 1.2060007985322774 distance-from-start_mean 1.2060007985322774 distance-from-start_median 1.2060007985322774 distance-from-start_min 1.2060007985322774 driven_any_max 3.4850840176967317 driven_any_mean 3.4850840176967317 driven_any_median 3.4850840176967317 driven_any_min 3.4850840176967317 driven_lanedir_consec_max 1.4204197100811673 driven_lanedir_consec_mean 1.4204197100811673 driven_lanedir_consec_min 1.4204197100811673 driven_lanedir_max 3.2905075260443173 driven_lanedir_mean 3.2905075260443173 driven_lanedir_median 3.2905075260443173 driven_lanedir_min 3.2905075260443173 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1499999999999666 in-drivable-lane_min 3.1499999999999666 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4850840176967317, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905075260443173, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574576193987, "distance-from-start": 1.2060007985322774, "deviation-center-line": 4.903600870629327, "driven_lanedir_consec": 1.4204197100811673}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6356723Bea Baselines minimal-agent-state aido-LF-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-02 19:18:34+00:00 2021-11-02 19:22:06+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.0528637692162603 deviation-center-line_median 5.91176225472802
other stats deviation-center-line_max 5.91176225472802 deviation-center-line_mean 5.91176225472802 deviation-center-line_min 5.91176225472802 deviation-heading_max 8.374149459714971 deviation-heading_mean 8.374149459714971 deviation-heading_median 8.374149459714971 deviation-heading_min 8.374149459714971 distance-from-start_max 0.99998148210146 distance-from-start_mean 0.99998148210146 distance-from-start_median 0.99998148210146 distance-from-start_min 0.99998148210146 driven_any_max 3.4100819966978593 driven_any_mean 3.4100819966978593 driven_any_median 3.4100819966978593 driven_any_min 3.4100819966978593 driven_lanedir_consec_max 2.0528637692162603 driven_lanedir_consec_mean 2.0528637692162603 driven_lanedir_consec_min 2.0528637692162603 driven_lanedir_max 3.1652526226678295 driven_lanedir_mean 3.1652526226678295 driven_lanedir_median 3.1652526226678295 driven_lanedir_min 3.1652526226678295 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4100819966978593, "survival_time": 59.99999999999873, "driven_lanedir": 3.1652526226678295, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.374149459714971, "distance-from-start": 0.99998148210146, "deviation-center-line": 5.91176225472802, "driven_lanedir_consec": 2.0528637692162603}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6345729Bea Baselines minimal-agent-state aido-LFV-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-02 19:08:56+00:00 2021-11-02 19:18:04+00:00 0:09:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.091631317677411 deviation-center-line_median 5.914152927086772
other stats deviation-center-line_max 5.914152927086772 deviation-center-line_mean 5.914152927086772 deviation-center-line_min 5.914152927086772 deviation-heading_max 8.388766833741702 deviation-heading_mean 8.388766833741702 deviation-heading_median 8.388766833741702 deviation-heading_min 8.388766833741702 distance-from-start_max 1.0308142273247416 distance-from-start_mean 1.0308142273247416 distance-from-start_median 1.0308142273247416 distance-from-start_min 1.0308142273247416 driven_any_max 3.449081983452879 driven_any_mean 3.449081983452879 driven_any_median 3.449081983452879 driven_any_min 3.449081983452879 driven_lanedir_consec_max 2.091631317677411 driven_lanedir_consec_mean 2.091631317677411 driven_lanedir_consec_min 2.091631317677411 driven_lanedir_max 3.203997570451749 driven_lanedir_mean 3.203997570451749 driven_lanedir_median 3.203997570451749 driven_lanedir_min 3.203997570451749 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"loop2-000-ego0": {"driven_any": 3.449081983452879, "survival_time": 59.99999999999873, "driven_lanedir": 3.203997570451749, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.388766833741702, "distance-from-start": 1.0308142273247416, "deviation-center-line": 5.914152927086772, "driven_lanedir_consec": 2.091631317677411}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6306699Bea Baselines minimal-agent aido-LFVI-sim-testingsim-2of4 timeout no gpu-staging-spot-0-032021-11-02 18:22:54+00:00 - - - - No reset possible 6290658Bea Baselines template-pytorch aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 18:17:29+00:00 2021-11-02 18:22:40+00:00 0:05:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.89102229678544 survival_time_median 59.99999999999873 deviation-center-line_median 2.2894558358386545 in-drivable-lane_median 31.199999999999243
other stats deviation-center-line_max 2.2894558358386545 deviation-center-line_mean 2.2894558358386545 deviation-center-line_min 2.2894558358386545 deviation-heading_max 23.54698697188732 deviation-heading_mean 23.54698697188732 deviation-heading_median 23.54698697188732 deviation-heading_min 23.54698697188732 distance-from-start_max 0.3404377611881298 distance-from-start_mean 0.3404377611881298 distance-from-start_median 0.3404377611881298 distance-from-start_min 0.3404377611881298 driven_any_max 9.799533402015337 driven_any_mean 9.799533402015337 driven_any_median 9.799533402015337 driven_any_min 9.799533402015337 driven_lanedir_consec_max 2.89102229678544 driven_lanedir_consec_mean 2.89102229678544 driven_lanedir_consec_min 2.89102229678544 driven_lanedir_max 2.89102229678544 driven_lanedir_mean 2.89102229678544 driven_lanedir_median 2.89102229678544 driven_lanedir_min 2.89102229678544 in-drivable-lane_max 31.199999999999243 in-drivable-lane_mean 31.199999999999243 in-drivable-lane_min 31.199999999999243 per-episodes details {"loop-000-ego0": {"driven_any": 9.799533402015337, "survival_time": 59.99999999999873, "driven_lanedir": 2.89102229678544, "in-drivable-lane": 31.199999999999243, "deviation-heading": 23.54698697188732, "distance-from-start": 0.3404377611881298, "deviation-center-line": 2.2894558358386545, "driven_lanedir_consec": 2.89102229678544}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6284672Bea Baselines template-tensorflow aido-LF-sim-testingsim-2of4 failed no gpu-staging-spot-0-032021-11-02 18:15:59+00:00 2021-11-02 18:17:10+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6278715Bea Baselines template-random aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-02 18:14:14+00:00 2021-11-02 18:15:53+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.02606899309120614 survival_time_median 11.950000000000037 deviation-center-line_median 0.3267562024231576 in-drivable-lane_median 8.500000000000023
other stats deviation-center-line_max 0.3267562024231576 deviation-center-line_mean 0.3267562024231576 deviation-center-line_min 0.3267562024231576 deviation-heading_max 2.556935476404166 deviation-heading_mean 2.556935476404166 deviation-heading_median 2.556935476404166 deviation-heading_min 2.556935476404166 distance-from-start_max 0.6291689351083347 distance-from-start_mean 0.6291689351083347 distance-from-start_median 0.6291689351083347 distance-from-start_min 0.6291689351083347 driven_any_max 2.617379035765366 driven_any_mean 2.617379035765366 driven_any_median 2.617379035765366 driven_any_min 2.617379035765366 driven_lanedir_consec_max 0.02606899309120614 driven_lanedir_consec_mean 0.02606899309120614 driven_lanedir_consec_min 0.02606899309120614 driven_lanedir_max 0.029415931236242088 driven_lanedir_mean 0.029415931236242088 driven_lanedir_median 0.029415931236242088 driven_lanedir_min 0.029415931236242088 in-drivable-lane_max 8.500000000000023 in-drivable-lane_mean 8.500000000000023 in-drivable-lane_min 8.500000000000023 per-episodes details {"loop-000-ego0": {"driven_any": 2.617379035765366, "survival_time": 11.950000000000037, "driven_lanedir": 0.029415931236242088, "in-drivable-lane": 8.500000000000023, "deviation-heading": 2.556935476404166, "distance-from-start": 0.6291689351083347, "deviation-center-line": 0.3267562024231576, "driven_lanedir_consec": 0.02606899309120614}}simulation-passed 1 survival_time_max 11.950000000000037 survival_time_mean 11.950000000000037 survival_time_min 11.950000000000037
No reset possible 6272689Bea Baselines minimal-agent aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-02 18:11:53+00:00 2021-11-02 18:13:54+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.949999999999987 in-drivable-lane_median 4.349999999999986 driven_lanedir_consec_median 0.1796243236291546 deviation-center-line_median 0.13064995214824765
other stats deviation-center-line_max 0.1356245705745657 deviation-center-line_mean 0.13064995214824765 deviation-center-line_min 0.1256753337219296 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.848315713252692 deviation-heading_median 0.848315713252692 deviation-heading_min 0.7478094709473374 distance-from-start_max 0.8124268507162298 distance-from-start_mean 0.8002552992142686 distance-from-start_median 0.8002552992142686 distance-from-start_min 0.7880837477123075 driven_any_max 0.8124423795236627 driven_any_mean 0.8002702946322935 driven_any_median 0.8002702946322935 driven_any_min 0.7880982097409241 driven_lanedir_consec_max 0.19955231542410212 driven_lanedir_consec_mean 0.1796243236291546 driven_lanedir_consec_min 0.15969633183420706 driven_lanedir_max 0.19955231542410212 driven_lanedir_mean 0.1796243236291546 driven_lanedir_median 0.1796243236291546 driven_lanedir_min 0.15969633183420706 in-drivable-lane_max 4.499999999999987 in-drivable-lane_mean 4.349999999999986 in-drivable-lane_min 4.199999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 0.8124423795236627, "survival_time": 5.949999999999987, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 4.199999999999986, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.8124268507162298, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}, "loop2-000-ego1": {"driven_any": 0.7880982097409241, "survival_time": 5.949999999999987, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 4.499999999999987, "deviation-heading": 0.7478094709473374, "distance-from-start": 0.7880837477123075, "deviation-center-line": 0.1356245705745657, "driven_lanedir_consec": 0.15969633183420706}}simulation-passed 1 survival_time_max 5.949999999999987 survival_time_mean 5.949999999999987 survival_time_min 5.949999999999987
No reset possible 6239385Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 05:41:58+00:00 2021-11-01 06:01:02+00:00 0:19:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.224999999999405 driven_lanedir_consec_median -4.074592000813068 deviation-center-line_median 2.1060929554243177
other stats deviation-center-line_max 5.9616222103163485 deviation-center-line_mean 2.9788867483581782 deviation-center-line_min 1.7417388722677276 deviation-heading_max 33.24619364811963 deviation-heading_mean 28.140780470558777 deviation-heading_median 27.60473850556142 deviation-heading_min 24.107451222992633 distance-from-start_max 0.22137663391621015 distance-from-start_mean 0.18374989297762995 distance-from-start_median 0.17491811241269112 distance-from-start_min 0.16378671316892732 driven_any_max 13.93110975466768 driven_any_mean 13.156386973983969 driven_any_median 13.013918250122728 driven_any_min 12.666601641022735 driven_lanedir_consec_max -3.777815846390818 driven_lanedir_consec_mean -4.029022126376116 driven_lanedir_consec_min -4.18908865748751 driven_lanedir_max -3.777815846390818 driven_lanedir_mean -5.209633941992003 driven_lanedir_median -4.33977067712706 driven_lanedir_min -8.381178567323076 in-drivable-lane_max 30.84999999999932 in-drivable-lane_mean 23.69999999999949 in-drivable-lane_min 7.499999999999845 per-episodes details {"autolab-000-ego0": {"driven_any": 13.06172429747107, "survival_time": 59.99999999999873, "driven_lanedir": -4.3453453798826605, "in-drivable-lane": 30.84999999999932, "deviation-heading": 24.107451222992633, "distance-from-start": 0.1639980107456099, "deviation-center-line": 2.04653671483529, "driven_lanedir_consec": -4.040081484427288}, "autolab-000-ego1": {"driven_any": 12.666601641022735, "survival_time": 59.99999999999873, "driven_lanedir": -3.777815846390818, "in-drivable-lane": 27.149999999999363, "deviation-heading": 28.75980242805347, "distance-from-start": 0.18583821407977236, "deviation-center-line": 2.165649196013345, "driven_lanedir_consec": -3.777815846390818}, "autolab-000-ego2": {"driven_any": 13.93110975466768, "survival_time": 59.99999999999873, "driven_lanedir": -8.381178567323076, "in-drivable-lane": 7.499999999999845, "deviation-heading": 33.24619364811963, "distance-from-start": 0.22137663391621015, "deviation-center-line": 5.9616222103163485, "driven_lanedir_consec": -4.18908865748751}, "autolab-000-ego3": {"driven_any": 12.966112202774386, "survival_time": 59.99999999999873, "driven_lanedir": -4.334195974371459, "in-drivable-lane": 29.299999999999443, "deviation-heading": 26.449674583069378, "distance-from-start": 0.16378671316892732, "deviation-center-line": 1.7417388722677276, "driven_lanedir_consec": -4.109102517198847}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6234386Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 05:35:09+00:00 2021-11-01 05:41:25+00:00 0:06:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 30.499999999999133 driven_lanedir_consec_median -3.1806625967431614 deviation-center-line_median 2.2997117704448793
other stats deviation-center-line_max 2.2997117704448793 deviation-center-line_mean 2.2997117704448793 deviation-center-line_min 2.2997117704448793 deviation-heading_max 25.44368633749165 deviation-heading_mean 25.44368633749165 deviation-heading_median 25.44368633749165 deviation-heading_min 25.44368633749165 distance-from-start_max 0.1651055430705789 distance-from-start_mean 0.1651055430705789 distance-from-start_median 0.1651055430705789 distance-from-start_min 0.1651055430705789 driven_any_max 11.877103086377264 driven_any_mean 11.877103086377264 driven_any_median 11.877103086377264 driven_any_min 11.877103086377264 driven_lanedir_consec_max -3.1806625967431614 driven_lanedir_consec_mean -3.1806625967431614 driven_lanedir_consec_min -3.1806625967431614 driven_lanedir_max -3.4833276693525788 driven_lanedir_mean -3.4833276693525788 driven_lanedir_median -3.4833276693525788 driven_lanedir_min -3.4833276693525788 in-drivable-lane_max 30.499999999999133 in-drivable-lane_mean 30.499999999999133 in-drivable-lane_min 30.499999999999133 per-episodes details {"autolab-000-ego0": {"driven_any": 11.877103086377264, "survival_time": 59.99999999999873, "driven_lanedir": -3.4833276693525788, "in-drivable-lane": 30.499999999999133, "deviation-heading": 25.44368633749165, "distance-from-start": 0.1651055430705789, "deviation-center-line": 2.2997117704448793, "driven_lanedir_consec": -3.1806625967431614}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6230387Bea Baselines baseline-RL-sim-pytorch aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 05:29:17+00:00 2021-11-01 05:34:48+00:00 0:05:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.60000000000013 in-drivable-lane_median 3.6500000000000177 driven_lanedir_consec_median -1.2134425642289377 deviation-center-line_median 1.4425955690038397
other stats deviation-center-line_max 1.4425955690038397 deviation-center-line_mean 1.4425955690038397 deviation-center-line_min 1.4425955690038397 deviation-heading_max 9.000415830991354 deviation-heading_mean 9.000415830991354 deviation-heading_median 9.000415830991354 deviation-heading_min 9.000415830991354 distance-from-start_max 0.19843618849884576 distance-from-start_mean 0.19843618849884576 distance-from-start_median 0.19843618849884576 distance-from-start_min 0.19843618849884576 driven_any_max 4.002863183187873 driven_any_mean 4.002863183187873 driven_any_median 4.002863183187873 driven_any_min 4.002863183187873 driven_lanedir_consec_max -1.2134425642289377 driven_lanedir_consec_mean -1.2134425642289377 driven_lanedir_consec_min -1.2134425642289377 driven_lanedir_max -2.171795554130247 driven_lanedir_mean -2.171795554130247 driven_lanedir_median -2.171795554130247 driven_lanedir_min -2.171795554130247 in-drivable-lane_max 3.6500000000000177 in-drivable-lane_mean 3.6500000000000177 in-drivable-lane_min 3.6500000000000177 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.002863183187873, "survival_time": 18.60000000000013, "driven_lanedir": -2.171795554130247, "in-drivable-lane": 3.6500000000000177, "deviation-heading": 9.000415830991354, "distance-from-start": 0.19843618849884576, "deviation-center-line": 1.4425955690038397, "driven_lanedir_consec": -1.2134425642289377}}simulation-passed 1 survival_time_max 18.60000000000013 survival_time_mean 18.60000000000013 survival_time_min 18.60000000000013
No reset possible 6228388Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 05:27:22+00:00 2021-11-01 05:29:04+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6224389Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 05:20:02+00:00 2021-11-01 05:27:09+00:00 0:07:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 21.59999999999936 driven_lanedir_consec_median -4.767513628786313 deviation-center-line_median 3.1063335284689884
other stats deviation-center-line_max 3.1063335284689884 deviation-center-line_mean 3.1063335284689884 deviation-center-line_min 3.1063335284689884 deviation-heading_max 27.546199608366855 deviation-heading_mean 27.546199608366855 deviation-heading_median 27.546199608366855 deviation-heading_min 27.546199608366855 distance-from-start_max 0.18891118948079472 distance-from-start_mean 0.18891118948079472 distance-from-start_median 0.18891118948079472 distance-from-start_min 0.18891118948079472 driven_any_max 15.27559311681964 driven_any_mean 15.27559311681964 driven_any_median 15.27559311681964 driven_any_min 15.27559311681964 driven_lanedir_consec_max -4.767513628786313 driven_lanedir_consec_mean -4.767513628786313 driven_lanedir_consec_min -4.767513628786313 driven_lanedir_max -6.87487789670744 driven_lanedir_mean -6.87487789670744 driven_lanedir_median -6.87487789670744 driven_lanedir_min -6.87487789670744 in-drivable-lane_max 21.59999999999936 in-drivable-lane_mean 21.59999999999936 in-drivable-lane_min 21.59999999999936 per-episodes details {"4way-000-ego0": {"driven_any": 15.27559311681964, "survival_time": 59.99999999999873, "driven_lanedir": -6.87487789670744, "in-drivable-lane": 21.59999999999936, "deviation-heading": 27.546199608366855, "distance-from-start": 0.18891118948079472, "deviation-center-line": 3.1063335284689884, "driven_lanedir_consec": -4.767513628786313}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6222389Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 05:17:36+00:00 2021-11-01 05:19:38+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6217390Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 05:12:36+00:00 2021-11-01 05:17:22+00:00 0:04:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -3.469173285658812 survival_time_median 59.99999999999873 deviation-center-line_median 2.564865222840027 in-drivable-lane_median 23.499999999999524
other stats deviation-center-line_max 2.564865222840027 deviation-center-line_mean 2.564865222840027 deviation-center-line_min 2.564865222840027 deviation-heading_max 28.846025987419967 deviation-heading_mean 28.846025987419967 deviation-heading_median 28.846025987419967 deviation-heading_min 28.846025987419967 distance-from-start_max 0.24245142236640785 distance-from-start_mean 0.24245142236640785 distance-from-start_median 0.24245142236640785 distance-from-start_min 0.24245142236640785 driven_any_max 12.18896057929192 driven_any_mean 12.18896057929192 driven_any_median 12.18896057929192 driven_any_min 12.18896057929192 driven_lanedir_consec_max -3.469173285658812 driven_lanedir_consec_mean -3.469173285658812 driven_lanedir_consec_min -3.469173285658812 driven_lanedir_max -3.7388231305317063 driven_lanedir_mean -3.7388231305317063 driven_lanedir_median -3.7388231305317063 driven_lanedir_min -3.7388231305317063 in-drivable-lane_max 23.499999999999524 in-drivable-lane_mean 23.499999999999524 in-drivable-lane_min 23.499999999999524 per-episodes details {"loop2-000-ego0": {"driven_any": 12.18896057929192, "survival_time": 59.99999999999873, "driven_lanedir": -3.7388231305317063, "in-drivable-lane": 23.499999999999524, "deviation-heading": 28.846025987419967, "distance-from-start": 0.24245142236640785, "deviation-center-line": 2.564865222840027, "driven_lanedir_consec": -3.469173285658812}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6216391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-1of4 host-error no gpu-staging-spot-0-032021-11-01 05:11:06+00:00 2021-11-01 05:12:30+00:00 0:01:24 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:
error in ego2 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6215391Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-validationsim-0of4 host-error no gpu-staging-spot-0-032021-11-01 05:09:22+00:00 2021-11-01 05:10:54+00:00 0:01:32 InvalidEnvironment:
[...] InvalidEnvironment:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:
error in ego1 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 306, in main
raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 338, in read_reply
raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error:
error in ego1 |Unexpected error:
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
|| call_if_fun_exists(node, "init", context=context_data)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/workspace/solution.py", line 38, in init
|| self.model = DDPG(state_dim=self.image_processor.shape, action_dim=2, max_action=1, net_type="cnn")
|| File "/workspace/model.py", line 160, in __init__
|| self.actor = ActorCNN(action_dim, max_action).to(device)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 612, in to
|| return self._apply(convert)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 359, in _apply
|| module._apply(fn)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 381, in _apply
|| param_applied = fn(param)
|| File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 610, in convert
|| return t.to(device, dtype if t.is_floating_point() else None, non_blocking)
|| RuntimeError: CUDA error: out of memory
||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6209392Bea Baselines baseline-RL-sim-pytorch aido-LFV_multi-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 05:01:04+00:00 2021-11-01 05:08:51+00:00 0:07:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.849999999999156 driven_lanedir_consec_median -2.1419119746484276 deviation-center-line_median 3.360637729653683
other stats deviation-center-line_max 4.022501758896335 deviation-center-line_mean 3.360637729653683 deviation-center-line_min 2.698773700411031 deviation-heading_max 27.725141295226916 deviation-heading_mean 25.60183092238656 deviation-heading_median 25.60183092238656 deviation-heading_min 23.4785205495462 distance-from-start_max 0.1459126604942941 distance-from-start_mean 0.136579163842971 distance-from-start_median 0.136579163842971 distance-from-start_min 0.1272456671916479 driven_any_max 10.769931572144536 driven_any_mean 10.485031218478394 driven_any_median 10.485031218478394 driven_any_min 10.200130864812252 driven_lanedir_consec_max -2.0062599101660723 driven_lanedir_consec_mean -2.1419119746484276 driven_lanedir_consec_min -2.277564039130783 driven_lanedir_max -2.0062599101660723 driven_lanedir_mean -2.1419119746484276 driven_lanedir_median -2.1419119746484276 driven_lanedir_min -2.277564039130783 in-drivable-lane_max 34.149999999999096 in-drivable-lane_mean 28.849999999999156 in-drivable-lane_min 23.549999999999216 per-episodes details {"loop2-000-ego0": {"driven_any": 10.200130864812252, "survival_time": 59.99999999999873, "driven_lanedir": -2.0062599101660723, "in-drivable-lane": 23.549999999999216, "deviation-heading": 27.725141295226916, "distance-from-start": 0.1459126604942941, "deviation-center-line": 4.022501758896335, "driven_lanedir_consec": -2.0062599101660723}, "loop2-000-ego1": {"driven_any": 10.769931572144536, "survival_time": 59.99999999999873, "driven_lanedir": -2.277564039130783, "in-drivable-lane": 34.149999999999096, "deviation-heading": 23.4785205495462, "distance-from-start": 0.1272456671916479, "deviation-center-line": 2.698773700411031, "driven_lanedir_consec": -2.277564039130783}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6205393Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 04:55:43+00:00 2021-11-01 05:00:36+00:00 0:04:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 21.19999999999942 driven_lanedir_consec_median -2.687169178370635 deviation-center-line_median 3.504836614230604
other stats deviation-center-line_max 3.504836614230604 deviation-center-line_mean 3.504836614230604 deviation-center-line_min 3.504836614230604 deviation-heading_max 29.262056412502144 deviation-heading_mean 29.262056412502144 deviation-heading_median 29.262056412502144 deviation-heading_min 29.262056412502144 distance-from-start_max 0.1437752781130328 distance-from-start_mean 0.1437752781130328 distance-from-start_median 0.1437752781130328 distance-from-start_min 0.1437752781130328 driven_any_max 10.772342401365052 driven_any_mean 10.772342401365052 driven_any_median 10.772342401365052 driven_any_min 10.772342401365052 driven_lanedir_consec_max -2.687169178370635 driven_lanedir_consec_mean -2.687169178370635 driven_lanedir_consec_min -2.687169178370635 driven_lanedir_max -2.687169178370635 driven_lanedir_mean -2.687169178370635 driven_lanedir_median -2.687169178370635 driven_lanedir_min -2.687169178370635 in-drivable-lane_max 21.19999999999942 in-drivable-lane_mean 21.19999999999942 in-drivable-lane_min 21.19999999999942 per-episodes details {"loop2-000-ego0": {"driven_any": 10.772342401365052, "survival_time": 59.99999999999873, "driven_lanedir": -2.687169178370635, "in-drivable-lane": 21.19999999999942, "deviation-heading": 29.262056412502144, "distance-from-start": 0.1437752781130328, "deviation-center-line": 3.504836614230604, "driven_lanedir_consec": -2.687169178370635}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6202393Bea Baselines baseline-RL-sim-pytorch aido-LFP-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-01 04:49:06+00:00 2021-11-01 04:55:31+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 34.64999999999904 driven_lanedir_consec_median -2.472740715234149 deviation-center-line_median 2.655423117577218
other stats deviation-center-line_max 2.655423117577218 deviation-center-line_mean 2.655423117577218 deviation-center-line_min 2.655423117577218 deviation-heading_max 22.903636813058295 deviation-heading_mean 22.903636813058295 deviation-heading_median 22.903636813058295 deviation-heading_min 22.903636813058295 distance-from-start_max 0.14207781252769106 distance-from-start_mean 0.14207781252769106 distance-from-start_median 0.14207781252769106 distance-from-start_min 0.14207781252769106 driven_any_max 10.61487240008348 driven_any_mean 10.61487240008348 driven_any_median 10.61487240008348 driven_any_min 10.61487240008348 driven_lanedir_consec_max -2.472740715234149 driven_lanedir_consec_mean -2.472740715234149 driven_lanedir_consec_min -2.472740715234149 driven_lanedir_max -2.472740715234149 driven_lanedir_mean -2.472740715234149 driven_lanedir_median -2.472740715234149 driven_lanedir_min -2.472740715234149 in-drivable-lane_max 34.64999999999904 in-drivable-lane_mean 34.64999999999904 in-drivable-lane_min 34.64999999999904 per-episodes details {"autolab-000-ego0": {"driven_any": 10.61487240008348, "survival_time": 59.99999999999873, "driven_lanedir": -2.472740715234149, "in-drivable-lane": 34.64999999999904, "deviation-heading": 22.903636813058295, "distance-from-start": 0.14207781252769106, "deviation-center-line": 2.655423117577218, "driven_lanedir_consec": -2.472740715234149}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6201394Bea Baselines baseline-RL-sim-pytorch aido-LFV-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 04:46:34+00:00 2021-11-01 04:48:59+00:00 0:02:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.549999999999986 in-drivable-lane_median 4.699999999999993 driven_lanedir_consec_median -0.4546944906864485 deviation-center-line_median 0.1393771149141514
other stats deviation-center-line_max 0.1393771149141514 deviation-center-line_mean 0.1393771149141514 deviation-center-line_min 0.1393771149141514 deviation-heading_max 3.2830062342605717 deviation-heading_mean 3.2830062342605717 deviation-heading_median 3.2830062342605717 deviation-heading_min 3.2830062342605717 distance-from-start_max 0.1548117984782586 distance-from-start_mean 0.1548117984782586 distance-from-start_median 0.1548117984782586 distance-from-start_min 0.1548117984782586 driven_any_max 1.384534691871151 driven_any_mean 1.384534691871151 driven_any_median 1.384534691871151 driven_any_min 1.384534691871151 driven_lanedir_consec_max -0.4546944906864485 driven_lanedir_consec_mean -0.4546944906864485 driven_lanedir_consec_min -0.4546944906864485 driven_lanedir_max -0.4546944906864485 driven_lanedir_mean -0.4546944906864485 driven_lanedir_median -0.4546944906864485 driven_lanedir_min -0.4546944906864485 in-drivable-lane_max 4.699999999999993 in-drivable-lane_mean 4.699999999999993 in-drivable-lane_min 4.699999999999993 per-episodes details {"loop2-000-ego0": {"driven_any": 1.384534691871151, "survival_time": 8.549999999999986, "driven_lanedir": -0.4546944906864485, "in-drivable-lane": 4.699999999999993, "deviation-heading": 3.2830062342605717, "distance-from-start": 0.1548117984782586, "deviation-center-line": 0.1393771149141514, "driven_lanedir_consec": -0.4546944906864485}}simulation-passed 1 survival_time_max 8.549999999999986 survival_time_mean 8.549999999999986 survival_time_min 8.549999999999986
No reset possible 6199394Bea Baselines baseline-RL-sim-pytorch aido-LFV-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-01 04:43:28+00:00 2021-11-01 04:46:16+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.849999999999984 in-drivable-lane_median 2.8999999999999915 driven_lanedir_consec_median -0.4444956426473472 deviation-center-line_median 0.10615791062777474
other stats deviation-center-line_max 0.10615791062777474 deviation-center-line_mean 0.10615791062777474 deviation-center-line_min 0.10615791062777474 deviation-heading_max 2.968818230110452 deviation-heading_mean 2.968818230110452 deviation-heading_median 2.968818230110452 deviation-heading_min 2.968818230110452 distance-from-start_max 0.16379790936858146 distance-from-start_mean 0.16379790936858146 distance-from-start_median 0.16379790936858146 distance-from-start_min 0.16379790936858146 driven_any_max 1.1901660151651656 driven_any_mean 1.1901660151651656 driven_any_median 1.1901660151651656 driven_any_min 1.1901660151651656 driven_lanedir_consec_max -0.4444956426473472 driven_lanedir_consec_mean -0.4444956426473472 driven_lanedir_consec_min -0.4444956426473472 driven_lanedir_max -0.4444956426473472 driven_lanedir_mean -0.4444956426473472 driven_lanedir_median -0.4444956426473472 driven_lanedir_min -0.4444956426473472 in-drivable-lane_max 2.8999999999999915 in-drivable-lane_mean 2.8999999999999915 in-drivable-lane_min 2.8999999999999915 per-episodes details {"autolab-000-ego0": {"driven_any": 1.1901660151651656, "survival_time": 6.849999999999984, "driven_lanedir": -0.4444956426473472, "in-drivable-lane": 2.8999999999999915, "deviation-heading": 2.968818230110452, "distance-from-start": 0.16379790936858146, "deviation-center-line": 0.10615791062777474, "driven_lanedir_consec": -0.4444956426473472}}simulation-passed 1 survival_time_max 6.849999999999984 survival_time_mean 6.849999999999984 survival_time_min 6.849999999999984
No reset possible 6197395Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 04:41:37+00:00 2021-11-01 04:43:08+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6194395Bea Baselines baseline-RL-sim-pytorch aido-LFVI-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 04:38:15+00:00 2021-11-01 04:41:30+00:00 0:03:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.299999999999995 in-drivable-lane_median 1.649999999999999 driven_lanedir_consec_median -0.1529948401842014 deviation-center-line_median 0.3613992091484364
other stats deviation-center-line_max 0.3613992091484364 deviation-center-line_mean 0.3613992091484364 deviation-center-line_min 0.3613992091484364 deviation-heading_max 6.37137180084792 deviation-heading_mean 6.37137180084792 deviation-heading_median 6.37137180084792 deviation-heading_min 6.37137180084792 distance-from-start_max 0.15624766017389352 distance-from-start_mean 0.15624766017389352 distance-from-start_median 0.15624766017389352 distance-from-start_min 0.15624766017389352 driven_any_max 1.2920819064825122 driven_any_mean 1.2920819064825122 driven_any_median 1.2920819064825122 driven_any_min 1.2920819064825122 driven_lanedir_consec_max -0.1529948401842014 driven_lanedir_consec_mean -0.1529948401842014 driven_lanedir_consec_min -0.1529948401842014 driven_lanedir_max -0.15137254147763324 driven_lanedir_mean -0.15137254147763324 driven_lanedir_median -0.15137254147763324 driven_lanedir_min -0.15137254147763324 in-drivable-lane_max 1.649999999999999 in-drivable-lane_mean 1.649999999999999 in-drivable-lane_min 1.649999999999999 per-episodes details {"udem-000-ego0": {"driven_any": 1.2920819064825122, "survival_time": 9.299999999999995, "driven_lanedir": -0.15137254147763324, "in-drivable-lane": 1.649999999999999, "deviation-heading": 6.37137180084792, "distance-from-start": 0.15624766017389352, "deviation-center-line": 0.3613992091484364, "driven_lanedir_consec": -0.1529948401842014}}simulation-passed 1 survival_time_max 9.299999999999995 survival_time_mean 9.299999999999995 survival_time_min 9.299999999999995
No reset possible 6193396Bea Baselines baseline-RL-sim-pytorch aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 04:36:31+00:00 2021-11-01 04:38:02+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6187398Bea Baselines baseline-RL-sim-pytorch aido-LFVI_multi-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 04:32:45+00:00 2021-11-01 04:36:18+00:00 0:03:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6185514Bea Baselines baseline-behavior-cloning aido-LFV_multi-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-01 04:31:23+00:00 2021-11-01 04:32:33+00:00 0:01:10 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6178515Bea Baselines baseline-behavior-cloning aido-LFP-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-01 04:29:50+00:00 2021-11-01 04:30:50+00:00 0:01:00 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6172517Bea Baselines baseline-behavior-cloning aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 04:27:47+00:00 2021-11-01 04:29:23+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6167518Bea Baselines baseline-behavior-cloning aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 04:25:53+00:00 2021-11-01 04:27:22+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6161519Bea Baselines baseline-behavior-cloning aido-LF-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-01 04:24:26+00:00 2021-11-01 04:25:21+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6156520Bea Baselines baseline-behavior-cloning aido-LFVI_multi-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-01 04:22:54+00:00 2021-11-01 04:24:00+00:00 0:01:06 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6133528Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 04:07:55+00:00 2021-11-01 04:22:34+00:00 0:14:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.8000000000000047 driven_lanedir_consec_median 9.576624766315131 deviation-center-line_median 3.1185189650539975
other stats deviation-center-line_max 3.448561142109162 deviation-center-line_mean 3.1174981139373017 deviation-center-line_min 2.7843933835320507 deviation-heading_max 16.886287852080468 deviation-heading_mean 15.228711049075285 deviation-heading_median 15.431934090808674 deviation-heading_min 13.164688162603314 distance-from-start_max 3.2727646225638383 distance-from-start_mean 2.7699656747995767 distance-from-start_median 2.9060215563334015 distance-from-start_min 1.9950549639676656 driven_any_max 11.127980740690338 driven_any_mean 10.712319936982382 driven_any_median 10.679395410815545 driven_any_min 10.36250818560811 driven_lanedir_consec_max 10.667165484033172 driven_lanedir_consec_mean 9.78350968613624 driven_lanedir_consec_min 9.313623727881527 driven_lanedir_max 10.667165484033172 driven_lanedir_mean 9.78350968613624 driven_lanedir_median 9.576624766315131 driven_lanedir_min 9.313623727881527 in-drivable-lane_max 2.3999999999999027 in-drivable-lane_mean 1.6124999999999716 in-drivable-lane_min 0.4499999999999744 per-episodes details {"loop-000-ego0": {"driven_any": 11.127980740690338, "survival_time": 59.99999999999873, "driven_lanedir": 10.667165484033172, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 13.164688162603314, "distance-from-start": 1.9950549639676656, "deviation-center-line": 2.7843933835320507, "driven_lanedir_consec": 10.667165484033172}, "loop-000-ego1": {"driven_any": 10.873073512440984, "survival_time": 59.99999999999873, "driven_lanedir": 9.78053337853676, "in-drivable-lane": 1.750000000000008, "deviation-heading": 16.886287852080468, "distance-from-start": 3.234343402319753, "deviation-center-line": 3.448561142109162, "driven_lanedir_consec": 9.78053337853676}, "loop-000-ego2": {"driven_any": 10.485717309190102, "survival_time": 59.99999999999873, "driven_lanedir": 9.313623727881527, "in-drivable-lane": 2.3999999999999027, "deviation-heading": 15.738073548877695, "distance-from-start": 3.2727646225638383, "deviation-center-line": 3.1266244941400467, "driven_lanedir_consec": 9.313623727881527}, "loop-000-ego3": {"driven_any": 10.36250818560811, "survival_time": 59.99999999999873, "driven_lanedir": 9.3727161540935, "in-drivable-lane": 1.8500000000000016, "deviation-heading": 15.125794632739652, "distance-from-start": 2.5776997103470496, "deviation-center-line": 3.110413435967948, "driven_lanedir_consec": 9.3727161540935}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6132528Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-01 04:06:30+00:00 2021-11-01 04:07:43+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6129529Bea Baselines baseline-dagger-pytorch aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 04:04:23+00:00 2021-11-01 04:06:07+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.999999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.982362836590532 deviation-center-line_median 0.3088502407427119
other stats deviation-center-line_max 0.3088502407427119 deviation-center-line_mean 0.3088502407427119 deviation-center-line_min 0.3088502407427119 deviation-heading_max 1.3284352310530148 deviation-heading_mean 1.3284352310530148 deviation-heading_median 1.3284352310530148 deviation-heading_min 1.3284352310530148 distance-from-start_max 0.7708540090430465 distance-from-start_mean 0.7708540090430465 distance-from-start_median 0.7708540090430465 distance-from-start_min 0.7708540090430465 driven_any_max 1.0047214266678608 driven_any_mean 1.0047214266678608 driven_any_median 1.0047214266678608 driven_any_min 1.0047214266678608 driven_lanedir_consec_max 0.982362836590532 driven_lanedir_consec_mean 0.982362836590532 driven_lanedir_consec_min 0.982362836590532 driven_lanedir_max 0.982362836590532 driven_lanedir_mean 0.982362836590532 driven_lanedir_median 0.982362836590532 driven_lanedir_min 0.982362836590532 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 1.0047214266678608, "survival_time": 5.999999999999987, "driven_lanedir": 0.982362836590532, "in-drivable-lane": 0.0, "deviation-heading": 1.3284352310530148, "distance-from-start": 0.7708540090430465, "deviation-center-line": 0.3088502407427119, "driven_lanedir_consec": 0.982362836590532}}simulation-passed 1 survival_time_max 5.999999999999987 survival_time_mean 5.999999999999987 survival_time_min 5.999999999999987
No reset possible 6119531Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 03:53:52+00:00 2021-11-01 04:04:03+00:00 0:10:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 54.14999999999906 in-drivable-lane_median 0.5500000000000007 driven_lanedir_consec_median 8.400353015155764 deviation-center-line_median 3.3171125913290043
other stats deviation-center-line_max 3.3171125913290043 deviation-center-line_mean 3.3171125913290043 deviation-center-line_min 3.3171125913290043 deviation-heading_max 13.647621601261806 deviation-heading_mean 13.647621601261806 deviation-heading_median 13.647621601261806 deviation-heading_min 13.647621601261806 distance-from-start_max 3.0150257825342948 distance-from-start_mean 3.0150257825342948 distance-from-start_median 3.0150257825342948 distance-from-start_min 3.0150257825342948 driven_any_max 9.352727152636083 driven_any_mean 9.352727152636083 driven_any_median 9.352727152636083 driven_any_min 9.352727152636083 driven_lanedir_consec_max 8.400353015155764 driven_lanedir_consec_mean 8.400353015155764 driven_lanedir_consec_min 8.400353015155764 driven_lanedir_max 8.675704944451388 driven_lanedir_mean 8.675704944451388 driven_lanedir_median 8.675704944451388 driven_lanedir_min 8.675704944451388 in-drivable-lane_max 0.5500000000000007 in-drivable-lane_mean 0.5500000000000007 in-drivable-lane_min 0.5500000000000007 per-episodes details {"4way-000-ego0": {"driven_any": 9.352727152636083, "survival_time": 54.14999999999906, "driven_lanedir": 8.675704944451388, "in-drivable-lane": 0.5500000000000007, "deviation-heading": 13.647621601261806, "distance-from-start": 3.0150257825342948, "deviation-center-line": 3.3171125913290043, "driven_lanedir_consec": 8.400353015155764}}simulation-passed 1 survival_time_max 54.14999999999906 survival_time_mean 54.14999999999906 survival_time_min 54.14999999999906
No reset possible 6112533Bea Baselines baseline-dagger-pytorch aido-LF-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:46:41+00:00 2021-11-01 03:53:31+00:00 0:06:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 10.620552192979485 survival_time_median 59.99999999999873 deviation-center-line_median 2.7662007391016448 in-drivable-lane_median 0.0
other stats deviation-center-line_max 2.7662007391016448 deviation-center-line_mean 2.7662007391016448 deviation-center-line_min 2.7662007391016448 deviation-heading_max 11.120030069977442 deviation-heading_mean 11.120030069977442 deviation-heading_median 11.120030069977442 deviation-heading_min 11.120030069977442 distance-from-start_max 1.079230965768263 distance-from-start_mean 1.079230965768263 distance-from-start_median 1.079230965768263 distance-from-start_min 1.079230965768263 driven_any_max 10.895037378082682 driven_any_mean 10.895037378082682 driven_any_median 10.895037378082682 driven_any_min 10.895037378082682 driven_lanedir_consec_max 10.620552192979485 driven_lanedir_consec_mean 10.620552192979485 driven_lanedir_consec_min 10.620552192979485 driven_lanedir_max 10.620552192979485 driven_lanedir_mean 10.620552192979485 driven_lanedir_median 10.620552192979485 driven_lanedir_min 10.620552192979485 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 10.895037378082682, "survival_time": 59.99999999999873, "driven_lanedir": 10.620552192979485, "in-drivable-lane": 0.0, "deviation-heading": 11.120030069977442, "distance-from-start": 1.079230965768263, "deviation-center-line": 2.7662007391016448, "driven_lanedir_consec": 10.620552192979485}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6107534Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 03:44:50+00:00 2021-11-01 03:46:21+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6105534Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 03:43:30+00:00 2021-11-01 03:44:31+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 6104535Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-11-01 03:42:04+00:00 2021-11-01 03:43:23+00:00 0:01:19 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6103535Bea Baselines baseline-dagger-pytorch aido-LFV_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-032021-11-01 03:40:43+00:00 2021-11-01 03:41:57+00:00 0:01:14 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6102536Bea Baselines baseline-dagger-pytorch aido-LFP-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 03:38:51+00:00 2021-11-01 03:40:23+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.299999999999989 in-drivable-lane_median 0.4000000000000003 driven_lanedir_consec_median 0.5030087419909126 deviation-center-line_median 0.3468466497971513
other stats deviation-center-line_max 0.3468466497971513 deviation-center-line_mean 0.3468466497971513 deviation-center-line_min 0.3468466497971513 deviation-heading_max 2.393041697305836 deviation-heading_mean 2.393041697305836 deviation-heading_median 2.393041697305836 deviation-heading_min 2.393041697305836 distance-from-start_max 0.5333793678342826 distance-from-start_mean 0.5333793678342826 distance-from-start_median 0.5333793678342826 distance-from-start_min 0.5333793678342826 driven_any_max 0.6345646450960469 driven_any_mean 0.6345646450960469 driven_any_median 0.6345646450960469 driven_any_min 0.6345646450960469 driven_lanedir_consec_max 0.5030087419909126 driven_lanedir_consec_mean 0.5030087419909126 driven_lanedir_consec_min 0.5030087419909126 driven_lanedir_max 0.5030087419909126 driven_lanedir_mean 0.5030087419909126 driven_lanedir_median 0.5030087419909126 driven_lanedir_min 0.5030087419909126 in-drivable-lane_max 0.4000000000000003 in-drivable-lane_mean 0.4000000000000003 in-drivable-lane_min 0.4000000000000003 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.6345646450960469, "survival_time": 5.299999999999989, "driven_lanedir": 0.5030087419909126, "in-drivable-lane": 0.4000000000000003, "deviation-heading": 2.393041697305836, "distance-from-start": 0.5333793678342826, "deviation-center-line": 0.3468466497971513, "driven_lanedir_consec": 0.5030087419909126}}simulation-passed 1 survival_time_max 5.299999999999989 survival_time_mean 5.299999999999989 survival_time_min 5.299999999999989
No reset possible 6098536Bea Baselines baseline-dagger-pytorch aido-LFP-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:36:52+00:00 2021-11-01 03:38:39+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.800000000000033 in-drivable-lane_median 3.950000000000033 driven_lanedir_consec_median 1.1589786614675637 deviation-center-line_median 0.522926488670938
other stats deviation-center-line_max 0.522926488670938 deviation-center-line_mean 0.522926488670938 deviation-center-line_min 0.522926488670938 deviation-heading_max 4.097036502770141 deviation-heading_mean 4.097036502770141 deviation-heading_median 4.097036502770141 deviation-heading_min 4.097036502770141 distance-from-start_max 1.4300825229602276 distance-from-start_mean 1.4300825229602276 distance-from-start_median 1.4300825229602276 distance-from-start_min 1.4300825229602276 driven_any_max 2.1270425121690923 driven_any_mean 2.1270425121690923 driven_any_median 2.1270425121690923 driven_any_min 2.1270425121690923 driven_lanedir_consec_max 1.1589786614675637 driven_lanedir_consec_mean 1.1589786614675637 driven_lanedir_consec_min 1.1589786614675637 driven_lanedir_max 1.1589786614675637 driven_lanedir_mean 1.1589786614675637 driven_lanedir_median 1.1589786614675637 driven_lanedir_min 1.1589786614675637 in-drivable-lane_max 3.950000000000033 in-drivable-lane_mean 3.950000000000033 in-drivable-lane_min 3.950000000000033 per-episodes details {"loop2-000-ego0": {"driven_any": 2.1270425121690923, "survival_time": 11.800000000000033, "driven_lanedir": 1.1589786614675637, "in-drivable-lane": 3.950000000000033, "deviation-heading": 4.097036502770141, "distance-from-start": 1.4300825229602276, "deviation-center-line": 0.522926488670938, "driven_lanedir_consec": 1.1589786614675637}}simulation-passed 1 survival_time_max 11.800000000000033 survival_time_mean 11.800000000000033 survival_time_min 11.800000000000033
No reset possible 6092537Bea Baselines baseline-dagger-pytorch aido-LFV-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:32:48+00:00 2021-11-01 03:36:39+00:00 0:03:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 25.900000000000233 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.442078147209961 deviation-center-line_median 1.4757476401929543
other stats deviation-center-line_max 1.4757476401929543 deviation-center-line_mean 1.4757476401929543 deviation-center-line_min 1.4757476401929543 deviation-heading_max 6.206173133588676 deviation-heading_mean 6.206173133588676 deviation-heading_median 6.206173133588676 deviation-heading_min 6.206173133588676 distance-from-start_max 1.1093244778558051 distance-from-start_mean 1.1093244778558051 distance-from-start_median 1.1093244778558051 distance-from-start_min 1.1093244778558051 driven_any_max 4.622647740138908 driven_any_mean 4.622647740138908 driven_any_median 4.622647740138908 driven_any_min 4.622647740138908 driven_lanedir_consec_max 4.442078147209961 driven_lanedir_consec_mean 4.442078147209961 driven_lanedir_consec_min 4.442078147209961 driven_lanedir_max 4.442078147209961 driven_lanedir_mean 4.442078147209961 driven_lanedir_median 4.442078147209961 driven_lanedir_min 4.442078147209961 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 4.622647740138908, "survival_time": 25.900000000000233, "driven_lanedir": 4.442078147209961, "in-drivable-lane": 0.0, "deviation-heading": 6.206173133588676, "distance-from-start": 1.1093244778558051, "deviation-center-line": 1.4757476401929543, "driven_lanedir_consec": 4.442078147209961}}simulation-passed 1 survival_time_max 25.900000000000233 survival_time_mean 25.900000000000233 survival_time_min 25.900000000000233
No reset possible 6086538Bea Baselines baseline-dagger-pytorch aido-LFVI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-01 03:30:05+00:00 2021-11-01 03:32:41+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.899999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7588801814911259 deviation-center-line_median 0.3032905883566949
other stats deviation-center-line_max 0.3032905883566949 deviation-center-line_mean 0.3032905883566949 deviation-center-line_min 0.3032905883566949 deviation-heading_max 1.7183721131884906 deviation-heading_mean 1.7183721131884906 deviation-heading_median 1.7183721131884906 deviation-heading_min 1.7183721131884906 distance-from-start_max 0.6996866220603754 distance-from-start_mean 0.6996866220603754 distance-from-start_median 0.6996866220603754 distance-from-start_min 0.6996866220603754 driven_any_max 0.7976786551991659 driven_any_mean 0.7976786551991659 driven_any_median 0.7976786551991659 driven_any_min 0.7976786551991659 driven_lanedir_consec_max 0.7588801814911259 driven_lanedir_consec_mean 0.7588801814911259 driven_lanedir_consec_min 0.7588801814911259 driven_lanedir_max 0.7588801814911259 driven_lanedir_mean 0.7588801814911259 driven_lanedir_median 0.7588801814911259 driven_lanedir_min 0.7588801814911259 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.7976786551991659, "survival_time": 5.899999999999987, "driven_lanedir": 0.7588801814911259, "in-drivable-lane": 0.0, "deviation-heading": 1.7183721131884906, "distance-from-start": 0.6996866220603754, "deviation-center-line": 0.3032905883566949, "driven_lanedir_consec": 0.7588801814911259}}simulation-passed 1 survival_time_max 5.899999999999987 survival_time_mean 5.899999999999987 survival_time_min 5.899999999999987
No reset possible 6079539Bea Baselines baseline-dagger-pytorch aido-LFI-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-01 03:28:13+00:00 2021-11-01 03:29:59+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.599999999999995 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4426047788629004 deviation-center-line_median 0.22507061267262013
other stats deviation-center-line_max 0.22507061267262013 deviation-center-line_mean 0.22507061267262013 deviation-center-line_min 0.22507061267262013 deviation-heading_max 1.3183214187610317 deviation-heading_mean 1.3183214187610317 deviation-heading_median 1.3183214187610317 deviation-heading_min 1.3183214187610317 distance-from-start_max 0.4478334814600798 distance-from-start_mean 0.4478334814600798 distance-from-start_median 0.4478334814600798 distance-from-start_min 0.4478334814600798 driven_any_max 0.4687478546755566 driven_any_mean 0.4687478546755566 driven_any_median 0.4687478546755566 driven_any_min 0.4687478546755566 driven_lanedir_consec_max 0.4426047788629004 driven_lanedir_consec_mean 0.4426047788629004 driven_lanedir_consec_min 0.4426047788629004 driven_lanedir_max 0.4426047788629004 driven_lanedir_mean 0.4426047788629004 driven_lanedir_median 0.4426047788629004 driven_lanedir_min 0.4426047788629004 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.4687478546755566, "survival_time": 3.599999999999995, "driven_lanedir": 0.4426047788629004, "in-drivable-lane": 0.0, "deviation-heading": 1.3183214187610317, "distance-from-start": 0.4478334814600798, "deviation-center-line": 0.22507061267262013, "driven_lanedir_consec": 0.4426047788629004}}simulation-passed 1 survival_time_max 3.599999999999995 survival_time_mean 3.599999999999995 survival_time_min 3.599999999999995
No reset possible 6065541Bea Baselines baseline-dagger-pytorch aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 03:22:43+00:00 2021-11-01 03:28:05+00:00 0:05:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 8.39200232624657 survival_time_median 59.99999999999873 deviation-center-line_median 2.963460213243294 in-drivable-lane_median 4.499999999999858
other stats deviation-center-line_max 2.963460213243294 deviation-center-line_mean 2.963460213243294 deviation-center-line_min 2.963460213243294 deviation-heading_max 16.447621852797827 deviation-heading_mean 16.447621852797827 deviation-heading_median 16.447621852797827 deviation-heading_min 16.447621852797827 distance-from-start_max 2.639640087074163 distance-from-start_mean 2.639640087074163 distance-from-start_median 2.639640087074163 distance-from-start_min 2.639640087074163 driven_any_max 10.067435440643235 driven_any_mean 10.067435440643235 driven_any_median 10.067435440643235 driven_any_min 10.067435440643235 driven_lanedir_consec_max 8.39200232624657 driven_lanedir_consec_mean 8.39200232624657 driven_lanedir_consec_min 8.39200232624657 driven_lanedir_max 8.39200232624657 driven_lanedir_mean 8.39200232624657 driven_lanedir_median 8.39200232624657 driven_lanedir_min 8.39200232624657 in-drivable-lane_max 4.499999999999858 in-drivable-lane_mean 4.499999999999858 in-drivable-lane_min 4.499999999999858 per-episodes details {"loop-000-ego0": {"driven_any": 10.067435440643235, "survival_time": 59.99999999999873, "driven_lanedir": 8.39200232624657, "in-drivable-lane": 4.499999999999858, "deviation-heading": 16.447621852797827, "distance-from-start": 2.639640087074163, "deviation-center-line": 2.963460213243294, "driven_lanedir_consec": 8.39200232624657}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 6058542Bea Baselines baseline-dagger-pytorch aido-LFVI_multi-sim-testingsim-2of4 failed no gpu-staging-spot-0-032021-11-01 03:19:29+00:00 2021-11-01 03:22:37+00:00 0:03:08 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6050600Liam Paull template-tensorflow aido-LF-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-01 03:18:13+00:00 2021-11-01 03:19:16+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 6040603Bea Baselines template-ros aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 03:15:05+00:00 2021-11-01 03:17:54+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.399999999999985 in-drivable-lane_median 4.624999999999986 driven_lanedir_consec_median 0.38899306774345055 deviation-center-line_median 0.08875246782384792
other stats deviation-center-line_max 0.1585755635428669 deviation-center-line_mean 0.09682094858315138 deviation-center-line_min 0.05120329514204279 deviation-heading_max 0.7519224515029374 deviation-heading_mean 0.6075726480730824 deviation-heading_median 0.585121812648737 deviation-heading_min 0.508124515491918 distance-from-start_max 1.519669675629756 distance-from-start_mean 0.9162280354861286 distance-from-start_median 0.8402488915541667 distance-from-start_min 0.4647446832064252 driven_any_max 1.5341305995523458 driven_any_mean 0.9277028311592936 driven_any_median 0.8552583439972653 driven_any_min 0.466164037090298 driven_lanedir_consec_max 0.6310310458351296 driven_lanedir_consec_mean 0.38583733327928393 driven_lanedir_consec_min 0.13433215179510516 driven_lanedir_max 0.6310310458351296 driven_lanedir_mean 0.38583733327928393 driven_lanedir_median 0.38899306774345055 driven_lanedir_min 0.13433215179510516 in-drivable-lane_max 5.449999999999985 in-drivable-lane_mean 4.624999999999986 in-drivable-lane_min 3.7999999999999865 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.466164037090298, "survival_time": 6.399999999999985, "driven_lanedir": 0.15625568338343587, "in-drivable-lane": 5.449999999999985, "deviation-heading": 0.6103790564841887, "distance-from-start": 0.4647446832064252, "deviation-center-line": 0.05888461825834579, "driven_lanedir_consec": 0.15625568338343587}, "zigzag-000-ego1": {"driven_any": 1.5341305995523458, "survival_time": 6.399999999999985, "driven_lanedir": 0.6217304521034652, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 0.7519224515029374, "distance-from-start": 1.519669675629756, "deviation-center-line": 0.1585755635428669, "driven_lanedir_consec": 0.6217304521034652}, "zigzag-000-ego2": {"driven_any": 0.8616388948533884, "survival_time": 6.399999999999985, "driven_lanedir": 0.6310310458351296, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 0.5598645688132854, "distance-from-start": 0.8537836701619851, "deviation-center-line": 0.11862031738935006, "driven_lanedir_consec": 0.6310310458351296}, "zigzag-000-ego3": {"driven_any": 0.8488777931411422, "survival_time": 6.399999999999985, "driven_lanedir": 0.13433215179510516, "in-drivable-lane": 5.449999999999985, "deviation-heading": 0.508124515491918, "distance-from-start": 0.8267141129463483, "deviation-center-line": 0.05120329514204279, "driven_lanedir_consec": 0.13433215179510516}}simulation-passed 1 survival_time_max 6.399999999999985 survival_time_mean 6.399999999999985 survival_time_min 6.399999999999985
No reset possible 6031605Bea Baselines template-ros aido-LFV-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:12:42+00:00 2021-11-01 03:14:46+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.049999999999983 in-drivable-lane_median 4.149999999999985 driven_lanedir_consec_median 0.5756258739769404 deviation-center-line_median 0.295388565951744
other stats deviation-center-line_max 0.295388565951744 deviation-center-line_mean 0.295388565951744 deviation-center-line_min 0.295388565951744 deviation-heading_max 1.5537870132812424 deviation-heading_mean 1.5537870132812424 deviation-heading_median 1.5537870132812424 deviation-heading_min 1.5537870132812424 distance-from-start_max 1.6784177218374474 distance-from-start_mean 1.6784177218374474 distance-from-start_median 1.6784177218374474 distance-from-start_min 1.6784177218374474 driven_any_max 1.7215876515006172 driven_any_mean 1.7215876515006172 driven_any_median 1.7215876515006172 driven_any_min 1.7215876515006172 driven_lanedir_consec_max 0.5756258739769404 driven_lanedir_consec_mean 0.5756258739769404 driven_lanedir_consec_min 0.5756258739769404 driven_lanedir_max 0.5756258739769404 driven_lanedir_mean 0.5756258739769404 driven_lanedir_median 0.5756258739769404 driven_lanedir_min 0.5756258739769404 in-drivable-lane_max 4.149999999999985 in-drivable-lane_mean 4.149999999999985 in-drivable-lane_min 4.149999999999985 per-episodes details {"loop2-000-ego0": {"driven_any": 1.7215876515006172, "survival_time": 7.049999999999983, "driven_lanedir": 0.5756258739769404, "in-drivable-lane": 4.149999999999985, "deviation-heading": 1.5537870132812424, "distance-from-start": 1.6784177218374474, "deviation-center-line": 0.295388565951744, "driven_lanedir_consec": 0.5756258739769404}}simulation-passed 1 survival_time_max 7.049999999999983 survival_time_mean 7.049999999999983 survival_time_min 7.049999999999983
No reset possible 6023607Bea Baselines template-ros aido-LFI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:10:49+00:00 2021-11-01 03:12:37+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.14999999999999 in-drivable-lane_median 2.399999999999996 driven_lanedir_consec_median 0.26914076231663486 deviation-center-line_median 0.294829516108191
other stats deviation-center-line_max 0.294829516108191 deviation-center-line_mean 0.294829516108191 deviation-center-line_min 0.294829516108191 deviation-heading_max 2.905307203134681 deviation-heading_mean 2.905307203134681 deviation-heading_median 2.905307203134681 deviation-heading_min 2.905307203134681 distance-from-start_max 1.120758542688608 distance-from-start_mean 1.120758542688608 distance-from-start_median 1.120758542688608 distance-from-start_min 1.120758542688608 driven_any_max 1.152167299306562 driven_any_mean 1.152167299306562 driven_any_median 1.152167299306562 driven_any_min 1.152167299306562 driven_lanedir_consec_max 0.26914076231663486 driven_lanedir_consec_mean 0.26914076231663486 driven_lanedir_consec_min 0.26914076231663486 driven_lanedir_max 0.26914273297199287 driven_lanedir_mean 0.26914273297199287 driven_lanedir_median 0.26914273297199287 driven_lanedir_min 0.26914273297199287 in-drivable-lane_max 2.399999999999996 in-drivable-lane_mean 2.399999999999996 in-drivable-lane_min 2.399999999999996 per-episodes details {"udem1-000-ego0": {"driven_any": 1.152167299306562, "survival_time": 5.14999999999999, "driven_lanedir": 0.26914273297199287, "in-drivable-lane": 2.399999999999996, "deviation-heading": 2.905307203134681, "distance-from-start": 1.120758542688608, "deviation-center-line": 0.294829516108191, "driven_lanedir_consec": 0.26914076231663486}}simulation-passed 1 survival_time_max 5.14999999999999 survival_time_mean 5.14999999999999 survival_time_min 5.14999999999999
No reset possible 6016609Bea Baselines template-ros aido-LFVI_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:07:58+00:00 2021-11-01 03:10:36+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.1999999999999895 in-drivable-lane_median 3.3249999999999904 driven_lanedir_consec_median 0.36107590732683215 deviation-center-line_median 0.1752371722030003
other stats deviation-center-line_max 0.5341085585400743 deviation-center-line_mean 0.23549199152253764 deviation-center-line_min 0.05738506314407549 deviation-heading_max 2.064304658113812 deviation-heading_mean 1.0905924477554254 deviation-heading_median 0.9163742065925744 deviation-heading_min 0.4653167197227409 distance-from-start_max 1.1997071250554947 distance-from-start_mean 0.6817314428553569 distance-from-start_median 0.5803375093291258 distance-from-start_min 0.3665436277076817 driven_any_max 1.2780859285249695 driven_any_mean 0.7038172954122109 driven_any_median 0.5837478714702238 driven_any_min 0.3696875101834263 driven_lanedir_consec_max 0.5011674313886679 driven_lanedir_consec_mean 0.34369251020484115 driven_lanedir_consec_min 0.15145079477703227 driven_lanedir_max 0.5011674313886679 driven_lanedir_mean 0.34369251020484115 driven_lanedir_median 0.36107590732683215 driven_lanedir_min 0.15145079477703227 in-drivable-lane_max 4.249999999999989 in-drivable-lane_mean 2.7249999999999925 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.7729827336864928, "survival_time": 5.1999999999999895, "driven_lanedir": 0.15145079477703227, "in-drivable-lane": 4.249999999999989, "deviation-heading": 0.6049351190235451, "distance-from-start": 0.7683002362197409, "deviation-center-line": 0.05738506314407549, "driven_lanedir_consec": 0.15145079477703227}, "udem-000-ego1": {"driven_any": 0.3696875101834263, "survival_time": 5.1999999999999895, "driven_lanedir": 0.3437616628530522, "in-drivable-lane": 3.6999999999999886, "deviation-heading": 0.4653167197227409, "distance-from-start": 0.3665436277076817, "deviation-center-line": 0.16819140743799788, "driven_lanedir_consec": 0.3437616628530522}, "udem-000-ego2": {"driven_any": 0.3945130092539548, "survival_time": 5.1999999999999895, "driven_lanedir": 0.3783901518006121, "in-drivable-lane": 0.0, "deviation-heading": 2.064304658113812, "distance-from-start": 0.3923747824385106, "deviation-center-line": 0.5341085585400743, "driven_lanedir_consec": 0.3783901518006121}, "udem-000-ego3": {"driven_any": 1.2780859285249695, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5011674313886679, "in-drivable-lane": 2.949999999999992, "deviation-heading": 1.2278132941616038, "distance-from-start": 1.1997071250554947, "deviation-center-line": 0.1822829369680027, "driven_lanedir_consec": 0.5011674313886679}}simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.1999999999999895 survival_time_min 5.1999999999999895
No reset possible 6009611Bea Baselines template-ros aido-LFP-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 03:05:51+00:00 2021-11-01 03:07:27+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.249999999999982 in-drivable-lane_median 6.399999999999985 driven_lanedir_consec_median 0.23983457752331083 deviation-center-line_median 0.14406946767758716
other stats deviation-center-line_max 0.14406946767758716 deviation-center-line_mean 0.14406946767758716 deviation-center-line_min 0.14406946767758716 deviation-heading_max 1.6271720051107297 deviation-heading_mean 1.6271720051107297 deviation-heading_median 1.6271720051107297 deviation-heading_min 1.6271720051107297 distance-from-start_max 2.1168668679669813 distance-from-start_mean 2.1168668679669813 distance-from-start_median 2.1168668679669813 distance-from-start_min 2.1168668679669813 driven_any_max 2.146064120584192 driven_any_mean 2.146064120584192 driven_any_median 2.146064120584192 driven_any_min 2.146064120584192 driven_lanedir_consec_max 0.23983457752331083 driven_lanedir_consec_mean 0.23983457752331083 driven_lanedir_consec_min 0.23983457752331083 driven_lanedir_max 0.23983457752331083 driven_lanedir_mean 0.23983457752331083 driven_lanedir_median 0.23983457752331083 driven_lanedir_min 0.23983457752331083 in-drivable-lane_max 6.399999999999985 in-drivable-lane_mean 6.399999999999985 in-drivable-lane_min 6.399999999999985 per-episodes details {"loop-000-ego0": {"driven_any": 2.146064120584192, "survival_time": 8.249999999999982, "driven_lanedir": 0.23983457752331083, "in-drivable-lane": 6.399999999999985, "deviation-heading": 1.6271720051107297, "distance-from-start": 2.1168668679669813, "deviation-center-line": 0.14406946767758716, "driven_lanedir_consec": 0.23983457752331083}}simulation-passed 1 survival_time_max 8.249999999999982 survival_time_mean 8.249999999999982 survival_time_min 8.249999999999982
No reset possible 6003612Bea Baselines template-ros aido-LFV-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:03:12+00:00 2021-11-01 03:05:17+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.449999999999989 in-drivable-lane_median 4.699999999999989 driven_lanedir_consec_median 0.10658210376442924 deviation-center-line_median 0.04755033310589867
other stats deviation-center-line_max 0.04755033310589867 deviation-center-line_mean 0.04755033310589867 deviation-center-line_min 0.04755033310589867 deviation-heading_max 0.5816533217920152 deviation-heading_mean 0.5816533217920152 deviation-heading_median 0.5816533217920152 deviation-heading_min 0.5816533217920152 distance-from-start_max 1.349557952758952 distance-from-start_mean 1.349557952758952 distance-from-start_median 1.349557952758952 distance-from-start_min 1.349557952758952 driven_any_max 1.390348929846995 driven_any_mean 1.390348929846995 driven_any_median 1.390348929846995 driven_any_min 1.390348929846995 driven_lanedir_consec_max 0.10658210376442924 driven_lanedir_consec_mean 0.10658210376442924 driven_lanedir_consec_min 0.10658210376442924 driven_lanedir_max 0.10658210376442924 driven_lanedir_mean 0.10658210376442924 driven_lanedir_median 0.10658210376442924 driven_lanedir_min 0.10658210376442924 in-drivable-lane_max 4.699999999999989 in-drivable-lane_mean 4.699999999999989 in-drivable-lane_min 4.699999999999989 per-episodes details {"loop2-000-ego0": {"driven_any": 1.390348929846995, "survival_time": 5.449999999999989, "driven_lanedir": 0.10658210376442924, "in-drivable-lane": 4.699999999999989, "deviation-heading": 0.5816533217920152, "distance-from-start": 1.349557952758952, "deviation-center-line": 0.04755033310589867, "driven_lanedir_consec": 0.10658210376442924}}simulation-passed 1 survival_time_max 5.449999999999989 survival_time_mean 5.449999999999989 survival_time_min 5.449999999999989
No reset possible 5996614Bea Baselines template-ros aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-11-01 03:01:01+00:00 2021-11-01 03:02:57+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.5999999999999988 in-drivable-lane_median 1.6499999999999986 driven_lanedir_consec_median 0.1295201332579965 deviation-center-line_median 0.06403016470364094
other stats deviation-center-line_max 0.06403016470364094 deviation-center-line_mean 0.06403016470364094 deviation-center-line_min 0.06403016470364094 deviation-heading_max 0.6653656929248848 deviation-heading_mean 0.6653656929248848 deviation-heading_median 0.6653656929248848 deviation-heading_min 0.6653656929248848 distance-from-start_max 0.48423154784867817 distance-from-start_mean 0.48423154784867817 distance-from-start_median 0.48423154784867817 distance-from-start_min 0.48423154784867817 driven_any_max 0.48748086771846905 driven_any_mean 0.48748086771846905 driven_any_median 0.48748086771846905 driven_any_min 0.48748086771846905 driven_lanedir_consec_max 0.1295201332579965 driven_lanedir_consec_mean 0.1295201332579965 driven_lanedir_consec_min 0.1295201332579965 driven_lanedir_max 0.1295201332579965 driven_lanedir_mean 0.1295201332579965 driven_lanedir_median 0.1295201332579965 driven_lanedir_min 0.1295201332579965 in-drivable-lane_max 1.6499999999999986 in-drivable-lane_mean 1.6499999999999986 in-drivable-lane_min 1.6499999999999986 per-episodes details {"udem1-000-ego0": {"driven_any": 0.48748086771846905, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1295201332579965, "in-drivable-lane": 1.6499999999999986, "deviation-heading": 0.6653656929248848, "distance-from-start": 0.48423154784867817, "deviation-center-line": 0.06403016470364094, "driven_lanedir_consec": 0.1295201332579965}}simulation-passed 1 survival_time_max 2.5999999999999988 survival_time_mean 2.5999999999999988 survival_time_min 2.5999999999999988
No reset possible 5986618Bea Baselines baseline-duckietown aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 02:54:11+00:00 2021-11-01 03:00:26+00:00 0:06:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 28.024999999999284 driven_lanedir_consec_median 3.1086943286480704 deviation-center-line_median 2.8498830261627432
other stats deviation-center-line_max 5.119252790865685 deviation-center-line_mean 2.8498830261627432 deviation-center-line_min 0.5805132614598013 deviation-heading_max 10.438352597083954 deviation-heading_mean 6.5319677253921125 deviation-heading_median 6.5319677253921125 deviation-heading_min 2.6255828537002706 distance-from-start_max 1.42172607928982 distance-from-start_mean 1.4134325265559635 distance-from-start_median 1.4134325265559635 distance-from-start_min 1.405138973822107 driven_any_max 7.907680104944172 driven_any_mean 5.371789696297551 driven_any_median 5.371789696297551 driven_any_min 2.8358992876509292 driven_lanedir_consec_max 5.347428849523848 driven_lanedir_consec_mean 3.1086943286480704 driven_lanedir_consec_min 0.8699598077722928 driven_lanedir_max 7.118789109618072 driven_lanedir_mean 3.994374458695183 driven_lanedir_median 3.994374458695183 driven_lanedir_min 0.8699598077722928 in-drivable-lane_max 52.349999999998744 in-drivable-lane_mean 28.024999999999284 in-drivable-lane_min 3.699999999999828 per-episodes details {"loop2-000-ego0": {"driven_any": 7.907680104944172, "survival_time": 59.99999999999873, "driven_lanedir": 7.118789109618072, "in-drivable-lane": 3.699999999999828, "deviation-heading": 10.438352597083954, "distance-from-start": 1.405138973822107, "deviation-center-line": 5.119252790865685, "driven_lanedir_consec": 5.347428849523848}, "loop2-000-ego1": {"driven_any": 2.8358992876509292, "survival_time": 59.99999999999873, "driven_lanedir": 0.8699598077722928, "in-drivable-lane": 52.349999999998744, "deviation-heading": 2.6255828537002706, "distance-from-start": 1.42172607928982, "deviation-center-line": 0.5805132614598013, "driven_lanedir_consec": 0.8699598077722928}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5962646Bea Baselines template-pytorch aido-LFV_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 02:35:08+00:00 2021-11-01 02:53:55+00:00 0:18:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 41.19999999999913 driven_lanedir_consec_median 0.8833324555206393 deviation-center-line_median 1.743679023382479
other stats deviation-center-line_max 3.3752207526549576 deviation-center-line_mean 1.9002257920023904 deviation-center-line_min 0.7383243685896453 deviation-heading_max 36.69165499708608 deviation-heading_mean 19.167901462637744 deviation-heading_median 16.40996773073988 deviation-heading_min 7.160015391985135 distance-from-start_max 1.2337169811900266 distance-from-start_mean 0.5967699600437208 distance-from-start_median 0.44603076012757714 distance-from-start_min 0.26130133872970224 driven_any_max 10.328367391799556 driven_any_mean 6.097813198481105 driven_any_median 5.936468343099485 driven_any_min 2.189948715925894 driven_lanedir_consec_max 1.164870958925025 driven_lanedir_consec_mean 0.7798345435278806 driven_lanedir_consec_min 0.1878023041452188 driven_lanedir_max 2.4376906841424564 driven_lanedir_mean 1.2177146307154432 driven_lanedir_median 1.0515996715647578 driven_lanedir_min 0.3299684955898008 in-drivable-lane_max 51.04999999999869 in-drivable-lane_mean 36.84999999999927 in-drivable-lane_min 13.950000000000124 per-episodes details {"zigzag-000-ego0": {"driven_any": 8.143256553608023, "survival_time": 59.99999999999873, "driven_lanedir": 1.049609427457299, "in-drivable-lane": 44.54999999999894, "deviation-heading": 15.07260630640348, "distance-from-start": 0.41695972051358027, "deviation-center-line": 1.7633532264675955, "driven_lanedir_consec": 0.7130749953690618}, "zigzag-000-ego1": {"driven_any": 3.729680132590948, "survival_time": 59.99999999999873, "driven_lanedir": 1.0535899156722168, "in-drivable-lane": 51.04999999999869, "deviation-heading": 7.160015391985135, "distance-from-start": 0.475101799741574, "deviation-center-line": 0.7383243685896453, "driven_lanedir_consec": 1.0535899156722168}, "zigzag-000-ego2": {"driven_any": 2.189948715925894, "survival_time": 59.99999999999873, "driven_lanedir": 0.3299684955898008, "in-drivable-lane": 13.950000000000124, "deviation-heading": 36.69165499708608, "distance-from-start": 0.26130133872970224, "deviation-center-line": 3.3752207526549576, "driven_lanedir_consec": 0.1878023041452188}, "zigzag-000-ego3": {"driven_any": 10.328367391799556, "survival_time": 59.99999999999873, "driven_lanedir": 2.4376906841424564, "in-drivable-lane": 37.84999999999932, "deviation-heading": 17.74732915507628, "distance-from-start": 1.2337169811900266, "deviation-center-line": 1.7240048202973626, "driven_lanedir_consec": 1.164870958925025}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5954647Bea Baselines template-pytorch aido-LFP-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 02:27:24+00:00 2021-11-01 02:34:48+00:00 0:07:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 35.449999999999136 driven_lanedir_consec_median 2.745978103073337 deviation-center-line_median 1.7800681240258385
other stats deviation-center-line_max 1.7800681240258385 deviation-center-line_mean 1.7800681240258385 deviation-center-line_min 1.7800681240258385 deviation-heading_max 18.194828421282292 deviation-heading_mean 18.194828421282292 deviation-heading_median 18.194828421282292 deviation-heading_min 18.194828421282292 distance-from-start_max 0.3152103502640566 distance-from-start_mean 0.3152103502640566 distance-from-start_median 0.3152103502640566 distance-from-start_min 0.3152103502640566 driven_any_max 9.763058232917842 driven_any_mean 9.763058232917842 driven_any_median 9.763058232917842 driven_any_min 9.763058232917842 driven_lanedir_consec_max 2.745978103073337 driven_lanedir_consec_mean 2.745978103073337 driven_lanedir_consec_min 2.745978103073337 driven_lanedir_max 2.745978103073337 driven_lanedir_mean 2.745978103073337 driven_lanedir_median 2.745978103073337 driven_lanedir_min 2.745978103073337 in-drivable-lane_max 35.449999999999136 in-drivable-lane_mean 35.449999999999136 in-drivable-lane_min 35.449999999999136 per-episodes details {"zigzag-000-ego0": {"driven_any": 9.763058232917842, "survival_time": 59.99999999999873, "driven_lanedir": 2.745978103073337, "in-drivable-lane": 35.449999999999136, "deviation-heading": 18.194828421282292, "distance-from-start": 0.3152103502640566, "deviation-center-line": 1.7800681240258385, "driven_lanedir_consec": 2.745978103073337}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5953647Bea Baselines template-pytorch aido-LFP-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 02:25:47+00:00 2021-11-01 02:27:12+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.599999999999995 in-drivable-lane_median 2.549999999999995 driven_lanedir_consec_median 0.1182088099463312 deviation-center-line_median 0.05559495489581963
other stats deviation-center-line_max 0.05559495489581963 deviation-center-line_mean 0.05559495489581963 deviation-center-line_min 0.05559495489581963 deviation-heading_max 0.7413948819701373 deviation-heading_mean 0.7413948819701373 deviation-heading_median 0.7413948819701373 deviation-heading_min 0.7413948819701373 distance-from-start_max 0.6295794711233436 distance-from-start_mean 0.6295794711233436 distance-from-start_median 0.6295794711233436 distance-from-start_min 0.6295794711233436 driven_any_max 0.6487534079668272 driven_any_mean 0.6487534079668272 driven_any_median 0.6487534079668272 driven_any_min 0.6487534079668272 driven_lanedir_consec_max 0.1182088099463312 driven_lanedir_consec_mean 0.1182088099463312 driven_lanedir_consec_min 0.1182088099463312 driven_lanedir_max 0.1182088099463312 driven_lanedir_mean 0.1182088099463312 driven_lanedir_median 0.1182088099463312 driven_lanedir_min 0.1182088099463312 in-drivable-lane_max 2.549999999999995 in-drivable-lane_mean 2.549999999999995 in-drivable-lane_min 2.549999999999995 per-episodes details {"loop2-000-ego0": {"driven_any": 0.6487534079668272, "survival_time": 3.599999999999995, "driven_lanedir": 0.1182088099463312, "in-drivable-lane": 2.549999999999995, "deviation-heading": 0.7413948819701373, "distance-from-start": 0.6295794711233436, "deviation-center-line": 0.05559495489581963, "driven_lanedir_consec": 0.1182088099463312}}simulation-passed 1 survival_time_max 3.599999999999995 survival_time_mean 3.599999999999995 survival_time_min 3.599999999999995
No reset possible 5943648Bea Baselines template-pytorch aido-LFV-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 02:20:29+00:00 2021-11-01 02:25:35+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.100000000000108 in-drivable-lane_median 9.350000000000072 driven_lanedir_consec_median 0.7928562239601498 deviation-center-line_median 0.4029080329015884
other stats deviation-center-line_max 0.4029080329015884 deviation-center-line_mean 0.4029080329015884 deviation-center-line_min 0.4029080329015884 deviation-heading_max 6.132775400405499 deviation-heading_mean 6.132775400405499 deviation-heading_median 6.132775400405499 deviation-heading_min 6.132775400405499 distance-from-start_max 0.2088266988760759 distance-from-start_mean 0.2088266988760759 distance-from-start_median 0.2088266988760759 distance-from-start_min 0.2088266988760759 driven_any_max 2.7973399127192025 driven_any_mean 2.7973399127192025 driven_any_median 2.7973399127192025 driven_any_min 2.7973399127192025 driven_lanedir_consec_max 0.7928562239601498 driven_lanedir_consec_mean 0.7928562239601498 driven_lanedir_consec_min 0.7928562239601498 driven_lanedir_max 0.7928562239601498 driven_lanedir_mean 0.7928562239601498 driven_lanedir_median 0.7928562239601498 driven_lanedir_min 0.7928562239601498 in-drivable-lane_max 9.350000000000072 in-drivable-lane_mean 9.350000000000072 in-drivable-lane_min 9.350000000000072 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.7973399127192025, "survival_time": 17.100000000000108, "driven_lanedir": 0.7928562239601498, "in-drivable-lane": 9.350000000000072, "deviation-heading": 6.132775400405499, "distance-from-start": 0.2088266988760759, "deviation-center-line": 0.4029080329015884, "driven_lanedir_consec": 0.7928562239601498}}simulation-passed 1 survival_time_max 17.100000000000108 survival_time_mean 17.100000000000108 survival_time_min 17.100000000000108
No reset possible 5939649Bea Baselines template-pytorch aido-LFVI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 02:18:26+00:00 2021-11-01 02:20:04+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5938650Bea Baselines template-pytorch aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 02:16:33+00:00 2021-11-01 02:18:05+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5935650Bea Baselines template-pytorch aido-LFI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 02:14:37+00:00 2021-11-01 02:16:27+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.3499999999999996 in-drivable-lane_median 1.2999999999999994 driven_lanedir_consec_median 0.07789975471931476 deviation-center-line_median 0.05751717449082963
other stats deviation-center-line_max 0.05751717449082963 deviation-center-line_mean 0.05751717449082963 deviation-center-line_min 0.05751717449082963 deviation-heading_max 0.8895060812799697 deviation-heading_mean 0.8895060812799697 deviation-heading_median 0.8895060812799697 deviation-heading_min 0.8895060812799697 distance-from-start_max 0.22295796605376572 distance-from-start_mean 0.22295796605376572 distance-from-start_median 0.22295796605376572 distance-from-start_min 0.22295796605376572 driven_any_max 0.26598515297545455 driven_any_mean 0.26598515297545455 driven_any_median 0.26598515297545455 driven_any_min 0.26598515297545455 driven_lanedir_consec_max 0.07789975471931476 driven_lanedir_consec_mean 0.07789975471931476 driven_lanedir_consec_min 0.07789975471931476 driven_lanedir_max 0.07789975471931476 driven_lanedir_mean 0.07789975471931476 driven_lanedir_median 0.07789975471931476 driven_lanedir_min 0.07789975471931476 in-drivable-lane_max 1.2999999999999994 in-drivable-lane_mean 1.2999999999999994 in-drivable-lane_min 1.2999999999999994 per-episodes details {"4way-000-ego0": {"driven_any": 0.26598515297545455, "survival_time": 2.3499999999999996, "driven_lanedir": 0.07789975471931476, "in-drivable-lane": 1.2999999999999994, "deviation-heading": 0.8895060812799697, "distance-from-start": 0.22295796605376572, "deviation-center-line": 0.05751717449082963, "driven_lanedir_consec": 0.07789975471931476}}simulation-passed 1 survival_time_max 2.3499999999999996 survival_time_mean 2.3499999999999996 survival_time_min 2.3499999999999996
No reset possible 5912653Bea Baselines template-pytorch aido-LFV_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:59:23+00:00 2021-11-01 02:14:24+00:00 0:15:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 41.17499999999893 driven_lanedir_consec_median 0.31413394237507686 deviation-center-line_median 1.5036457700519237
other stats deviation-center-line_max 3.600483014691232 deviation-center-line_mean 1.6852746390591726 deviation-center-line_min 0.1333240014416111 deviation-heading_max 45.12688233843615 deviation-heading_mean 18.666082322879955 deviation-heading_median 14.50176115674383 deviation-heading_min 0.5339246395960152 distance-from-start_max 1.2113803250147606 distance-from-start_mean 0.4309750478873525 distance-from-start_median 0.24966830347696112 distance-from-start_min 0.013183259580727249 driven_any_max 6.957404814427607 driven_any_mean 2.329715804702612 driven_any_median 1.1741335533573776 driven_any_min 0.013191297668085578 driven_lanedir_consec_max 0.8557519593977576 driven_lanedir_consec_mean 0.3735124151115416 driven_lanedir_consec_min 0.010029816298255056 driven_lanedir_max 1.2367066903570616 driven_lanedir_mean 0.4687510978513676 driven_lanedir_median 0.31413394237507686 driven_lanedir_min 0.010029816298255056 in-drivable-lane_max 58.54999999999873 in-drivable-lane_mean 35.22499999999915 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 6.957404814427607, "survival_time": 59.99999999999873, "driven_lanedir": 1.2367066903570616, "in-drivable-lane": 50.199999999998646, "deviation-heading": 7.194096713656713, "distance-from-start": 1.2113803250147606, "deviation-center-line": 0.9143508144685688, "driven_lanedir_consec": 0.8557519593977576}, "zigzag-000-ego1": {"driven_any": 0.33278657777423604, "survival_time": 59.99999999999873, "driven_lanedir": 0.19310173901795613, "in-drivable-lane": 58.54999999999873, "deviation-heading": 0.5339246395960152, "distance-from-start": 0.2612882617639483, "deviation-center-line": 0.1333240014416111, "driven_lanedir_consec": 0.19310173901795613}, "zigzag-000-ego2": {"driven_any": 2.015480528940519, "survival_time": 59.99999999999873, "driven_lanedir": 0.4351661457321976, "in-drivable-lane": 32.14999999999922, "deviation-heading": 21.80942559983095, "distance-from-start": 0.23804834518997395, "deviation-center-line": 2.0929407256352786, "driven_lanedir_consec": 0.4351661457321976}, "zigzag-000-ego3": {"driven_any": 0.013191297668085578, "survival_time": 59.99999999999873, "driven_lanedir": 0.010029816298255056, "in-drivable-lane": 0.0, "deviation-heading": 45.12688233843615, "distance-from-start": 0.013183259580727249, "deviation-center-line": 3.600483014691232, "driven_lanedir_consec": 0.010029816298255056}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5903654Bea Baselines template-pytorch aido-LFP-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-11-01 01:52:25+00:00 2021-11-01 01:59:02+00:00 0:06:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 47.14999999999862 driven_lanedir_consec_median 0.5635556620381159 deviation-center-line_median 1.081328982991225
other stats deviation-center-line_max 1.081328982991225 deviation-center-line_mean 1.081328982991225 deviation-center-line_min 1.081328982991225 deviation-heading_max 10.02120097840263 deviation-heading_mean 10.02120097840263 deviation-heading_median 10.02120097840263 deviation-heading_min 10.02120097840263 distance-from-start_max 0.3396003903871212 distance-from-start_mean 0.3396003903871212 distance-from-start_median 0.3396003903871212 distance-from-start_min 0.3396003903871212 driven_any_max 4.3305365953385815 driven_any_mean 4.3305365953385815 driven_any_median 4.3305365953385815 driven_any_min 4.3305365953385815 driven_lanedir_consec_max 0.5635556620381159 driven_lanedir_consec_mean 0.5635556620381159 driven_lanedir_consec_min 0.5635556620381159 driven_lanedir_max 0.5635556620381159 driven_lanedir_mean 0.5635556620381159 driven_lanedir_median 0.5635556620381159 driven_lanedir_min 0.5635556620381159 in-drivable-lane_max 47.14999999999862 in-drivable-lane_mean 47.14999999999862 in-drivable-lane_min 47.14999999999862 per-episodes details {"autolab-000-ego0": {"driven_any": 4.3305365953385815, "survival_time": 59.99999999999873, "driven_lanedir": 0.5635556620381159, "in-drivable-lane": 47.14999999999862, "deviation-heading": 10.02120097840263, "distance-from-start": 0.3396003903871212, "deviation-center-line": 1.081328982991225, "driven_lanedir_consec": 0.5635556620381159}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5898655Bea Baselines template-pytorch aido-LFV-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 01:49:46+00:00 2021-11-01 01:52:07+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.199999999999993 in-drivable-lane_median 2.1499999999999924 driven_lanedir_consec_median 0.2493303195992869 deviation-center-line_median 0.10456955167171143
other stats deviation-center-line_max 0.10456955167171143 deviation-center-line_mean 0.10456955167171143 deviation-center-line_min 0.10456955167171143 deviation-heading_max 1.2275180303743072 deviation-heading_mean 1.2275180303743072 deviation-heading_median 1.2275180303743072 deviation-heading_min 1.2275180303743072 distance-from-start_max 0.3620878111817813 distance-from-start_mean 0.3620878111817813 distance-from-start_median 0.3620878111817813 distance-from-start_min 0.3620878111817813 driven_any_max 0.6248617573823282 driven_any_mean 0.6248617573823282 driven_any_median 0.6248617573823282 driven_any_min 0.6248617573823282 driven_lanedir_consec_max 0.2493303195992869 driven_lanedir_consec_mean 0.2493303195992869 driven_lanedir_consec_min 0.2493303195992869 driven_lanedir_max 0.2493303195992869 driven_lanedir_mean 0.2493303195992869 driven_lanedir_median 0.2493303195992869 driven_lanedir_min 0.2493303195992869 in-drivable-lane_max 2.1499999999999924 in-drivable-lane_mean 2.1499999999999924 in-drivable-lane_min 2.1499999999999924 per-episodes details {"loop-000-ego0": {"driven_any": 0.6248617573823282, "survival_time": 4.199999999999993, "driven_lanedir": 0.2493303195992869, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 1.2275180303743072, "distance-from-start": 0.3620878111817813, "deviation-center-line": 0.10456955167171143, "driven_lanedir_consec": 0.2493303195992869}}simulation-passed 1 survival_time_max 4.199999999999993 survival_time_mean 4.199999999999993 survival_time_min 4.199999999999993
No reset possible 5893656Bea Baselines template-pytorch aido-LFVI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:48:06+00:00 2021-11-01 01:49:34+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5888657Bea Baselines template-pytorch aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 01:46:05+00:00 2021-11-01 01:47:35+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5881659Bea Baselines template-pytorch aido-LFVI_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:44:15+00:00 2021-11-01 01:45:31+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5877660Bea Baselines template-tensorflow aido-LFV_multi-sim-validationsim-2of4 failed no gpu-staging-spot-0-032021-11-01 01:42:58+00:00 2021-11-01 01:44:09+00:00 0:01:11 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5871662Bea Baselines template-tensorflow aido-LFV-sim-validationsim-2of4 failed no gpu-staging-spot-0-032021-11-01 01:41:10+00:00 2021-11-01 01:42:45+00:00 0:01:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5864663Bea Baselines template-tensorflow aido-LFVI-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-01 01:39:26+00:00 2021-11-01 01:41:04+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5859664Bea Baselines template-tensorflow aido-LFI-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-01 01:37:36+00:00 2021-11-01 01:39:01+00:00 0:01:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5854665Bea Baselines template-tensorflow aido-LF-sim-validationsim-2of4 failed no gpu-staging-spot-0-032021-11-01 01:36:15+00:00 2021-11-01 01:37:10+00:00 0:00:55 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5850666Bea Baselines template-tensorflow aido-LFVI_multi-sim-validationsim-0of4 failed no gpu-staging-spot-0-032021-11-01 01:34:37+00:00 2021-11-01 01:35:50+00:00 0:01:13 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5846667Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-11-01 01:33:25+00:00 2021-11-01 01:34:32+00:00 0:01:07 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5840668Bea Baselines template-tensorflow aido-LFP-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-11-01 01:32:13+00:00 2021-11-01 01:33:11+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5837669Bea Baselines template-tensorflow aido-LFV-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-11-01 01:30:31+00:00 2021-11-01 01:31:59+00:00 0:01:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5833670Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-11-01 01:28:50+00:00 2021-11-01 01:30:19+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5829671Bea Baselines template-tensorflow aido-LFI-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:27:08+00:00 2021-11-01 01:28:38+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5819673Bea Baselines template-tensorflow aido-LFVI_multi-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:22:52+00:00 2021-11-01 01:26:42+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5806705Bea Baselines template-random aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 01:14:47+00:00 2021-11-01 01:22:32+00:00 0:07:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 5800707Bea Baselines template-random aido-LFI-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 01:12:05+00:00 2021-11-01 01:14:13+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.7499999999999942 in-drivable-lane_median 0.9 driven_lanedir_consec_median 0.39017518658850303 deviation-center-line_median 0.17124897035562547
other stats deviation-center-line_max 0.17124897035562547 deviation-center-line_mean 0.17124897035562547 deviation-center-line_min 0.17124897035562547 deviation-heading_max 1.7031418047241604 deviation-heading_mean 1.7031418047241604 deviation-heading_median 1.7031418047241604 deviation-heading_min 1.7031418047241604 distance-from-start_max 0.40285563030398 distance-from-start_mean 0.40285563030398 distance-from-start_median 0.40285563030398 distance-from-start_min 0.40285563030398 driven_any_max 0.4240764502839632 driven_any_mean 0.4240764502839632 driven_any_median 0.4240764502839632 driven_any_min 0.4240764502839632 driven_lanedir_consec_max 0.39017518658850303 driven_lanedir_consec_mean 0.39017518658850303 driven_lanedir_consec_min 0.39017518658850303 driven_lanedir_max 0.39017518658850303 driven_lanedir_mean 0.39017518658850303 driven_lanedir_median 0.39017518658850303 driven_lanedir_min 0.39017518658850303 in-drivable-lane_max 0.9 in-drivable-lane_mean 0.9 in-drivable-lane_min 0.9 per-episodes details {"4way-000-ego0": {"driven_any": 0.4240764502839632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.39017518658850303, "in-drivable-lane": 0.9, "deviation-heading": 1.7031418047241604, "distance-from-start": 0.40285563030398, "deviation-center-line": 0.17124897035562547, "driven_lanedir_consec": 0.39017518658850303}}simulation-passed 1 survival_time_max 3.7499999999999942 survival_time_mean 3.7499999999999942 survival_time_min 3.7499999999999942
No reset possible 5799707Bea Baselines template-random aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 01:10:17+00:00 2021-11-01 01:12:00+00:00 0:01:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5790709Bea Baselines template-random aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 01:02:09+00:00 2021-11-01 01:10:11+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 27.85000000000026 in-drivable-lane_median 23.575000000000244 driven_lanedir_consec_median 0.2152178291743677 deviation-center-line_median 0.34607680035313926
other stats deviation-center-line_max 0.7555295762526522 deviation-center-line_mean 0.3831880038858158 deviation-center-line_min 0.0850688385843324 deviation-heading_max 5.523299013646982 deviation-heading_mean 2.976848653346106 deviation-heading_median 2.577175729127456 deviation-heading_min 1.229744141482529 distance-from-start_max 0.8413577961802242 distance-from-start_mean 0.6171534020652945 distance-from-start_median 0.6122000908884857 distance-from-start_min 0.4028556303039823 driven_any_max 6.724613878580574 driven_any_mean 3.448516774187835 driven_any_median 3.322688383943399 driven_any_min 0.4240764502839678 driven_lanedir_consec_max 0.3926134494082678 driven_lanedir_consec_mean 0.23172102279300744 driven_lanedir_consec_min 0.10383498341502671 driven_lanedir_max 0.3926134494082678 driven_lanedir_mean 0.22283655208020933 driven_lanedir_median 0.1995874449338097 driven_lanedir_min 0.09955786904495012 in-drivable-lane_max 25.750000000000263 in-drivable-lane_mean 23.05000000000025 in-drivable-lane_min 19.30000000000024 per-episodes details {"4way-000-ego0": {"driven_any": 6.724613878580574, "survival_time": 27.85000000000026, "driven_lanedir": 0.24963678127672728, "in-drivable-lane": 19.30000000000024, "deviation-heading": 5.523299013646982, "distance-from-start": 0.8413577961802242, "deviation-center-line": 0.7555295762526522, "driven_lanedir_consec": 0.26764984149988424}, "4way-000-ego1": {"driven_any": 0.4240764502839678, "survival_time": 27.85000000000026, "driven_lanedir": 0.3926134494082678, "in-drivable-lane": 25.750000000000263, "deviation-heading": 1.229744141482529, "distance-from-start": 0.4028556303039823, "deviation-center-line": 0.0850688385843324, "driven_lanedir_consec": 0.3926134494082678}, "4way-000-ego2": {"driven_any": 4.117732239446978, "survival_time": 27.85000000000026, "driven_lanedir": 0.14953810859089212, "in-drivable-lane": 22.75000000000024, "deviation-heading": 2.8042483888415783, "distance-from-start": 0.6736010379604935, "deviation-center-line": 0.4035531580478341, "driven_lanedir_consec": 0.16278581684885107}, "4way-000-ego3": {"driven_any": 2.527644528439821, "survival_time": 27.85000000000026, "driven_lanedir": 0.09955786904495012, "in-drivable-lane": 24.40000000000025, "deviation-heading": 2.350103069413334, "distance-from-start": 0.5507991438164779, "deviation-center-line": 0.2886004426584445, "driven_lanedir_consec": 0.10383498341502671}}simulation-passed 1 survival_time_max 27.85000000000026 survival_time_mean 27.85000000000026 survival_time_min 27.85000000000026
No reset possible 5782711Bea Baselines template-random aido-LFP-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 00:58:35+00:00 2021-11-01 01:01:51+00:00 0:03:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.750000000000203 in-drivable-lane_median 18.450000000000163 driven_lanedir_consec_median 0.02131905156671587 deviation-center-line_median 0.43050856325619097
other stats deviation-center-line_max 0.43050856325619097 deviation-center-line_mean 0.43050856325619097 deviation-center-line_min 0.43050856325619097 deviation-heading_max 4.072119010163631 deviation-heading_mean 4.072119010163631 deviation-heading_median 4.072119010163631 deviation-heading_min 4.072119010163631 distance-from-start_max 0.7357883576773695 distance-from-start_mean 0.7357883576773695 distance-from-start_median 0.7357883576773695 distance-from-start_min 0.7357883576773695 driven_any_max 5.629722876849649 driven_any_mean 5.629722876849649 driven_any_median 5.629722876849649 driven_any_min 5.629722876849649 driven_lanedir_consec_max 0.02131905156671587 driven_lanedir_consec_mean 0.02131905156671587 driven_lanedir_consec_min 0.02131905156671587 driven_lanedir_max 0.004357978552197217 driven_lanedir_mean 0.004357978552197217 driven_lanedir_median 0.004357978552197217 driven_lanedir_min 0.004357978552197217 in-drivable-lane_max 18.450000000000163 in-drivable-lane_mean 18.450000000000163 in-drivable-lane_min 18.450000000000163 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.629722876849649, "survival_time": 23.750000000000203, "driven_lanedir": 0.004357978552197217, "in-drivable-lane": 18.450000000000163, "deviation-heading": 4.072119010163631, "distance-from-start": 0.7357883576773695, "deviation-center-line": 0.43050856325619097, "driven_lanedir_consec": 0.02131905156671587}}simulation-passed 1 survival_time_max 23.750000000000203 survival_time_mean 23.750000000000203 survival_time_min 23.750000000000203
No reset possible 5764732Bea Baselines baseline-duckietown-ml aido-LFV_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-11-01 00:47:22+00:00 2021-11-01 00:57:59+00:00 0:10:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 1.5116951606795332
other stats deviation-center-line_max 2.946768139128097 deviation-center-line_mean 1.576975791536685 deviation-center-line_min 0.3377447056595774 deviation-heading_max 32.249113233675025 deviation-heading_mean 22.83949643715976 deviation-heading_median 22.59726568012299 deviation-heading_min 13.914341154718024 distance-from-start_max 3.1401849173675503e-16 distance-from-start_mean 1.3401577416544655e-16 distance-from-start_median 1.1102230246251563e-16 distance-from-start_min 0.0 driven_any_max 3.7682219008410875e-13 driven_any_mean 1.608189289985366e-13 driven_any_median 1.3322676295501878e-13 driven_any_min 0.0 driven_lanedir_consec_max 0.000286102294921875 driven_lanedir_consec_mean 7.152557373046875e-05 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.000286102294921875 driven_lanedir_mean 7.152557373046875e-05 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.894912424505976, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.12847789685309, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168328, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.946768139128097, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5759733Bea Baselines baseline-duckietown-ml aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 00:42:40+00:00 2021-11-01 00:47:09+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948988630736971
other stats deviation-center-line_max 0.8948988630736971 deviation-center-line_mean 0.8948988630736971 deviation-center-line_min 0.8948988630736971 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 4.965068306494546e-16 distance-from-start_mean 4.965068306494546e-16 distance-from-start_median 4.965068306494546e-16 distance-from-start_min 4.965068306494546e-16 driven_any_max 5.95808196779335e-13 driven_any_mean 5.95808196779335e-13 driven_any_median 5.95808196779335e-13 driven_any_min 5.95808196779335e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.95808196779335e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 4.965068306494546e-16, "deviation-center-line": 0.8948988630736971, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5755734Bea Baselines baseline-duckietown-ml aido-LFV-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 00:36:24+00:00 2021-11-01 00:42:07+00:00 0:05:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948943425962775
other stats deviation-center-line_max 0.8948943425962775 deviation-center-line_mean 0.8948943425962775 deviation-center-line_min 0.8948943425962775 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 0.0 distance-from-start_mean 0.0 distance-from-start_median 0.0 distance-from-start_min 0.0 driven_any_max 0.0 driven_any_mean 0.0 driven_any_median 0.0 driven_any_min 0.0 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 0.0, "deviation-center-line": 0.8948943425962775, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5749735Bea Baselines baseline-duckietown-ml aido-LFVI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-11-01 00:34:25+00:00 2021-11-01 00:36:05+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5747736Bea Baselines baseline-duckietown-ml aido-LFI-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 00:32:23+00:00 2021-11-01 00:33:53+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5742737Bea Baselines baseline-duckietown-ml aido-LF-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-11-01 00:28:28+00:00 2021-11-01 00:32:12+00:00 0:03:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0 survival_time_median 59.99999999999873 deviation-center-line_median 0.8948943425963037 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8948943425963037 deviation-center-line_mean 0.8948943425963037 deviation-center-line_min 0.8948943425963037 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 1.3877787807814454e-16 distance-from-start_mean 1.3877787807814454e-16 distance-from-start_median 1.3877787807814454e-16 distance-from-start_min 1.3877787807814454e-16 driven_any_max 1.665334536937735e-13 driven_any_mean 1.665334536937735e-13 driven_any_median 1.665334536937735e-13 driven_any_min 1.665334536937735e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5739738Bea Baselines baseline-duckietown-ml aido-LFVI_multi-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-11-01 00:27:00+00:00 2021-11-01 00:28:21+00:00 0:01:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5726741Bea Baselines baseline-duckietown-ml aido-LFV-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-11-01 00:14:46+00:00 2021-11-01 00:26:35+00:00 0:11:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median -1.5805760034126592e-07 deviation-center-line_median 0.4065262312424091
other stats deviation-center-line_max 0.4065262312424091 deviation-center-line_mean 0.4065262312424091 deviation-center-line_min 0.4065262312424091 deviation-heading_max 40.967334973173536 deviation-heading_mean 40.967334973173536 deviation-heading_median 40.967334973173536 deviation-heading_min 40.967334973173536 distance-from-start_max 0.0 distance-from-start_mean 0.0 distance-from-start_median 0.0 distance-from-start_min 0.0 driven_any_max 0.0 driven_any_mean 0.0 driven_any_median 0.0 driven_any_min 0.0 driven_lanedir_consec_max -1.5805760034126592e-07 driven_lanedir_consec_mean -1.5805760034126592e-07 driven_lanedir_consec_min -1.5805760034126592e-07 driven_lanedir_max -1.5805760034126592e-07 driven_lanedir_mean -1.5805760034126592e-07 driven_lanedir_median -1.5805760034126592e-07 driven_lanedir_min -1.5805760034126592e-07 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -1.5805760034126592e-07, "in-drivable-lane": 0.0, "deviation-heading": 40.967334973173536, "distance-from-start": 0.0, "deviation-center-line": 0.4065262312424091, "driven_lanedir_consec": -1.5805760034126592e-07}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5702749Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-01 00:03:57+00:00 2021-11-01 00:05:02+00:00 0:01:05 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5699751Bea Baselines baseline-RPL-ros aido-LFV-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-11-01 00:02:28+00:00 2021-11-01 00:03:43+00:00 0:01:15 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5689752Bea Baselines baseline-RPL-ros aido-LFVI-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-11-01 00:00:17+00:00 2021-11-01 00:02:22+00:00 0:02:05 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5684753Bea Baselines baseline-RPL-ros aido-LFI-sim-validationsim-3of4 failed no gpu-staging-spot-0-032021-10-31 23:58:53+00:00 2021-11-01 00:00:05+00:00 0:01:12 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5679754Bea Baselines baseline-RPL-ros aido-LF-sim-validationsim-1of4 failed no gpu-staging-spot-0-032021-10-31 23:57:33+00:00 2021-10-31 23:58:28+00:00 0:00:55 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5676756Bea Baselines baseline-RPL-ros aido-LFV_multi-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-10-31 23:56:24+00:00 2021-10-31 23:57:27+00:00 0:01:03 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5671757Bea Baselines baseline-RPL-ros aido-LFP-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-10-31 23:55:24+00:00 2021-10-31 23:56:18+00:00 0:00:54 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5666758Bea Baselines baseline-RPL-ros aido-LFV-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-10-31 23:54:09+00:00 2021-10-31 23:55:17+00:00 0:01:08 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5659759Bea Baselines baseline-RPL-ros aido-LFVI-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-10-31 23:52:36+00:00 2021-10-31 23:53:49+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5652760Bea Baselines baseline-RPL-ros aido-LFI-sim-testingsim-1of4 failed no gpu-staging-spot-0-032021-10-31 23:51:04+00:00 2021-10-31 23:52:17+00:00 0:01:13 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5645761Bea Baselines baseline-RPL-ros aido-LF-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-10-31 23:49:50+00:00 2021-10-31 23:50:45+00:00 0:00:55 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5627634Bea Baselines minimal-agent-full aido-LFV-full-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 23:39:58+00:00 2021-10-31 23:49:12+00:00 0:09:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0499999999998835 driven_lanedir_consec_median 2.005370976726069 deviation-center-line_median 4.560679878295524
other stats deviation-center-line_max 4.560679878295524 deviation-center-line_mean 4.560679878295524 deviation-center-line_min 4.560679878295524 deviation-heading_max 5.286212973968547 deviation-heading_mean 5.286212973968547 deviation-heading_median 5.286212973968547 deviation-heading_min 5.286212973968547 distance-from-start_max 1.684158125324709 distance-from-start_mean 1.684158125324709 distance-from-start_median 1.684158125324709 distance-from-start_min 1.684158125324709 driven_any_max 3.5180872032668677 driven_any_mean 3.5180872032668677 driven_any_median 3.5180872032668677 driven_any_min 3.5180872032668677 driven_lanedir_consec_max 2.005370976726069 driven_lanedir_consec_mean 2.005370976726069 driven_lanedir_consec_min 2.005370976726069 driven_lanedir_max 3.3812461213263134 driven_lanedir_mean 3.3812461213263134 driven_lanedir_median 3.3812461213263134 driven_lanedir_min 3.3812461213263134 in-drivable-lane_max 2.0499999999998835 in-drivable-lane_mean 2.0499999999998835 in-drivable-lane_min 2.0499999999998835 per-episodes details {"loop-000-ego0": {"driven_any": 3.5180872032668677, "survival_time": 59.99999999999873, "driven_lanedir": 3.3812461213263134, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.286212973968547, "distance-from-start": 1.684158125324709, "deviation-center-line": 4.560679878295524, "driven_lanedir_consec": 2.005370976726069}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5615637Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-10-31 23:26:13+00:00 2021-10-31 23:39:51+00:00 0:13:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.9250000000000131 driven_lanedir_consec_median 3.091330139165637 deviation-center-line_median 4.331903062775425
other stats deviation-center-line_max 7.3442261312145165 deviation-center-line_mean 4.724617132133722 deviation-center-line_min 2.8904362717695213 deviation-heading_max 5.663266158111513 deviation-heading_mean 4.199882636226624 deviation-heading_median 3.814086876678531 deviation-heading_min 3.508090633437921 distance-from-start_max 2.492336237280679 distance-from-start_mean 2.1292805692057786 distance-from-start_median 2.293970973840236 distance-from-start_min 1.4368440918619638 driven_any_max 3.579594996204495 driven_any_mean 3.312966315843872 driven_any_median 3.2690876797298554 driven_any_min 3.1340949077112814 driven_lanedir_consec_max 3.539826151958123 driven_lanedir_consec_mean 2.770427752354536 driven_lanedir_consec_min 1.3592245791287456 driven_lanedir_max 3.5595521168819433 driven_lanedir_mean 3.2453753842618753 driven_lanedir_median 3.1929309611498056 driven_lanedir_min 3.036087497865947 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 0.9625000000000136 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.579594996204495, "survival_time": 59.99999999999873, "driven_lanedir": 3.5595521168819433, "in-drivable-lane": 0.0, "deviation-heading": 3.735588116547547, "distance-from-start": 2.3422362133197785, "deviation-center-line": 3.1814195463645407, "driven_lanedir_consec": 3.539826151958123}, "udem-000-ego1": {"driven_any": 3.1340949077112814, "survival_time": 59.99999999999873, "driven_lanedir": 3.036087497865947, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.508090633437921, "distance-from-start": 2.492336237280679, "deviation-center-line": 7.3442261312145165, "driven_lanedir_consec": 3.036087477425353}, "udem-000-ego2": {"driven_any": 3.3155875122220144, "survival_time": 59.99999999999873, "driven_lanedir": 3.2954837547738993, "in-drivable-lane": 0.0, "deviation-heading": 3.892585636809516, "distance-from-start": 2.245705734360693, "deviation-center-line": 2.8904362717695213, "driven_lanedir_consec": 3.146572800905921}, "udem-000-ego3": {"driven_any": 3.222587847237696, "survival_time": 59.99999999999873, "driven_lanedir": 3.090378167525712, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663266158111513, "distance-from-start": 1.4368440918619638, "deviation-center-line": 5.4823865791863104, "driven_lanedir_consec": 1.3592245791287456}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5611637Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 23:24:38+00:00 2021-10-31 23:25:54+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5588643Bea Baselines minimal-agent-full aido-LFV_multi-full-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 23:09:26+00:00 2021-10-31 23:24:17+00:00 0:14:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.92499999999992 driven_lanedir_consec_median 1.6962974393876302 deviation-center-line_median 5.6660077048179875
other stats deviation-center-line_max 9.920539816203728 deviation-center-line_mean 6.424810657621769 deviation-center-line_min 4.446687404647375 deviation-heading_max 10.760072335048156 deviation-heading_mean 7.75849277281716 deviation-heading_median 9.162709521693651 deviation-heading_min 1.9484797128331772 distance-from-start_max 2.9523651631034435 distance-from-start_mean 1.7043556043896877 distance-from-start_median 1.5711589276694409 distance-from-start_min 0.7227393991164262 driven_any_max 3.524085546529847 driven_any_mean 2.8239999291942457 driven_any_median 3.4851575826810635 driven_any_min 0.8015990048850082 driven_lanedir_consec_max 3.348811260212561 driven_lanedir_consec_mean 1.8837014899010265 driven_lanedir_consec_min 0.7933998206162842 driven_lanedir_max 3.351348627110138 driven_lanedir_mean 2.6742463059555184 driven_lanedir_median 3.276118388047826 driven_lanedir_min 0.7933998206162842 in-drivable-lane_max 4.299999999999898 in-drivable-lane_mean 2.0374999999999344 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.5197332868688487, "survival_time": 59.99999999999873, "driven_lanedir": 3.351348627110138, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 9.476018293244575, "distance-from-start": 2.0738235372013047, "deviation-center-line": 4.446687404647375, "driven_lanedir_consec": 2.179559038524113}, "zigzag-000-ego1": {"driven_any": 3.4505818784932787, "survival_time": 59.99999999999873, "driven_lanedir": 3.203425515883091, "in-drivable-lane": 4.299999999999898, "deviation-heading": 8.84940075014273, "distance-from-start": 1.068494318137577, "deviation-center-line": 5.899268750309402, "driven_lanedir_consec": 1.2130358402511474}, "zigzag-000-ego2": {"driven_any": 0.8015990048850082, "survival_time": 59.99999999999873, "driven_lanedir": 0.7933998206162842, "in-drivable-lane": 0.0, "deviation-heading": 1.9484797128331772, "distance-from-start": 0.7227393991164262, "deviation-center-line": 9.920539816203728, "driven_lanedir_consec": 0.7933998206162842}, "zigzag-000-ego3": {"driven_any": 3.524085546529847, "survival_time": 59.99999999999873, "driven_lanedir": 3.348811260212561, "in-drivable-lane": 1.8499999999999537, "deviation-heading": 10.760072335048156, "distance-from-start": 2.9523651631034435, "deviation-center-line": 5.432746659326572, "driven_lanedir_consec": 3.348811260212561}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5583675Bea Baselines baseline-simple-yield aido-LFI-state-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-10-31 23:04:23+00:00 2021-10-31 23:09:06+00:00 0:04:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.161183222767684 deviation-center-line_median 0.16237308678117102
other stats deviation-center-line_max 0.16237308678117102 deviation-center-line_mean 0.16237308678117102 deviation-center-line_min 0.16237308678117102 deviation-heading_max 1.6697144680274827 deviation-heading_mean 1.6697144680274827 deviation-heading_median 1.6697144680274827 deviation-heading_min 1.6697144680274827 distance-from-start_max 2.3375328751443054 distance-from-start_mean 2.3375328751443054 distance-from-start_median 2.3375328751443054 distance-from-start_min 2.3375328751443054 driven_any_max 5.867610759158524 driven_any_mean 5.867610759158524 driven_any_median 5.867610759158524 driven_any_min 5.867610759158524 driven_lanedir_consec_max 5.161183222767684 driven_lanedir_consec_mean 5.161183222767684 driven_lanedir_consec_min 5.161183222767684 driven_lanedir_max 5.859601719805226 driven_lanedir_mean 5.859601719805226 driven_lanedir_median 5.859601719805226 driven_lanedir_min 5.859601719805226 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 5.867610759158524, "survival_time": 59.99999999999873, "driven_lanedir": 5.859601719805226, "in-drivable-lane": 0.0, "deviation-heading": 1.6697144680274827, "distance-from-start": 2.3375328751443054, "deviation-center-line": 0.16237308678117102, "driven_lanedir_consec": 5.161183222767684}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5572677Bea Baselines baseline-simple-yield aido-LFVI-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-10-31 22:54:53+00:00 2021-10-31 23:03:59+00:00 0:09:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.68215125613533 deviation-center-line_median 0.07395327503038837
other stats deviation-center-line_max 0.07395327503038837 deviation-center-line_mean 0.07395327503038837 deviation-center-line_min 0.07395327503038837 deviation-heading_max 0.5851001197983932 deviation-heading_mean 0.5851001197983932 deviation-heading_median 0.5851001197983932 deviation-heading_min 0.5851001197983932 distance-from-start_max 2.029871473762164 distance-from-start_mean 2.029871473762164 distance-from-start_median 2.029871473762164 distance-from-start_min 2.029871473762164 driven_any_max 2.684176116815528 driven_any_mean 2.684176116815528 driven_any_median 2.684176116815528 driven_any_min 2.684176116815528 driven_lanedir_consec_max 2.68215125613533 driven_lanedir_consec_mean 2.68215125613533 driven_lanedir_consec_min 2.68215125613533 driven_lanedir_max 2.6821513356789115 driven_lanedir_mean 2.6821513356789115 driven_lanedir_median 2.6821513356789115 driven_lanedir_min 2.6821513356789115 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.684176116815528, "survival_time": 59.99999999999873, "driven_lanedir": 2.6821513356789115, "in-drivable-lane": 0.0, "deviation-heading": 0.5851001197983932, "distance-from-start": 2.029871473762164, "deviation-center-line": 0.07395327503038837, "driven_lanedir_consec": 2.68215125613533}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5564680Bea Baselines baseline-simple-yield aido-LF-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 22:51:09+00:00 2021-10-31 22:54:34+00:00 0:03:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065102356188296
other stats deviation-center-line_max 0.4065102356188296 deviation-center-line_mean 0.4065102356188296 deviation-center-line_min 0.4065102356188296 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 7.63278329429795e-17 distance-from-start_mean 7.63278329429795e-17 distance-from-start_median 7.63278329429795e-17 distance-from-start_min 7.63278329429795e-17 driven_any_max 9.15933995315754e-14 driven_any_mean 9.15933995315754e-14 driven_any_median 9.15933995315754e-14 driven_any_min 9.15933995315754e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5556397Bea Baselines baseline-RL-sim-pytorch aido-LF-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 22:43:39+00:00 2021-10-31 22:50:48+00:00 0:07:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -2.247941836008024 survival_time_median 59.99999999999873 deviation-center-line_median 3.515494537717644 in-drivable-lane_median 24.1999999999994
other stats deviation-center-line_max 3.515494537717644 deviation-center-line_mean 3.515494537717644 deviation-center-line_min 3.515494537717644 deviation-heading_max 26.882465971777663 deviation-heading_mean 26.882465971777663 deviation-heading_median 26.882465971777663 deviation-heading_min 26.882465971777663 distance-from-start_max 0.13515289534002783 distance-from-start_mean 0.13515289534002783 distance-from-start_median 0.13515289534002783 distance-from-start_min 0.13515289534002783 driven_any_max 9.781799213968236 driven_any_mean 9.781799213968236 driven_any_median 9.781799213968236 driven_any_min 9.781799213968236 driven_lanedir_consec_max -2.247941836008024 driven_lanedir_consec_mean -2.247941836008024 driven_lanedir_consec_min -2.247941836008024 driven_lanedir_max -2.247941836008024 driven_lanedir_mean -2.247941836008024 driven_lanedir_median -2.247941836008024 driven_lanedir_min -2.247941836008024 in-drivable-lane_max 24.1999999999994 in-drivable-lane_mean 24.1999999999994 in-drivable-lane_min 24.1999999999994 per-episodes details {"loop-000-ego0": {"driven_any": 9.781799213968236, "survival_time": 59.99999999999873, "driven_lanedir": -2.247941836008024, "in-drivable-lane": 24.1999999999994, "deviation-heading": 26.882465971777663, "distance-from-start": 0.13515289534002783, "deviation-center-line": 3.515494537717644, "driven_lanedir_consec": -2.247941836008024}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5546658Bea Baselines template-pytorch aido-LF-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 22:38:22+00:00 2021-10-31 22:43:07+00:00 0:04:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.192958390258134 survival_time_median 59.99999999999873 deviation-center-line_median 1.1278648323806957 in-drivable-lane_median 43.49999999999871
other stats deviation-center-line_max 1.1278648323806957 deviation-center-line_mean 1.1278648323806957 deviation-center-line_min 1.1278648323806957 deviation-heading_max 14.252328967553154 deviation-heading_mean 14.252328967553154 deviation-heading_median 14.252328967553154 deviation-heading_min 14.252328967553154 distance-from-start_max 0.3421316662819649 distance-from-start_mean 0.3421316662819649 distance-from-start_median 0.3421316662819649 distance-from-start_min 0.3421316662819649 driven_any_max 8.751364502414102 driven_any_mean 8.751364502414102 driven_any_median 8.751364502414102 driven_any_min 8.751364502414102 driven_lanedir_consec_max 1.192958390258134 driven_lanedir_consec_mean 1.192958390258134 driven_lanedir_consec_min 1.192958390258134 driven_lanedir_max 1.3051411233211978 driven_lanedir_mean 1.3051411233211978 driven_lanedir_median 1.3051411233211978 driven_lanedir_min 1.3051411233211978 in-drivable-lane_max 43.49999999999871 in-drivable-lane_mean 43.49999999999871 in-drivable-lane_min 43.49999999999871 per-episodes details {"loop2-000-ego0": {"driven_any": 8.751364502414102, "survival_time": 59.99999999999873, "driven_lanedir": 1.3051411233211978, "in-drivable-lane": 43.49999999999871, "deviation-heading": 14.252328967553154, "distance-from-start": 0.3421316662819649, "deviation-center-line": 1.1278648323806957, "driven_lanedir_consec": 1.192958390258134}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5542672Bea Baselines template-tensorflow aido-LF-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-10-31 22:35:40+00:00 2021-10-31 22:38:16+00:00 0:02:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5535715Bea Baselines template-random aido-LF-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 22:30:00+00:00 2021-10-31 22:35:28+00:00 0:05:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.012426269112546516 survival_time_median 51.799999999999194 deviation-center-line_median 0.5849700317973118 in-drivable-lane_median 45.549999999999145
other stats deviation-center-line_max 0.5849700317973118 deviation-center-line_mean 0.5849700317973118 deviation-center-line_min 0.5849700317973118 deviation-heading_max 4.775258870776366 deviation-heading_mean 4.775258870776366 deviation-heading_median 4.775258870776366 deviation-heading_min 4.775258870776366 distance-from-start_max 1.2120262829129234 distance-from-start_mean 1.2120262829129234 distance-from-start_median 1.2120262829129234 distance-from-start_min 1.2120262829129234 driven_any_max 12.87870380836428 driven_any_mean 12.87870380836428 driven_any_median 12.87870380836428 driven_any_min 12.87870380836428 driven_lanedir_consec_max 0.012426269112546516 driven_lanedir_consec_mean 0.012426269112546516 driven_lanedir_consec_min 0.012426269112546516 driven_lanedir_max 0.015772611211180454 driven_lanedir_mean 0.015772611211180454 driven_lanedir_median 0.015772611211180454 driven_lanedir_min 0.015772611211180454 in-drivable-lane_max 45.549999999999145 in-drivable-lane_mean 45.549999999999145 in-drivable-lane_min 45.549999999999145 per-episodes details {"loop2-000-ego0": {"driven_any": 12.87870380836428, "survival_time": 51.799999999999194, "driven_lanedir": 0.015772611211180454, "in-drivable-lane": 45.549999999999145, "deviation-heading": 4.775258870776366, "distance-from-start": 1.2120262829129234, "deviation-center-line": 0.5849700317973118, "driven_lanedir_consec": 0.012426269112546516}}simulation-passed 1 survival_time_max 51.799999999999194 survival_time_mean 51.799999999999194 survival_time_min 51.799999999999194
No reset possible 5525684Bea Baselines baseline-simple-yield aido-LFV_multi-state-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 22:21:50+00:00 2021-10-31 22:29:45+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3225169615019583 deviation-center-line_median 0.6106323511970384
other stats deviation-center-line_max 2.7624766981243565 deviation-center-line_mean 1.0519970062330533 deviation-center-line_min 0.22424662441377963 deviation-heading_max 37.82293240559152 deviation-heading_mean 10.912898130454176 deviation-heading_median 2.0831892986732727 deviation-heading_min 1.662281518878632 distance-from-start_max 2.3178967556009846 distance-from-start_mean 1.3561716835463995 distance-from-start_median 1.5533949892923062 distance-from-start_min 4.577566798522237e-16 driven_any_max 5.273775150152415 driven_any_mean 2.4826108851577655 driven_any_median 2.3283341952390493 driven_any_min 5.49308015822675e-13 driven_lanedir_consec_max 5.26083024755342 driven_lanedir_consec_mean 2.476466042639334 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.26083024755342 driven_lanedir_mean 2.476466042639334 driven_lanedir_median 2.3225169615019583 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.273775150152415, "survival_time": 59.99999999999873, "driven_lanedir": 5.26083024755342, "in-drivable-lane": 0.0, "deviation-heading": 2.111513261391546, "distance-from-start": 2.3178967556009846, "deviation-center-line": 0.22424662441377963, "driven_lanedir_consec": 5.26083024755342}, "loop-000-ego1": {"driven_any": 1.5746103029952832, "survival_time": 59.99999999999873, "driven_lanedir": 1.5658385330081717, "in-drivable-lane": 0.0, "deviation-heading": 2.054865335955, "distance-from-start": 1.0292579667018384, "deviation-center-line": 0.5524823741667937, "driven_lanedir_consec": 1.5658385330081717}, "loop-000-ego2": {"driven_any": 3.082058087482815, "survival_time": 59.99999999999873, "driven_lanedir": 3.0791953899957454, "in-drivable-lane": 0.0, "deviation-heading": 1.662281518878632, "distance-from-start": 2.077532011882774, "deviation-center-line": 0.6687823282272832, "driven_lanedir_consec": 3.0791953899957454}, "loop-000-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 2.7624766981243565, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5519686Bea Baselines baseline-simple-yield aido-LFV-state-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 22:19:36+00:00 2021-10-31 22:21:43+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.750000000000004 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7199000882778759 deviation-center-line_median 0.16571411064010536
other stats deviation-center-line_max 0.16571411064010536 deviation-center-line_mean 0.16571411064010536 deviation-center-line_min 0.16571411064010536 deviation-heading_max 1.3921530764896437 deviation-heading_mean 1.3921530764896437 deviation-heading_median 1.3921530764896437 deviation-heading_min 1.3921530764896437 distance-from-start_max 0.6832017558427702 distance-from-start_mean 0.6832017558427702 distance-from-start_median 0.6832017558427702 distance-from-start_min 0.6832017558427702 driven_any_max 0.7330980289948952 driven_any_mean 0.7330980289948952 driven_any_median 0.7330980289948952 driven_any_min 0.7330980289948952 driven_lanedir_consec_max 0.7199000882778759 driven_lanedir_consec_mean 0.7199000882778759 driven_lanedir_consec_min 0.7199000882778759 driven_lanedir_max 0.7199000882778759 driven_lanedir_mean 0.7199000882778759 driven_lanedir_median 0.7199000882778759 driven_lanedir_min 0.7199000882778759 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7330980289948952, "survival_time": 9.750000000000004, "driven_lanedir": 0.7199000882778759, "in-drivable-lane": 0.0, "deviation-heading": 1.3921530764896437, "distance-from-start": 0.6832017558427702, "deviation-center-line": 0.16571411064010536, "driven_lanedir_consec": 0.7199000882778759}}simulation-passed 1 survival_time_max 9.750000000000004 survival_time_mean 9.750000000000004 survival_time_min 9.750000000000004
No reset possible 5516687Bea Baselines baseline-simple-yield aido-LFP-state-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-10-31 22:16:38+00:00 2021-10-31 22:19:07+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 22.20000000000018 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.7931242458645529 deviation-center-line_median 0.1961591864911841
other stats deviation-center-line_max 0.1961591864911841 deviation-center-line_mean 0.1961591864911841 deviation-center-line_min 0.1961591864911841 deviation-heading_max 1.690974780395429 deviation-heading_mean 1.690974780395429 deviation-heading_median 1.690974780395429 deviation-heading_min 1.690974780395429 distance-from-start_max 1.4244240674089024 distance-from-start_mean 1.4244240674089024 distance-from-start_median 1.4244240674089024 distance-from-start_min 1.4244240674089024 driven_any_max 1.805900837286754 driven_any_mean 1.805900837286754 driven_any_median 1.805900837286754 driven_any_min 1.805900837286754 driven_lanedir_consec_max 1.7931242458645529 driven_lanedir_consec_mean 1.7931242458645529 driven_lanedir_consec_min 1.7931242458645529 driven_lanedir_max 1.7931242458645529 driven_lanedir_mean 1.7931242458645529 driven_lanedir_median 1.7931242458645529 driven_lanedir_min 1.7931242458645529 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.805900837286754, "survival_time": 22.20000000000018, "driven_lanedir": 1.7931242458645529, "in-drivable-lane": 0.0, "deviation-heading": 1.690974780395429, "distance-from-start": 1.4244240674089024, "deviation-center-line": 0.1961591864911841, "driven_lanedir_consec": 1.7931242458645529}}simulation-passed 1 survival_time_max 22.20000000000018 survival_time_mean 22.20000000000018 survival_time_min 22.20000000000018
No reset possible 5511687Bea Baselines baseline-simple-yield aido-LFP-state-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 22:14:28+00:00 2021-10-31 22:16:14+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.450000000000056 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.239051419614633 deviation-center-line_median 0.0997629919452237
other stats deviation-center-line_max 0.0997629919452237 deviation-center-line_mean 0.0997629919452237 deviation-center-line_min 0.0997629919452237 deviation-heading_max 0.96870438500335 deviation-heading_mean 0.96870438500335 deviation-heading_median 0.96870438500335 deviation-heading_min 0.96870438500335 distance-from-start_max 1.2390725918040948 distance-from-start_mean 1.2390725918040948 distance-from-start_median 1.2390725918040948 distance-from-start_min 1.2390725918040948 driven_any_max 1.2494632844349631 driven_any_mean 1.2494632844349631 driven_any_median 1.2494632844349631 driven_any_min 1.2494632844349631 driven_lanedir_consec_max 1.239051419614633 driven_lanedir_consec_mean 1.239051419614633 driven_lanedir_consec_min 1.239051419614633 driven_lanedir_max 1.239051419614633 driven_lanedir_mean 1.239051419614633 driven_lanedir_median 1.239051419614633 driven_lanedir_min 1.239051419614633 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 1.2494632844349631, "survival_time": 13.450000000000056, "driven_lanedir": 1.239051419614633, "in-drivable-lane": 0.0, "deviation-heading": 0.96870438500335, "distance-from-start": 1.2390725918040948, "deviation-center-line": 0.0997629919452237, "driven_lanedir_consec": 1.239051419614633}}simulation-passed 1 survival_time_max 13.450000000000056 survival_time_mean 13.450000000000056 survival_time_min 13.450000000000056
No reset possible 5507718Bea Baselines minimal-agent-state aido-LFI-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-10-31 22:12:49+00:00 2021-10-31 22:14:22+00:00 0:01:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5504718Bea Baselines minimal-agent-state aido-LFI-state-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-10-31 22:07:50+00:00 2021-10-31 22:12:42+00:00 0:04:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4226928398281333 deviation-center-line_median 4.174748477462163
other stats deviation-center-line_max 4.174748477462163 deviation-center-line_mean 4.174748477462163 deviation-center-line_min 4.174748477462163 deviation-heading_max 4.533756317111154 deviation-heading_mean 4.533756317111154 deviation-heading_median 4.533756317111154 deviation-heading_min 4.533756317111154 distance-from-start_max 2.2784552815665835 distance-from-start_mean 2.2784552815665835 distance-from-start_median 2.2784552815665835 distance-from-start_min 2.2784552815665835 driven_any_max 3.579587154113982 driven_any_mean 3.579587154113982 driven_any_median 3.579587154113982 driven_any_min 3.579587154113982 driven_lanedir_consec_max 3.4226928398281333 driven_lanedir_consec_mean 3.4226928398281333 driven_lanedir_consec_min 3.4226928398281333 driven_lanedir_max 3.55610753301965 driven_lanedir_mean 3.55610753301965 driven_lanedir_median 3.55610753301965 driven_lanedir_min 3.55610753301965 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5491721Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-validation276 success yes gpu-staging-spot-0-032021-10-31 22:00:11+00:00 2021-10-31 22:07:11+00:00 0:07:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.2749999999998938 driven_lanedir_consec_median 2.712004979582506 deviation-center-line_median 6.830233669694479
other stats deviation-center-line_max 7.154226688493768 deviation-center-line_mean 6.804680157069402 deviation-center-line_min 6.404026600394878 deviation-heading_max 8.100880505860715 deviation-heading_mean 5.973168085503508 deviation-heading_median 5.5013083102031874 deviation-heading_min 4.7891752157469405 distance-from-start_max 2.416015397978839 distance-from-start_mean 1.6093143700204056 distance-from-start_median 1.566033493936358 distance-from-start_min 0.8891750942300684 driven_any_max 3.5195878597991426 driven_any_mean 3.4828384673828054 driven_any_median 3.4813415720692342 driven_any_min 3.4490828655936094 driven_lanedir_consec_max 3.330338922875351 driven_lanedir_consec_mean 2.6711177029407134 driven_lanedir_consec_min 1.9301219297224912 driven_lanedir_max 3.3876167841121174 driven_lanedir_mean 3.308291004109226 driven_lanedir_median 3.318066104091547 driven_lanedir_min 3.209415024141693 in-drivable-lane_max 4.349999999999898 in-drivable-lane_mean 3.2249999999999286 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}, "loop-000-ego1": {"driven_any": 3.486592048337899, "survival_time": 59.99999999999873, "driven_lanedir": 3.330338922875351, "in-drivable-lane": 3.0999999999999055, "deviation-heading": 4.7891752157469405, "distance-from-start": 2.416015397978839, "deviation-center-line": 6.91888991237436, "driven_lanedir_consec": 3.330338922875351}, "loop-000-ego2": {"driven_any": 3.4490828655936094, "survival_time": 59.99999999999873, "driven_lanedir": 3.209415024141693, "in-drivable-lane": 4.349999999999898, "deviation-heading": 8.100880505860715, "distance-from-start": 0.8891750942300684, "deviation-center-line": 6.404026600394878, "driven_lanedir_consec": 1.9301219297224912}, "loop-000-ego3": {"driven_any": 3.5195878597991426, "survival_time": 59.99999999999873, "driven_lanedir": 3.3876167841121174, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654519418770767, "distance-from-start": 1.5016994335658966, "deviation-center-line": 6.741577427014599, "driven_lanedir_consec": 2.118216673857269}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5490722Bea Baselines minimal-agent-state aido-LFP-state-sim-validationsim-1of4 host-error no gpu-staging-spot-0-032021-10-31 21:59:40+00:00 2021-10-31 22:00:04+00:00 0:00:24 Error while running [...] Error while running Docker Compose:
Cannot get process ids
│ output: ''
│ names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5486723Bea Baselines minimal-agent-state aido-LF-state-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 21:56:08+00:00 2021-10-31 21:59:14+00:00 0:03:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 40.04999999999986 in-drivable-lane_median 2.5000000000000098 driven_lanedir_consec_median 1.160366146360421 deviation-center-line_median 2.940039735198709
other stats deviation-center-line_max 2.940039735198709 deviation-center-line_mean 2.940039735198709 deviation-center-line_min 2.940039735198709 deviation-heading_max 9.167157492761987 deviation-heading_mean 9.167157492761987 deviation-heading_median 9.167157492761987 deviation-heading_min 9.167157492761987 distance-from-start_max 1.1396211983149378 distance-from-start_mean 1.1396211983149378 distance-from-start_median 1.1396211983149378 distance-from-start_min 1.1396211983149378 driven_any_max 2.265732411375476 driven_any_mean 2.265732411375476 driven_any_median 2.265732411375476 driven_any_min 2.265732411375476 driven_lanedir_consec_max 1.160366146360421 driven_lanedir_consec_mean 1.160366146360421 driven_lanedir_consec_min 1.160366146360421 driven_lanedir_max 2.08337576497627 driven_lanedir_mean 2.08337576497627 driven_lanedir_median 2.08337576497627 driven_lanedir_min 2.08337576497627 in-drivable-lane_max 2.5000000000000098 in-drivable-lane_mean 2.5000000000000098 in-drivable-lane_min 2.5000000000000098 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.265732411375476, "survival_time": 40.04999999999986, "driven_lanedir": 2.08337576497627, "in-drivable-lane": 2.5000000000000098, "deviation-heading": 9.167157492761987, "distance-from-start": 1.1396211983149378, "deviation-center-line": 2.940039735198709, "driven_lanedir_consec": 1.160366146360421}}simulation-passed 1 survival_time_max 40.04999999999986 survival_time_mean 40.04999999999986 survival_time_min 40.04999999999986
No reset possible 5473726Bea Baselines minimal-agent-state aido-LFVI-state-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-10-31 21:46:46+00:00 2021-10-31 21:55:41+00:00 0:08:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.385444945074485 deviation-center-line_median 3.9396057444508545
other stats deviation-center-line_max 3.9396057444508545 deviation-center-line_mean 3.9396057444508545 deviation-center-line_min 3.9396057444508545 deviation-heading_max 5.447727941053875 deviation-heading_mean 5.447727941053875 deviation-heading_median 5.447727941053875 deviation-heading_min 5.447727941053875 distance-from-start_max 2.271008875297506 distance-from-start_mean 2.271008875297506 distance-from-start_median 2.271008875297506 distance-from-start_min 2.271008875297506 driven_any_max 3.5795880628439725 driven_any_mean 3.5795880628439725 driven_any_median 3.5795880628439725 driven_any_min 3.5795880628439725 driven_lanedir_consec_max 3.385444945074485 driven_lanedir_consec_mean 3.385444945074485 driven_lanedir_consec_min 3.385444945074485 driven_lanedir_max 3.547670088627387 driven_lanedir_mean 3.547670088627387 driven_lanedir_median 3.547670088627387 driven_lanedir_min 3.547670088627387 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.5795880628439725, "survival_time": 59.99999999999873, "driven_lanedir": 3.547670088627387, "in-drivable-lane": 0.0, "deviation-heading": 5.447727941053875, "distance-from-start": 2.271008875297506, "deviation-center-line": 3.9396057444508545, "driven_lanedir_consec": 3.385444945074485}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5465728Bea Baselines minimal-agent-state aido-LFV-state-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 21:38:24+00:00 2021-10-31 21:46:12+00:00 0:07:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 3.48568324399197 deviation-center-line_median 7.514954227940093
other stats deviation-center-line_max 7.514954227940093 deviation-center-line_mean 7.514954227940093 deviation-center-line_min 7.514954227940093 deviation-heading_max 2.9198322000428 deviation-heading_mean 2.9198322000428 deviation-heading_median 2.9198322000428 deviation-heading_min 2.9198322000428 distance-from-start_max 2.8766441683061994 distance-from-start_mean 2.8766441683061994 distance-from-start_median 2.8766441683061994 distance-from-start_min 2.8766441683061994 driven_any_max 3.5465963271061254 driven_any_mean 3.5465963271061254 driven_any_median 3.5465963271061254 driven_any_min 3.5465963271061254 driven_lanedir_consec_max 3.48568324399197 driven_lanedir_consec_mean 3.48568324399197 driven_lanedir_consec_min 3.48568324399197 driven_lanedir_max 3.48568324399197 driven_lanedir_mean 3.48568324399197 driven_lanedir_median 3.48568324399197 driven_lanedir_min 3.48568324399197 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"loop-000-ego0": {"driven_any": 3.5465963271061254, "survival_time": 59.99999999999873, "driven_lanedir": 3.48568324399197, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322000428, "distance-from-start": 2.8766441683061994, "deviation-center-line": 7.514954227940093, "driven_lanedir_consec": 3.48568324399197}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5458730Bea Baselines minimal-agent-state aido-LFP-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 21:35:09+00:00 2021-10-31 21:38:03+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 46.149999999999515 in-drivable-lane_median 2.3499999999998664 driven_lanedir_consec_median 2.508574663906291 deviation-center-line_median 4.735586424524718
other stats deviation-center-line_max 4.735586424524718 deviation-center-line_mean 4.735586424524718 deviation-center-line_min 4.735586424524718 deviation-heading_max 5.424677508305602 deviation-heading_mean 5.424677508305602 deviation-heading_median 5.424677508305602 deviation-heading_min 5.424677508305602 distance-from-start_max 1.6314587171506916 distance-from-start_mean 1.6314587171506916 distance-from-start_median 1.6314587171506916 distance-from-start_min 1.6314587171506916 driven_any_max 2.6360923257918736 driven_any_mean 2.6360923257918736 driven_any_median 2.6360923257918736 driven_any_min 2.6360923257918736 driven_lanedir_consec_max 2.508574663906291 driven_lanedir_consec_mean 2.508574663906291 driven_lanedir_consec_min 2.508574663906291 driven_lanedir_max 2.508574663906291 driven_lanedir_mean 2.508574663906291 driven_lanedir_median 2.508574663906291 driven_lanedir_min 2.508574663906291 in-drivable-lane_max 2.3499999999998664 in-drivable-lane_mean 2.3499999999998664 in-drivable-lane_min 2.3499999999998664 per-episodes details {"loop2-000-ego0": {"driven_any": 2.6360923257918736, "survival_time": 46.149999999999515, "driven_lanedir": 2.508574663906291, "in-drivable-lane": 2.3499999999998664, "deviation-heading": 5.424677508305602, "distance-from-start": 1.6314587171506916, "deviation-center-line": 4.735586424524718, "driven_lanedir_consec": 2.508574663906291}}simulation-passed 1 survival_time_max 46.149999999999515 survival_time_mean 46.149999999999515 survival_time_min 46.149999999999515
No reset possible 5451689Bea Baselines minimal-agent aido-LFV_multi-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-10-31 21:33:00+00:00 2021-10-31 21:34:57+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.949999999999987 in-drivable-lane_median 4.349999999999986 driven_lanedir_consec_median 0.1796243236291546 deviation-center-line_median 0.13064995214824765
other stats deviation-center-line_max 0.1356245705745657 deviation-center-line_mean 0.13064995214824765 deviation-center-line_min 0.1256753337219296 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.848315713252692 deviation-heading_median 0.848315713252692 deviation-heading_min 0.7478094709473374 distance-from-start_max 0.8124268507162298 distance-from-start_mean 0.8002552992142686 distance-from-start_median 0.8002552992142686 distance-from-start_min 0.7880837477123075 driven_any_max 0.8124423795236627 driven_any_mean 0.8002702946322935 driven_any_median 0.8002702946322935 driven_any_min 0.7880982097409241 driven_lanedir_consec_max 0.19955231542410212 driven_lanedir_consec_mean 0.1796243236291546 driven_lanedir_consec_min 0.15969633183420706 driven_lanedir_max 0.19955231542410212 driven_lanedir_mean 0.1796243236291546 driven_lanedir_median 0.1796243236291546 driven_lanedir_min 0.15969633183420706 in-drivable-lane_max 4.499999999999987 in-drivable-lane_mean 4.349999999999986 in-drivable-lane_min 4.199999999999986 per-episodes details {"loop2-000-ego0": {"driven_any": 0.8124423795236627, "survival_time": 5.949999999999987, "driven_lanedir": 0.19955231542410212, "in-drivable-lane": 4.199999999999986, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.8124268507162298, "deviation-center-line": 0.1256753337219296, "driven_lanedir_consec": 0.19955231542410212}, "loop2-000-ego1": {"driven_any": 0.7880982097409241, "survival_time": 5.949999999999987, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 4.499999999999987, "deviation-heading": 0.7478094709473374, "distance-from-start": 0.7880837477123075, "deviation-center-line": 0.1356245705745657, "driven_lanedir_consec": 0.15969633183420706}}simulation-passed 1 survival_time_max 5.949999999999987 survival_time_mean 5.949999999999987 survival_time_min 5.949999999999987
No reset possible 5441692Bea Baselines minimal-agent aido-LFVI-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-10-31 21:30:39+00:00 2021-10-31 21:32:41+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.8999999999999977 in-drivable-lane_median 1.1499999999999968 driven_lanedir_consec_median 0.1995526730519679 deviation-center-line_median 0.1256753841612143
other stats deviation-center-line_max 0.1256753841612143 deviation-center-line_mean 0.1256753841612143 deviation-center-line_min 0.1256753841612143 deviation-heading_max 0.9488219555580462 deviation-heading_mean 0.9488219555580462 deviation-heading_median 0.9488219555580462 deviation-heading_min 0.9488219555580462 distance-from-start_max 0.30742487448707223 distance-from-start_mean 0.30742487448707223 distance-from-start_median 0.30742487448707223 distance-from-start_min 0.30742487448707223 driven_any_max 0.3074291281738806 driven_any_mean 0.3074291281738806 driven_any_median 0.3074291281738806 driven_any_min 0.3074291281738806 driven_lanedir_consec_max 0.1995526730519679 driven_lanedir_consec_mean 0.1995526730519679 driven_lanedir_consec_min 0.1995526730519679 driven_lanedir_max 0.1995526730519679 driven_lanedir_mean 0.1995526730519679 driven_lanedir_median 0.1995526730519679 driven_lanedir_min 0.1995526730519679 in-drivable-lane_max 1.1499999999999968 in-drivable-lane_mean 1.1499999999999968 in-drivable-lane_min 1.1499999999999968 per-episodes details {"udem-000-ego0": {"driven_any": 0.3074291281738806, "survival_time": 2.8999999999999977, "driven_lanedir": 0.1995526730519679, "in-drivable-lane": 1.1499999999999968, "deviation-heading": 0.9488219555580462, "distance-from-start": 0.30742487448707223, "deviation-center-line": 0.1256753841612143, "driven_lanedir_consec": 0.1995526730519679}}simulation-passed 1 survival_time_max 2.8999999999999977 survival_time_mean 2.8999999999999977 survival_time_min 2.8999999999999977
No reset possible 5427695Bea Baselines minimal-agent aido-LFVI_multi-sim-validationsim-1of4 success no gpu-staging-spot-0-032021-10-31 21:26:22+00:00 2021-10-31 21:30:19+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.250000000000068 in-drivable-lane_median 11.000000000000073 driven_lanedir_consec_median 0.3959648974675054 deviation-center-line_median 0.2727383614229232
other stats deviation-center-line_max 0.3711792475730154 deviation-center-line_mean 0.2630702395458521 deviation-center-line_min 0.1356249877645468 deviation-heading_max 2.5383505748046193 deviation-heading_mean 1.5839274061600843 deviation-heading_median 1.530547580682912 deviation-heading_min 0.7362638884698944 distance-from-start_max 2.1822334065150604 distance-from-start_mean 1.3494658762364755 distance-from-start_median 1.4254146254447235 distance-from-start_min 0.3648008475413942 driven_any_max 2.182581278372698 driven_any_mean 1.3495961616000156 driven_any_median 1.4254980882355446 driven_any_min 0.3648071915562748 driven_lanedir_consec_max 0.6388981877279706 driven_lanedir_consec_mean 0.39763107862429714 driven_lanedir_consec_min 0.15969633183420706 driven_lanedir_max 0.6388981877279706 driven_lanedir_mean 0.39763107862429714 driven_lanedir_median 0.3959648974675054 driven_lanedir_min 0.15969633183420706 in-drivable-lane_max 12.800000000000068 in-drivable-lane_mean 11.012500000000074 in-drivable-lane_min 9.250000000000078 per-episodes details {"4way-000-ego0": {"driven_any": 1.1588419001142332, "survival_time": 14.250000000000068, "driven_lanedir": 0.331229062365487, "in-drivable-lane": 10.950000000000072, "deviation-heading": 2.5383505748046193, "distance-from-start": 1.1587848457868677, "deviation-center-line": 0.26973530940385876, "driven_lanedir_consec": 0.331229062365487}, "4way-000-ego1": {"driven_any": 0.3648071915562748, "survival_time": 14.250000000000068, "driven_lanedir": 0.15969633183420706, "in-drivable-lane": 12.800000000000068, "deviation-heading": 0.7478094709473372, "distance-from-start": 0.3648008475413942, "deviation-center-line": 0.1356249877645468, "driven_lanedir_consec": 0.15969633183420706}, "4way-000-ego2": {"driven_any": 1.692154276356856, "survival_time": 14.250000000000068, "driven_lanedir": 0.6388981877279706, "in-drivable-lane": 9.250000000000078, "deviation-heading": 2.3132856904184864, "distance-from-start": 1.6920444051025798, "deviation-center-line": 0.3711792475730154, "driven_lanedir_consec": 0.6388981877279706}, "4way-000-ego3": {"driven_any": 2.182581278372698, "survival_time": 14.250000000000068, "driven_lanedir": 0.4607007325695238, "in-drivable-lane": 11.050000000000072, "deviation-heading": 0.7362638884698944, "distance-from-start": 2.1822334065150604, "deviation-center-line": 0.2757414134419876, "driven_lanedir_consec": 0.4607007325695238}}simulation-passed 1 survival_time_max 14.250000000000068 survival_time_mean 14.250000000000068 survival_time_min 14.250000000000068
No reset possible 5396643Bea Baselines minimal-agent-full aido-LFV_multi-full-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-10-31 21:12:42+00:00 2021-10-31 21:25:57+00:00 0:13:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.17499999999996 driven_lanedir_consec_median 1.885977987821864 deviation-center-line_median 5.3420440939969716
other stats deviation-center-line_max 7.275924926736645 deviation-center-line_mean 5.706188820851575 deviation-center-line_min 4.86474216867571 deviation-heading_max 24.381184135059772 deviation-heading_mean 11.29955148851905 deviation-heading_median 7.478334178737182 deviation-heading_min 5.860353461542065 distance-from-start_max 2.7566543136035913 distance-from-start_mean 1.9175184910035223 distance-from-start_median 1.732391267435746 distance-from-start_min 1.4486371155390068 driven_any_max 3.519592343713626 driven_any_mean 2.7625082847871507 driven_any_median 2.7621738784712173 driven_any_min 2.006093038492542 driven_lanedir_consec_max 3.3853872720615663 driven_lanedir_consec_mean 2.143156838888662 driven_lanedir_consec_min 1.4152841078493523 driven_lanedir_max 3.3853872720615663 driven_lanedir_mean 2.6342033343012377 driven_lanedir_median 2.6339394480283285 driven_lanedir_min 1.883547169086726 in-drivable-lane_max 2.400000000000034 in-drivable-lane_mean 2.18749999999996 in-drivable-lane_min 1.9999999999998863 per-episodes details {"autolab-000-ego0": {"driven_any": 2.016760537304334, "survival_time": 59.99999999999873, "driven_lanedir": 1.904099016664742, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 24.381184135059772, "distance-from-start": 1.967934233485134, "deviation-center-line": 5.25275935214242, "driven_lanedir_consec": 1.8884088065570024}, "autolab-000-ego1": {"driven_any": 3.519592343713626, "survival_time": 59.99999999999873, "driven_lanedir": 3.3853872720615663, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066767019151304, "distance-from-start": 2.7566543136035913, "deviation-center-line": 5.431328835851522, "driven_lanedir_consec": 3.3853872720615663}, "autolab-000-ego2": {"driven_any": 3.5075872196381, "survival_time": 59.99999999999873, "driven_lanedir": 3.363779879391915, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.860353461542065, "distance-from-start": 1.4486371155390068, "deviation-center-line": 4.86474216867571, "driven_lanedir_consec": 1.4152841078493523}, "autolab-000-ego3": {"driven_any": 2.006093038492542, "survival_time": 59.99999999999873, "driven_lanedir": 1.883547169086726, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 7.889901338323059, "distance-from-start": 1.496848301386358, "deviation-center-line": 7.275924926736645, "driven_lanedir_consec": 1.883547169086726}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5395644Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 21:11:21+00:00 2021-10-31 21:12:36+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5393644Bea Baselines minimal-agent-full aido-LFVI_multi-full-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 21:09:45+00:00 2021-10-31 21:11:00+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5388434Bea Baselines template-tensorflow aido-LFV_multi-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-10-31 21:08:31+00:00 2021-10-31 21:09:39+00:00 0:01:08 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5384436Bea Baselines template-tensorflow aido-LFV-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-10-31 21:06:55+00:00 2021-10-31 21:08:18+00:00 0:01:23 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5374437Bea Baselines template-tensorflow aido-LFVI-sim-testingsim-0of4 failed no gpu-staging-spot-0-032021-10-31 21:05:10+00:00 2021-10-31 21:06:48+00:00 0:01:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5370438Bea Baselines template-tensorflow aido-LFI-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 21:03:17+00:00 2021-10-31 21:05:03+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5360439Bea Baselines template-tensorflow aido-LF-sim-testingsim-3of4 failed no gpu-staging-spot-0-032021-10-31 21:00:19+00:00 2021-10-31 21:02:52+00:00 0:02:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5354440Bea Baselines template-tensorflow aido-LFVI_multi-sim-testingsim-0of4 host-error no gpu-staging-spot-0-032021-10-31 20:57:59+00:00 2021-10-31 21:00:11+00:00 0:02:12 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/481264e9ad991b5e2c3bc0f9f0f7f343d37433d8b6033d09f43275a3fcd2ee15/json
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1265, in run_one
container = client.containers.get(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 897, in get
resp = self.client.api.inspect_container(container_id)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 771, in inspect_container
return self._result(
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/481264e9ad991b5e2c3bc0f9f0f7f343d37433d8b6033d09f43275a3fcd2ee15/json: Not Found ("No such container: 481264e9ad991b5e2c3bc0f9f0f7f343d37433d8b6033d09f43275a3fcd2ee15")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5338467Bea Baselines minimal-agent-state aido-LFVI-state-sim-testingsim-1of4 success no gpu-staging-spot-0-032021-10-31 20:49:09+00:00 2021-10-31 20:57:45+00:00 0:08:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.385444945074485 deviation-center-line_median 3.9396057444508545
other stats deviation-center-line_max 3.9396057444508545 deviation-center-line_mean 3.9396057444508545 deviation-center-line_min 3.9396057444508545 deviation-heading_max 5.447727941053875 deviation-heading_mean 5.447727941053875 deviation-heading_median 5.447727941053875 deviation-heading_min 5.447727941053875 distance-from-start_max 2.271008875297506 distance-from-start_mean 2.271008875297506 distance-from-start_median 2.271008875297506 distance-from-start_min 2.271008875297506 driven_any_max 3.5795880628439725 driven_any_mean 3.5795880628439725 driven_any_median 3.5795880628439725 driven_any_min 3.5795880628439725 driven_lanedir_consec_max 3.385444945074485 driven_lanedir_consec_mean 3.385444945074485 driven_lanedir_consec_min 3.385444945074485 driven_lanedir_max 3.547670088627387 driven_lanedir_mean 3.547670088627387 driven_lanedir_median 3.547670088627387 driven_lanedir_min 3.547670088627387 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.5795880628439725, "survival_time": 59.99999999999873, "driven_lanedir": 3.547670088627387, "in-drivable-lane": 0.0, "deviation-heading": 5.447727941053875, "distance-from-start": 2.271008875297506, "deviation-center-line": 3.9396057444508545, "driven_lanedir_consec": 3.385444945074485}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5331468Bea Baselines minimal-agent-state aido-LFV_multi-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 20:45:07+00:00 2021-10-31 20:48:55+00:00 0:03:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.9499999999998447 driven_lanedir_consec_median 3.263240026998127 deviation-center-line_median 6.92092898374527
other stats deviation-center-line_max 7.278875768698185 deviation-center-line_mean 6.92092898374527 deviation-center-line_min 6.562982198792354 deviation-heading_max 6.398456444977544 deviation-heading_mean 6.382402306354827 deviation-heading_median 6.382402306354827 deviation-heading_min 6.36634816773211 distance-from-start_max 1.6564545383599565 distance-from-start_mean 1.643956757921588 distance-from-start_median 1.643956757921588 distance-from-start_min 1.63145897748322 driven_any_max 3.4717176906196623 driven_any_mean 3.4611535550941017 driven_any_median 3.4611535550941017 driven_any_min 3.450589419568541 driven_lanedir_consec_max 3.2881993578511035 driven_lanedir_consec_mean 3.263240026998127 driven_lanedir_consec_min 3.2382806961451513 driven_lanedir_max 3.2881993578511035 driven_lanedir_mean 3.263240026998127 driven_lanedir_median 3.263240026998127 driven_lanedir_min 3.2382806961451513 in-drivable-lane_max 4.299999999999894 in-drivable-lane_mean 3.9499999999998447 in-drivable-lane_min 3.5999999999997954 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4717176906196623, "survival_time": 59.99999999999873, "driven_lanedir": 3.2881993578511035, "in-drivable-lane": 3.5999999999997954, "deviation-heading": 6.36634816773211, "distance-from-start": 1.63145897748322, "deviation-center-line": 6.562982198792354, "driven_lanedir_consec": 3.2881993578511035}, "loop2-000-ego1": {"driven_any": 3.450589419568541, "survival_time": 59.99999999999873, "driven_lanedir": 3.2382806961451513, "in-drivable-lane": 4.299999999999894, "deviation-heading": 6.398456444977544, "distance-from-start": 1.6564545383599565, "deviation-center-line": 7.278875768698185, "driven_lanedir_consec": 3.2382806961451513}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5324470Bea Baselines minimal-agent-state aido-LFV-state-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 20:39:29+00:00 2021-10-31 20:44:54+00:00 0:05:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.849999999999876 driven_lanedir_consec_median 2.2261398186252195 deviation-center-line_median 6.026388852659691
other stats deviation-center-line_max 6.026388852659691 deviation-center-line_mean 6.026388852659691 deviation-center-line_min 6.026388852659691 deviation-heading_max 10.12511562520589 deviation-heading_mean 10.12511562520589 deviation-heading_median 10.12511562520589 deviation-heading_min 10.12511562520589 distance-from-start_max 1.712119374671022 distance-from-start_mean 1.712119374671022 distance-from-start_median 1.712119374671022 distance-from-start_min 1.712119374671022 driven_any_max 3.434227933985191 driven_any_mean 3.434227933985191 driven_any_median 3.434227933985191 driven_any_min 3.434227933985191 driven_lanedir_consec_max 2.2261398186252195 driven_lanedir_consec_mean 2.2261398186252195 driven_lanedir_consec_min 2.2261398186252195 driven_lanedir_max 3.1490843763375547 driven_lanedir_mean 3.1490843763375547 driven_lanedir_median 3.1490843763375547 driven_lanedir_min 3.1490843763375547 in-drivable-lane_max 4.849999999999876 in-drivable-lane_mean 4.849999999999876 in-drivable-lane_min 4.849999999999876 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.434227933985191, "survival_time": 59.99999999999873, "driven_lanedir": 3.1490843763375547, "in-drivable-lane": 4.849999999999876, "deviation-heading": 10.12511562520589, "distance-from-start": 1.712119374671022, "deviation-center-line": 6.026388852659691, "driven_lanedir_consec": 2.2261398186252195}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5314483Bea Baselines baseline-simple-yield aido-LFV-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-10-31 20:36:36+00:00 2021-10-31 20:39:01+00:00 0:02:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.35000000000004 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.116943263707006 deviation-center-line_median 0.11371523984155717
other stats deviation-center-line_max 0.11371523984155717 deviation-center-line_mean 0.11371523984155717 deviation-center-line_min 0.11371523984155717 deviation-heading_max 1.1964666868192868 deviation-heading_mean 1.1964666868192868 deviation-heading_median 1.1964666868192868 deviation-heading_min 1.1964666868192868 distance-from-start_max 0.9553119406629068 distance-from-start_mean 0.9553119406629068 distance-from-start_median 0.9553119406629068 distance-from-start_min 0.9553119406629068 driven_any_max 1.1261312214304977 driven_any_mean 1.1261312214304977 driven_any_median 1.1261312214304977 driven_any_min 1.1261312214304977 driven_lanedir_consec_max 1.116943263707006 driven_lanedir_consec_mean 1.116943263707006 driven_lanedir_consec_min 1.116943263707006 driven_lanedir_max 1.116943263707006 driven_lanedir_mean 1.116943263707006 driven_lanedir_median 1.116943263707006 driven_lanedir_min 1.116943263707006 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.1261312214304977, "survival_time": 12.35000000000004, "driven_lanedir": 1.116943263707006, "in-drivable-lane": 0.0, "deviation-heading": 1.1964666868192868, "distance-from-start": 0.9553119406629068, "deviation-center-line": 0.11371523984155717, "driven_lanedir_consec": 1.116943263707006}}simulation-passed 1 survival_time_max 12.35000000000004 survival_time_mean 12.35000000000004 survival_time_min 12.35000000000004
No reset possible 5306472Bea Baselines baseline-simple-yield aido-LF-state-sim-validationsim-3of4 success no gpu-staging-spot-0-032021-10-31 20:31:54+00:00 2021-10-31 20:36:07+00:00 0:04:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.379280605881083 deviation-center-line_median 0.4086426394863958
other stats deviation-center-line_max 0.4086426394863958 deviation-center-line_mean 0.4086426394863958 deviation-center-line_min 0.4086426394863958 deviation-heading_max 3.257710113460004 deviation-heading_mean 3.257710113460004 deviation-heading_median 3.257710113460004 deviation-heading_min 3.257710113460004 distance-from-start_max 2.710848600829782 distance-from-start_mean 2.710848600829782 distance-from-start_median 2.710848600829782 distance-from-start_min 2.710848600829782 driven_any_max 5.395555302886635 driven_any_mean 5.395555302886635 driven_any_median 5.395555302886635 driven_any_min 5.395555302886635 driven_lanedir_consec_max 5.379280605881083 driven_lanedir_consec_mean 5.379280605881083 driven_lanedir_consec_min 5.379280605881083 driven_lanedir_max 5.379280605881083 driven_lanedir_mean 5.379280605881083 driven_lanedir_median 5.379280605881083 driven_lanedir_min 5.379280605881083 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.395555302886635, "survival_time": 59.99999999999873, "driven_lanedir": 5.379280605881083, "in-drivable-lane": 0.0, "deviation-heading": 3.257710113460004, "distance-from-start": 2.710848600829782, "deviation-center-line": 0.4086426394863958, "driven_lanedir_consec": 5.379280605881083}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5299487Bea Baselines minimal-agent aido-LFP-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 20:30:26+00:00 2021-10-31 20:31:48+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.4499999999999993 in-drivable-lane_median 0.6999999999999984 driven_lanedir_consec_median 0.19955231542409924 deviation-center-line_median 0.1256753125869936
other stats deviation-center-line_max 0.1256753125869936 deviation-center-line_mean 0.1256753125869936 deviation-center-line_min 0.1256753125869936 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.23316122665354827 distance-from-start_mean 0.23316122665354827 distance-from-start_median 0.23316122665354827 distance-from-start_min 0.23316122665354827 driven_any_max 0.23316442419546207 driven_any_mean 0.23316442419546207 driven_any_median 0.23316442419546207 driven_any_min 0.23316442419546207 driven_lanedir_consec_max 0.19955231542409924 driven_lanedir_consec_mean 0.19955231542409924 driven_lanedir_consec_min 0.19955231542409924 driven_lanedir_max 0.19955231542409924 driven_lanedir_mean 0.19955231542409924 driven_lanedir_median 0.19955231542409924 driven_lanedir_min 0.19955231542409924 in-drivable-lane_max 0.6999999999999984 in-drivable-lane_mean 0.6999999999999984 in-drivable-lane_min 0.6999999999999984 per-episodes details {"loop-000-ego0": {"driven_any": 0.23316442419546207, "survival_time": 2.4499999999999993, "driven_lanedir": 0.19955231542409924, "in-drivable-lane": 0.6999999999999984, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.23316122665354827, "deviation-center-line": 0.1256753125869936, "driven_lanedir_consec": 0.19955231542409924}}simulation-passed 1 survival_time_max 2.4499999999999993 survival_time_mean 2.4499999999999993 survival_time_min 2.4499999999999993
No reset possible 5282481Bea Baselines baseline-simple-yield aido-LFVI-state-sim-testingsim-2of4 success no gpu-staging-spot-0-032021-10-31 20:21:09+00:00 2021-10-31 20:30:12+00:00 0:09:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.936558467770946 deviation-center-line_median 0.704072479117435
other stats deviation-center-line_max 0.704072479117435 deviation-center-line_mean 0.704072479117435 deviation-center-line_min 0.704072479117435 deviation-heading_max 3.2476993641319134 deviation-heading_mean 3.2476993641319134 deviation-heading_median 3.2476993641319134 deviation-heading_min 3.2476993641319134 distance-from-start_max 2.4908879599333775 distance-from-start_mean 2.4908879599333775 distance-from-start_median 2.4908879599333775 distance-from-start_min 2.4908879599333775 driven_any_max 4.95168286773776 driven_any_mean 4.95168286773776 driven_any_median 4.95168286773776 driven_any_min 4.95168286773776 driven_lanedir_consec_max 4.936558467770946 driven_lanedir_consec_mean 4.936558467770946 driven_lanedir_consec_min 4.936558467770946 driven_lanedir_max 4.936558467770946 driven_lanedir_mean 4.936558467770946 driven_lanedir_median 4.936558467770946 driven_lanedir_min 4.936558467770946 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 4.95168286773776, "survival_time": 59.99999999999873, "driven_lanedir": 4.936558467770946, "in-drivable-lane": 0.0, "deviation-heading": 3.2476993641319134, "distance-from-start": 2.4908879599333775, "deviation-center-line": 0.704072479117435, "driven_lanedir_consec": 4.936558467770946}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5278490Bea Baselines minimal-agent aido-LFI-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 20:19:15+00:00 2021-10-31 20:21:02+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 5270475Bea Baselines baseline-simple-yield aido-LFVI-state-sim-validationsim-0of4 success no gpu-staging-spot-0-032021-10-31 20:09:23+00:00 2021-10-31 20:18:54+00:00 0:09:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.331344237139176 deviation-center-line_median 0.14341993721660595
other stats deviation-center-line_max 0.14341993721660595 deviation-center-line_mean 0.14341993721660595 deviation-center-line_min 0.14341993721660595 deviation-heading_max 1.3020944572743824 deviation-heading_mean 1.3020944572743824 deviation-heading_median 1.3020944572743824 deviation-heading_min 1.3020944572743824 distance-from-start_max 2.952739272534191 distance-from-start_mean 2.952739272534191 distance-from-start_median 2.952739272534191 distance-from-start_min 2.952739272534191 driven_any_max 5.629455349358906 driven_any_mean 5.629455349358906 driven_any_median 5.629455349358906 driven_any_min 5.629455349358906 driven_lanedir_consec_max 5.331344237139176 driven_lanedir_consec_mean 5.331344237139176 driven_lanedir_consec_min 5.331344237139176 driven_lanedir_max 5.62600246220405 driven_lanedir_mean 5.62600246220405 driven_lanedir_median 5.62600246220405 driven_lanedir_min 5.62600246220405 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.629455349358906, "survival_time": 59.99999999999873, "driven_lanedir": 5.62600246220405, "in-drivable-lane": 0.0, "deviation-heading": 1.3020944572743824, "distance-from-start": 2.952739272534191, "deviation-center-line": 0.14341993721660595, "driven_lanedir_consec": 5.331344237139176}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5257480Bea Baselines baseline-simple-yield aido-LFVI_multi-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 19:59:07+00:00 2021-10-31 20:09:15+00:00 0:10:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.49634916578956 deviation-center-line_median 0.19094046425276645
other stats deviation-center-line_max 0.24986042415305248 deviation-center-line_mean 0.18985217391943776 deviation-center-line_min 0.1276673430191657 deviation-heading_max 1.717963512215023 deviation-heading_mean 1.4545462563339835 deviation-heading_median 1.4664624947252969 deviation-heading_min 1.1672965236703177 distance-from-start_max 3.468692663867372 distance-from-start_mean 3.0052111787863516 distance-from-start_median 3.0986320628962627 distance-from-start_min 2.354887925485507 driven_any_max 5.804604986504682 driven_any_mean 5.267122824628235 driven_any_median 5.648531176262696 driven_any_min 3.966823959482864 driven_lanedir_consec_max 5.799353840314662 driven_lanedir_consec_mean 5.187606175229343 driven_lanedir_consec_min 3.9583725290235874 driven_lanedir_max 5.799353840314662 driven_lanedir_mean 5.261671552684617 driven_lanedir_median 5.644479920700109 driven_lanedir_min 3.9583725290235874 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 5.53848260532673, "survival_time": 59.99999999999873, "driven_lanedir": 5.53379952227268, "in-drivable-lane": 0.0, "deviation-heading": 1.359126757476075, "distance-from-start": 2.354887925485507, "deviation-center-line": 0.18361566006061136, "driven_lanedir_consec": 5.533799451359386}, "udem-001-ego1": {"driven_any": 5.804604986504682, "survival_time": 59.99999999999873, "driven_lanedir": 5.799353840314662, "in-drivable-lane": 0.0, "deviation-heading": 1.717963512215023, "distance-from-start": 3.468692663867372, "deviation-center-line": 0.1982652684449215, "driven_lanedir_consec": 5.799353840314662}, "udem-001-ego2": {"driven_any": 5.758579747198662, "survival_time": 59.99999999999873, "driven_lanedir": 5.755160319127538, "in-drivable-lane": 0.0, "deviation-heading": 1.1672965236703177, "distance-from-start": 3.1342802968590027, "deviation-center-line": 0.1276673430191657, "driven_lanedir_consec": 5.458898880219736}, "udem-001-ego3": {"driven_any": 3.966823959482864, "survival_time": 59.99999999999873, "driven_lanedir": 3.9583725290235874, "in-drivable-lane": 0.0, "deviation-heading": 1.5737982319745187, "distance-from-start": 3.062983828933523, "deviation-center-line": 0.24986042415305248, "driven_lanedir_consec": 3.9583725290235874}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5245482Bea Baselines baseline-simple-yield aido-LFV_multi-state-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 19:54:29+00:00 2021-10-31 19:58:38+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.666632590007421 deviation-center-line_median 0.31140873000764646
other stats deviation-center-line_max 0.36025561964774255 deviation-center-line_mean 0.31140873000764646 deviation-center-line_min 0.2625618403675503 deviation-heading_max 2.4450188093470064 deviation-heading_mean 2.41067092677401 deviation-heading_median 2.41067092677401 deviation-heading_min 2.3763230442010137 distance-from-start_max 1.5561803536011607 distance-from-start_mean 1.5387418886345556 distance-from-start_median 1.5387418886345556 distance-from-start_min 1.5213034236679508 driven_any_max 5.681963014330128 driven_any_mean 5.678653750290054 driven_any_median 5.678653750290054 driven_any_min 5.67534448624998 driven_lanedir_consec_max 5.667494145070765 driven_lanedir_consec_mean 5.666632590007421 driven_lanedir_consec_min 5.665771034944077 driven_lanedir_max 5.667494145070765 driven_lanedir_mean 5.666632590007421 driven_lanedir_median 5.666632590007421 driven_lanedir_min 5.665771034944077 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.681963014330128, "survival_time": 59.99999999999873, "driven_lanedir": 5.667494145070765, "in-drivable-lane": 0.0, "deviation-heading": 2.4450188093470064, "distance-from-start": 1.5213034236679508, "deviation-center-line": 0.2625618403675503, "driven_lanedir_consec": 5.667494145070765}, "loop2-000-ego1": {"driven_any": 5.67534448624998, "survival_time": 59.99999999999873, "driven_lanedir": 5.665771034944077, "in-drivable-lane": 0.0, "deviation-heading": 2.3763230442010137, "distance-from-start": 1.5561803536011607, "deviation-center-line": 0.36025561964774255, "driven_lanedir_consec": 5.665771034944077}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 5238488Bea Baselines minimal-agent aido-LFV-sim-validationsim-2of4 success no gpu-staging-spot-0-032021-10-31 19:51:59+00:00 2021-10-31 19:54:23+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.1999999999999895 in-drivable-lane_median 3.4499999999999886 driven_lanedir_consec_median 0.19955005044754337 deviation-center-line_median 0.12567516126913286
other stats deviation-center-line_max 0.12567516126913286 deviation-center-line_mean 0.12567516126913286 deviation-center-line_min 0.12567516126913286 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.689742337316815 distance-from-start_mean 0.689742337316815 distance-from-start_median 0.689742337316815 distance-from-start_min 0.689742337316815 driven_any_max 0.6897540728183593 driven_any_mean 0.6897540728183593 driven_any_median 0.6897540728183593 driven_any_min 0.6897540728183593 driven_lanedir_consec_max 0.19955005044754337 driven_lanedir_consec_mean 0.19955005044754337 driven_lanedir_consec_min 0.19955005044754337 driven_lanedir_max 0.19955005044754337 driven_lanedir_mean 0.19955005044754337 driven_lanedir_median 0.19955005044754337 driven_lanedir_min 0.19955005044754337 in-drivable-lane_max 3.4499999999999886 in-drivable-lane_mean 3.4499999999999886 in-drivable-lane_min 3.4499999999999886 per-episodes details {"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.1999999999999895 survival_time_min 5.1999999999999895
No reset possible 5235497Bea Baselines minimal-agent aido-LFI-sim-testingsim-0of4 success no gpu-staging-spot-0-032021-10-31 19:50:02+00:00 2021-10-31 19:51:52+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.049999999999994 in-drivable-lane_median 2.6499999999999932 driven_lanedir_consec_median 0.13666480491620847 deviation-center-line_median 0.1078383533310603
other stats deviation-center-line_max 0.1078383533310603 deviation-center-line_mean 0.1078383533310603 deviation-center-line_min 0.1078383533310603 deviation-heading_max 0.9508048428349388 deviation-heading_mean 0.9508048428349388 deviation-heading_median 0.9508048428349388 deviation-heading_min 0.9508048428349388 distance-from-start_max 0.4978300060106534 distance-from-start_mean 0.4978300060106534 distance-from-start_median 0.4978300060106534 distance-from-start_min 0.4978300060106534 driven_any_max 0.49784012437011577 driven_any_mean 0.49784012437011577 driven_any_median 0.49784012437011577 driven_any_min 0.49784012437011577 driven_lanedir_consec_max 0.13666480491620847 driven_lanedir_consec_mean 0.13666480491620847 driven_lanedir_consec_min 0.13666480491620847 driven_lanedir_max 0.13666480491620847 driven_lanedir_mean 0.13666480491620847 driven_lanedir_median 0.13666480491620847 driven_lanedir_min 0.13666480491620847 in-drivable-lane_max 2.6499999999999932 in-drivable-lane_mean 2.6499999999999932 in-drivable-lane_min 2.6499999999999932 per-episodes details {"udem1-000-ego0": {"driven_any": 0.49784012437011577, "survival_time": 4.049999999999994, "driven_lanedir": 0.13666480491620847, "in-drivable-lane": 2.6499999999999932, "deviation-heading": 0.9508048428349388, "distance-from-start": 0.4978300060106534, "deviation-center-line": 0.1078383533310603, "driven_lanedir_consec": 0.13666480491620847}}simulation-passed 1 survival_time_max 4.049999999999994 survival_time_mean 4.049999999999994 survival_time_min 4.049999999999994
No reset possible 5229495Bea Baselines minimal-agent aido-LFV-sim-testingsim-3of4 success no gpu-staging-spot-0-032021-10-31 19:47:00+00:00 2021-10-31 19:49:49+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.499999999999981 in-drivable-lane_median 6.299999999999981 driven_lanedir_consec_median 0.08715284181267591 deviation-center-line_median 0.0853101739641597
other stats deviation-center-line_max 0.0853101739641597 deviation-center-line_mean 0.0853101739641597 deviation-center-line_min 0.0853101739641597 deviation-heading_max 1.0211244921119549 deviation-heading_mean 1.0211244921119549 deviation-heading_median 1.0211244921119549 deviation-heading_min 1.0211244921119549 distance-from-start_max 1.0680700911320733 distance-from-start_mean 1.0680700911320733 distance-from-start_median 1.0680700911320733 distance-from-start_min 1.0680700911320733 driven_any_max 1.068124105945306 driven_any_mean 1.068124105945306 driven_any_median 1.068124105945306 driven_any_min 1.068124105945306 driven_lanedir_consec_max 0.08715284181267591 driven_lanedir_consec_mean 0.08715284181267591 driven_lanedir_consec_min 0.08715284181267591 driven_lanedir_max 0.08715284181267591 driven_lanedir_mean 0.08715284181267591 driven_lanedir_median 0.08715284181267591 driven_lanedir_min 0.08715284181267591 in-drivable-lane_max 6.299999999999981 in-drivable-lane_mean 6.299999999999981 in-drivable-lane_min 6.299999999999981 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.068124105945306, "survival_time": 7.499999999999981, "driven_lanedir": 0.08715284181267591, "in-drivable-lane": 6.299999999999981, "deviation-heading": 1.0211244921119549, "distance-from-start": 1.0680700911320733, "deviation-center-line": 0.0853101739641597, "driven_lanedir_consec": 0.08715284181267591}}simulation-passed 1 survival_time_max 7.499999999999981 survival_time_mean 7.499999999999981 survival_time_min 7.499999999999981
No reset possible 5195573Bea Baselines daffy-staging-9d9f8cdff21fbcfd152864fc4d7b7797c3f44a66 aido-hello-sim-validationsanity-check success no gpu-staging-spot-0-032021-10-31 13:39:22+00:00 2021-10-31 13:40:30+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.029510571514304473 deviation-center-line_median 0.005539674890560824
other stats deviation-center-line_max 0.005539674890560824 deviation-center-line_mean 0.005539674890560824 deviation-center-line_min 0.005539674890560824 deviation-heading_max 0.2974314644554261 deviation-heading_mean 0.2974314644554261 deviation-heading_median 0.2974314644554261 deviation-heading_min 0.2974314644554261 distance-from-start_max 0.03752968373190638 distance-from-start_mean 0.03752968373190638 distance-from-start_median 0.03752968373190638 distance-from-start_min 0.03752968373190638 driven_any_max 0.03765698314806042 driven_any_mean 0.03765698314806042 driven_any_median 0.03765698314806042 driven_any_min 0.03765698314806042 driven_lanedir_consec_max 0.029510571514304473 driven_lanedir_consec_mean 0.029510571514304473 driven_lanedir_consec_min 0.029510571514304473 driven_lanedir_max 0.029510571514304473 driven_lanedir_mean 0.029510571514304473 driven_lanedir_median 0.029510571514304473 driven_lanedir_min 0.029510571514304473 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03765698314806042, "survival_time": 0.49999999999999994, "driven_lanedir": 0.029510571514304473, "in-drivable-lane": 0.0, "deviation-heading": 0.2974314644554261, "distance-from-start": 0.03752968373190638, "deviation-center-line": 0.005539674890560824, "driven_lanedir_consec": 0.029510571514304473}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 5191598Bea Baselines challenge-aido_LF-template-tensorflow:daffy-staging:af1fc014c2aee6db343f310c27ecb68c7f4321ed aido-hello-sim-validationsanity-check failed no gpu-staging-spot-0-032021-10-31 13:33:05+00:00 2021-10-31 13:38:57+00:00 0:05:52 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Bea Baselines 🐤
Andrea Daniele
Liam Paull