Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 11942
746
Bea Baselines 🐤baseline-duckietown-ml aido-LFVI_multi-sim-testing
sim-0of4 timeout no davinci-stage-05-6.2.46
2022-11-18 21:12:17+00:00 - - - - No reset possible 11919
769
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-18 20:40:59+00:00 2022-11-18 21:10:06+00:00 0:29:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 14.074999999999708 driven_lanedir_consec_median 5.141182816211044 deviation-center-line_median 3.955967803308326
other stats deviation-center-line_max 4.5322745296846385 deviation-center-line_mean 3.926728071160226 deviation-center-line_min 3.2627021483396144 deviation-heading_max 20.569481201692433 deviation-heading_mean 19.23831802899749 deviation-heading_median 19.368804199972452 deviation-heading_min 17.646182514352624 distance-from-start_max 4.378987326571853 distance-from-start_mean 3.720837407830333 distance-from-start_median 3.909251003495856 distance-from-start_min 2.6858602977577664 driven_any_max 7.913722883063188 driven_any_mean 7.913624316618913 driven_any_median 7.913620123402469 driven_any_min 7.913534136607526 driven_lanedir_consec_max 5.37732577178441 driven_lanedir_consec_mean 5.08141783567593 driven_lanedir_consec_min 4.665979938497223 driven_lanedir_max 5.687353095341618 driven_lanedir_mean 5.233601519609524 driven_lanedir_median 5.290536522299626 driven_lanedir_min 4.665979938497223 in-drivable-lane_max 18.34999999999972 in-drivable-lane_mean 14.087499999999736 in-drivable-lane_min 9.849999999999806 per-episodes details {"autolab-000-ego0": {"driven_any": 7.913593620591611, "survival_time": 59.99999999999873, "driven_lanedir": 4.665979938497223, "in-drivable-lane": 18.34999999999972, "deviation-heading": 18.6238007214484, "distance-from-start": 3.832918892649974, "deviation-center-line": 3.2627021483396144, "driven_lanedir_consec": 4.665979938497223}, "autolab-000-ego1": {"driven_any": 7.913534136607526, "survival_time": 59.99999999999873, "driven_lanedir": 5.687353095341618, "in-drivable-lane": 9.849999999999806, "deviation-heading": 20.569481201692433, "distance-from-start": 4.378987326571853, "deviation-center-line": 4.5322745296846385, "driven_lanedir_consec": 5.240826461046253}, "autolab-000-ego2": {"driven_any": 7.913646626213328, "survival_time": 59.99999999999873, "driven_lanedir": 5.041539171375835, "in-drivable-lane": 15.149999999999627, "deviation-heading": 20.1138076784965, "distance-from-start": 2.6858602977577664, "deviation-center-line": 4.448668272401632, "driven_lanedir_consec": 5.041539171375835}, "autolab-000-ego3": {"driven_any": 7.913722883063188, "survival_time": 59.99999999999873, "driven_lanedir": 5.539533873223418, "in-drivable-lane": 12.999999999999789, "deviation-heading": 17.646182514352624, "distance-from-start": 3.9855831143417384, "deviation-center-line": 3.4632673342150193, "driven_lanedir_consec": 5.37732577178441}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11916
770
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-18 20:37:50+00:00 2022-11-18 20:40:40+00:00 0:02:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.200000000000038 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3389339891308152 deviation-center-line_median 0.7065545234291071
other stats deviation-center-line_max 0.7065545234291071 deviation-center-line_mean 0.7065545234291071 deviation-center-line_min 0.7065545234291071 deviation-heading_max 3.984357521916657 deviation-heading_mean 3.984357521916657 deviation-heading_median 3.984357521916657 deviation-heading_min 3.984357521916657 distance-from-start_max 1.1476012623330083 distance-from-start_mean 1.1476012623330083 distance-from-start_median 1.1476012623330083 distance-from-start_min 1.1476012623330083 driven_any_max 1.4683792901162775 driven_any_mean 1.4683792901162775 driven_any_median 1.4683792901162775 driven_any_min 1.4683792901162775 driven_lanedir_consec_max 1.3389339891308152 driven_lanedir_consec_mean 1.3389339891308152 driven_lanedir_consec_min 1.3389339891308152 driven_lanedir_max 1.3389339891308152 driven_lanedir_mean 1.3389339891308152 driven_lanedir_median 1.3389339891308152 driven_lanedir_min 1.3389339891308152 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.4683792901162775, "survival_time": 12.200000000000038, "driven_lanedir": 1.3389339891308152, "in-drivable-lane": 0.0, "deviation-heading": 3.984357521916657, "distance-from-start": 1.1476012623330083, "deviation-center-line": 0.7065545234291071, "driven_lanedir_consec": 1.3389339891308152}}simulation-passed 1 survival_time_max 12.200000000000038 survival_time_mean 12.200000000000038 survival_time_min 12.200000000000038
No reset possible 11910
771
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-18 20:27:06+00:00 2022-11-18 20:37:27+00:00 0:10:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 37.7 in-drivable-lane_median 11.25000000000016 driven_lanedir_consec_median 2.275468278969396 deviation-center-line_median 1.2809664411792592
other stats deviation-center-line_max 1.2809664411792592 deviation-center-line_mean 1.2809664411792592 deviation-center-line_min 1.2809664411792592 deviation-heading_max 4.432676093910391 deviation-heading_mean 4.432676093910391 deviation-heading_median 4.432676093910391 deviation-heading_min 4.432676093910391 distance-from-start_max 2.2150956855273507 distance-from-start_mean 2.2150956855273507 distance-from-start_median 2.2150956855273507 distance-from-start_min 2.2150956855273507 driven_any_max 4.860450204196046 driven_any_mean 4.860450204196046 driven_any_median 4.860450204196046 driven_any_min 4.860450204196046 driven_lanedir_consec_max 2.275468278969396 driven_lanedir_consec_mean 2.275468278969396 driven_lanedir_consec_min 2.275468278969396 driven_lanedir_max 3.1990430075191765 driven_lanedir_mean 3.1990430075191765 driven_lanedir_median 3.1990430075191765 driven_lanedir_min 3.1990430075191765 in-drivable-lane_max 11.25000000000016 in-drivable-lane_mean 11.25000000000016 in-drivable-lane_min 11.25000000000016 per-episodes details {"autolab-000-ego0": {"driven_any": 4.860450204196046, "survival_time": 37.7, "driven_lanedir": 3.1990430075191765, "in-drivable-lane": 11.25000000000016, "deviation-heading": 4.432676093910391, "distance-from-start": 2.2150956855273507, "deviation-center-line": 1.2809664411792592, "driven_lanedir_consec": 2.275468278969396}}simulation-passed 1 survival_time_max 37.7 survival_time_mean 37.7 survival_time_min 37.7
No reset possible 11908
772
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-18 20:24:26+00:00 2022-11-18 20:27:00+00:00 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11905
773
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-18 20:21:41+00:00 2022-11-18 20:23:48+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.749999999999991 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4527532014389899 deviation-center-line_median 0.14740407930293228
other stats deviation-center-line_max 0.14740407930293228 deviation-center-line_mean 0.14740407930293228 deviation-center-line_min 0.14740407930293228 deviation-heading_max 1.5861385859040529 deviation-heading_mean 1.5861385859040529 deviation-heading_median 1.5861385859040529 deviation-heading_min 1.5861385859040529 distance-from-start_max 0.4583692045648861 distance-from-start_mean 0.4583692045648861 distance-from-start_median 0.4583692045648861 distance-from-start_min 0.4583692045648861 driven_any_max 0.47930048659455193 driven_any_mean 0.47930048659455193 driven_any_median 0.47930048659455193 driven_any_min 0.47930048659455193 driven_lanedir_consec_max 0.4527532014389899 driven_lanedir_consec_mean 0.4527532014389899 driven_lanedir_consec_min 0.4527532014389899 driven_lanedir_max 0.4527532014389899 driven_lanedir_mean 0.4527532014389899 driven_lanedir_median 0.4527532014389899 driven_lanedir_min 0.4527532014389899 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.47930048659455193, "survival_time": 4.749999999999991, "driven_lanedir": 0.4527532014389899, "in-drivable-lane": 0.0, "deviation-heading": 1.5861385859040529, "distance-from-start": 0.4583692045648861, "deviation-center-line": 0.14740407930293228, "driven_lanedir_consec": 0.4527532014389899}}simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 4.749999999999991 survival_time_min 4.749999999999991
No reset possible 11901
775
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-18 20:13:14+00:00 2022-11-18 20:21:11+00:00 0:07:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.65000000000006 in-drivable-lane_median 3.425000000000006 driven_lanedir_consec_median 0.6605896105000579 deviation-center-line_median 0.6540547431104823
other stats deviation-center-line_max 1.0636556357405234 deviation-center-line_mean 0.742335918756299 deviation-center-line_min 0.5975785530637079 deviation-heading_max 6.827141382750471 deviation-heading_mean 4.886833506515348 deviation-heading_median 4.836178109010353 deviation-heading_min 3.0478364252902144 distance-from-start_max 1.0302491463967631 distance-from-start_mean 0.7416562689637659 distance-from-start_median 0.7494663440045719 distance-from-start_min 0.4374432414491566 driven_any_max 1.6672913246802954 driven_any_mean 1.2375736914087108 driven_any_median 1.4084899152061474 driven_any_min 0.4660236105422531 driven_lanedir_consec_max 1.0256784273690882 driven_lanedir_consec_mean 0.6950989765932919 driven_lanedir_consec_min 0.4335382580039635 driven_lanedir_max 1.0407277515327629 driven_lanedir_mean 0.8087643467606702 driven_lanedir_median 0.8803956887529771 driven_lanedir_min 0.4335382580039635 in-drivable-lane_max 4.600000000000023 in-drivable-lane_mean 2.8625000000000087 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.6672913246802954, "survival_time": 13.65000000000006, "driven_lanedir": 1.0256784273690882, "in-drivable-lane": 3.650000000000023, "deviation-heading": 3.7042581674074504, "distance-from-start": 1.0302491463967631, "deviation-center-line": 0.6791989476964148, "driven_lanedir_consec": 1.0256784273690882}, "4way-000-ego1": {"driven_any": 1.5013451356712324, "survival_time": 13.65000000000006, "driven_lanedir": 1.0407277515327629, "in-drivable-lane": 4.600000000000023, "deviation-heading": 3.0478364252902144, "distance-from-start": 0.5311800028610036, "deviation-center-line": 0.5975785530637079, "driven_lanedir_consec": 0.5860687577571109}, "4way-000-ego2": {"driven_any": 1.3156346947410624, "survival_time": 13.65000000000006, "driven_lanedir": 0.735112950136866, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 5.968098050613256, "distance-from-start": 0.96775268514814, "deviation-center-line": 0.6289105385245498, "driven_lanedir_consec": 0.7351104632430051}, "4way-000-ego3": {"driven_any": 0.4660236105422531, "survival_time": 13.65000000000006, "driven_lanedir": 0.4335382580039635, "in-drivable-lane": 0.0, "deviation-heading": 6.827141382750471, "distance-from-start": 0.4374432414491566, "deviation-center-line": 1.0636556357405234, "driven_lanedir_consec": 0.4335382580039635}}simulation-passed 1 survival_time_max 13.65000000000006 survival_time_mean 13.65000000000006 survival_time_min 13.65000000000006
No reset possible 11899
775
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-18 20:11:31+00:00 2022-11-18 20:13:06+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11892
776
Bea Baselines 🐤baseline-RPL-ros aido-LFV_multi-sim-testing
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-18 20:07:40+00:00 2022-11-18 20:11:17+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.800000000000075 in-drivable-lane_median 1.3000000000000105 driven_lanedir_consec_median 1.1666473134865585 deviation-center-line_median 1.3095731197953775
other stats deviation-center-line_max 1.627219519230752 deviation-center-line_mean 1.3095731197953775 deviation-center-line_min 0.9919267203600034 deviation-heading_max 4.052831428421009 deviation-heading_mean 3.60494110964668 deviation-heading_median 3.60494110964668 deviation-heading_min 3.1570507908723515 distance-from-start_max 1.1298887050544093 distance-from-start_mean 0.9362750418613616 distance-from-start_median 0.9362750418613616 distance-from-start_min 0.742661378668314 driven_any_max 1.8136447117422525 driven_any_mean 1.8135971966032312 driven_any_median 1.8135971966032312 driven_any_min 1.81354968146421 driven_lanedir_consec_max 1.4315670076336438 driven_lanedir_consec_mean 1.1666473134865585 driven_lanedir_consec_min 0.901727619339473 driven_lanedir_max 1.5889815808284078 driven_lanedir_mean 1.5607441457785618 driven_lanedir_median 1.5607441457785618 driven_lanedir_min 1.5325067107287158 in-drivable-lane_max 1.7000000000000242 in-drivable-lane_mean 1.3000000000000105 in-drivable-lane_min 0.8999999999999968 per-episodes details {"loop2-000-ego0": {"driven_any": 1.8136447117422525, "survival_time": 14.800000000000075, "driven_lanedir": 1.5889815808284078, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 3.1570507908723515, "distance-from-start": 0.742661378668314, "deviation-center-line": 0.9919267203600034, "driven_lanedir_consec": 0.901727619339473}, "loop2-000-ego1": {"driven_any": 1.81354968146421, "survival_time": 14.800000000000075, "driven_lanedir": 1.5325067107287158, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 4.052831428421009, "distance-from-start": 1.1298887050544093, "deviation-center-line": 1.627219519230752, "driven_lanedir_consec": 1.4315670076336438}}simulation-passed 1 survival_time_max 14.800000000000075 survival_time_mean 14.800000000000075 survival_time_min 14.800000000000075
No reset possible 11867
778
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-18 19:49:32+00:00 2022-11-18 19:55:58+00:00 0:06:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 19.850000000000147 in-drivable-lane_median 8.800000000000125 driven_lanedir_consec_median 1.1782221780314162 deviation-center-line_median 0.6176429159942289
other stats deviation-center-line_max 0.6176429159942289 deviation-center-line_mean 0.6176429159942289 deviation-center-line_min 0.6176429159942289 deviation-heading_max 4.4914846830164565 deviation-heading_mean 4.4914846830164565 deviation-heading_median 4.4914846830164565 deviation-heading_min 4.4914846830164565 distance-from-start_max 1.0975500969105816 distance-from-start_mean 1.0975500969105816 distance-from-start_median 1.0975500969105816 distance-from-start_min 1.0975500969105816 driven_any_max 2.4902767162296384 driven_any_mean 2.4902767162296384 driven_any_median 2.4902767162296384 driven_any_min 2.4902767162296384 driven_lanedir_consec_max 1.1782221780314162 driven_lanedir_consec_mean 1.1782221780314162 driven_lanedir_consec_min 1.1782221780314162 driven_lanedir_max 1.1782221780314162 driven_lanedir_mean 1.1782221780314162 driven_lanedir_median 1.1782221780314162 driven_lanedir_min 1.1782221780314162 in-drivable-lane_max 8.800000000000125 in-drivable-lane_mean 8.800000000000125 in-drivable-lane_min 8.800000000000125 per-episodes details {"autolab-000-ego0": {"driven_any": 2.4902767162296384, "survival_time": 19.850000000000147, "driven_lanedir": 1.1782221780314162, "in-drivable-lane": 8.800000000000125, "deviation-heading": 4.4914846830164565, "distance-from-start": 1.0975500969105816, "deviation-center-line": 0.6176429159942289, "driven_lanedir_consec": 1.1782221780314162}}simulation-passed 1 survival_time_max 19.850000000000147 survival_time_mean 19.850000000000147 survival_time_min 19.850000000000147
No reset possible 11803
781
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-testing
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-17 22:57:13+00:00 2022-11-17 23:03:23+00:00 0:06:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 5.822059164325163 survival_time_median 59.99999999999873 deviation-center-line_median 4.39684639132684 in-drivable-lane_median 12.399999999999542
other stats deviation-center-line_max 4.39684639132684 deviation-center-line_mean 4.39684639132684 deviation-center-line_min 4.39684639132684 deviation-heading_max 11.58658232761342 deviation-heading_mean 11.58658232761342 deviation-heading_median 11.58658232761342 deviation-heading_min 11.58658232761342 distance-from-start_max 2.84262918857978 distance-from-start_mean 2.84262918857978 distance-from-start_median 2.84262918857978 distance-from-start_min 2.84262918857978 driven_any_max 7.907701940705028 driven_any_mean 7.907701940705028 driven_any_median 7.907701940705028 driven_any_min 7.907701940705028 driven_lanedir_consec_max 5.822059164325163 driven_lanedir_consec_mean 5.822059164325163 driven_lanedir_consec_min 5.822059164325163 driven_lanedir_max 5.906165721321953 driven_lanedir_mean 5.906165721321953 driven_lanedir_median 5.906165721321953 driven_lanedir_min 5.906165721321953 in-drivable-lane_max 12.399999999999542 in-drivable-lane_mean 12.399999999999542 in-drivable-lane_min 12.399999999999542 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.907701940705028, "survival_time": 59.99999999999873, "driven_lanedir": 5.906165721321953, "in-drivable-lane": 12.399999999999542, "deviation-heading": 11.58658232761342, "distance-from-start": 2.84262918857978, "deviation-center-line": 4.39684639132684, "driven_lanedir_consec": 5.822059164325163}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11795
782
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-17 22:52:12+00:00 2022-11-17 22:57:05+00:00 0:04:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.399999999999984 in-drivable-lane_median 2.074999999999998 driven_lanedir_consec_median 0.5707075217159034 deviation-center-line_median 0.4029769416170714
other stats deviation-center-line_max 0.8176183600311697 deviation-center-line_mean 0.48302499740267135 deviation-center-line_min 0.3085277463453726 deviation-heading_max 3.695581885093652 deviation-heading_mean 2.240741744153695 deviation-heading_median 2.0951895416999604 deviation-heading_min 1.077006008121209 distance-from-start_max 0.939170817967668 distance-from-start_mean 0.5530468986080372 distance-from-start_median 0.5770312613204687 distance-from-start_min 0.11895425382354372 driven_any_max 0.9705537104028884 driven_any_mean 0.7513730930377183 driven_any_median 0.7944956058310584 driven_any_min 0.4459474500858678 driven_lanedir_consec_max 0.936985340525009 driven_lanedir_consec_mean 0.5534397498433035 driven_lanedir_consec_min 0.13535861541639815 driven_lanedir_max 0.936985340525009 driven_lanedir_mean 0.5962104468686237 driven_lanedir_median 0.6562489157665438 driven_lanedir_min 0.13535861541639815 in-drivable-lane_max 2.849999999999996 in-drivable-lane_mean 1.749999999999998 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.4459474500858678, "survival_time": 8.399999999999984, "driven_lanedir": 0.13535861541639815, "in-drivable-lane": 1.749999999999998, "deviation-heading": 3.695581885093652, "distance-from-start": 0.11895425382354372, "deviation-center-line": 0.3589148024208607, "driven_lanedir_consec": 0.13535861541639815}, "udem-000-ego1": {"driven_any": 0.9705537104028884, "survival_time": 8.399999999999984, "driven_lanedir": 0.936985340525009, "in-drivable-lane": 0.0, "deviation-heading": 1.787376778568852, "distance-from-start": 0.939170817967668, "deviation-center-line": 0.8176183600311697, "driven_lanedir_consec": 0.936985340525009}, "udem-000-ego2": {"driven_any": 0.7779324659167339, "survival_time": 8.399999999999984, "driven_lanedir": 0.6565515895684806, "in-drivable-lane": 2.849999999999996, "deviation-heading": 1.077006008121209, "distance-from-start": 0.5794659737067182, "deviation-center-line": 0.3085277463453726, "driven_lanedir_consec": 0.577829445905619}, "udem-000-ego3": {"driven_any": 0.811058745745383, "survival_time": 8.399999999999984, "driven_lanedir": 0.6559462419646069, "in-drivable-lane": 2.3999999999999977, "deviation-heading": 2.403002304831069, "distance-from-start": 0.5745965489342192, "deviation-center-line": 0.44703908081328214, "driven_lanedir_consec": 0.5635855975261879}}simulation-passed 1 survival_time_max 8.399999999999984 survival_time_mean 8.399999999999984 survival_time_min 8.399999999999984
No reset possible 11791
800
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-0of4 failed no davinci-stage-05-6.2.46
2022-11-17 22:47:06+00:00 2022-11-17 22:51:43+00:00 0:04:37 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11783
801
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-1of4 failed no davinci-stage-05-6.2.46
2022-11-17 22:44:16+00:00 2022-11-17 22:46:50+00:00 0:02:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11776
806
user1000001 minimal-agent aido-LFV-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 22:40:42+00:00 2022-11-17 22:43:46+00:00 0:03:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.1999999999999895 in-drivable-lane_median 3.4499999999999886 driven_lanedir_consec_median 0.19955005044754337 deviation-center-line_median 0.12567516126913286
other stats deviation-center-line_max 0.12567516126913286 deviation-center-line_mean 0.12567516126913286 deviation-center-line_min 0.12567516126913286 deviation-heading_max 0.9488219555580458 deviation-heading_mean 0.9488219555580458 deviation-heading_median 0.9488219555580458 deviation-heading_min 0.9488219555580458 distance-from-start_max 0.689742337316815 distance-from-start_mean 0.689742337316815 distance-from-start_median 0.689742337316815 distance-from-start_min 0.689742337316815 driven_any_max 0.6897540728183593 driven_any_mean 0.6897540728183593 driven_any_median 0.6897540728183593 driven_any_min 0.6897540728183593 driven_lanedir_consec_max 0.19955005044754337 driven_lanedir_consec_mean 0.19955005044754337 driven_lanedir_consec_min 0.19955005044754337 driven_lanedir_max 0.19955005044754337 driven_lanedir_mean 0.19955005044754337 driven_lanedir_median 0.19955005044754337 driven_lanedir_min 0.19955005044754337 in-drivable-lane_max 3.4499999999999886 in-drivable-lane_mean 3.4499999999999886 in-drivable-lane_min 3.4499999999999886 per-episodes details {"loop-000-ego0": {"driven_any": 0.6897540728183593, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19955005044754337, "in-drivable-lane": 3.4499999999999886, "deviation-heading": 0.9488219555580458, "distance-from-start": 0.689742337316815, "deviation-center-line": 0.12567516126913286, "driven_lanedir_consec": 0.19955005044754337}}simulation-passed 1 survival_time_max 5.1999999999999895 survival_time_mean 5.1999999999999895 survival_time_min 5.1999999999999895
No reset possible 11767
808
Andrea Censi template-random aido-LFV-sim-validation
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-17 22:31:04+00:00 2022-11-17 22:39:05+00:00 0:08:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 18.400000000000126 in-drivable-lane_median 9.6500000000001 driven_lanedir_consec_median 0.2737818968396458 deviation-center-line_median 0.799573856657706
other stats deviation-center-line_max 0.799573856657706 deviation-center-line_mean 0.799573856657706 deviation-center-line_min 0.799573856657706 deviation-heading_max 6.366511388189685 deviation-heading_mean 6.366511388189685 deviation-heading_median 6.366511388189685 deviation-heading_min 6.366511388189685 distance-from-start_max 0.6736010379604951 distance-from-start_mean 0.6736010379604951 distance-from-start_median 0.6736010379604951 distance-from-start_min 0.6736010379604951 driven_any_max 4.170232497072811 driven_any_mean 4.170232497072811 driven_any_median 4.170232497072811 driven_any_min 4.170232497072811 driven_lanedir_consec_max 0.2737818968396458 driven_lanedir_consec_mean 0.2737818968396458 driven_lanedir_consec_min 0.2737818968396458 driven_lanedir_max 0.2565970421753513 driven_lanedir_mean 0.2565970421753513 driven_lanedir_median 0.2565970421753513 driven_lanedir_min 0.2565970421753513 in-drivable-lane_max 9.6500000000001 in-drivable-lane_mean 9.6500000000001 in-drivable-lane_min 9.6500000000001 per-episodes details {"zigzag-000-ego0": {"driven_any": 4.170232497072811, "survival_time": 18.400000000000126, "driven_lanedir": 0.2565970421753513, "in-drivable-lane": 9.6500000000001, "deviation-heading": 6.366511388189685, "distance-from-start": 0.6736010379604951, "deviation-center-line": 0.799573856657706, "driven_lanedir_consec": 0.2737818968396458}}simulation-passed 1 survival_time_max 18.400000000000126 survival_time_mean 18.400000000000126 survival_time_min 18.400000000000126
No reset possible 11728
811
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-17 22:11:59+00:00 2022-11-17 22:25:49+00:00 0:13:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 51.34999999999922 in-drivable-lane_median 15.599999999999683 driven_lanedir_consec_median 4.337179518719494 deviation-center-line_median 2.666217770879334
other stats deviation-center-line_max 2.666217770879334 deviation-center-line_mean 2.666217770879334 deviation-center-line_min 2.666217770879334 deviation-heading_max 7.951512255252329 deviation-heading_mean 7.951512255252329 deviation-heading_median 7.951512255252329 deviation-heading_min 7.951512255252329 distance-from-start_max 2.5870127422826052 distance-from-start_mean 2.5870127422826052 distance-from-start_median 2.5870127422826052 distance-from-start_min 2.5870127422826052 driven_any_max 6.672893795686705 driven_any_mean 6.672893795686705 driven_any_median 6.672893795686705 driven_any_min 6.672893795686705 driven_lanedir_consec_max 4.337179518719494 driven_lanedir_consec_mean 4.337179518719494 driven_lanedir_consec_min 4.337179518719494 driven_lanedir_max 4.337179518719494 driven_lanedir_mean 4.337179518719494 driven_lanedir_median 4.337179518719494 driven_lanedir_min 4.337179518719494 in-drivable-lane_max 15.599999999999683 in-drivable-lane_mean 15.599999999999683 in-drivable-lane_min 15.599999999999683 per-episodes details {"autolab-000-ego0": {"driven_any": 6.672893795686705, "survival_time": 51.34999999999922, "driven_lanedir": 4.337179518719494, "in-drivable-lane": 15.599999999999683, "deviation-heading": 7.951512255252329, "distance-from-start": 2.5870127422826052, "deviation-center-line": 2.666217770879334, "driven_lanedir_consec": 4.337179518719494}}simulation-passed 1 survival_time_max 51.34999999999922 survival_time_mean 51.34999999999922 survival_time_min 51.34999999999922
No reset possible 11727
811
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-3of4 host-error no davinci-stage-05-6.2.46
2022-11-17 22:04:29+00:00 2022-11-17 22:11:44+00:00 0:07:15 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-05-6.2.46-job11727-611457, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.46-job11727-611457', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11720
813
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-17 21:57:59+00:00 2022-11-17 22:04:09+00:00 0:06:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6017417553703126e-06 survival_time_median 59.99999999999873 deviation-center-line_median 0.8949077950231444 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8949077950231444 deviation-center-line_mean 0.8949077950231444 deviation-center-line_min 0.8949077950231444 deviation-heading_max 32.24912799874442 deviation-heading_mean 32.24912799874442 deviation-heading_median 32.24912799874442 deviation-heading_min 32.24912799874442 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 2.6017417553703126e-06 driven_lanedir_consec_mean 2.6017417553703126e-06 driven_lanedir_consec_min 2.6017417553703126e-06 driven_lanedir_max 2.6017417553703126e-06 driven_lanedir_mean 2.6017417553703126e-06 driven_lanedir_median 2.6017417553703126e-06 driven_lanedir_min 2.6017417553703126e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11710
813
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-17 21:48:15+00:00 2022-11-17 21:54:34+00:00 0:06:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 4.299873040820765 survival_time_median 59.99999999999873 deviation-center-line_median 3.9369300809648857 in-drivable-lane_median 19.19999999999972
other stats deviation-center-line_max 3.9369300809648857 deviation-center-line_mean 3.9369300809648857 deviation-center-line_min 3.9369300809648857 deviation-heading_max 12.987045081279454 deviation-heading_mean 12.987045081279454 deviation-heading_median 12.987045081279454 deviation-heading_min 12.987045081279454 distance-from-start_max 1.18605467583518 distance-from-start_mean 1.18605467583518 distance-from-start_median 1.18605467583518 distance-from-start_min 1.18605467583518 driven_any_max 7.9072598222482124 driven_any_mean 7.9072598222482124 driven_any_median 7.9072598222482124 driven_any_min 7.9072598222482124 driven_lanedir_consec_max 4.299873040820765 driven_lanedir_consec_mean 4.299873040820765 driven_lanedir_consec_min 4.299873040820765 driven_lanedir_max 4.81588361637947 driven_lanedir_mean 4.81588361637947 driven_lanedir_median 4.81588361637947 driven_lanedir_min 4.81588361637947 in-drivable-lane_max 19.19999999999972 in-drivable-lane_mean 19.19999999999972 in-drivable-lane_min 19.19999999999972 per-episodes details {"loop2-000-ego0": {"driven_any": 7.9072598222482124, "survival_time": 59.99999999999873, "driven_lanedir": 4.81588361637947, "in-drivable-lane": 19.19999999999972, "deviation-heading": 12.987045081279454, "distance-from-start": 1.18605467583518, "deviation-center-line": 3.9369300809648857, "driven_lanedir_consec": 4.299873040820765}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11703
814
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-17 21:42:53+00:00 2022-11-17 21:48:09+00:00 0:05:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0 survival_time_median 59.99999999999873 deviation-center-line_median 0.8948943425963037 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8948943425963037 deviation-center-line_mean 0.8948943425963037 deviation-center-line_min 0.8948943425963037 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 1.3877787807814454e-16 distance-from-start_mean 1.3877787807814454e-16 distance-from-start_median 1.3877787807814454e-16 distance-from-start_min 1.3877787807814454e-16 driven_any_max 1.665334536937735e-13 driven_any_mean 1.665334536937735e-13 driven_any_median 1.665334536937735e-13 driven_any_min 1.665334536937735e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11698
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 21:37:20+00:00 2022-11-17 21:42:32+00:00 0:05:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.833625978773518 deviation-center-line_median 0.2109719022502864
other stats deviation-center-line_max 0.2109719022502864 deviation-center-line_mean 0.2109719022502864 deviation-center-line_min 0.2109719022502864 deviation-heading_max 1.8837432004186612 deviation-heading_mean 1.8837432004186612 deviation-heading_median 1.8837432004186612 deviation-heading_min 1.8837432004186612 distance-from-start_max 2.0412677228822265 distance-from-start_mean 2.0412677228822265 distance-from-start_median 2.0412677228822265 distance-from-start_min 2.0412677228822265 driven_any_max 5.844418063649684 driven_any_mean 5.844418063649684 driven_any_median 5.844418063649684 driven_any_min 5.844418063649684 driven_lanedir_consec_max 5.833625978773518 driven_lanedir_consec_mean 5.833625978773518 driven_lanedir_consec_min 5.833625978773518 driven_lanedir_max 5.833625978773518 driven_lanedir_mean 5.833625978773518 driven_lanedir_median 5.833625978773518 driven_lanedir_min 5.833625978773518 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.844418063649684, "survival_time": 59.99999999999873, "driven_lanedir": 5.833625978773518, "in-drivable-lane": 0.0, "deviation-heading": 1.8837432004186612, "distance-from-start": 2.0412677228822265, "deviation-center-line": 0.2109719022502864, "driven_lanedir_consec": 5.833625978773518}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11697
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-0of4 host-error no davinci-stage-05-6.2.46
2022-11-17 21:36:39+00:00 2022-11-17 21:37:13+00:00 0:00:34 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11696
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-2of4 host-error no davinci-stage-05-6.2.46
2022-11-17 21:34:42+00:00 2022-11-17 21:36:30+00:00 0:01:48 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11695
816
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-validation
sim-3of4 host-error no davinci-stage-05-6.2.46
2022-11-17 21:33:32+00:00 2022-11-17 21:34:35+00:00 0:01:03 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11690
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-17 21:21:40+00:00 2022-11-17 21:33:04+00:00 0:11:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.9345733957247475 deviation-center-line_median 0.1495255122147401
other stats deviation-center-line_max 1.0816161636507569 deviation-center-line_mean 0.3677032911639634 deviation-center-line_min 0.09014597657561622 deviation-heading_max 7.662512790853319 deviation-heading_mean 2.8003090495633742 deviation-heading_median 1.3383485799995245 deviation-heading_min 0.8620262474011284 distance-from-start_max 2.328675391154607 distance-from-start_mean 1.768545897067653 distance-from-start_median 1.8943393617573885 distance-from-start_min 0.9568294736012292 driven_any_max 5.743174255101718 driven_any_mean 2.8303400578667937 driven_any_median 2.141544029418139 driven_any_min 1.2950979175291768 driven_lanedir_consec_max 5.737782330849534 driven_lanedir_consec_mean 2.72368023429597 driven_lanedir_consec_min 1.2877918148848522 driven_lanedir_max 5.737782401111865 driven_lanedir_mean 2.8244219785143843 driven_lanedir_median 2.1360568490304095 driven_lanedir_min 1.2877918148848522 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 1.2950979175291768, "survival_time": 59.99999999999873, "driven_lanedir": 1.2877918148848522, "in-drivable-lane": 0.0, "deviation-heading": 1.3173151367489415, "distance-from-start": 0.9568294736012292, "deviation-center-line": 0.1343792570180741, "driven_lanedir_consec": 1.2877918148848522}, "4way-000-ego1": {"driven_any": 1.793822470316908, "survival_time": 59.99999999999873, "driven_lanedir": 1.785553264636787, "in-drivable-lane": 0.0, "deviation-heading": 7.662512790853319, "distance-from-start": 1.7715478688511692, "deviation-center-line": 1.0816161636507569, "driven_lanedir_consec": 1.382586358025463}, "4way-000-ego2": {"driven_any": 5.743174255101718, "survival_time": 59.99999999999873, "driven_lanedir": 5.737782401111865, "in-drivable-lane": 0.0, "deviation-heading": 1.3593820232501066, "distance-from-start": 2.328675391154607, "deviation-center-line": 0.16467176741140607, "driven_lanedir_consec": 5.737782330849534}, "4way-000-ego3": {"driven_any": 2.48926558851937, "survival_time": 59.99999999999873, "driven_lanedir": 2.486560433424032, "in-drivable-lane": 0.0, "deviation-heading": 0.8620262474011284, "distance-from-start": 2.0171308546636073, "deviation-center-line": 0.09014597657561622, "driven_lanedir_consec": 2.486560433424032}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11684
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
348 success yes davinci-stage-05-6.2.46
2022-11-17 21:10:40+00:00 2022-11-17 21:21:26+00:00 0:10:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5649213529050588 deviation-center-line_median 0.32197407354104046
other stats deviation-center-line_max 0.8949001904483446 deviation-center-line_mean 0.4523845261121684 deviation-center-line_min 0.27068976691824803 deviation-heading_max 32.24915642112976 deviation-heading_mean 12.711557252051277 deviation-heading_median 8.147951606871079 deviation-heading_min 2.301169373333178 distance-from-start_max 3.1060422160938748 distance-from-start_mean 1.0193988517697523 distance-from-start_median 0.48577659549256713 distance-from-start_min 8.881784197001252e-16 driven_any_max 4.07828206784938 driven_any_mean 1.304428171740143 driven_any_median 0.5697153095550628 driven_any_min 1.0658141036401505e-12 driven_lanedir_consec_max 4.070208187293515 driven_lanedir_consec_mean 1.300012820004533 driven_lanedir_consec_min 3.869145004387065e-07 driven_lanedir_max 4.070208187293515 driven_lanedir_mean 1.300012820004533 driven_lanedir_median 0.5649213529050588 driven_lanedir_min 3.869145004387065e-07 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.0658141036401505e-12, "survival_time": 59.99999999999873, "driven_lanedir": 7.578759220194797e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24915642112976, "distance-from-start": 8.881784197001252e-16, "deviation-center-line": 0.8949001904483446, "driven_lanedir_consec": 7.578759220194797e-06}, "zigzag-000-ego1": {"driven_any": 1.1394306191090269, "survival_time": 59.99999999999873, "driven_lanedir": 1.1298351270508975, "in-drivable-lane": 0.0, "deviation-heading": 2.3815687633177767, "distance-from-start": 0.9715531909851334, "deviation-center-line": 0.27068976691824803, "driven_lanedir_consec": 1.1298351270508975}, "zigzag-000-ego2": {"driven_any": 4.07828206784938, "survival_time": 59.99999999999873, "driven_lanedir": 4.070208187293515, "in-drivable-lane": 0.0, "deviation-heading": 2.301169373333178, "distance-from-start": 3.1060422160938748, "deviation-center-line": 0.30621476099086364, "driven_lanedir_consec": 4.070208187293515}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 3.869145004387065e-07, "in-drivable-lane": 0.0, "deviation-heading": 13.91433445042438, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773338609121734, "driven_lanedir_consec": 3.869145004387065e-07}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11679
820
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-17 21:08:12+00:00 2022-11-17 21:10:27+00:00 0:02:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 17.750000000000117 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.53847507295702 deviation-center-line_median 0.16257777325206482
other stats deviation-center-line_max 0.16257777325206482 deviation-center-line_mean 0.16257777325206482 deviation-center-line_min 0.16257777325206482 deviation-heading_max 1.4712837581470402 deviation-heading_mean 1.4712837581470402 deviation-heading_median 1.4712837581470402 deviation-heading_min 1.4712837581470402 distance-from-start_max 1.0671562227466285 distance-from-start_mean 1.0671562227466285 distance-from-start_median 1.0671562227466285 distance-from-start_min 1.0671562227466285 driven_any_max 1.547713297174875 driven_any_mean 1.547713297174875 driven_any_median 1.547713297174875 driven_any_min 1.547713297174875 driven_lanedir_consec_max 1.53847507295702 driven_lanedir_consec_mean 1.53847507295702 driven_lanedir_consec_min 1.53847507295702 driven_lanedir_max 1.53847507295702 driven_lanedir_mean 1.53847507295702 driven_lanedir_median 1.53847507295702 driven_lanedir_min 1.53847507295702 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.547713297174875, "survival_time": 17.750000000000117, "driven_lanedir": 1.53847507295702, "in-drivable-lane": 0.0, "deviation-heading": 1.4712837581470402, "distance-from-start": 1.0671562227466285, "deviation-center-line": 0.16257777325206482, "driven_lanedir_consec": 1.53847507295702}}simulation-passed 1 survival_time_max 17.750000000000117 survival_time_mean 17.750000000000117 survival_time_min 17.750000000000117
No reset possible 11675
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-17 21:03:11+00:00 2022-11-17 21:08:02+00:00 0:04:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065102356188296
other stats deviation-center-line_max 0.4065102356188296 deviation-center-line_mean 0.4065102356188296 deviation-center-line_min 0.4065102356188296 deviation-heading_max 40.967332753486225 deviation-heading_mean 40.967332753486225 deviation-heading_median 40.967332753486225 deviation-heading_min 40.967332753486225 distance-from-start_max 7.63278329429795e-17 distance-from-start_mean 7.63278329429795e-17 distance-from-start_median 7.63278329429795e-17 distance-from-start_min 7.63278329429795e-17 driven_any_max 9.15933995315754e-14 driven_any_mean 9.15933995315754e-14 driven_any_median 9.15933995315754e-14 driven_any_min 9.15933995315754e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 9.15933995315754e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486225, "distance-from-start": 7.63278329429795e-17, "deviation-center-line": 0.4065102356188296, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11671
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 20:57:33+00:00 2022-11-17 21:03:03+00:00 0:05:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.8581320544290545 deviation-center-line_median 0.4209794622238876
other stats deviation-center-line_max 0.4209794622238876 deviation-center-line_mean 0.4209794622238876 deviation-center-line_min 0.4209794622238876 deviation-heading_max 3.015813483230351 deviation-heading_mean 3.015813483230351 deviation-heading_median 3.015813483230351 deviation-heading_min 3.015813483230351 distance-from-start_max 2.4941894584954443 distance-from-start_mean 2.4941894584954443 distance-from-start_median 2.4941894584954443 distance-from-start_min 2.4941894584954443 driven_any_max 5.878911569774922 driven_any_mean 5.878911569774922 driven_any_median 5.878911569774922 driven_any_min 5.878911569774922 driven_lanedir_consec_max 5.8581320544290545 driven_lanedir_consec_mean 5.8581320544290545 driven_lanedir_consec_min 5.8581320544290545 driven_lanedir_max 5.8581320544290545 driven_lanedir_mean 5.8581320544290545 driven_lanedir_median 5.8581320544290545 driven_lanedir_min 5.8581320544290545 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem1-000-ego0": {"driven_any": 5.878911569774922, "survival_time": 59.99999999999873, "driven_lanedir": 5.8581320544290545, "in-drivable-lane": 0.0, "deviation-heading": 3.015813483230351, "distance-from-start": 2.4941894584954443, "deviation-center-line": 0.4209794622238876, "driven_lanedir_consec": 5.8581320544290545}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11666
823
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-testing
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-17 20:45:06+00:00 2022-11-17 20:56:58+00:00 0:11:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3396682743607817 deviation-center-line_median 0.47467850444644666
other stats deviation-center-line_max 2.7624735124851627 deviation-center-line_mean 0.9837388055255328 deviation-center-line_min 0.22312470072407511 deviation-heading_max 37.82293240559152 deviation-heading_mean 12.027592251390926 deviation-heading_median 4.152980159928612 deviation-heading_min 1.9814762801149592 distance-from-start_max 2.493583137044009 distance-from-start_mean 1.23889774392311 distance-from-start_median 1.2310039193242155 distance-from-start_min 2.220446049250313e-16 driven_any_max 5.800963325947782 driven_any_mean 2.6242223629299586 driven_any_median 2.3479630628858925 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 5.788647556544016 driven_lanedir_consec_mean 2.6169960263163947 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.788647556544016 driven_lanedir_mean 2.6169960263163947 driven_lanedir_median 2.3396682743607817 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 4.695926125771519, "survival_time": 59.99999999999873, "driven_lanedir": 4.6793365487215635, "in-drivable-lane": 0.0, "deviation-heading": 3.6538476930540615, "distance-from-start": 2.493583137044009, "deviation-center-line": 0.6128395606196001, "driven_lanedir_consec": 4.6793365487215635}, "4way-000-ego1": {"driven_any": 5.800963325947782, "survival_time": 59.99999999999873, "driven_lanedir": 5.788647556544016, "in-drivable-lane": 0.0, "deviation-heading": 1.9814762801149592, "distance-from-start": 2.462007838648431, "deviation-center-line": 0.3365174482732932, "driven_lanedir_consec": 5.788647556544016}, "4way-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803163, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.22312470072407511, "driven_lanedir_consec": 0.0}, "4way-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 2.7624735124851627, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11661
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-17 20:34:29+00:00 2022-11-17 20:44:52+00:00 0:10:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.57254251112803 deviation-center-line_median 0.3023078005735761
other stats deviation-center-line_max 0.3023078005735761 deviation-center-line_mean 0.3023078005735761 deviation-center-line_min 0.3023078005735761 deviation-heading_max 1.9428208342834787 deviation-heading_mean 1.9428208342834787 deviation-heading_median 1.9428208342834787 deviation-heading_min 1.9428208342834787 distance-from-start_max 2.475080487701063 distance-from-start_mean 2.475080487701063 distance-from-start_median 2.475080487701063 distance-from-start_min 2.475080487701063 driven_any_max 5.745302788245269 driven_any_mean 5.745302788245269 driven_any_median 5.745302788245269 driven_any_min 5.745302788245269 driven_lanedir_consec_max 5.57254251112803 driven_lanedir_consec_mean 5.57254251112803 driven_lanedir_consec_min 5.57254251112803 driven_lanedir_max 5.734875658069805 driven_lanedir_mean 5.734875658069805 driven_lanedir_median 5.734875658069805 driven_lanedir_min 5.734875658069805 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.745302788245269, "survival_time": 59.99999999999873, "driven_lanedir": 5.734875658069805, "in-drivable-lane": 0.0, "deviation-heading": 1.9428208342834787, "distance-from-start": 2.475080487701063, "deviation-center-line": 0.3023078005735761, "driven_lanedir_consec": 5.57254251112803}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11654
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 20:24:56+00:00 2022-11-17 20:33:58+00:00 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.3225169615019583 deviation-center-line_median 0.6106323511970384
other stats deviation-center-line_max 2.7624766981243565 deviation-center-line_mean 1.0519970062330533 deviation-center-line_min 0.22424662441377963 deviation-heading_max 37.82293240559152 deviation-heading_mean 10.912898130454176 deviation-heading_median 2.0831892986732727 deviation-heading_min 1.662281518878632 distance-from-start_max 2.3178967556009846 distance-from-start_mean 1.3561716835463995 distance-from-start_median 1.5533949892923062 distance-from-start_min 4.577566798522237e-16 driven_any_max 5.273775150152415 driven_any_mean 2.4826108851577655 driven_any_median 2.3283341952390493 driven_any_min 5.49308015822675e-13 driven_lanedir_consec_max 5.26083024755342 driven_lanedir_consec_mean 2.476466042639334 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.26083024755342 driven_lanedir_mean 2.476466042639334 driven_lanedir_median 2.3225169615019583 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 5.273775150152415, "survival_time": 59.99999999999873, "driven_lanedir": 5.26083024755342, "in-drivable-lane": 0.0, "deviation-heading": 2.111513261391546, "distance-from-start": 2.3178967556009846, "deviation-center-line": 0.22424662441377963, "driven_lanedir_consec": 5.26083024755342}, "loop-000-ego1": {"driven_any": 1.5746103029952832, "survival_time": 59.99999999999873, "driven_lanedir": 1.5658385330081717, "in-drivable-lane": 0.0, "deviation-heading": 2.054865335955, "distance-from-start": 1.0292579667018384, "deviation-center-line": 0.5524823741667937, "driven_lanedir_consec": 1.5658385330081717}, "loop-000-ego2": {"driven_any": 3.082058087482815, "survival_time": 59.99999999999873, "driven_lanedir": 3.0791953899957454, "in-drivable-lane": 0.0, "deviation-heading": 1.662281518878632, "distance-from-start": 2.077532011882774, "deviation-center-line": 0.6687823282272832, "driven_lanedir_consec": 3.0791953899957454}, "loop-000-ego3": {"driven_any": 5.49308015822675e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 37.82293240559152, "distance-from-start": 4.577566798522237e-16, "deviation-center-line": 2.7624766981243565, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11653
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-0of4 host-error no davinci-stage-05-6.2.46
2022-11-17 20:23:50+00:00 2022-11-17 20:24:33+00:00 0:00:43 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11602
829
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-17 19:54:22+00:00 2022-11-17 20:06:25+00:00 0:12:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.437734232870294 deviation-center-line_median 2.765649805151934
other stats deviation-center-line_max 2.765649805151934 deviation-center-line_mean 2.765649805151934 deviation-center-line_min 2.765649805151934 deviation-heading_max 4.001942616338776 deviation-heading_mean 4.001942616338776 deviation-heading_median 4.001942616338776 deviation-heading_min 4.001942616338776 distance-from-start_max 2.235923337296991 distance-from-start_mean 2.235923337296991 distance-from-start_median 2.235923337296991 distance-from-start_min 2.235923337296991 driven_any_max 3.579586929119037 driven_any_mean 3.579586929119037 driven_any_median 3.579586929119037 driven_any_min 3.579586929119037 driven_lanedir_consec_max 3.437734232870294 driven_lanedir_consec_mean 3.437734232870294 driven_lanedir_consec_min 3.437734232870294 driven_lanedir_max 3.557789693077632 driven_lanedir_mean 3.557789693077632 driven_lanedir_median 3.557789693077632 driven_lanedir_min 3.557789693077632 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.579586929119037, "survival_time": 59.99999999999873, "driven_lanedir": 3.557789693077632, "in-drivable-lane": 0.0, "deviation-heading": 4.001942616338776, "distance-from-start": 2.235923337296991, "deviation-center-line": 2.765649805151934, "driven_lanedir_consec": 3.437734232870294}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11585
830
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 19:48:14+00:00 2022-11-17 19:50:54+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.200000000000053 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7222898911877377 deviation-center-line_median 0.6263425139703784
other stats deviation-center-line_max 0.6263425139703784 deviation-center-line_mean 0.6263425139703784 deviation-center-line_min 0.6263425139703784 deviation-heading_max 1.417085318647224 deviation-heading_mean 1.417085318647224 deviation-heading_median 1.417085318647224 deviation-heading_min 1.417085318647224 distance-from-start_max 0.7201981002422111 distance-from-start_mean 0.7201981002422111 distance-from-start_median 0.7201981002422111 distance-from-start_min 0.7201981002422111 driven_any_max 0.7295990048299438 driven_any_mean 0.7295990048299438 driven_any_median 0.7295990048299438 driven_any_min 0.7295990048299438 driven_lanedir_consec_max 0.7222898911877377 driven_lanedir_consec_mean 0.7222898911877377 driven_lanedir_consec_min 0.7222898911877377 driven_lanedir_max 0.7222898911877377 driven_lanedir_mean 0.7222898911877377 driven_lanedir_median 0.7222898911877377 driven_lanedir_min 0.7222898911877377 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 0.7295990048299438, "survival_time": 13.200000000000053, "driven_lanedir": 0.7222898911877377, "in-drivable-lane": 0.0, "deviation-heading": 1.417085318647224, "distance-from-start": 0.7201981002422111, "deviation-center-line": 0.6263425139703784, "driven_lanedir_consec": 0.7222898911877377}}simulation-passed 1 survival_time_max 13.200000000000053 survival_time_mean 13.200000000000053 survival_time_min 13.200000000000053
No reset possible 11351
832
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-17 05:55:08+00:00 2022-11-17 06:03:03+00:00 0:07:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0499999999998835 driven_lanedir_consec_median 2.590378556136369 deviation-center-line_median 4.845049346482264
other stats deviation-center-line_max 4.845049346482264 deviation-center-line_mean 4.845049346482264 deviation-center-line_min 4.845049346482264 deviation-heading_max 5.268595331340627 deviation-heading_mean 5.268595331340627 deviation-heading_median 5.268595331340627 deviation-heading_min 5.268595331340627 distance-from-start_max 2.032818085613036 distance-from-start_mean 2.032818085613036 distance-from-start_median 2.032818085613036 distance-from-start_min 2.032818085613036 driven_any_max 3.518087215362921 driven_any_mean 3.518087215362921 driven_any_median 3.518087215362921 driven_any_min 3.518087215362921 driven_lanedir_consec_max 2.590378556136369 driven_lanedir_consec_mean 2.590378556136369 driven_lanedir_consec_min 2.590378556136369 driven_lanedir_max 3.3814215182774663 driven_lanedir_mean 3.3814215182774663 driven_lanedir_median 3.3814215182774663 driven_lanedir_min 3.3814215182774663 in-drivable-lane_max 2.0499999999998835 in-drivable-lane_mean 2.0499999999998835 in-drivable-lane_min 2.0499999999998835 per-episodes details {"udem1-000-ego0": {"driven_any": 3.518087215362921, "survival_time": 59.99999999999873, "driven_lanedir": 3.3814215182774663, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.268595331340627, "distance-from-start": 2.032818085613036, "deviation-center-line": 4.845049346482264, "driven_lanedir_consec": 2.590378556136369}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11350
833
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-17 02:00:42+00:00 2022-11-17 02:19:08+00:00 0:18:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.899999999999888 driven_lanedir_consec_median 2.577147081404033 deviation-center-line_median 6.473819545759991
other stats deviation-center-line_max 6.67414186858749 deviation-center-line_mean 6.181505974927821 deviation-center-line_min 5.104242939603813 deviation-heading_max 10.109778463057898 deviation-heading_mean 8.400916955237046 deviation-heading_median 8.14470326891814 deviation-heading_min 7.204482820054009 distance-from-start_max 2.170988126335053 distance-from-start_mean 1.563488645703338 distance-from-start_median 1.6003159096716135 distance-from-start_min 0.8823346371350725 driven_any_max 3.4820813210699813 driven_any_mean 3.464122337409231 driven_any_median 3.4626626970634273 driven_any_min 3.449082634440088 driven_lanedir_consec_max 3.283655000392273 driven_lanedir_consec_mean 2.512031151865401 driven_lanedir_consec_min 1.6101754442612652 driven_lanedir_max 3.283655000392273 driven_lanedir_mean 3.242098610430684 driven_lanedir_median 3.2385172829127216 driven_lanedir_min 3.2077048755050215 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 3.8499999999999073 in-drivable-lane_min 3.249999999999958 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4715894450565123, "survival_time": 59.99999999999873, "driven_lanedir": 3.283655000392273, "in-drivable-lane": 3.599999999999884, "deviation-heading": 7.204482820054009, "distance-from-start": 1.6768936287564808, "deviation-center-line": 6.67414186858749, "driven_lanedir_consec": 3.283655000392273}, "zigzag-000-ego1": {"driven_any": 3.453735949070342, "survival_time": 59.99999999999873, "driven_lanedir": 3.215991718710423, "in-drivable-lane": 4.199999999999893, "deviation-heading": 8.20099581172048, "distance-from-start": 2.170988126335053, "deviation-center-line": 6.65956544167938, "driven_lanedir_consec": 3.215991718710423}, "zigzag-000-ego2": {"driven_any": 3.4820813210699813, "survival_time": 59.99999999999873, "driven_lanedir": 3.26104284711502, "in-drivable-lane": 3.249999999999958, "deviation-heading": 10.109778463057898, "distance-from-start": 1.5237381905867464, "deviation-center-line": 5.104242939603813, "driven_lanedir_consec": 1.6101754442612652}, "zigzag-000-ego3": {"driven_any": 3.449082634440088, "survival_time": 59.99999999999873, "driven_lanedir": 3.2077048755050215, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.088410726115796, "distance-from-start": 0.8823346371350725, "deviation-center-line": 6.2880736498406025, "driven_lanedir_consec": 1.9383024440976424}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11256
832
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-validation
sim-3of4 host-error no davinci-stage-05-6.2.46
2022-11-16 23:23:13+00:00 2022-11-16 23:26:51+00:00 0:03:38 Error while running [...] Error while running Docker Compose:
Could not run command
│ cmd: [docker-compose, -p, davinci-stage-05-6.2.46-job11256-808198, up, --no-start,
│ --renew-anon-volumes]
│ stdout: ''
│ sderr: ''
│ e: Command '['docker-compose', '-p', 'davinci-stage-05-6.2.46-job11256-808198', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11028
834
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-16 23:05:41+00:00 2022-11-16 23:23:05+00:00 0:17:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.9250000000000131 driven_lanedir_consec_median 3.091330139165637 deviation-center-line_median 4.331903062775425
other stats deviation-center-line_max 7.3442261312145165 deviation-center-line_mean 4.724617132133722 deviation-center-line_min 2.8904362717695213 deviation-heading_max 5.663266158111513 deviation-heading_mean 4.199882636226624 deviation-heading_median 3.814086876678531 deviation-heading_min 3.508090633437921 distance-from-start_max 2.492336237280679 distance-from-start_mean 2.1292805692057786 distance-from-start_median 2.293970973840236 distance-from-start_min 1.4368440918619638 driven_any_max 3.579594996204495 driven_any_mean 3.312966315843872 driven_any_median 3.2690876797298554 driven_any_min 3.1340949077112814 driven_lanedir_consec_max 3.539826151958123 driven_lanedir_consec_mean 2.770427752354536 driven_lanedir_consec_min 1.3592245791287456 driven_lanedir_max 3.5595521168819433 driven_lanedir_mean 3.2453753842618753 driven_lanedir_median 3.1929309611498056 driven_lanedir_min 3.036087497865947 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 0.9625000000000136 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.579594996204495, "survival_time": 59.99999999999873, "driven_lanedir": 3.5595521168819433, "in-drivable-lane": 0.0, "deviation-heading": 3.735588116547547, "distance-from-start": 2.3422362133197785, "deviation-center-line": 3.1814195463645407, "driven_lanedir_consec": 3.539826151958123}, "udem-000-ego1": {"driven_any": 3.1340949077112814, "survival_time": 59.99999999999873, "driven_lanedir": 3.036087497865947, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 3.508090633437921, "distance-from-start": 2.492336237280679, "deviation-center-line": 7.3442261312145165, "driven_lanedir_consec": 3.036087477425353}, "udem-000-ego2": {"driven_any": 3.3155875122220144, "survival_time": 59.99999999999873, "driven_lanedir": 3.2954837547738993, "in-drivable-lane": 0.0, "deviation-heading": 3.892585636809516, "distance-from-start": 2.245705734360693, "deviation-center-line": 2.8904362717695213, "driven_lanedir_consec": 3.146572800905921}, "udem-000-ego3": {"driven_any": 3.222587847237696, "survival_time": 59.99999999999873, "driven_lanedir": 3.090378167525712, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663266158111513, "distance-from-start": 1.4368440918619638, "deviation-center-line": 5.4823865791863104, "driven_lanedir_consec": 1.3592245791287456}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10943
835
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-16 23:00:09+00:00 2022-11-16 23:05:34+00:00 0:05:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.099999999999902 driven_lanedir_consec_median 2.8149940810866236 deviation-center-line_median 4.094985063841091
other stats deviation-center-line_max 4.094985063841091 deviation-center-line_mean 4.094985063841091 deviation-center-line_min 4.094985063841091 deviation-heading_max 9.104325322582234 deviation-heading_mean 9.104325322582234 deviation-heading_median 9.104325322582234 deviation-heading_min 9.104325322582234 distance-from-start_max 2.645340381315678 distance-from-start_mean 2.645340381315678 distance-from-start_median 2.645340381315678 distance-from-start_min 2.645340381315678 driven_any_max 3.486581977234586 driven_any_mean 3.486581977234586 driven_any_median 3.486581977234586 driven_any_min 3.486581977234586 driven_lanedir_consec_max 2.8149940810866236 driven_lanedir_consec_mean 2.8149940810866236 driven_lanedir_consec_min 2.8149940810866236 driven_lanedir_max 3.274708374952958 driven_lanedir_mean 3.274708374952958 driven_lanedir_median 3.274708374952958 driven_lanedir_min 3.274708374952958 in-drivable-lane_max 3.099999999999902 in-drivable-lane_mean 3.099999999999902 in-drivable-lane_min 3.099999999999902 per-episodes details {"loop-000-ego0": {"driven_any": 3.486581977234586, "survival_time": 59.99999999999873, "driven_lanedir": 3.274708374952958, "in-drivable-lane": 3.099999999999902, "deviation-heading": 9.104325322582234, "distance-from-start": 2.645340381315678, "deviation-center-line": 4.094985063841091, "driven_lanedir_consec": 2.8149940810866236}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10709
838
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-16 22:45:07+00:00 2022-11-16 22:59:49+00:00 0:14:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.349999999999895 driven_lanedir_consec_median 2.047658018790259 deviation-center-line_median 5.126485444166568
other stats deviation-center-line_max 5.126485444166568 deviation-center-line_mean 5.126485444166568 deviation-center-line_min 5.126485444166568 deviation-heading_max 11.28545261059378 deviation-heading_mean 11.28545261059378 deviation-heading_median 11.28545261059378 deviation-heading_min 11.28545261059378 distance-from-start_max 1.221190637429476 distance-from-start_mean 1.221190637429476 distance-from-start_median 1.221190637429476 distance-from-start_min 1.221190637429476 driven_any_max 3.44907658257651 driven_any_mean 3.44907658257651 driven_any_median 3.44907658257651 driven_any_min 3.44907658257651 driven_lanedir_consec_max 2.047658018790259 driven_lanedir_consec_mean 2.047658018790259 driven_lanedir_consec_min 2.047658018790259 driven_lanedir_max 3.1600582421938994 driven_lanedir_mean 3.1600582421938994 driven_lanedir_median 3.1600582421938994 driven_lanedir_min 3.1600582421938994 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 4.349999999999895 in-drivable-lane_min 4.349999999999895 per-episodes details {"autolab-000-ego0": {"driven_any": 3.44907658257651, "survival_time": 59.99999999999873, "driven_lanedir": 3.1600582421938994, "in-drivable-lane": 4.349999999999895, "deviation-heading": 11.28545261059378, "distance-from-start": 1.221190637429476, "deviation-center-line": 5.126485444166568, "driven_lanedir_consec": 2.047658018790259}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10533
840
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-testing
sim-2of4 success no davinci-stage-05-6.2.46
2022-11-16 22:32:42+00:00 2022-11-16 22:44:53+00:00 0:12:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.7249999999999304 driven_lanedir_consec_median 1.782451327913266 deviation-center-line_median 5.7520060807300135
other stats deviation-center-line_max 5.91724099846388 deviation-center-line_mean 5.7520060807300135 deviation-center-line_min 5.586771162996147 deviation-heading_max 8.389432963329451 deviation-heading_mean 8.327307052651967 deviation-heading_median 8.327307052651967 deviation-heading_min 8.265181141974484 distance-from-start_max 1.2351380366112437 distance-from-start_mean 1.1329605710789614 distance-from-start_median 1.1329605710789614 distance-from-start_min 1.0307831055466792 driven_any_max 3.4865836159248382 driven_any_mean 3.467832799824648 driven_any_median 3.467832799824648 driven_any_min 3.449081983724458 driven_lanedir_consec_max 2.091635105125694 driven_lanedir_consec_mean 1.782451327913266 driven_lanedir_consec_min 1.473267550700838 driven_lanedir_max 3.2880107027760648 driven_lanedir_mean 3.2460173239276555 driven_lanedir_median 3.2460173239276555 driven_lanedir_min 3.2040239450792463 in-drivable-lane_max 4.349999999999895 in-drivable-lane_mean 3.7249999999999304 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.449081983724458, "survival_time": 59.99999999999873, "driven_lanedir": 3.2040239450792463, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.389432963329451, "distance-from-start": 1.0307831055466792, "deviation-center-line": 5.91724099846388, "driven_lanedir_consec": 2.091635105125694}, "loop2-000-ego1": {"driven_any": 3.4865836159248382, "survival_time": 59.99999999999873, "driven_lanedir": 3.2880107027760648, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.265181141974484, "distance-from-start": 1.2351380366112437, "deviation-center-line": 5.586771162996147, "driven_lanedir_consec": 1.473267550700838}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10266
841
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-16 22:10:37+00:00 2022-11-16 22:32:36+00:00 0:21:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.320847663449453 deviation-center-line_median 5.509202824089039
other stats deviation-center-line_max 6.756952476930072 deviation-center-line_mean 5.338579474021433 deviation-center-line_min 3.57895977097758 deviation-heading_max 5.165991236119989 deviation-heading_mean 3.955233800626404 deviation-heading_median 4.636249730116838 deviation-heading_min 1.3824445061519497 distance-from-start_max 2.6950407308462383 distance-from-start_mean 1.8279509363781563 distance-from-start_median 1.656487541106691 distance-from-start_min 1.3037879324530055 driven_any_max 3.4716897005858773 driven_any_mean 2.4718702523002105 driven_any_median 2.3375972316718254 driven_any_min 1.7405968452713143 driven_lanedir_consec_max 3.292155930923049 driven_lanedir_consec_mean 2.4129950677964196 driven_lanedir_consec_min 1.7181290133637237 driven_lanedir_max 3.292155930923049 driven_lanedir_mean 2.4187239388545523 driven_lanedir_median 2.3243071631921324 driven_lanedir_min 1.734125498110895 in-drivable-lane_max 3.5999999999999623 in-drivable-lane_mean 0.8999999999999906 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.9345947247910176, "survival_time": 59.99999999999873, "driven_lanedir": 2.909967111085985, "in-drivable-lane": 0.0, "deviation-heading": 4.334701203563791, "distance-from-start": 1.5738878476280138, "deviation-center-line": 5.185168540477153, "driven_lanedir_consec": 2.9030481116006257}, "4way-000-ego1": {"driven_any": 1.7405997385526328, "survival_time": 59.99999999999873, "driven_lanedir": 1.73864721529828, "in-drivable-lane": 0.0, "deviation-heading": 4.937798256669886, "distance-from-start": 1.7390872345853683, "deviation-center-line": 5.833237107700924, "driven_lanedir_consec": 1.73864721529828}, "4way-000-ego2": {"driven_any": 1.7405968452713143, "survival_time": 59.99999999999873, "driven_lanedir": 1.734125498110895, "in-drivable-lane": 0.0, "deviation-heading": 1.3824445061519497, "distance-from-start": 1.3037879324530055, "deviation-center-line": 3.57895977097758, "driven_lanedir_consec": 1.7181290133637237}, "4way-000-ego3": {"driven_any": 3.4716897005858773, "survival_time": 59.99999999999873, "driven_lanedir": 3.292155930923049, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.165991236119989, "distance-from-start": 2.6950407308462383, "deviation-center-line": 6.756952476930072, "driven_lanedir_consec": 3.292155930923049}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10145
842
Bea Baselines 🐤minimal-agent-full aido-LF-full-sim-testing
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-16 22:03:21+00:00 2022-11-16 22:10:29+00:00 0:07:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.149999999999878 driven_lanedir_consec_median 3.364933059128671 deviation-center-line_median 5.251516924575099
other stats deviation-center-line_max 5.251516924575099 deviation-center-line_mean 5.251516924575099 deviation-center-line_min 5.251516924575099 deviation-heading_max 8.784883477445916 deviation-heading_mean 8.784883477445916 deviation-heading_median 8.784883477445916 deviation-heading_min 8.784883477445916 distance-from-start_max 2.151743265759588 distance-from-start_mean 2.151743265759588 distance-from-start_median 2.151743265759588 distance-from-start_min 2.151743265759588 driven_any_max 3.5150892362964212 driven_any_mean 3.5150892362964212 driven_any_median 3.5150892362964212 driven_any_min 3.5150892362964212 driven_lanedir_consec_max 3.364933059128671 driven_lanedir_consec_mean 3.364933059128671 driven_lanedir_consec_min 3.364933059128671 driven_lanedir_max 3.364933059128671 driven_lanedir_mean 3.364933059128671 driven_lanedir_median 3.364933059128671 driven_lanedir_min 3.364933059128671 in-drivable-lane_max 2.149999999999878 in-drivable-lane_mean 2.149999999999878 in-drivable-lane_min 2.149999999999878 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.5150892362964212, "survival_time": 59.99999999999873, "driven_lanedir": 3.364933059128671, "in-drivable-lane": 2.149999999999878, "deviation-heading": 8.784883477445916, "distance-from-start": 2.151743265759588, "deviation-center-line": 5.251516924575099, "driven_lanedir_consec": 3.364933059128671}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10059
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-16 21:57:29+00:00 2022-11-16 22:03:02+00:00 0:05:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.4226928398281333 deviation-center-line_median 4.174748477462163
other stats deviation-center-line_max 4.174748477462163 deviation-center-line_mean 4.174748477462163 deviation-center-line_min 4.174748477462163 deviation-heading_max 4.533756317111154 deviation-heading_mean 4.533756317111154 deviation-heading_median 4.533756317111154 deviation-heading_min 4.533756317111154 distance-from-start_max 2.2784552815665835 distance-from-start_mean 2.2784552815665835 distance-from-start_median 2.2784552815665835 distance-from-start_min 2.2784552815665835 driven_any_max 3.579587154113982 driven_any_mean 3.579587154113982 driven_any_median 3.579587154113982 driven_any_min 3.579587154113982 driven_lanedir_consec_max 3.4226928398281333 driven_lanedir_consec_mean 3.4226928398281333 driven_lanedir_consec_min 3.4226928398281333 driven_lanedir_max 3.55610753301965 driven_lanedir_mean 3.55610753301965 driven_lanedir_median 3.55610753301965 driven_lanedir_min 3.55610753301965 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 3.579587154113982, "survival_time": 59.99999999999873, "driven_lanedir": 3.55610753301965, "in-drivable-lane": 0.0, "deviation-heading": 4.533756317111154, "distance-from-start": 2.2784552815665835, "deviation-center-line": 4.174748477462163, "driven_lanedir_consec": 3.4226928398281333}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10020
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-2of4 host-error no davinci-stage-05-6.2.46
2022-11-16 21:55:13+00:00 2022-11-16 21:57:23+00:00 0:02:10 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 449, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 444, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
response.begin()
File "/usr/lib/python3.8/http/client.py", line 316, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 489, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 550, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 770, in reraise
raise value
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 703, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 451, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 340, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 149, in login
response = self._post_json(self._url('/auth'), data=req_data)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 296, in _post_json
return self._post(url, data=json.dumps(data2), **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 233, in _post
return self.post(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 635, in post
return self.request("POST", url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 578, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9849
846
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-16 21:43:44+00:00 2022-11-16 21:54:56+00:00 0:11:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.2000000000000313 driven_lanedir_consec_median 3.0719634979059167 deviation-center-line_median 2.5127522585495656
other stats deviation-center-line_max 2.5127522585495656 deviation-center-line_mean 2.5127522585495656 deviation-center-line_min 2.5127522585495656 deviation-heading_max 5.80643510594152 deviation-heading_mean 5.80643510594152 deviation-heading_median 5.80643510594152 deviation-heading_min 5.80643510594152 distance-from-start_max 2.558018844429722 distance-from-start_mean 2.558018844429722 distance-from-start_median 2.558018844429722 distance-from-start_min 2.558018844429722 driven_any_max 3.5135741911352505 driven_any_mean 3.5135741911352505 driven_any_median 3.5135741911352505 driven_any_min 3.5135741911352505 driven_lanedir_consec_max 3.0719634979059167 driven_lanedir_consec_mean 3.0719634979059167 driven_lanedir_consec_min 3.0719634979059167 driven_lanedir_max 3.3771987735835296 driven_lanedir_mean 3.3771987735835296 driven_lanedir_median 3.3771987735835296 driven_lanedir_min 3.3771987735835296 in-drivable-lane_max 2.2000000000000313 in-drivable-lane_mean 2.2000000000000313 in-drivable-lane_min 2.2000000000000313 per-episodes details {"4way-001-ego0": {"driven_any": 3.5135741911352505, "survival_time": 59.99999999999873, "driven_lanedir": 3.3771987735835296, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.80643510594152, "distance-from-start": 2.558018844429722, "deviation-center-line": 2.5127522585495656, "driven_lanedir_consec": 3.0719634979059167}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9794
846
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-validation
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-16 21:39:49+00:00 2022-11-16 21:43:36+00:00 0:03:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.449999999999985 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4398565700031045 deviation-center-line_median 0.2725613901951368
other stats deviation-center-line_max 0.2725613901951368 deviation-center-line_mean 0.2725613901951368 deviation-center-line_min 0.2725613901951368 deviation-heading_max 0.7151184294493084 deviation-heading_mean 0.7151184294493084 deviation-heading_median 0.7151184294493084 deviation-heading_min 0.7151184294493084 distance-from-start_max 0.44094173644960993 distance-from-start_mean 0.44094173644960993 distance-from-start_median 0.44094173644960993 distance-from-start_min 0.44094173644960993 driven_any_max 0.4445992768886744 driven_any_mean 0.4445992768886744 driven_any_median 0.4445992768886744 driven_any_min 0.4445992768886744 driven_lanedir_consec_max 0.4398565700031045 driven_lanedir_consec_mean 0.4398565700031045 driven_lanedir_consec_min 0.4398565700031045 driven_lanedir_max 0.4398565700031045 driven_lanedir_mean 0.4398565700031045 driven_lanedir_median 0.4398565700031045 driven_lanedir_min 0.4398565700031045 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 0.4445992768886744, "survival_time": 8.449999999999985, "driven_lanedir": 0.4398565700031045, "in-drivable-lane": 0.0, "deviation-heading": 0.7151184294493084, "distance-from-start": 0.44094173644960993, "deviation-center-line": 0.2725613901951368, "driven_lanedir_consec": 0.4398565700031045}}simulation-passed 1 survival_time_max 8.449999999999985 survival_time_mean 8.449999999999985 survival_time_min 8.449999999999985
No reset possible 9668
847
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
346 success yes davinci-stage-05-6.2.46
2022-11-16 21:32:06+00:00 2022-11-16 21:39:41+00:00 0:07:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.2749999999998938 driven_lanedir_consec_median 2.712004979582506 deviation-center-line_median 6.830233669694479
other stats deviation-center-line_max 7.154226688493768 deviation-center-line_mean 6.804680157069402 deviation-center-line_min 6.404026600394878 deviation-heading_max 8.100880505860715 deviation-heading_mean 5.973168085503508 deviation-heading_median 5.5013083102031874 deviation-heading_min 4.7891752157469405 distance-from-start_max 2.416015397978839 distance-from-start_mean 1.6093143700204056 distance-from-start_median 1.566033493936358 distance-from-start_min 0.8891750942300684 driven_any_max 3.5195878597991426 driven_any_mean 3.4828384673828054 driven_any_median 3.4813415720692342 driven_any_min 3.4490828655936094 driven_lanedir_consec_max 3.330338922875351 driven_lanedir_consec_mean 2.6711177029407134 driven_lanedir_consec_min 1.9301219297224912 driven_lanedir_max 3.3876167841121174 driven_lanedir_mean 3.308291004109226 driven_lanedir_median 3.318066104091547 driven_lanedir_min 3.209415024141693 in-drivable-lane_max 4.349999999999898 in-drivable-lane_mean 3.2249999999999286 in-drivable-lane_min 2.0000000000000284 per-episodes details {"loop-000-ego0": {"driven_any": 3.47609109580057, "survival_time": 59.99999999999873, "driven_lanedir": 3.3057932853077427, "in-drivable-lane": 3.449999999999882, "deviation-heading": 5.348097201635609, "distance-from-start": 1.6303675543068192, "deviation-center-line": 7.154226688493768, "driven_lanedir_consec": 3.3057932853077427}, "loop-000-ego1": {"driven_any": 3.486592048337899, "survival_time": 59.99999999999873, "driven_lanedir": 3.330338922875351, "in-drivable-lane": 3.0999999999999055, "deviation-heading": 4.7891752157469405, "distance-from-start": 2.416015397978839, "deviation-center-line": 6.91888991237436, "driven_lanedir_consec": 3.330338922875351}, "loop-000-ego2": {"driven_any": 3.4490828655936094, "survival_time": 59.99999999999873, "driven_lanedir": 3.209415024141693, "in-drivable-lane": 4.349999999999898, "deviation-heading": 8.100880505860715, "distance-from-start": 0.8891750942300684, "deviation-center-line": 6.404026600394878, "driven_lanedir_consec": 1.9301219297224912}, "loop-000-ego3": {"driven_any": 3.5195878597991426, "survival_time": 59.99999999999873, "driven_lanedir": 3.3876167841121174, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.654519418770767, "distance-from-start": 1.5016994335658966, "deviation-center-line": 6.741577427014599, "driven_lanedir_consec": 2.118216673857269}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9599
849
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-16 21:27:48+00:00 2022-11-16 21:31:59+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.0000000000000284 driven_lanedir_consec_median 2.241204615389226 deviation-center-line_median 4.759684198968496
other stats deviation-center-line_max 4.759684198968496 deviation-center-line_mean 4.759684198968496 deviation-center-line_min 4.759684198968496 deviation-heading_max 9.18078892152259 deviation-heading_mean 9.18078892152259 deviation-heading_median 9.18078892152259 deviation-heading_min 9.18078892152259 distance-from-start_max 1.6296054226673595 distance-from-start_mean 1.6296054226673595 distance-from-start_median 1.6296054226673595 distance-from-start_min 1.6296054226673595 driven_any_max 3.519583547683476 driven_any_mean 3.519583547683476 driven_any_median 3.519583547683476 driven_any_min 3.519583547683476 driven_lanedir_consec_max 2.241204615389226 driven_lanedir_consec_mean 2.241204615389226 driven_lanedir_consec_min 2.241204615389226 driven_lanedir_max 3.353584317203001 driven_lanedir_mean 3.353584317203001 driven_lanedir_median 3.353584317203001 driven_lanedir_min 3.353584317203001 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 2.0000000000000284 in-drivable-lane_min 2.0000000000000284 per-episodes details {"autolab-000-ego0": {"driven_any": 3.519583547683476, "survival_time": 59.99999999999873, "driven_lanedir": 3.353584317203001, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 9.18078892152259, "distance-from-start": 1.6296054226673595, "deviation-center-line": 4.759684198968496, "driven_lanedir_consec": 2.241204615389226}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9563
850
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-testing
sim-3of4 success no davinci-stage-05-6.2.46
2022-11-16 21:25:45+00:00 2022-11-16 21:27:32+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 9403
851
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-0of4 success no davinci-stage-05-6.2.46
2022-11-16 21:15:24+00:00 2022-11-16 21:25:25+00:00 0:10:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.2750000000000039 driven_lanedir_consec_median 2.262131809498861 deviation-center-line_median 5.455124522064782
other stats deviation-center-line_max 6.730071373430627 deviation-center-line_mean 5.363556493446593 deviation-center-line_min 3.8139055562261825 deviation-heading_max 5.398374386296501 deviation-heading_mean 3.491175943520638 deviation-heading_median 3.0776780033278266 deviation-heading_min 2.410973381130398 distance-from-start_max 2.360894719942372 distance-from-start_mean 1.8716522429526965 distance-from-start_median 1.8806284295314877 distance-from-start_min 1.364457392805438 driven_any_max 3.5795955917544644 driven_any_mean 2.913869978092242 driven_any_median 3.16539328993713 driven_any_min 1.7450977407402446 driven_lanedir_consec_max 3.5416185695211757 driven_lanedir_consec_mean 2.4016268429389926 driven_lanedir_consec_min 1.5406251832370743 driven_lanedir_max 3.563713603597634 driven_lanedir_mean 2.85515386748651 driven_lanedir_median 3.07574943123194 driven_lanedir_min 1.7054030038845247 in-drivable-lane_max 2.9499999999999744 in-drivable-lane_mean 0.8749999999999956 in-drivable-lane_min 0.0 per-episodes details {"udem-001-ego0": {"driven_any": 3.5795955917544644, "survival_time": 59.99999999999873, "driven_lanedir": 3.563713603597634, "in-drivable-lane": 0.0, "deviation-heading": 3.2731563320543304, "distance-from-start": 2.360894719942372, "deviation-center-line": 3.8139055562261825, "driven_lanedir_consec": 3.5416185695211757}, "udem-001-ego1": {"driven_any": 1.7450977407402446, "survival_time": 59.99999999999873, "driven_lanedir": 1.7054030038845247, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 2.882199674601323, "distance-from-start": 1.364457392805438, "deviation-center-line": 6.730071373430627, "driven_lanedir_consec": 1.7054030038845247}, "udem-001-ego2": {"driven_any": 2.8295986786833778, "survival_time": 59.99999999999873, "driven_lanedir": 2.8188609934486073, "in-drivable-lane": 0.0, "deviation-heading": 2.410973381130398, "distance-from-start": 2.3395282410041216, "deviation-center-line": 5.461686107117372, "driven_lanedir_consec": 2.818860615113197}, "udem-001-ego3": {"driven_any": 3.501187901190882, "survival_time": 59.99999999999873, "driven_lanedir": 3.3326378690152723, "in-drivable-lane": 2.9499999999999744, "deviation-heading": 5.398374386296501, "distance-from-start": 1.4217286180588538, "deviation-center-line": 5.448562937012193, "driven_lanedir_consec": 1.5406251832370743}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9242
852
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-16 21:04:51+00:00 2022-11-16 21:15:05+00:00 0:10:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.385444945074485 deviation-center-line_median 3.9396057444508545
other stats deviation-center-line_max 3.9396057444508545 deviation-center-line_mean 3.9396057444508545 deviation-center-line_min 3.9396057444508545 deviation-heading_max 5.447727941053875 deviation-heading_mean 5.447727941053875 deviation-heading_median 5.447727941053875 deviation-heading_min 5.447727941053875 distance-from-start_max 2.271008875297506 distance-from-start_mean 2.271008875297506 distance-from-start_median 2.271008875297506 distance-from-start_min 2.271008875297506 driven_any_max 3.5795880628439725 driven_any_mean 3.5795880628439725 driven_any_median 3.5795880628439725 driven_any_min 3.5795880628439725 driven_lanedir_consec_max 3.385444945074485 driven_lanedir_consec_mean 3.385444945074485 driven_lanedir_consec_min 3.385444945074485 driven_lanedir_max 3.547670088627387 driven_lanedir_mean 3.547670088627387 driven_lanedir_median 3.547670088627387 driven_lanedir_min 3.547670088627387 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 3.5795880628439725, "survival_time": 59.99999999999873, "driven_lanedir": 3.547670088627387, "in-drivable-lane": 0.0, "deviation-heading": 5.447727941053875, "distance-from-start": 2.271008875297506, "deviation-center-line": 3.9396057444508545, "driven_lanedir_consec": 3.385444945074485}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9214
854
Bea Baselines 🐤minimal-agent-state aido-LFV-state-sim-validation
sim-0of4 host-error no davinci-stage-05-6.2.46
2022-11-16 21:02:58+00:00 2022-11-16 21:04:26+00:00 0:01:28 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9085
853
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-1of4 success no davinci-stage-05-6.2.46
2022-11-16 20:54:55+00:00 2022-11-16 21:02:39+00:00 0:07:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.274999999999924 driven_lanedir_consec_median 2.9601189865763886 deviation-center-line_median 5.787503619673483
other stats deviation-center-line_max 6.225435220559491 deviation-center-line_mean 5.663130447397847 deviation-center-line_min 4.852079329684934 deviation-heading_max 10.580538307983838 deviation-heading_mean 8.264581204111865 deviation-heading_median 7.754751325434261 deviation-heading_min 6.968283857595098 distance-from-start_max 2.654399044738202 distance-from-start_mean 2.1218160828483192 distance-from-start_median 2.2988549971726475 distance-from-start_min 1.2351552923097806 driven_any_max 3.476087765832689 driven_any_mean 3.2864825052178803 driven_any_median 3.2731312027162502 driven_any_min 3.1235798496063323 driven_lanedir_consec_max 3.276672417637001 driven_lanedir_consec_mean 2.6675495945362115 driven_lanedir_consec_min 1.473287987355069 driven_lanedir_max 3.276672417637001 driven_lanedir_mean 3.103994542373825 driven_lanedir_median 3.138392083101138 driven_lanedir_min 2.862521585656024 in-drivable-lane_max 3.8999999999999138 in-drivable-lane_mean 2.9249999999999226 in-drivable-lane_min 1.249999999999929 per-episodes details {"loop-000-ego0": {"driven_any": 3.2036786887321167, "survival_time": 59.99999999999873, "driven_lanedir": 3.132204583992982, "in-drivable-lane": 1.249999999999929, "deviation-heading": 6.968283857595098, "distance-from-start": 2.3820708473302497, "deviation-center-line": 6.225435220559491, "driven_lanedir_consec": 3.132204583992982}, "loop-000-ego1": {"driven_any": 3.3425837167003833, "survival_time": 59.99999999999873, "driven_lanedir": 3.1445795822092935, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.452427331971558, "distance-from-start": 1.2351552923097806, "deviation-center-line": 5.558720177405185, "driven_lanedir_consec": 1.473287987355069}, "loop-000-ego2": {"driven_any": 3.476087765832689, "survival_time": 59.99999999999873, "driven_lanedir": 3.276672417637001, "in-drivable-lane": 3.449999999999882, "deviation-heading": 7.057075318896964, "distance-from-start": 2.2156391470150454, "deviation-center-line": 6.016287061941781, "driven_lanedir_consec": 3.276672417637001}, "loop-000-ego3": {"driven_any": 3.1235798496063323, "survival_time": 59.99999999999873, "driven_lanedir": 2.862521585656024, "in-drivable-lane": 3.8999999999999138, "deviation-heading": 10.580538307983838, "distance-from-start": 2.654399044738202, "deviation-center-line": 4.852079329684934, "driven_lanedir_consec": 2.7880333891597946}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible