Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 11946
745
Bea Baselines 🐤baseline-duckietown-ml aido-LF-sim-testing
sim-3of4 timeout no davinci-stage-02-6.2.46
2022-11-18 21:15:48+00:00 - - - - No reset possible 11928
763
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy:e107400fd98b91bb7c02b7b24d7be5f5d7623035 aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.46
2022-11-18 20:53:49+00:00 2022-11-18 20:55:15+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.03059452042078714 deviation-center-line_median 0.005589718966405544
other stats deviation-center-line_max 0.005589718966405544 deviation-center-line_mean 0.005589718966405544 deviation-center-line_min 0.005589718966405544 deviation-heading_max 0.25777352746122356 deviation-heading_mean 0.25777352746122356 deviation-heading_median 0.25777352746122356 deviation-heading_min 0.25777352746122356 distance-from-start_max 0.03470011857015614 distance-from-start_mean 0.03470011857015614 distance-from-start_median 0.03470011857015614 distance-from-start_min 0.03470011857015614 driven_any_max 0.03470306042420724 driven_any_mean 0.03470306042420724 driven_any_median 0.03470306042420724 driven_any_min 0.03470306042420724 driven_lanedir_consec_max 0.03059452042078714 driven_lanedir_consec_mean 0.03059452042078714 driven_lanedir_consec_min 0.03059452042078714 driven_lanedir_max 0.03059452042078714 driven_lanedir_mean 0.03059452042078714 driven_lanedir_median 0.03059452042078714 driven_lanedir_min 0.03059452042078714 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.03470306042420724, "survival_time": 0.49999999999999994, "driven_lanedir": 0.03059452042078714, "in-drivable-lane": 0.0, "deviation-heading": 0.25777352746122356, "distance-from-start": 0.03470011857015614, "deviation-center-line": 0.005589718966405544, "driven_lanedir_consec": 0.03059452042078714}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11926
765
Bea Baselines 🐤challenge-aido_LF-template-pytorch:daffy-staging:bc692490acbff19e3dcb581b0cdc6ef53963f802 aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.46
2022-11-18 20:49:43+00:00 2022-11-18 20:53:30+00:00 0:03:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.02119228463694789 deviation-center-line_median 0.005461910667399036
other stats deviation-center-line_max 0.005461910667399036 deviation-center-line_mean 0.005461910667399036 deviation-center-line_min 0.005461910667399036 deviation-heading_max 0.3109294887465121 deviation-heading_mean 0.3109294887465121 deviation-heading_median 0.3109294887465121 deviation-heading_min 0.3109294887465121 distance-from-start_max 0.02841204510534442 distance-from-start_mean 0.02841204510534442 distance-from-start_median 0.02841204510534442 distance-from-start_min 0.02841204510534442 driven_any_max 0.028559154519486617 driven_any_mean 0.028559154519486617 driven_any_median 0.028559154519486617 driven_any_min 0.028559154519486617 driven_lanedir_consec_max 0.02119228463694789 driven_lanedir_consec_mean 0.02119228463694789 driven_lanedir_consec_min 0.02119228463694789 driven_lanedir_max 0.02119228463694789 driven_lanedir_mean 0.02119228463694789 driven_lanedir_median 0.02119228463694789 driven_lanedir_min 0.02119228463694789 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.028559154519486617, "survival_time": 0.49999999999999994, "driven_lanedir": 0.02119228463694789, "in-drivable-lane": 0.0, "deviation-heading": 0.3109294887465121, "distance-from-start": 0.02841204510534442, "deviation-center-line": 0.005461910667399036, "driven_lanedir_consec": 0.02119228463694789}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11922
768
Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:e625ad6e3d7dcafd3e31a42aa57e3ac0e2ccc484 aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.46
2022-11-18 20:46:42+00:00 2022-11-18 20:48:19+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.009278681037743208 deviation-center-line_median 0.007005513692561462
other stats deviation-center-line_max 0.007005513692561462 deviation-center-line_mean 0.007005513692561462 deviation-center-line_min 0.007005513692561462 deviation-heading_max 0.26336905085970874 deviation-heading_mean 0.26336905085970874 deviation-heading_median 0.26336905085970874 deviation-heading_min 0.26336905085970874 distance-from-start_max 0.010492587570749548 distance-from-start_mean 0.010492587570749548 distance-from-start_median 0.010492587570749548 distance-from-start_min 0.010492587570749548 driven_any_max 0.010496654309411447 driven_any_mean 0.010496654309411447 driven_any_median 0.010496654309411447 driven_any_min 0.010496654309411447 driven_lanedir_consec_max 0.009278681037743208 driven_lanedir_consec_mean 0.009278681037743208 driven_lanedir_consec_min 0.009278681037743208 driven_lanedir_max 0.009278681037743208 driven_lanedir_mean 0.009278681037743208 driven_lanedir_median 0.009278681037743208 driven_lanedir_min 0.009278681037743208 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.010496654309411447, "survival_time": 0.49999999999999994, "driven_lanedir": 0.009278681037743208, "in-drivable-lane": 0.0, "deviation-heading": 0.26336905085970874, "distance-from-start": 0.010492587570749548, "deviation-center-line": 0.007005513692561462, "driven_lanedir_consec": 0.009278681037743208}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11913
771
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-18 20:32:28+00:00 2022-11-18 20:46:29+00:00 0:14:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948975282353262
other stats deviation-center-line_max 0.8948975282353262 deviation-center-line_mean 0.8948975282353262 deviation-center-line_min 0.8948975282353262 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.7755575615628914e-17 distance-from-start_mean 2.7755575615628914e-17 distance-from-start_median 2.7755575615628914e-17 distance-from-start_min 2.7755575615628914e-17 driven_any_max 3.3306690738754696e-14 driven_any_mean 3.3306690738754696e-14 driven_any_median 3.3306690738754696e-14 driven_any_min 3.3306690738754696e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.3306690738754696e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.7755575615628914e-17, "deviation-center-line": 0.8948975282353262, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11906
772
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-validation
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-18 20:22:59+00:00 2022-11-18 20:32:06+00:00 0:09:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 34.40000000000018 in-drivable-lane_median 6.599999999999973 driven_lanedir_consec_median 2.629714897484002 deviation-center-line_median 1.6678459219291568
other stats deviation-center-line_max 1.6678459219291568 deviation-center-line_mean 1.6678459219291568 deviation-center-line_min 1.6678459219291568 deviation-heading_max 5.654700257785572 deviation-heading_mean 5.654700257785572 deviation-heading_median 5.654700257785572 deviation-heading_min 5.654700257785572 distance-from-start_max 2.554354723616289 distance-from-start_mean 2.554354723616289 distance-from-start_median 2.554354723616289 distance-from-start_min 2.554354723616289 driven_any_max 4.4224854258072535 driven_any_mean 4.4224854258072535 driven_any_median 4.4224854258072535 driven_any_min 4.4224854258072535 driven_lanedir_consec_max 2.629714897484002 driven_lanedir_consec_mean 2.629714897484002 driven_lanedir_consec_min 2.629714897484002 driven_lanedir_max 3.460630688749065 driven_lanedir_mean 3.460630688749065 driven_lanedir_median 3.460630688749065 driven_lanedir_min 3.460630688749065 in-drivable-lane_max 6.599999999999973 in-drivable-lane_mean 6.599999999999973 in-drivable-lane_min 6.599999999999973 per-episodes details {"4way-000-ego0": {"driven_any": 4.4224854258072535, "survival_time": 34.40000000000018, "driven_lanedir": 3.460630688749065, "in-drivable-lane": 6.599999999999973, "deviation-heading": 5.654700257785572, "distance-from-start": 2.554354723616289, "deviation-center-line": 1.6678459219291568, "driven_lanedir_consec": 2.629714897484002}}simulation-passed 1 survival_time_max 34.40000000000018 survival_time_mean 34.40000000000018 survival_time_min 34.40000000000018
No reset possible 11903
773
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-18 20:20:40+00:00 2022-11-18 20:22:26+00:00 0:01:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11902
773
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-18 20:17:49+00:00 2022-11-18 20:20:25+00:00 0:02:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11900
775
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-18 20:12:24+00:00 2022-11-18 20:17:31+00:00 0:05:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.450000000000028 in-drivable-lane_median 0.6999999999999983 driven_lanedir_consec_median 0.4133514852526836 deviation-center-line_median 1.2642205282290808
other stats deviation-center-line_max 1.6422748961513538 deviation-center-line_mean 1.1666750531182484 deviation-center-line_min 0.4959842598634781 deviation-heading_max 12.464231805340384 deviation-heading_mean 8.098285563349222 deviation-heading_median 8.898018071147316 deviation-heading_min 2.1328743057618693 distance-from-start_max 1.1444318772870006 distance-from-start_mean 0.5987756660476432 distance-from-start_median 0.4299417776705759 distance-from-start_min 0.3907872315624206 driven_any_max 1.375479220433876 driven_any_mean 0.7149251631440889 driven_any_median 0.5356572420914834 driven_any_min 0.41290694795951305 driven_lanedir_consec_max 1.2618067560075457 driven_lanedir_consec_mean 0.5984543174522505 driven_lanedir_consec_min 0.305307543296089 driven_lanedir_max 1.2618067560075457 driven_lanedir_mean 0.5984543174522505 driven_lanedir_median 0.4133514852526836 driven_lanedir_min 0.305307543296089 in-drivable-lane_max 1.200000000000017 in-drivable-lane_mean 0.6500000000000035 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 1.375479220433876, "survival_time": 11.450000000000028, "driven_lanedir": 1.2618067560075457, "in-drivable-lane": 1.200000000000017, "deviation-heading": 2.1328743057618693, "distance-from-start": 1.1444318772870006, "deviation-center-line": 0.4959842598634781, "driven_lanedir_consec": 1.2618067560075457}, "udem-000-ego1": {"driven_any": 0.47923704234245645, "survival_time": 11.450000000000028, "driven_lanedir": 0.305307543296089, "in-drivable-lane": 0.7499999999999989, "deviation-heading": 7.946675469391188, "distance-from-start": 0.40078970362846345, "deviation-center-line": 1.3459702966024352, "driven_lanedir_consec": 0.305307543296089}, "udem-000-ego2": {"driven_any": 0.41290694795951305, "survival_time": 11.450000000000028, "driven_lanedir": 0.3657344090323482, "in-drivable-lane": 0.0, "deviation-heading": 12.464231805340384, "distance-from-start": 0.3907872315624206, "deviation-center-line": 1.6422748961513538, "driven_lanedir_consec": 0.3657344090323482}, "udem-000-ego3": {"driven_any": 0.5920774418405103, "survival_time": 11.450000000000028, "driven_lanedir": 0.460968561473019, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 9.849360672903442, "distance-from-start": 0.45909385171268846, "deviation-center-line": 1.1824707598557265, "driven_lanedir_consec": 0.460968561473019}}simulation-passed 1 survival_time_max 11.450000000000028 survival_time_mean 11.450000000000028 survival_time_min 11.450000000000028
No reset possible 11898
775
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-18 20:10:33+00:00 2022-11-18 20:11:59+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11884
777
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-18 20:02:30+00:00 2022-11-18 20:10:27+00:00 0:07:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.0499999999999 driven_lanedir_consec_median 6.595792992854295 deviation-center-line_median 4.202486072587921
other stats deviation-center-line_max 4.202486072587921 deviation-center-line_mean 4.202486072587921 deviation-center-line_min 4.202486072587921 deviation-heading_max 12.75685804799978 deviation-heading_mean 12.75685804799978 deviation-heading_median 12.75685804799978 deviation-heading_min 12.75685804799978 distance-from-start_max 2.83697826197125 distance-from-start_mean 2.83697826197125 distance-from-start_median 2.83697826197125 distance-from-start_min 2.83697826197125 driven_any_max 7.907740670517925 driven_any_mean 7.907740670517925 driven_any_median 7.907740670517925 driven_any_min 7.907740670517925 driven_lanedir_consec_max 6.595792992854295 driven_lanedir_consec_mean 6.595792992854295 driven_lanedir_consec_min 6.595792992854295 driven_lanedir_max 6.828839538675067 driven_lanedir_mean 6.828839538675067 driven_lanedir_median 6.828839538675067 driven_lanedir_min 6.828839538675067 in-drivable-lane_max 5.0499999999999 in-drivable-lane_mean 5.0499999999999 in-drivable-lane_min 5.0499999999999 per-episodes details {"zigzag-000-ego0": {"driven_any": 7.907740670517925, "survival_time": 59.99999999999873, "driven_lanedir": 6.828839538675067, "in-drivable-lane": 5.0499999999999, "deviation-heading": 12.75685804799978, "distance-from-start": 2.83697826197125, "deviation-center-line": 4.202486072587921, "driven_lanedir_consec": 6.595792992854295}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11877
777
Bea Baselines 🐤baseline-RPL-ros aido-LFP-sim-testing
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-18 19:54:39+00:00 2022-11-18 19:57:53+00:00 0:03:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 20.300000000000153 in-drivable-lane_median 18.60000000000015 driven_lanedir_consec_median 0.12252303784042208 deviation-center-line_median 0.11808274737603992
other stats deviation-center-line_max 0.11808274737603992 deviation-center-line_mean 0.11808274737603992 deviation-center-line_min 0.11808274737603992 deviation-heading_max 1.212549030511736 deviation-heading_mean 1.212549030511736 deviation-heading_median 1.212549030511736 deviation-heading_min 1.212549030511736 distance-from-start_max 1.2760332200245663 distance-from-start_mean 1.2760332200245663 distance-from-start_median 1.2760332200245663 distance-from-start_min 1.2760332200245663 driven_any_max 2.5438214489648594 driven_any_mean 2.5438214489648594 driven_any_median 2.5438214489648594 driven_any_min 2.5438214489648594 driven_lanedir_consec_max 0.12252303784042208 driven_lanedir_consec_mean 0.12252303784042208 driven_lanedir_consec_min 0.12252303784042208 driven_lanedir_max 0.12252303784042208 driven_lanedir_mean 0.12252303784042208 driven_lanedir_median 0.12252303784042208 driven_lanedir_min 0.12252303784042208 in-drivable-lane_max 18.60000000000015 in-drivable-lane_mean 18.60000000000015 in-drivable-lane_min 18.60000000000015 per-episodes details {"loop-000-ego0": {"driven_any": 2.5438214489648594, "survival_time": 20.300000000000153, "driven_lanedir": 0.12252303784042208, "in-drivable-lane": 18.60000000000015, "deviation-heading": 1.212549030511736, "distance-from-start": 1.2760332200245663, "deviation-center-line": 0.11808274737603992, "driven_lanedir_consec": 0.12252303784042208}}simulation-passed 1 survival_time_max 20.300000000000153 survival_time_mean 20.300000000000153 survival_time_min 20.300000000000153
No reset possible 11873
778
Bea Baselines 🐤baseline-RPL-ros aido-LFV-sim-testing
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-18 19:51:25+00:00 2022-11-18 19:54:18+00:00 0:02:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.84999999999998 in-drivable-lane_median 5.099999999999982 driven_lanedir_consec_median 0.2281465692051801 deviation-center-line_median 0.2458662450241987
other stats deviation-center-line_max 0.2458662450241987 deviation-center-line_mean 0.2458662450241987 deviation-center-line_min 0.2458662450241987 deviation-heading_max 1.7538321023418728 deviation-heading_mean 1.7538321023418728 deviation-heading_median 1.7538321023418728 deviation-heading_min 1.7538321023418728 distance-from-start_max 0.7504458143219682 distance-from-start_mean 0.7504458143219682 distance-from-start_median 0.7504458143219682 distance-from-start_min 0.7504458143219682 driven_any_max 0.8975361152531085 driven_any_mean 0.8975361152531085 driven_any_median 0.8975361152531085 driven_any_min 0.8975361152531085 driven_lanedir_consec_max 0.2281465692051801 driven_lanedir_consec_mean 0.2281465692051801 driven_lanedir_consec_min 0.2281465692051801 driven_lanedir_max 0.2349211893410308 driven_lanedir_mean 0.2349211893410308 driven_lanedir_median 0.2349211893410308 driven_lanedir_min 0.2349211893410308 in-drivable-lane_max 5.099999999999982 in-drivable-lane_mean 5.099999999999982 in-drivable-lane_min 5.099999999999982 per-episodes details {"loop2-000-ego0": {"driven_any": 0.8975361152531085, "survival_time": 7.84999999999998, "driven_lanedir": 0.2349211893410308, "in-drivable-lane": 5.099999999999982, "deviation-heading": 1.7538321023418728, "distance-from-start": 0.7504458143219682, "deviation-center-line": 0.2458662450241987, "driven_lanedir_consec": 0.2281465692051801}}simulation-passed 1 survival_time_max 7.84999999999998 survival_time_mean 7.84999999999998 survival_time_min 7.84999999999998
No reset possible 11808
779
Bea Baselines 🐤baseline-RPL-ros aido-LFVI-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 23:02:05+00:00 2022-11-17 23:14:21+00:00 0:12:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.39999999999997726 driven_lanedir_consec_median 6.406138458956091 deviation-center-line_median 3.792630774745968
other stats deviation-center-line_max 3.792630774745968 deviation-center-line_mean 3.792630774745968 deviation-center-line_min 3.792630774745968 deviation-heading_max 10.786728798082512 deviation-heading_mean 10.786728798082512 deviation-heading_median 10.786728798082512 deviation-heading_min 10.786728798082512 distance-from-start_max 2.9361509547431393 distance-from-start_mean 2.9361509547431393 distance-from-start_median 2.9361509547431393 distance-from-start_min 2.9361509547431393 driven_any_max 7.914367654242932 driven_any_mean 7.914367654242932 driven_any_median 7.914367654242932 driven_any_min 7.914367654242932 driven_lanedir_consec_max 6.406138458956091 driven_lanedir_consec_mean 6.406138458956091 driven_lanedir_consec_min 6.406138458956091 driven_lanedir_max 7.537363816047078 driven_lanedir_mean 7.537363816047078 driven_lanedir_median 7.537363816047078 driven_lanedir_min 7.537363816047078 in-drivable-lane_max 0.39999999999997726 in-drivable-lane_mean 0.39999999999997726 in-drivable-lane_min 0.39999999999997726 per-episodes details {"udem-000-ego0": {"driven_any": 7.914367654242932, "survival_time": 59.99999999999873, "driven_lanedir": 7.537363816047078, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 10.786728798082512, "distance-from-start": 2.9361509547431393, "deviation-center-line": 3.792630774745968, "driven_lanedir_consec": 6.406138458956091}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11804
780
Bea Baselines 🐤baseline-RPL-ros aido-LFI-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 22:58:49+00:00 2022-11-17 23:01:38+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 11799
782
Bea Baselines 🐤baseline-RPL-ros aido-LFVI_multi-sim-testing
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-17 22:53:54+00:00 2022-11-17 22:58:41+00:00 0:04:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.250000000000025 in-drivable-lane_median 1.250000000000016 driven_lanedir_consec_median 0.43859224629881666 deviation-center-line_median 0.7885102299338609
other stats deviation-center-line_max 0.9536702696243732 deviation-center-line_mean 0.6647487461760964 deviation-center-line_min 0.12830425521229072 deviation-heading_max 8.125427807001703 deviation-heading_mean 4.8155462190267215 deviation-heading_median 5.150157834661471 deviation-heading_min 0.8364413997822427 distance-from-start_max 1.144807682203056 distance-from-start_mean 0.5612532869618118 distance-from-start_median 0.4416439955332233 distance-from-start_min 0.2169174745777445 driven_any_max 1.3488887811096872 driven_any_mean 0.63527416602065 driven_any_median 0.4693184148345353 driven_any_min 0.2535710533038423 driven_lanedir_consec_max 0.9185979926200272 driven_lanedir_consec_mean 0.5013910928185102 driven_lanedir_consec_min 0.20978188605638048 driven_lanedir_max 0.9251013929161104 driven_lanedir_mean 0.5030169428925311 driven_lanedir_median 0.43859224629881666 driven_lanedir_min 0.20978188605638048 in-drivable-lane_max 6.950000000000032 in-drivable-lane_mean 2.362500000000016 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 0.2535710533038423, "survival_time": 11.250000000000025, "driven_lanedir": 0.20978188605638048, "in-drivable-lane": 0.0, "deviation-heading": 6.941135668749319, "distance-from-start": 0.2169174745777445, "deviation-center-line": 0.8730869797774721, "driven_lanedir_consec": 0.20978188605638048}, "4way-000-ego1": {"driven_any": 0.4195412317744449, "survival_time": 11.250000000000025, "driven_lanedir": 0.4017382771236513, "in-drivable-lane": 0.0, "deviation-heading": 8.125427807001703, "distance-from-start": 0.4019210410178838, "deviation-center-line": 0.9536702696243732, "driven_lanedir_consec": 0.4017382771236513}, "4way-000-ego2": {"driven_any": 0.5190955978946257, "survival_time": 11.250000000000025, "driven_lanedir": 0.475446215473982, "in-drivable-lane": 6.950000000000032, "deviation-heading": 0.8364413997822427, "distance-from-start": 0.4813669500485629, "deviation-center-line": 0.12830425521229072, "driven_lanedir_consec": 0.475446215473982}, "4way-000-ego3": {"driven_any": 1.3488887811096872, "survival_time": 11.250000000000025, "driven_lanedir": 0.9251013929161104, "in-drivable-lane": 2.500000000000032, "deviation-heading": 3.3591800005736228, "distance-from-start": 1.144807682203056, "deviation-center-line": 0.7039334800902496, "driven_lanedir_consec": 0.9185979926200272}}simulation-passed 1 survival_time_max 11.250000000000025 survival_time_mean 11.250000000000025 survival_time_min 11.250000000000025
No reset possible 11796
791
Bea Baselines 🐤challenge-aido_LF-baseline-RPL-ros:daffy-staging:61ce4781fdb88fb08748da51bde492a74499e71d aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.46
2022-11-17 22:52:13+00:00 2022-11-17 22:53:48+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.013220226681785352 deviation-center-line_median 0.006545250944492689
other stats deviation-center-line_max 0.006545250944492689 deviation-center-line_mean 0.006545250944492689 deviation-center-line_min 0.006545250944492689 deviation-heading_max 0.2645649530541569 deviation-heading_mean 0.2645649530541569 deviation-heading_median 0.2645649530541569 deviation-heading_min 0.2645649530541569 distance-from-start_max 0.0150786463098234 distance-from-start_mean 0.0150786463098234 distance-from-start_median 0.0150786463098234 distance-from-start_min 0.0150786463098234 driven_any_max 0.015084437929537668 driven_any_mean 0.015084437929537668 driven_any_median 0.015084437929537668 driven_any_min 0.015084437929537668 driven_lanedir_consec_max 0.013220226681785352 driven_lanedir_consec_mean 0.013220226681785352 driven_lanedir_consec_min 0.013220226681785352 driven_lanedir_max 0.013220226681785352 driven_lanedir_mean 0.013220226681785352 driven_lanedir_median 0.013220226681785352 driven_lanedir_min 0.013220226681785352 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.015084437929537668, "survival_time": 0.49999999999999994, "driven_lanedir": 0.013220226681785352, "in-drivable-lane": 0.0, "deviation-heading": 0.2645649530541569, "distance-from-start": 0.0150786463098234, "deviation-center-line": 0.006545250944492689, "driven_lanedir_consec": 0.013220226681785352}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11790
800
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-1of4 failed no davinci-stage-02-6.2.46
2022-11-17 22:47:01+00:00 2022-11-17 22:51:44+00:00 0:04:43 The container "solut [...] The container "solution-ego0" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11787
801
Andrea Daniele template-tensorflow aido-LF-sim-validation
sim-0of4 failed no davinci-stage-02-6.2.46
2022-11-17 22:45:55+00:00 2022-11-17 22:46:54+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
robot_ci.write_topic_and_expect_zero("seed", config.seed)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
yield cie
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11779
804
Bea Baselines 🐤challenge-aido_LF-template-ros:daffy-staging:3d125842a05be049b6ee6fe0059908c18c57ebb2 aido-hello-sim-validation
sanity-check success no davinci-stage-02-6.2.46
2022-11-17 22:42:52+00:00 2022-11-17 22:44:37+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.49999999999999994 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.06148731405559315 deviation-center-line_median 0.006535749059604603
other stats deviation-center-line_max 0.006535749059604603 deviation-center-line_mean 0.006535749059604603 deviation-center-line_min 0.006535749059604603 deviation-heading_max 0.24864805731739287 deviation-heading_mean 0.24864805731739287 deviation-heading_median 0.24864805731739287 deviation-heading_min 0.24864805731739287 distance-from-start_max 0.06854722017944499 distance-from-start_mean 0.06854722017944499 distance-from-start_median 0.06854722017944499 distance-from-start_min 0.06854722017944499 driven_any_max 0.06857994813955536 driven_any_mean 0.06857994813955536 driven_any_median 0.06857994813955536 driven_any_min 0.06857994813955536 driven_lanedir_consec_max 0.06148731405559315 driven_lanedir_consec_mean 0.06148731405559315 driven_lanedir_consec_min 0.06148731405559315 driven_lanedir_max 0.06148731405559315 driven_lanedir_mean 0.06148731405559315 driven_lanedir_median 0.06148731405559315 driven_lanedir_min 0.06148731405559315 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"scenarios-ego0": {"driven_any": 0.06857994813955536, "survival_time": 0.49999999999999994, "driven_lanedir": 0.06148731405559315, "in-drivable-lane": 0.0, "deviation-heading": 0.24864805731739287, "distance-from-start": 0.06854722017944499, "deviation-center-line": 0.006535749059604603, "driven_lanedir_consec": 0.06148731405559315}}simulation-passed 1 survival_time_max 0.49999999999999994 survival_time_mean 0.49999999999999994 survival_time_min 0.49999999999999994
No reset possible 11775
806
user1000001 minimal-agent aido-LFV-sim-validation
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 22:40:12+00:00 2022-11-17 22:42:45+00:00 0:02:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.8499999999999943 in-drivable-lane_median 2.0999999999999934 driven_lanedir_consec_median 0.19955565328420843 deviation-center-line_median 0.12567516126913225
other stats deviation-center-line_max 0.12567516126913225 deviation-center-line_mean 0.12567516126913225 deviation-center-line_min 0.12567516126913225 deviation-heading_max 0.9488219555580464 deviation-heading_mean 0.9488219555580464 deviation-heading_median 0.9488219555580464 deviation-heading_min 0.9488219555580464 distance-from-start_max 0.46487640009490927 distance-from-start_mean 0.46487640009490927 distance-from-start_median 0.46487640009490927 distance-from-start_min 0.46487640009490927 driven_any_max 0.46488519376666826 driven_any_mean 0.46488519376666826 driven_any_median 0.46488519376666826 driven_any_min 0.46488519376666826 driven_lanedir_consec_max 0.19955565328420843 driven_lanedir_consec_mean 0.19955565328420843 driven_lanedir_consec_min 0.19955565328420843 driven_lanedir_max 0.19955565328420843 driven_lanedir_mean 0.19955565328420843 driven_lanedir_median 0.19955565328420843 driven_lanedir_min 0.19955565328420843 in-drivable-lane_max 2.0999999999999934 in-drivable-lane_mean 2.0999999999999934 in-drivable-lane_min 2.0999999999999934 per-episodes details {"autolab-000-ego0": {"driven_any": 0.46488519376666826, "survival_time": 3.8499999999999943, "driven_lanedir": 0.19955565328420843, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.9488219555580464, "distance-from-start": 0.46487640009490927, "deviation-center-line": 0.12567516126913225, "driven_lanedir_consec": 0.19955565328420843}}simulation-passed 1 survival_time_max 3.8499999999999943 survival_time_mean 3.8499999999999943 survival_time_min 3.8499999999999943
No reset possible 11760
809
Andrea Censi template-random aido-LFV-sim-validation
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-17 22:28:05+00:00 2022-11-17 22:40:05+00:00 0:12:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 45.099999999999575 in-drivable-lane_median 36.54999999999956 driven_lanedir_consec_median 0.271834711171973 deviation-center-line_median 0.7655520909538922
other stats deviation-center-line_max 0.7655520909538922 deviation-center-line_mean 0.7655520909538922 deviation-center-line_min 0.7655520909538922 deviation-heading_max 5.708723015945327 deviation-heading_mean 5.708723015945327 deviation-heading_median 5.708723015945327 deviation-heading_min 5.708723015945327 distance-from-start_max 1.044224797669198 distance-from-start_mean 1.044224797669198 distance-from-start_median 1.044224797669198 distance-from-start_min 1.044224797669198 driven_any_max 11.376062002465094 driven_any_mean 11.376062002465094 driven_any_median 11.376062002465094 driven_any_min 11.376062002465094 driven_lanedir_consec_max 0.271834711171973 driven_lanedir_consec_mean 0.271834711171973 driven_lanedir_consec_min 0.271834711171973 driven_lanedir_max 0.25382999559920805 driven_lanedir_mean 0.25382999559920805 driven_lanedir_median 0.25382999559920805 driven_lanedir_min 0.25382999559920805 in-drivable-lane_max 36.54999999999956 in-drivable-lane_mean 36.54999999999956 in-drivable-lane_min 36.54999999999956 per-episodes details {"loop-000-ego0": {"driven_any": 11.376062002465094, "survival_time": 45.099999999999575, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.708723015945327, "distance-from-start": 1.044224797669198, "deviation-center-line": 0.7655520909538922, "driven_lanedir_consec": 0.271834711171973}}simulation-passed 1 survival_time_max 45.099999999999575 survival_time_mean 45.099999999999575 survival_time_min 45.099999999999575
No reset possible 11751
811
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-17 22:22:17+00:00 2022-11-17 22:27:52+00:00 0:05:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 30.7000000000003 in-drivable-lane_median 10.200000000000143 driven_lanedir_consec_median 2.204507029290708 deviation-center-line_median 1.6198378353951173
other stats deviation-center-line_max 1.6198378353951173 deviation-center-line_mean 1.6198378353951173 deviation-center-line_min 1.6198378353951173 deviation-heading_max 5.968465188687281 deviation-heading_mean 5.968465188687281 deviation-heading_median 5.968465188687281 deviation-heading_min 5.968465188687281 distance-from-start_max 1.150317558691735 distance-from-start_mean 1.150317558691735 distance-from-start_median 1.150317558691735 distance-from-start_min 1.150317558691735 driven_any_max 3.924408810241565 driven_any_mean 3.924408810241565 driven_any_median 3.924408810241565 driven_any_min 3.924408810241565 driven_lanedir_consec_max 2.204507029290708 driven_lanedir_consec_mean 2.204507029290708 driven_lanedir_consec_min 2.204507029290708 driven_lanedir_max 2.450836588886575 driven_lanedir_mean 2.450836588886575 driven_lanedir_median 2.450836588886575 driven_lanedir_min 2.450836588886575 in-drivable-lane_max 10.200000000000143 in-drivable-lane_mean 10.200000000000143 in-drivable-lane_min 10.200000000000143 per-episodes details {"loop2-000-ego0": {"driven_any": 3.924408810241565, "survival_time": 30.7000000000003, "driven_lanedir": 2.450836588886575, "in-drivable-lane": 10.200000000000143, "deviation-heading": 5.968465188687281, "distance-from-start": 1.150317558691735, "deviation-center-line": 1.6198378353951173, "driven_lanedir_consec": 2.204507029290708}}simulation-passed 1 survival_time_max 30.7000000000003 survival_time_mean 30.7000000000003 survival_time_min 30.7000000000003
No reset possible 11724
812
Bea Baselines 🐤baseline-duckietown-ml aido-LFV-sim-validation
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 21:59:43+00:00 2022-11-17 22:13:53+00:00 0:14:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0001430511474609375 deviation-center-line_median 0.8949084199909547
other stats deviation-center-line_max 0.8949084199909547 deviation-center-line_mean 0.8949084199909547 deviation-center-line_min 0.8949084199909547 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 9.714451465470121e-17 distance-from-start_mean 9.714451465470121e-17 distance-from-start_median 9.714451465470121e-17 distance-from-start_min 9.714451465470121e-17 driven_any_max 1.1657341758564146e-13 driven_any_mean 1.1657341758564146e-13 driven_any_median 1.1657341758564146e-13 driven_any_min 1.1657341758564146e-13 driven_lanedir_consec_max 0.0001430511474609375 driven_lanedir_consec_mean 0.0001430511474609375 driven_lanedir_consec_min 0.0001430511474609375 driven_lanedir_max 0.0001430511474609375 driven_lanedir_mean 0.0001430511474609375 driven_lanedir_median 0.0001430511474609375 driven_lanedir_min 0.0001430511474609375 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 1.1657341758564146e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 9.714451465470121e-17, "deviation-center-line": 0.8949084199909547, "driven_lanedir_consec": 0.0001430511474609375}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11712
813
Bea Baselines 🐤baseline-RPL-ros aido-LF-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 21:51:03+00:00 2022-11-17 21:58:06+00:00 0:07:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6017417553703126e-06 survival_time_median 59.99999999999873 deviation-center-line_median 0.8949077950231444 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8949077950231444 deviation-center-line_mean 0.8949077950231444 deviation-center-line_min 0.8949077950231444 deviation-heading_max 32.24912799874442 deviation-heading_mean 32.24912799874442 deviation-heading_median 32.24912799874442 deviation-heading_min 32.24912799874442 distance-from-start_max 4.440892098500626e-16 distance-from-start_mean 4.440892098500626e-16 distance-from-start_median 4.440892098500626e-16 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.329070518200751e-13 driven_any_mean 5.329070518200751e-13 driven_any_median 5.329070518200751e-13 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 2.6017417553703126e-06 driven_lanedir_consec_mean 2.6017417553703126e-06 driven_lanedir_consec_min 2.6017417553703126e-06 driven_lanedir_max 2.6017417553703126e-06 driven_lanedir_mean 2.6017417553703126e-06 driven_lanedir_median 2.6017417553703126e-06 driven_lanedir_min 2.6017417553703126e-06 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 2.6017417553703126e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24912799874442, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.8949077950231444, "driven_lanedir_consec": 2.6017417553703126e-06}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11706
814
Bea Baselines 🐤baseline-duckietown aido-LF-sim-validation
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-17 21:46:30+00:00 2022-11-17 21:50:41+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0 survival_time_median 59.99999999999873 deviation-center-line_median 0.8949084199908882 in-drivable-lane_median 0.0
other stats deviation-center-line_max 0.8949084199908882 deviation-center-line_mean 0.8949084199908882 deviation-center-line_min 0.8949084199908882 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.8949084199908882, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11702
815
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-17 21:41:13+00:00 2022-11-17 21:46:22+00:00 0:05:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.5342392748923 deviation-center-line_median 0.219904045457012
other stats deviation-center-line_max 0.219904045457012 deviation-center-line_mean 0.219904045457012 deviation-center-line_min 0.219904045457012 deviation-heading_max 2.302069906172969 deviation-heading_mean 2.302069906172969 deviation-heading_median 2.302069906172969 deviation-heading_min 2.302069906172969 distance-from-start_max 1.5178953029412718 distance-from-start_mean 1.5178953029412718 distance-from-start_median 1.5178953029412718 distance-from-start_min 1.5178953029412718 driven_any_max 5.543896156524706 driven_any_mean 5.543896156524706 driven_any_median 5.543896156524706 driven_any_min 5.543896156524706 driven_lanedir_consec_max 5.5342392748923 driven_lanedir_consec_mean 5.5342392748923 driven_lanedir_consec_min 5.5342392748923 driven_lanedir_max 5.5342392748923 driven_lanedir_mean 5.5342392748923 driven_lanedir_median 5.5342392748923 driven_lanedir_min 5.5342392748923 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 5.543896156524706, "survival_time": 59.99999999999873, "driven_lanedir": 5.5342392748923, "in-drivable-lane": 0.0, "deviation-heading": 2.302069906172969, "distance-from-start": 1.5178953029412718, "deviation-center-line": 0.219904045457012, "driven_lanedir_consec": 5.5342392748923}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11693
817
Bea Baselines 🐤baseline-simple-yield aido-LFVI_multi-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 21:28:19+00:00 2022-11-17 21:40:44+00:00 0:12:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.02620788009815445 deviation-center-line_median 0.5078452545325405
other stats deviation-center-line_max 0.927053231877248 deviation-center-line_mean 0.5493180342782131 deviation-center-line_min 0.2545283961705238 deviation-heading_max 24.927759797558803 deviation-heading_mean 12.75886411102093 deviation-heading_median 12.083790865588464 deviation-heading_min 1.940114915347987 distance-from-start_max 2.463697137894826 distance-from-start_mean 0.6299095496275323 distance-from-start_median 0.0279705303076513 distance-from-start_min 4.440892098500626e-16 driven_any_max 5.995138898638472 driven_any_mean 1.5127928534510304 driven_any_median 0.028016257582558556 driven_any_min 5.329070518200751e-13 driven_lanedir_consec_max 5.580966757799386 driven_lanedir_consec_mean 1.4083456294989238 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.983208605322819 driven_lanedir_mean 1.508906091379782 driven_lanedir_median 0.02620788009815445 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 9.946396239005722, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.3027462438305415, "driven_lanedir_consec": 0.0}, "4way-001-ego1": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 24.927759797558803, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 0.927053231877248, "driven_lanedir_consec": 0.0}, "4way-001-ego2": {"driven_any": 0.056032515164580056, "survival_time": 59.99999999999873, "driven_lanedir": 0.05241576019630889, "in-drivable-lane": 0.0, "deviation-heading": 14.22118549217121, "distance-from-start": 0.05594106061530216, "deviation-center-line": 0.7129442652345395, "driven_lanedir_consec": 0.05241576019630889}, "4way-001-ego3": {"driven_any": 5.995138898638472, "survival_time": 59.99999999999873, "driven_lanedir": 5.983208605322819, "in-drivable-lane": 0.0, "deviation-heading": 1.940114915347987, "distance-from-start": 2.463697137894826, "deviation-center-line": 0.2545283961705238, "driven_lanedir_consec": 5.580966757799386}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11688
818
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 21:17:43+00:00 2022-11-17 21:28:11+00:00 0:10:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.68215125613533 deviation-center-line_median 0.07395327503038837
other stats deviation-center-line_max 0.07395327503038837 deviation-center-line_mean 0.07395327503038837 deviation-center-line_min 0.07395327503038837 deviation-heading_max 0.5851001197983932 deviation-heading_mean 0.5851001197983932 deviation-heading_median 0.5851001197983932 deviation-heading_min 0.5851001197983932 distance-from-start_max 2.029871473762164 distance-from-start_mean 2.029871473762164 distance-from-start_median 2.029871473762164 distance-from-start_min 2.029871473762164 driven_any_max 2.684176116815528 driven_any_mean 2.684176116815528 driven_any_median 2.684176116815528 driven_any_min 2.684176116815528 driven_lanedir_consec_max 2.68215125613533 driven_lanedir_consec_mean 2.68215125613533 driven_lanedir_consec_min 2.68215125613533 driven_lanedir_max 2.6821513356789115 driven_lanedir_mean 2.6821513356789115 driven_lanedir_median 2.6821513356789115 driven_lanedir_min 2.6821513356789115 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-001-ego0": {"driven_any": 2.684176116815528, "survival_time": 59.99999999999873, "driven_lanedir": 2.6821513356789115, "in-drivable-lane": 0.0, "deviation-heading": 0.5851001197983932, "distance-from-start": 2.029871473762164, "deviation-center-line": 0.07395327503038837, "driven_lanedir_consec": 2.68215125613533}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11680
819
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-validation
346 success yes davinci-stage-02-6.2.46
2022-11-17 21:08:25+00:00 2022-11-17 21:17:35+00:00 0:09:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3002634346487274 deviation-center-line_median 0.7196587394263382
other stats deviation-center-line_max 2.946747690455274 deviation-center-line_mean 1.1476127366277404 deviation-center-line_min 0.20438577720301088 deviation-heading_max 14.481564596168331 deviation-heading_mean 7.741984297971248 deviation-heading_median 7.028384188277798 deviation-heading_min 2.429604219161062 distance-from-start_max 3.2396193091764305 distance-from-start_mean 1.334325698944544 distance-from-start_median 1.0488417433008723 distance-from-start_min 4.47545209131181e-16 driven_any_max 5.606562725658094 driven_any_mean 2.053995095327341 driven_any_median 1.3047088278253671 driven_any_min 5.370542509574138e-13 driven_lanedir_consec_max 5.594025281629358 driven_lanedir_consec_mean 2.048638037731703 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.594025281629358 driven_lanedir_mean 2.048638037731703 driven_lanedir_median 1.3002634346487274 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop-000-ego0": {"driven_any": 1.9556664137081567, "survival_time": 59.99999999999873, "driven_lanedir": 1.9489815249615767, "in-drivable-lane": 0.0, "deviation-heading": 4.451378386780232, "distance-from-start": 1.471444190689407, "deviation-center-line": 0.20438577720301088, "driven_lanedir_consec": 1.9489815249615767}, "loop-000-ego1": {"driven_any": 5.606562725658094, "survival_time": 59.99999999999873, "driven_lanedir": 5.594025281629358, "in-drivable-lane": 0.0, "deviation-heading": 2.429604219161062, "distance-from-start": 3.2396193091764305, "deviation-center-line": 0.3255000542191074, "driven_lanedir_consec": 5.594025281629358}, "loop-000-ego2": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 2.946747690455274, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.6537512419425775, "survival_time": 59.99999999999873, "driven_lanedir": 0.6515453443358781, "in-drivable-lane": 0.0, "deviation-heading": 9.605389989775365, "distance-from-start": 0.6262392959123381, "deviation-center-line": 1.113817424633569, "driven_lanedir_consec": 0.6515453443358781}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11676
821
Bea Baselines 🐤baseline-simple-yield aido-LF-state-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 21:03:12+00:00 2022-11-17 21:08:18+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.6173794793891885 deviation-center-line_median 0.3790863571459804
other stats deviation-center-line_max 0.3790863571459804 deviation-center-line_mean 0.3790863571459804 deviation-center-line_min 0.3790863571459804 deviation-heading_max 2.844192295741865 deviation-heading_mean 2.844192295741865 deviation-heading_median 2.844192295741865 deviation-heading_min 2.844192295741865 distance-from-start_max 2.723986924723346 distance-from-start_mean 2.723986924723346 distance-from-start_median 2.723986924723346 distance-from-start_min 2.723986924723346 driven_any_max 5.636243490208466 driven_any_mean 5.636243490208466 driven_any_median 5.636243490208466 driven_any_min 5.636243490208466 driven_lanedir_consec_max 5.6173794793891885 driven_lanedir_consec_mean 5.6173794793891885 driven_lanedir_consec_min 5.6173794793891885 driven_lanedir_max 5.6173794793891885 driven_lanedir_mean 5.6173794793891885 driven_lanedir_median 5.6173794793891885 driven_lanedir_min 5.6173794793891885 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 5.636243490208466, "survival_time": 59.99999999999873, "driven_lanedir": 5.6173794793891885, "in-drivable-lane": 0.0, "deviation-heading": 2.844192295741865, "distance-from-start": 2.723986924723346, "deviation-center-line": 0.3790863571459804, "driven_lanedir_consec": 5.6173794793891885}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11669
822
Bea Baselines 🐤baseline-simple-yield aido-LFI-state-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 20:55:33+00:00 2022-11-17 21:02:50+00:00 0:07:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 6.008901010886451 deviation-center-line_median 0.30597991997662005
other stats deviation-center-line_max 0.30597991997662005 deviation-center-line_mean 0.30597991997662005 deviation-center-line_min 0.30597991997662005 deviation-heading_max 2.2018930022147423 deviation-heading_mean 2.2018930022147423 deviation-heading_median 2.2018930022147423 deviation-heading_min 2.2018930022147423 distance-from-start_max 2.7090569978004524 distance-from-start_mean 2.7090569978004524 distance-from-start_median 2.7090569978004524 distance-from-start_min 2.7090569978004524 driven_any_max 6.026055195101287 driven_any_mean 6.026055195101287 driven_any_median 6.026055195101287 driven_any_min 6.026055195101287 driven_lanedir_consec_max 6.008901010886451 driven_lanedir_consec_mean 6.008901010886451 driven_lanedir_consec_min 6.008901010886451 driven_lanedir_max 6.008901010886451 driven_lanedir_mean 6.008901010886451 driven_lanedir_median 6.008901010886451 driven_lanedir_min 6.008901010886451 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 6.026055195101287, "survival_time": 59.99999999999873, "driven_lanedir": 6.008901010886451, "in-drivable-lane": 0.0, "deviation-heading": 2.2018930022147423, "distance-from-start": 2.7090569978004524, "deviation-center-line": 0.30597991997662005, "driven_lanedir_consec": 6.008901010886451}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11665
824
Bea Baselines 🐤baseline-simple-yield aido-LFVI-state-sim-testing
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-17 20:43:17+00:00 2022-11-17 20:55:18+00:00 0:12:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.619340458553207 deviation-center-line_median 0.29362362810082904
other stats deviation-center-line_max 0.29362362810082904 deviation-center-line_mean 0.29362362810082904 deviation-center-line_min 0.29362362810082904 deviation-heading_max 2.404267084079743 deviation-heading_mean 2.404267084079743 deviation-heading_median 2.404267084079743 deviation-heading_min 2.404267084079743 distance-from-start_max 2.3421142281734313 distance-from-start_mean 2.3421142281734313 distance-from-start_median 2.3421142281734313 distance-from-start_min 2.3421142281734313 driven_any_max 4.634748572927819 driven_any_mean 4.634748572927819 driven_any_median 4.634748572927819 driven_any_min 4.634748572927819 driven_lanedir_consec_max 4.619340458553207 driven_lanedir_consec_mean 4.619340458553207 driven_lanedir_consec_min 4.619340458553207 driven_lanedir_max 4.6193404722652875 driven_lanedir_mean 4.6193404722652875 driven_lanedir_median 4.6193404722652875 driven_lanedir_min 4.6193404722652875 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 4.634748572927819, "survival_time": 59.99999999999873, "driven_lanedir": 4.6193404722652875, "in-drivable-lane": 0.0, "deviation-heading": 2.404267084079743, "distance-from-start": 2.3421142281734313, "deviation-center-line": 0.29362362810082904, "driven_lanedir_consec": 4.619340458553207}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11658
825
Bea Baselines 🐤baseline-simple-yield aido-LFV_multi-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 20:31:45+00:00 2022-11-17 20:42:55+00:00 0:11:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 5.293807887862121 deviation-center-line_median 0.417556197927667
other stats deviation-center-line_max 0.4788119027447813 deviation-center-line_mean 0.38425873048239617 deviation-center-line_min 0.2231106233294694 deviation-heading_max 4.652112626803104 deviation-heading_mean 3.667961558670906 deviation-heading_median 3.597719749437933 deviation-heading_min 2.8242941090046534 distance-from-start_max 3.3013861756867433 distance-from-start_mean 2.2100546361683504 distance-from-start_median 2.7694161844933296 distance-from-start_min 2.220446049250313e-16 driven_any_max 5.5948873493535904 driven_any_mean 4.054721847884187 driven_any_median 5.312000021091446 driven_any_min 2.6645352591003757e-13 driven_lanedir_consec_max 5.571268137204079 driven_lanedir_consec_mean 4.03972097823208 driven_lanedir_consec_min 0.0 driven_lanedir_max 5.571268137204079 driven_lanedir_mean 4.03972097823208 driven_lanedir_median 5.293807887862121 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 5.5948873493535904, "survival_time": 59.99999999999873, "driven_lanedir": 5.571268137204079, "in-drivable-lane": 0.0, "deviation-heading": 3.859259059290984, "distance-from-start": 3.3013861756867433, "deviation-center-line": 0.4788119027447813, "driven_lanedir_consec": 5.571268137204079}, "zigzag-000-ego1": {"driven_any": 5.168733567764957, "survival_time": 59.99999999999873, "driven_lanedir": 5.151583839955128, "in-drivable-lane": 0.0, "deviation-heading": 2.8242941090046534, "distance-from-start": 2.805316210020219, "deviation-center-line": 0.36023058448263773, "driven_lanedir_consec": 5.151583839955128}, "zigzag-000-ego2": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 4.652112626803104, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.2231106233294694, "driven_lanedir_consec": 0.0}, "zigzag-000-ego3": {"driven_any": 5.455266474417934, "survival_time": 59.99999999999873, "driven_lanedir": 5.436031935769113, "in-drivable-lane": 0.0, "deviation-heading": 3.3361804395848824, "distance-from-start": 2.7335161589664403, "deviation-center-line": 0.4748818113726963, "driven_lanedir_consec": 5.436031935769113}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11655
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-17 20:24:56+00:00 2022-11-17 20:31:28+00:00 0:06:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.8948975282353535
other stats deviation-center-line_max 0.8948975282353535 deviation-center-line_mean 0.8948975282353535 deviation-center-line_min 0.8948975282353535 deviation-heading_max 32.249113233675025 deviation-heading_mean 32.249113233675025 deviation-heading_median 32.249113233675025 deviation-heading_min 32.249113233675025 distance-from-start_max 2.482534153247273e-16 distance-from-start_mean 2.482534153247273e-16 distance-from-start_median 2.482534153247273e-16 distance-from-start_min 2.482534153247273e-16 driven_any_max 2.9790409838966753e-13 driven_any_mean 2.9790409838966753e-13 driven_any_median 2.9790409838966753e-13 driven_any_min 2.9790409838966753e-13 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 2.9790409838966753e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 2.482534153247273e-16, "deviation-center-line": 0.8948975282353535, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11652
826
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-validation
sim-3of4 host-error no davinci-stage-02-6.2.46
2022-11-17 20:23:19+00:00 2022-11-17 20:24:34+00:00 0:01:15 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: Get https://registry-stage2.duckietown.org/v2/token?account=duckietowndaemon&client_id=docker&offline_token=true&service=registry-stage2.duckietown.org: dial tcp: lookup registry-stage2.duckietown.org: Temporary failure in name resolution")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11642
827
Bea Baselines 🐤baseline-simple-yield aido-LFV-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 20:10:18+00:00 2022-11-17 20:13:26+00:00 0:03:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.750000000000004 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.7199000882778759 deviation-center-line_median 0.16571411064010536
other stats deviation-center-line_max 0.16571411064010536 deviation-center-line_mean 0.16571411064010536 deviation-center-line_min 0.16571411064010536 deviation-heading_max 1.3921530764896437 deviation-heading_mean 1.3921530764896437 deviation-heading_median 1.3921530764896437 deviation-heading_min 1.3921530764896437 distance-from-start_max 0.6832017558427702 distance-from-start_mean 0.6832017558427702 distance-from-start_median 0.6832017558427702 distance-from-start_min 0.6832017558427702 driven_any_max 0.7330980289948952 driven_any_mean 0.7330980289948952 driven_any_median 0.7330980289948952 driven_any_min 0.7330980289948952 driven_lanedir_consec_max 0.7199000882778759 driven_lanedir_consec_mean 0.7199000882778759 driven_lanedir_consec_min 0.7199000882778759 driven_lanedir_max 0.7199000882778759 driven_lanedir_mean 0.7199000882778759 driven_lanedir_median 0.7199000882778759 driven_lanedir_min 0.7199000882778759 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7330980289948952, "survival_time": 9.750000000000004, "driven_lanedir": 0.7199000882778759, "in-drivable-lane": 0.0, "deviation-heading": 1.3921530764896437, "distance-from-start": 0.6832017558427702, "deviation-center-line": 0.16571411064010536, "driven_lanedir_consec": 0.7199000882778759}}simulation-passed 1 survival_time_max 9.750000000000004 survival_time_mean 9.750000000000004 survival_time_min 9.750000000000004
No reset possible 11611
828
Bea Baselines 🐤baseline-simple-yield aido-LFP-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-17 19:59:00+00:00 2022-11-17 20:03:05+00:00 0:04:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.0 deviation-center-line_median 0.4065274986524993
other stats deviation-center-line_max 0.4065274986524993 deviation-center-line_mean 0.4065274986524993 deviation-center-line_min 0.4065274986524993 deviation-heading_max 40.967332753486254 deviation-heading_mean 40.967332753486254 deviation-heading_median 40.967332753486254 deviation-heading_min 40.967332753486254 distance-from-start_max 5.551115123125783e-17 distance-from-start_mean 5.551115123125783e-17 distance-from-start_median 5.551115123125783e-17 distance-from-start_min 5.551115123125783e-17 driven_any_max 6.661338147750939e-14 driven_any_mean 6.661338147750939e-14 driven_any_median 6.661338147750939e-14 driven_any_min 6.661338147750939e-14 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"loop2-000-ego0": {"driven_any": 6.661338147750939e-14, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 40.967332753486254, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.4065274986524993, "driven_lanedir_consec": 0.0}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11597
829
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-validation
sim-1of4 success no davinci-stage-02-6.2.46
2022-11-17 19:52:27+00:00 2022-11-17 19:58:45+00:00 0:06:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 30.200000000000298 in-drivable-lane_median 1.1000000000000156 driven_lanedir_consec_median 1.6557496945576338 deviation-center-line_median 3.0292371299157934
other stats deviation-center-line_max 3.0292371299157934 deviation-center-line_mean 3.0292371299157934 deviation-center-line_min 3.0292371299157934 deviation-heading_max 2.9200444744909024 deviation-heading_mean 2.9200444744909024 deviation-heading_median 2.9200444744909024 deviation-heading_min 2.9200444744909024 distance-from-start_max 1.3121126948157773 distance-from-start_mean 1.3121126948157773 distance-from-start_median 1.3121126948157773 distance-from-start_min 1.3121126948157773 driven_any_max 1.7165963269618534 driven_any_mean 1.7165963269618534 driven_any_median 1.7165963269618534 driven_any_min 1.7165963269618534 driven_lanedir_consec_max 1.6557496945576338 driven_lanedir_consec_mean 1.6557496945576338 driven_lanedir_consec_min 1.6557496945576338 driven_lanedir_max 1.6557496945576338 driven_lanedir_mean 1.6557496945576338 driven_lanedir_median 1.6557496945576338 driven_lanedir_min 1.6557496945576338 in-drivable-lane_max 1.1000000000000156 in-drivable-lane_mean 1.1000000000000156 in-drivable-lane_min 1.1000000000000156 per-episodes details {"4way-000-ego0": {"driven_any": 1.7165963269618534, "survival_time": 30.200000000000298, "driven_lanedir": 1.6557496945576338, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200444744909024, "distance-from-start": 1.3121126948157773, "deviation-center-line": 3.0292371299157934, "driven_lanedir_consec": 1.6557496945576338}}simulation-passed 1 survival_time_max 30.200000000000298 survival_time_mean 30.200000000000298 survival_time_min 30.200000000000298
No reset possible 11356
830
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-validation
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-17 06:00:29+00:00 2022-11-17 06:07:02+00:00 0:06:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0999999999999377 driven_lanedir_consec_median 3.485872931964064 deviation-center-line_median 4.220405873962668
other stats deviation-center-line_max 4.220405873962668 deviation-center-line_mean 4.220405873962668 deviation-center-line_min 4.220405873962668 deviation-heading_max 2.9174896774298857 deviation-heading_mean 2.9174896774298857 deviation-heading_median 2.9174896774298857 deviation-heading_min 2.9174896774298857 distance-from-start_max 2.8928218615311083 distance-from-start_mean 2.8928218615311083 distance-from-start_median 2.8928218615311083 distance-from-start_min 2.8928218615311083 driven_any_max 3.5465963319759144 driven_any_mean 3.5465963319759144 driven_any_median 3.5465963319759144 driven_any_min 3.5465963319759144 driven_lanedir_consec_max 3.485872931964064 driven_lanedir_consec_mean 3.485872931964064 driven_lanedir_consec_min 3.485872931964064 driven_lanedir_max 3.485872931964064 driven_lanedir_mean 3.485872931964064 driven_lanedir_median 3.485872931964064 driven_lanedir_min 3.485872931964064 in-drivable-lane_max 1.0999999999999377 in-drivable-lane_mean 1.0999999999999377 in-drivable-lane_min 1.0999999999999377 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465963319759144, "survival_time": 59.99999999999873, "driven_lanedir": 3.485872931964064, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.9174896774298857, "distance-from-start": 2.8928218615311083, "deviation-center-line": 4.220405873962668, "driven_lanedir_consec": 3.485872931964064}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11354
831
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-17 05:55:21+00:00 2022-11-17 06:00:22+00:00 0:05:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.500000000000213 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.3888839040115122 deviation-center-line_median 1.4738039593225314
other stats deviation-center-line_max 1.4738039593225314 deviation-center-line_mean 1.4738039593225314 deviation-center-line_min 1.4738039593225314 deviation-heading_max 3.246880369897966 deviation-heading_mean 3.246880369897966 deviation-heading_median 3.246880369897966 deviation-heading_min 3.246880369897966 distance-from-start_max 1.289007654085733 distance-from-start_mean 1.289007654085733 distance-from-start_median 1.289007654085733 distance-from-start_min 1.289007654085733 driven_any_max 1.4075976974295576 driven_any_mean 1.4075976974295576 driven_any_median 1.4075976974295576 driven_any_min 1.4075976974295576 driven_lanedir_consec_max 1.3888839040115122 driven_lanedir_consec_mean 1.3888839040115122 driven_lanedir_consec_min 1.3888839040115122 driven_lanedir_max 1.3888839040115122 driven_lanedir_mean 1.3888839040115122 driven_lanedir_median 1.3888839040115122 driven_lanedir_min 1.3888839040115122 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 1.4075976974295576, "survival_time": 24.500000000000213, "driven_lanedir": 1.3888839040115122, "in-drivable-lane": 0.0, "deviation-heading": 3.246880369897966, "distance-from-start": 1.289007654085733, "deviation-center-line": 1.4738039593225314, "driven_lanedir_consec": 1.3888839040115122}}simulation-passed 1 survival_time_max 24.500000000000213 survival_time_mean 24.500000000000213 survival_time_min 24.500000000000213
No reset possible 11349
833
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-17 02:00:34+00:00 2022-11-17 02:09:32+00:00 0:08:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.1249999999999662 driven_lanedir_consec_median 1.4456503520453423 deviation-center-line_median 5.2165714063097
other stats deviation-center-line_max 5.528679809125458 deviation-center-line_mean 5.2165714063097 deviation-center-line_min 4.904463003493942 deviation-heading_max 8.48735406391615 deviation-heading_mean 8.116239531071809 deviation-heading_median 8.116239531071809 deviation-heading_min 7.7451249982274675 distance-from-start_max 1.242743835742773 distance-from-start_mean 1.2243627584318864 distance-from-start_median 1.2243627584318864 distance-from-start_min 1.205981681121 driven_any_max 3.4865832572710787 driven_any_mean 3.4858336367538625 driven_any_median 3.4858336367538625 driven_any_min 3.4850840162366463 driven_lanedir_consec_max 1.4708900970780958 driven_lanedir_consec_mean 1.4456503520453423 driven_lanedir_consec_min 1.4204106070125888 driven_lanedir_max 3.2904966241055256 driven_lanedir_mean 3.288148700061684 driven_lanedir_median 3.288148700061684 driven_lanedir_min 3.285800776017842 in-drivable-lane_max 3.1499999999999666 in-drivable-lane_mean 3.1249999999999662 in-drivable-lane_min 3.099999999999966 per-episodes details {"loop2-000-ego0": {"driven_any": 3.4850840162366463, "survival_time": 59.99999999999873, "driven_lanedir": 3.2904966241055256, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7451249982274675, "distance-from-start": 1.205981681121, "deviation-center-line": 4.904463003493942, "driven_lanedir_consec": 1.4204106070125888}, "loop2-000-ego1": {"driven_any": 3.4865832572710787, "survival_time": 59.99999999999873, "driven_lanedir": 3.285800776017842, "in-drivable-lane": 3.099999999999966, "deviation-heading": 8.48735406391615, "distance-from-start": 1.242743835742773, "deviation-center-line": 5.528679809125458, "driven_lanedir_consec": 1.4708900970780958}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 11063
833
Bea Baselines 🐤minimal-agent-full aido-LFV_multi-full-sim-validation
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-16 23:09:10+00:00 2022-11-16 23:30:36+00:00 0:21:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.4749999999999552 driven_lanedir_consec_median 3.4002821622357984 deviation-center-line_median 5.992377953630339
other stats deviation-center-line_max 7.516029088900642 deviation-center-line_mean 6.078065413935748 deviation-center-line_min 4.81147665958167 deviation-heading_max 12.168685206029926 deviation-heading_mean 6.8808867794243 deviation-heading_median 6.217393990233779 deviation-heading_min 2.9200739311997133 distance-from-start_max 3.0901348300566136 distance-from-start_mean 2.5082472337191244 distance-from-start_median 2.747884262658891 distance-from-start_min 1.4470855795021027 driven_any_max 3.549582457242765 driven_any_mean 3.534964335885894 driven_any_median 3.5353456174417777 driven_any_min 3.5195836514172565 driven_lanedir_consec_max 3.485653904322902 driven_lanedir_consec_mean 3.0923220036529804 driven_lanedir_consec_min 2.0830697858174214 driven_lanedir_max 3.485653904322902 driven_lanedir_mean 3.409680770298687 driven_lanedir_median 3.4002821622357984 driven_lanedir_min 3.3525048524002488 in-drivable-lane_max 2.0000000000000284 in-drivable-lane_mean 1.4874999999999703 in-drivable-lane_min 0.9999999999999432 per-episodes details {"autolab-000-ego0": {"driven_any": 3.5465963269625904, "survival_time": 59.99999999999873, "driven_lanedir": 3.485653904322902, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9200739311997133, "distance-from-start": 2.876631299535302, "deviation-center-line": 7.516029088900642, "driven_lanedir_consec": 3.485653904322902}, "autolab-000-ego1": {"driven_any": 3.524094907920965, "survival_time": 59.99999999999873, "driven_lanedir": 3.4260604158491743, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.516330158155915, "distance-from-start": 2.6191372257824805, "deviation-center-line": 6.510873598064531, "driven_lanedir_consec": 3.4260604158491743}, "autolab-000-ego2": {"driven_any": 3.549582457242765, "survival_time": 59.99999999999873, "driven_lanedir": 3.3745039086224224, "in-drivable-lane": 0.9999999999999432, "deviation-heading": 12.168685206029926, "distance-from-start": 3.0901348300566136, "deviation-center-line": 4.81147665958167, "driven_lanedir_consec": 3.3745039086224224}, "autolab-000-ego3": {"driven_any": 3.5195836514172565, "survival_time": 59.99999999999873, "driven_lanedir": 3.3525048524002488, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 8.918457822311643, "distance-from-start": 1.4470855795021027, "deviation-center-line": 5.4738823091961475, "driven_lanedir_consec": 2.0830697858174214}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10928
836
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-16 22:59:12+00:00 2022-11-16 23:08:56+00:00 0:09:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 49.9499999999993 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.903013185974951 deviation-center-line_median 3.78943987331601
other stats deviation-center-line_max 3.78943987331601 deviation-center-line_mean 3.78943987331601 deviation-center-line_min 3.78943987331601 deviation-heading_max 4.334690003953373 deviation-heading_mean 4.334690003953373 deviation-heading_median 4.334690003953373 deviation-heading_min 4.334690003953373 distance-from-start_max 1.5738876609453012 distance-from-start_mean 1.5738876609453012 distance-from-start_median 1.5738876609453012 distance-from-start_min 1.5738876609453012 driven_any_max 2.934594724791732 driven_any_mean 2.934594724791732 driven_any_median 2.934594724791732 driven_any_min 2.934594724791732 driven_lanedir_consec_max 2.903013185974951 driven_lanedir_consec_mean 2.903013185974951 driven_lanedir_consec_min 2.903013185974951 driven_lanedir_max 2.9099324876731436 driven_lanedir_mean 2.9099324876731436 driven_lanedir_median 2.9099324876731436 driven_lanedir_min 2.9099324876731436 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.934594724791732, "survival_time": 49.9499999999993, "driven_lanedir": 2.9099324876731436, "in-drivable-lane": 0.0, "deviation-heading": 4.334690003953373, "distance-from-start": 1.5738876609453012, "deviation-center-line": 3.78943987331601, "driven_lanedir_consec": 2.903013185974951}}simulation-passed 1 survival_time_max 49.9499999999993 survival_time_mean 49.9499999999993 survival_time_min 49.9499999999993
No reset possible 10876
836
Bea Baselines 🐤minimal-agent-full aido-LFVI-full-sim-testing
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-16 22:55:52+00:00 2022-11-16 22:58:50+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 10759
837
Bea Baselines 🐤minimal-agent-full aido-LFP-full-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 22:48:20+00:00 2022-11-16 22:55:46+00:00 0:07:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.249999999999972 driven_lanedir_consec_median 1.5873305909427766 deviation-center-line_median 5.442861863263418
other stats deviation-center-line_max 5.442861863263418 deviation-center-line_mean 5.442861863263418 deviation-center-line_min 5.442861863263418 deviation-heading_max 11.057314603573452 deviation-heading_mean 11.057314603573452 deviation-heading_median 11.057314603573452 deviation-heading_min 11.057314603573452 distance-from-start_max 1.519244551350185 distance-from-start_mean 1.519244551350185 distance-from-start_median 1.519244551350185 distance-from-start_min 1.519244551350185 driven_any_max 3.452076592019539 driven_any_mean 3.452076592019539 driven_any_median 3.452076592019539 driven_any_min 3.452076592019539 driven_lanedir_consec_max 1.5873305909427766 driven_lanedir_consec_mean 1.5873305909427766 driven_lanedir_consec_min 1.5873305909427766 driven_lanedir_max 3.163920824988357 driven_lanedir_mean 3.163920824988357 driven_lanedir_median 3.163920824988357 driven_lanedir_min 3.163920824988357 in-drivable-lane_max 4.249999999999972 in-drivable-lane_mean 4.249999999999972 in-drivable-lane_min 4.249999999999972 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.452076592019539, "survival_time": 59.99999999999873, "driven_lanedir": 3.163920824988357, "in-drivable-lane": 4.249999999999972, "deviation-heading": 11.057314603573452, "distance-from-start": 1.519244551350185, "deviation-center-line": 5.442861863263418, "driven_lanedir_consec": 1.5873305909427766}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10695
838
Bea Baselines 🐤minimal-agent-full aido-LFV-full-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 22:44:05+00:00 2022-11-16 22:48:05+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.70000000000006 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.746673767524618 deviation-center-line_median 0.7161949626619292
other stats deviation-center-line_max 0.7161949626619292 deviation-center-line_mean 0.7161949626619292 deviation-center-line_min 0.7161949626619292 deviation-heading_max 2.160741888859268 deviation-heading_mean 2.160741888859268 deviation-heading_median 2.160741888859268 deviation-heading_min 2.160741888859268 distance-from-start_max 0.7031149433813478 distance-from-start_mean 0.7031149433813478 distance-from-start_median 0.7031149433813478 distance-from-start_min 0.7031149433813478 driven_any_max 0.7595982247497333 driven_any_mean 0.7595982247497333 driven_any_median 0.7595982247497333 driven_any_min 0.7595982247497333 driven_lanedir_consec_max 0.746673767524618 driven_lanedir_consec_mean 0.746673767524618 driven_lanedir_consec_min 0.746673767524618 driven_lanedir_max 0.746673767524618 driven_lanedir_mean 0.746673767524618 driven_lanedir_median 0.746673767524618 driven_lanedir_min 0.746673767524618 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 0.7595982247497333, "survival_time": 13.70000000000006, "driven_lanedir": 0.746673767524618, "in-drivable-lane": 0.0, "deviation-heading": 2.160741888859268, "distance-from-start": 0.7031149433813478, "deviation-center-line": 0.7161949626619292, "driven_lanedir_consec": 0.746673767524618}}simulation-passed 1 survival_time_max 13.70000000000006 survival_time_mean 13.70000000000006 survival_time_min 13.70000000000006
No reset possible 10531
839
Bea Baselines 🐤minimal-agent-full aido-LFI-full-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-16 22:32:39+00:00 2022-11-16 22:43:50+00:00 0:11:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 3.249999999999958 driven_lanedir_consec_median 2.186789824803002 deviation-center-line_median 5.756192467557295
other stats deviation-center-line_max 5.756192467557295 deviation-center-line_mean 5.756192467557295 deviation-center-line_min 5.756192467557295 deviation-heading_max 6.2307698813353865 deviation-heading_mean 6.2307698813353865 deviation-heading_median 6.2307698813353865 deviation-heading_min 6.2307698813353865 distance-from-start_max 1.6298009498956398 distance-from-start_mean 1.6298009498956398 distance-from-start_median 1.6298009498956398 distance-from-start_min 1.6298009498956398 driven_any_max 3.483691022699812 driven_any_mean 3.483691022699812 driven_any_median 3.483691022699812 driven_any_min 3.483691022699812 driven_lanedir_consec_max 2.186789824803002 driven_lanedir_consec_mean 2.186789824803002 driven_lanedir_consec_min 2.186789824803002 driven_lanedir_max 3.299163918160777 driven_lanedir_mean 3.299163918160777 driven_lanedir_median 3.299163918160777 driven_lanedir_min 3.299163918160777 in-drivable-lane_max 3.249999999999958 in-drivable-lane_mean 3.249999999999958 in-drivable-lane_min 3.249999999999958 per-episodes details {"4way-000-ego0": {"driven_any": 3.483691022699812, "survival_time": 59.99999999999873, "driven_lanedir": 3.299163918160777, "in-drivable-lane": 3.249999999999958, "deviation-heading": 6.2307698813353865, "distance-from-start": 1.6298009498956398, "deviation-center-line": 5.756192467557295, "driven_lanedir_consec": 2.186789824803002}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10277
841
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-16 22:11:22+00:00 2022-11-16 22:32:29+00:00 0:21:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 0.0 driven_lanedir_consec_median 3.133472186206734 deviation-center-line_median 3.5692749184210433
other stats deviation-center-line_max 5.1851715974128805 deviation-center-line_mean 3.738598388104289 deviation-center-line_min 2.6306721181621886 deviation-heading_max 8.12390911081905 deviation-heading_mean 4.904445207680925 deviation-heading_median 3.9916054069886826 deviation-heading_min 3.5106609059272844 distance-from-start_max 2.230934169509707 distance-from-start_mean 1.8422550059061231 distance-from-start_median 1.83762780726357 distance-from-start_min 1.4628302395876456 driven_any_max 3.5795876791383257 driven_any_mean 3.408211238652514 driven_any_median 3.559331275339633 driven_any_min 2.934594724792462 driven_lanedir_consec_max 3.4288085645898976 driven_lanedir_consec_mean 2.8688896370650867 driven_lanedir_consec_min 1.779805611256981 driven_lanedir_max 3.561567679231453 driven_lanedir_mean 3.351579340793875 driven_lanedir_median 3.467420167967693 driven_lanedir_min 2.909909348008662 in-drivable-lane_max 1.3499999999999446 in-drivable-lane_mean 0.33749999999998614 in-drivable-lane_min 0.0 per-episodes details {"udem-000-ego0": {"driven_any": 2.934594724792462, "survival_time": 59.99999999999873, "driven_lanedir": 2.909909348008662, "in-drivable-lane": 0.0, "deviation-heading": 4.334701504286533, "distance-from-start": 1.5738876834742443, "deviation-center-line": 5.1851715974128805, "driven_lanedir_consec": 2.9029908891375724}, "udem-000-ego1": {"driven_any": 3.539079376082114, "survival_time": 59.99999999999873, "driven_lanedir": 3.3772467891566187, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 8.12390911081905, "distance-from-start": 1.4628302395876456, "deviation-center-line": 4.14966050504133, "driven_lanedir_consec": 1.779805611256981}, "udem-000-ego2": {"driven_any": 3.5795876791383257, "survival_time": 59.99999999999873, "driven_lanedir": 3.561567679231453, "in-drivable-lane": 0.0, "deviation-heading": 3.5106609059272844, "distance-from-start": 2.230934169509707, "deviation-center-line": 2.6306721181621886, "driven_lanedir_consec": 3.4288085645898976}, "udem-000-ego3": {"driven_any": 3.5795831745971527, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575935467787665, "in-drivable-lane": 0.0, "deviation-heading": 3.648509309690832, "distance-from-start": 2.101367931052896, "deviation-center-line": 2.988889331800756, "driven_lanedir_consec": 3.3639534832758957}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10228
841
Bea Baselines 🐤minimal-agent-full aido-LFVI_multi-full-sim-testing
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-16 22:08:07+00:00 2022-11-16 22:11:00+00:00 0:02:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 10144
843
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 22:03:15+00:00 2022-11-16 22:07:44+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.8920792929900845 deviation-center-line_median 5.680288946152966
other stats deviation-center-line_max 5.680288946152966 deviation-center-line_mean 5.680288946152966 deviation-center-line_min 5.680288946152966 deviation-heading_max 11.490175070254152 deviation-heading_mean 11.490175070254152 deviation-heading_median 11.490175070254152 deviation-heading_min 11.490175070254152 distance-from-start_max 2.5229792435928395 distance-from-start_mean 2.5229792435928395 distance-from-start_median 2.5229792435928395 distance-from-start_min 2.5229792435928395 driven_any_max 3.4265750684858305 driven_any_mean 3.4265750684858305 driven_any_median 3.4265750684858305 driven_any_min 3.4265750684858305 driven_lanedir_consec_max 2.8920792929900845 driven_lanedir_consec_mean 2.8920792929900845 driven_lanedir_consec_min 2.8920792929900845 driven_lanedir_max 3.0978303472366893 driven_lanedir_mean 3.0978303472366893 driven_lanedir_median 3.0978303472366893 driven_lanedir_min 3.0978303472366893 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.4265750684858305, "survival_time": 59.99999999999873, "driven_lanedir": 3.0978303472366893, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.490175070254152, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.680288946152966, "driven_lanedir_consec": 2.8920792929900845}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 10083
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-16 21:59:01+00:00 2022-11-16 22:03:09+00:00 0:04:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 10027
844
Bea Baselines 🐤minimal-agent-state aido-LFI-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 21:55:35+00:00 2022-11-16 21:58:46+00:00 0:03:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats simulation-passed 1 skipped 1
No reset possible 9861
845
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-validation
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-16 21:44:17+00:00 2022-11-16 21:55:07+00:00 0:10:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.0000000000000142 driven_lanedir_consec_median 2.7045955609117347 deviation-center-line_median 5.298353292175556
other stats deviation-center-line_max 6.7415423051179255 deviation-center-line_mean 5.28094688646254 deviation-center-line_min 3.785538656381124 deviation-heading_max 13.312014280207482 deviation-heading_mean 6.591214978958582 deviation-heading_median 4.957876569877463 deviation-heading_min 3.137092495871918 distance-from-start_max 2.2873183363783496 distance-from-start_mean 1.7377713014167755 distance-from-start_median 1.9053628015189592 distance-from-start_min 0.8530412662508342 driven_any_max 3.579587180103618 driven_any_mean 2.867838687646443 driven_any_median 2.919589855341645 driven_any_min 2.052587859798864 driven_lanedir_consec_max 3.384490798043468 driven_lanedir_consec_mean 2.391979057772581 driven_lanedir_consec_min 0.7742343112233858 driven_lanedir_max 3.5625563105123215 driven_lanedir_mean 2.790015327019447 driven_lanedir_median 2.838407939721475 driven_lanedir_min 1.9206891181225152 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 1.1249999999999716 in-drivable-lane_min 0.0 per-episodes details {"4way-000-ego0": {"driven_any": 2.259597875697513, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590471343353, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280207482, "distance-from-start": 1.740927094321447, "deviation-center-line": 6.213697824668821, "driven_lanedir_consec": 2.0736045752466756}, "4way-000-ego1": {"driven_any": 3.5795818349857766, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625563105123215, "in-drivable-lane": 0.0, "deviation-heading": 3.137092495871918, "distance-from-start": 2.069798508716472, "deviation-center-line": 3.785538656381124, "driven_lanedir_consec": 3.3355865465767938}, "4way-000-ego2": {"driven_any": 3.579587180103618, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589568323086147, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646358412, "distance-from-start": 2.2873183363783496, "deviation-center-line": 4.3830087596822915, "driven_lanedir_consec": 3.384490798043468}, "4way-000-ego3": {"driven_any": 2.052587859798864, "survival_time": 59.99999999999873, "driven_lanedir": 1.9206891181225152, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545204933965145, "distance-from-start": 0.8530412662508342, "deviation-center-line": 6.7415423051179255, "driven_lanedir_consec": 0.7742343112233858}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9719
847
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-validation
348 success yes davinci-stage-02-6.2.46
2022-11-16 21:34:53+00:00 2022-11-16 21:44:02+00:00 0:09:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 4.3499999999998895 driven_lanedir_consec_median 2.2675849461568647 deviation-center-line_median 5.560918027752658
other stats deviation-center-line_max 5.665543834003993 deviation-center-line_mean 5.3727149067087066 deviation-center-line_min 4.703479737325517 deviation-heading_max 10.454471793859122 deviation-heading_mean 9.605748204053755 deviation-heading_median 9.670620842366962 deviation-heading_min 8.627279337621992 distance-from-start_max 3.0406853340722217 distance-from-start_mean 2.0347241290700784 distance-from-start_median 2.024381858976593 distance-from-start_min 1.0494474642549068 driven_any_max 3.5795904164549563 driven_any_mean 3.481407758763025 driven_any_median 3.4491559187079543 driven_any_min 3.447728781181236 driven_lanedir_consec_max 3.500351716832338 driven_lanedir_consec_mean 2.3551359976981656 driven_lanedir_consec_min 1.385022381646594 driven_lanedir_max 3.500351716832338 driven_lanedir_mean 3.2651576913078557 driven_lanedir_median 3.1933040571981905 driven_lanedir_min 3.173670934002705 in-drivable-lane_max 4.399999999999963 in-drivable-lane_mean 3.2749999999999355 in-drivable-lane_min 0.0 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.449081931990942, "survival_time": 59.99999999999873, "driven_lanedir": 3.2020361174014584, "in-drivable-lane": 4.349999999999895, "deviation-heading": 8.627279337621992, "distance-from-start": 1.0494474642549068, "deviation-center-line": 5.586766604699417, "driven_lanedir_consec": 1.385022381646594}, "zigzag-000-ego1": {"driven_any": 3.447728781181236, "survival_time": 59.99999999999873, "driven_lanedir": 3.173670934002705, "in-drivable-lane": 4.399999999999963, "deviation-heading": 10.454471793859122, "distance-from-start": 1.5345351360434751, "deviation-center-line": 5.665543834003993, "driven_lanedir_consec": 1.63302491241896}, "zigzag-000-ego2": {"driven_any": 3.5795904164549563, "survival_time": 59.99999999999873, "driven_lanedir": 3.500351716832338, "in-drivable-lane": 0.0, "deviation-heading": 9.518767283173348, "distance-from-start": 3.0406853340722217, "deviation-center-line": 4.703479737325517, "driven_lanedir_consec": 3.500351716832338}, "zigzag-000-ego3": {"driven_any": 3.4492299054249664, "survival_time": 59.99999999999873, "driven_lanedir": 3.184571996994922, "in-drivable-lane": 4.349999999999884, "deviation-heading": 9.822474401560571, "distance-from-start": 2.5142285819097103, "deviation-center-line": 5.535069450805898, "driven_lanedir_consec": 2.9021449798947696}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9622
848
Bea Baselines 🐤minimal-agent-state aido-LFP-state-sim-validation
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 21:29:14+00:00 2022-11-16 21:34:32+00:00 0:05:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 58.999999999998785 in-drivable-lane_median 5.099999999999877 driven_lanedir_consec_median 2.8920792929900845 deviation-center-line_median 5.6806740116942835
other stats deviation-center-line_max 5.6806740116942835 deviation-center-line_mean 5.6806740116942835 deviation-center-line_min 5.6806740116942835 deviation-heading_max 11.30344108488696 deviation-heading_mean 11.30344108488696 deviation-heading_median 11.30344108488696 deviation-heading_min 11.30344108488696 distance-from-start_max 2.5229792435928395 distance-from-start_mean 2.5229792435928395 distance-from-start_median 2.5229792435928395 distance-from-start_min 2.5229792435928395 driven_any_max 3.3245754522163784 driven_any_mean 3.3245754522163784 driven_any_median 3.3245754522163784 driven_any_min 3.3245754522163784 driven_lanedir_consec_max 2.8920792929900845 driven_lanedir_consec_mean 2.8920792929900845 driven_lanedir_consec_min 2.8920792929900845 driven_lanedir_max 2.9981420562404173 driven_lanedir_mean 2.9981420562404173 driven_lanedir_median 2.9981420562404173 driven_lanedir_min 2.9981420562404173 in-drivable-lane_max 5.099999999999877 in-drivable-lane_mean 5.099999999999877 in-drivable-lane_min 5.099999999999877 per-episodes details {"zigzag-000-ego0": {"driven_any": 3.3245754522163784, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420562404173, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.30344108488696, "distance-from-start": 2.5229792435928395, "deviation-center-line": 5.6806740116942835, "driven_lanedir_consec": 2.8920792929900845}}simulation-passed 1 survival_time_max 58.999999999998785 survival_time_mean 58.999999999998785 survival_time_min 58.999999999998785
No reset possible 9561
849
Bea Baselines 🐤minimal-agent-state aido-LF-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 21:25:42+00:00 2022-11-16 21:29:06+00:00 0:03:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 40.04999999999986 in-drivable-lane_median 2.5000000000000098 driven_lanedir_consec_median 1.160366146360421 deviation-center-line_median 2.940039735198709
other stats deviation-center-line_max 2.940039735198709 deviation-center-line_mean 2.940039735198709 deviation-center-line_min 2.940039735198709 deviation-heading_max 9.167157492761987 deviation-heading_mean 9.167157492761987 deviation-heading_median 9.167157492761987 deviation-heading_min 9.167157492761987 distance-from-start_max 1.1396211983149378 distance-from-start_mean 1.1396211983149378 distance-from-start_median 1.1396211983149378 distance-from-start_min 1.1396211983149378 driven_any_max 2.265732411375476 driven_any_mean 2.265732411375476 driven_any_median 2.265732411375476 driven_any_min 2.265732411375476 driven_lanedir_consec_max 1.160366146360421 driven_lanedir_consec_mean 1.160366146360421 driven_lanedir_consec_min 1.160366146360421 driven_lanedir_max 2.08337576497627 driven_lanedir_mean 2.08337576497627 driven_lanedir_median 2.08337576497627 driven_lanedir_min 2.08337576497627 in-drivable-lane_max 2.5000000000000098 in-drivable-lane_mean 2.5000000000000098 in-drivable-lane_min 2.5000000000000098 per-episodes details {"zigzag-000-ego0": {"driven_any": 2.265732411375476, "survival_time": 40.04999999999986, "driven_lanedir": 2.08337576497627, "in-drivable-lane": 2.5000000000000098, "deviation-heading": 9.167157492761987, "distance-from-start": 1.1396211983149378, "deviation-center-line": 2.940039735198709, "driven_lanedir_consec": 1.160366146360421}}simulation-passed 1 survival_time_max 40.04999999999986 survival_time_mean 40.04999999999986 survival_time_min 40.04999999999986
No reset possible 9392
851
Bea Baselines 🐤minimal-agent-state aido-LFVI_multi-state-sim-testing
sim-2of4 success no davinci-stage-02-6.2.46
2022-11-16 21:14:46+00:00 2022-11-16 21:25:28+00:00 0:10:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.2000000000000313 driven_lanedir_consec_median 2.398726594458411 deviation-center-line_median 5.385973951445022
other stats deviation-center-line_max 6.768119261305023 deviation-center-line_mean 5.141910550077539 deviation-center-line_min 3.027575036115088 deviation-heading_max 18.81946877878392 deviation-heading_mean 8.820040813941052 deviation-heading_median 5.631621361292126 deviation-heading_min 5.197451754396037 distance-from-start_max 2.6950459245155516 distance-from-start_mean 1.825294574395911 distance-from-start_median 1.900162687326769 distance-from-start_min 0.8058069984145542 driven_any_max 3.465429040061589 driven_any_mean 2.7198217462465735 driven_any_median 2.716635137969776 driven_any_min 1.9805876689851512 driven_lanedir_consec_max 3.2592891649667823 driven_lanedir_consec_mean 2.198266437088204 driven_lanedir_consec_min 0.736323394469212 driven_lanedir_max 3.3234641052144616 driven_lanedir_mean 2.5697421917278698 driven_lanedir_median 2.5539937726256654 driven_lanedir_min 1.8475171164456856 in-drivable-lane_max 3.5999999999999623 in-drivable-lane_mean 2.3374999999999924 in-drivable-lane_min 1.3499999999999446 per-episodes details {"4way-000-ego0": {"driven_any": 1.9805876689851512, "survival_time": 59.99999999999873, "driven_lanedir": 1.8486983802845485, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.38991345016137, "distance-from-start": 0.8058069984145542, "deviation-center-line": 5.720664140368309, "driven_lanedir_consec": 0.736323394469212}, "4way-000-ego1": {"driven_any": 2.000247935197531, "survival_time": 59.99999999999873, "driven_lanedir": 1.8475171164456856, "in-drivable-lane": 1.3499999999999446, "deviation-heading": 18.81946877878392, "distance-from-start": 1.4628422402543046, "deviation-center-line": 5.051283762521735, "driven_lanedir_consec": 1.7798051238862296}, "4way-000-ego2": {"driven_any": 3.465429040061589, "survival_time": 59.99999999999873, "driven_lanedir": 3.3234641052144616, "in-drivable-lane": 2.400000000000034, "deviation-heading": 5.873329272422881, "distance-from-start": 2.3374831343992333, "deviation-center-line": 3.027575036115088, "driven_lanedir_consec": 3.017648065030592}, "4way-000-ego3": {"driven_any": 3.4330223407420215, "survival_time": 59.99999999999873, "driven_lanedir": 3.2592891649667823, "in-drivable-lane": 3.5999999999999623, "deviation-heading": 5.197451754396037, "distance-from-start": 2.6950459245155516, "deviation-center-line": 6.768119261305023, "driven_lanedir_consec": 3.2592891649667823}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9241
852
Bea Baselines 🐤minimal-agent-state aido-LFVI-state-sim-testing
sim-3of4 success no davinci-stage-02-6.2.46
2022-11-16 21:04:51+00:00 2022-11-16 21:14:36+00:00 0:09:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 2.499999999999858 driven_lanedir_consec_median 2.0183982038959174 deviation-center-line_median 5.116869283415678
other stats deviation-center-line_max 5.116869283415678 deviation-center-line_mean 5.116869283415678 deviation-center-line_min 5.116869283415678 deviation-heading_max 5.091155339747139 deviation-heading_mean 5.091155339747139 deviation-heading_median 5.091155339747139 deviation-heading_min 5.091155339747139 distance-from-start_max 1.6832286746350418 distance-from-start_mean 1.6832286746350418 distance-from-start_median 1.6832286746350418 distance-from-start_min 1.6832286746350418 driven_any_max 3.5045866946371738 driven_any_mean 3.5045866946371738 driven_any_median 3.5045866946371738 driven_any_min 3.5045866946371738 driven_lanedir_consec_max 2.0183982038959174 driven_lanedir_consec_mean 2.0183982038959174 driven_lanedir_consec_min 2.0183982038959174 driven_lanedir_max 3.36042557719213 driven_lanedir_mean 3.36042557719213 driven_lanedir_median 3.36042557719213 driven_lanedir_min 3.36042557719213 in-drivable-lane_max 2.499999999999858 in-drivable-lane_mean 2.499999999999858 in-drivable-lane_min 2.499999999999858 per-episodes details {"4way-001-ego0": {"driven_any": 3.5045866946371738, "survival_time": 59.99999999999873, "driven_lanedir": 3.36042557719213, "in-drivable-lane": 2.499999999999858, "deviation-heading": 5.091155339747139, "distance-from-start": 1.6832286746350418, "deviation-center-line": 5.116869283415678, "driven_lanedir_consec": 2.0183982038959174}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 9230
853
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-2of4 host-error no davinci-stage-02-6.2.46
2022-11-16 21:03:59+00:00 2022-11-16 21:04:17+00:00 0:00:18 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.41/auth
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 36, in docker_login
client.login(username=docker_username, password=docker_password, reauth=True, registry=registry)
File "/usr/local/lib/python3.8/dist-packages/docker/client.py", line 199, in login
return self.api.login(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/daemon.py", line 152, in login
return self._result(response, json=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
raise create_api_error_from_http_exception(e) from e
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 39, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation) from e
docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get https://registry-stage2.duckietown.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 865, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1067, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
do_login_for_registry(client, credentials, br.registry)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 64, in do_login_for_registry
docker_login(client, registry, credentials[registry]["username"], credentials[registry]["secret"])
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_logging_in.py", line 42, in docker_login
raise DockerLoginError(f"Could not login to {registry!r} as {docker_username!r} {pwd}") from e
duckietown_build_utils.docker_logging_in.DockerLoginError: Could not login to 'registry-stage2.duckietown.org' as 'duckietowndaemon'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9082
853
Bea Baselines 🐤minimal-agent-state aido-LFV_multi-state-sim-testing
sim-0of4 success no davinci-stage-02-6.2.46
2022-11-16 20:54:38+00:00 2022-11-16 21:02:57+00:00 0:08:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 59.99999999999873 in-drivable-lane_median 1.549999999999912 driven_lanedir_consec_median 3.4373147503288832 deviation-center-line_median 5.543408016755537
other stats deviation-center-line_max 7.09102922648354 deviation-center-line_mean 5.54329471184905 deviation-center-line_min 3.995333587401586 deviation-heading_max 7.066664369148437 deviation-heading_mean 5.842960213142369 deviation-heading_median 6.8999459874551246 deviation-heading_min 2.505284508510791 distance-from-start_max 2.955798853097406 distance-from-start_mean 2.4988165096278374 distance-from-start_median 2.699886878673919 distance-from-start_min 1.6396934280661062 driven_any_max 3.579593246505303 driven_any_mean 3.521842404663172 driven_any_median 3.5330944521151153 driven_any_min 3.441587467917153 driven_lanedir_consec_max 3.525823359544204 driven_lanedir_consec_mean 3.4022655912637405 driven_lanedir_consec_min 3.2086095048529906 driven_lanedir_max 3.525823359544204 driven_lanedir_mean 3.4022655912637405 driven_lanedir_median 3.4373147503288832 driven_lanedir_min 3.2086095048529906 in-drivable-lane_max 4.5999999999999055 in-drivable-lane_mean 1.9249999999999323 in-drivable-lane_min 0.0 per-episodes details {"autolab-000-ego0": {"driven_any": 3.579593246505303, "survival_time": 59.99999999999873, "driven_lanedir": 3.525823359544204, "in-drivable-lane": 0.0, "deviation-heading": 6.822136240935285, "distance-from-start": 2.955798853097406, "deviation-center-line": 5.656377133944901, "driven_lanedir_consec": 3.525823359544204}, "autolab-000-ego1": {"driven_any": 3.51959204448395, "survival_time": 59.99999999999873, "driven_lanedir": 3.385438564236927, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 7.066664369148437, "distance-from-start": 2.7565963439290773, "deviation-center-line": 5.430438899566171, "driven_lanedir_consec": 3.385438564236927}, "autolab-000-ego2": {"driven_any": 3.5465968597462805, "survival_time": 59.99999999999873, "driven_lanedir": 3.48919093642084, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.505284508510791, "distance-from-start": 2.643177413418761, "deviation-center-line": 3.995333587401586, "driven_lanedir_consec": 3.48919093642084}, "autolab-000-ego3": {"driven_any": 3.441587467917153, "survival_time": 59.99999999999873, "driven_lanedir": 3.2086095048529906, "in-drivable-lane": 4.5999999999999055, "deviation-heading": 6.977755733974964, "distance-from-start": 1.6396934280661062, "deviation-center-line": 7.09102922648354, "driven_lanedir_consec": 3.2086095048529906}}simulation-passed 1 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible