Submission 1633

Submission

1633

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:18:45+00:00

Last status update

2022-11-29 12:37:38+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16922 sim-1of4: 16923 sim-2of4: 16918 sim-3of4: 16917

User label

baseline-duckietown-ml

Admin priority

Blessing

n/a

User priority

16923

Click the images to see detailed statistics about the episode.

loop-000

16922

Click the images to see detailed statistics about the episode.

autolab-000

16918

Click the images to see detailed statistics about the episode.

loop2-000

16917

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16923

sim-1of4

success

yes

2022-11-29 12:22:37+00:00

2022-11-29 12:37:14+00:00

0:14:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	7.152557373046875e-05
deviation-center-line_median	1.5117049755778469

other stats

deviation-center-line_max	2.9467758452445567
deviation-center-line_mean	1.5769826255149473
deviation-center-line_min	0.33774470565953923
deviation-heading_max	32.249113233675025
deviation-heading_mean	22.83949643715976
deviation-heading_median	22.597265680122995
deviation-heading_min	13.914341154718024
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	1.5700924586837752e-16
distance-from-start_median	0.0
distance-from-start_min	0.0
driven_any_max	7.536443801682175e-13
driven_any_mean	1.8841109504205443e-13
driven_any_median	0.0
driven_any_min	0.0
driven_lanedir_consec_max	0.0001430511474609375
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0001430511474609375
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	7.152557373046875e-05
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8949070851524836, "driven_lanedir_consec": 0.0001430511474609375}, "loop-000-ego1": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 0.0, "deviation-center-line": 2.1285028660032097, "driven_lanedir_consec": 0.0}, "loop-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 0.0, "deviation-center-line": 2.9467758452445567, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 0.0001430511474609375, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 0.0, "deviation-center-line": 0.33774470565953923, "driven_lanedir_consec": 0.0001430511474609375}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16922

sim-0of4

success

yes

2022-11-29 12:22:36+00:00

2022-11-29 12:37:14+00:00

0:14:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.5117001971192878

other stats

deviation-center-line_max	2.946786737000149
deviation-center-line_mean	1.5769829592245754
deviation-center-line_min	0.3377447056595774
deviation-heading_max	32.249113233675025
deviation-heading_mean	22.83949643715976
deviation-heading_median	22.597265680122995
deviation-heading_min	13.914341154718024
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	3.5129827517777994e-16
distance-from-start_median	3.3306690738754696e-16
distance-from-start_min	1.1102230246251563e-16
driven_any_max	7.536443801682175e-13
driven_any_mean	4.215579302133373e-13
driven_any_median	3.9968028886505635e-13
driven_any_min	1.3322676295501878e-13
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 7.536443801682175e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.8948975282353634, "driven_lanedir_consec": 0.0}, "autolab-000-ego1": {"driven_any": 1.3322676295501878e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 1.1102230246251563e-16, "deviation-center-line": 2.1285028660032124, "driven_lanedir_consec": 0.0}, "autolab-000-ego2": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 2.946786737000149, "driven_lanedir_consec": 0.0}, "autolab-000-ego3": {"driven_any": 2.6645352591003757e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 2.220446049250313e-16, "deviation-center-line": 0.3377447056595774, "driven_lanedir_consec": 0.000286102294921875}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16918

sim-2of4

success

yes

2022-11-29 12:21:44+00:00

2022-11-29 12:30:02+00:00

0:08:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.0
deviation-center-line_median	1.5116931584219764

other stats

deviation-center-line_max	2.128491974247649
deviation-center-line_mean	1.5116931584219764
deviation-center-line_min	0.8948943425963037
deviation-heading_max	32.249113233675025
deviation-heading_mean	31.48103999887634
deviation-heading_median	31.48103999887634
deviation-heading_min	30.712966764077652
distance-from-start_max	3.1401849173675503e-16
distance-from-start_mean	2.2639818490744983e-16
distance-from-start_median	2.2639818490744983e-16
distance-from-start_min	1.3877787807814454e-16
driven_any_max	3.7682219008410875e-13
driven_any_mean	2.716778218889411e-13
driven_any_median	2.716778218889411e-13
driven_any_min	1.665334536937735e-13
driven_lanedir_consec_max	0.0
driven_lanedir_consec_mean	0.0
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.0
driven_lanedir_mean	0.0
driven_lanedir_median	0.0
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.665334536937735e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 32.249113233675025, "distance-from-start": 1.3877787807814454e-16, "deviation-center-line": 0.8948943425963037, "driven_lanedir_consec": 0.0}, "loop2-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.128491974247649, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16917

sim-3of4

success

yes

2022-11-29 12:20:08+00:00

2022-11-29 12:35:40+00:00

0:15:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.939287230801057e-07
deviation-center-line_median	1.5116956155527117

other stats

deviation-center-line_max	2.9467746047984105
deviation-center-line_mean	1.5769755996667565
deviation-center-line_min	0.33773656276319197
deviation-heading_max	32.24910212696788
deviation-heading_mean	22.839461787379523
deviation-heading_median	22.597236152907925
deviation-heading_min	13.91427271673436
distance-from-start_max	9.155133597044477e-16
distance-from-start_mean	3.073829628603006e-16
distance-from-start_median	1.5700924586837752e-16
distance-from-start_min	0.0
driven_any_max	1.0986160316453499e-12
driven_any_mean	3.6885955543236473e-13
driven_any_median	1.8841109504205443e-13
driven_any_min	0.0
driven_lanedir_consec_max	4.4323372971888375e-06
driven_lanedir_consec_mean	-6.959346956214585e-05
driven_lanedir_consec_min	-0.00028319407299193244
driven_lanedir_max	4.4323372971888375e-06
driven_lanedir_mean	-6.959346956214585e-05
driven_lanedir_median	1.939287230801057e-07
driven_lanedir_min	-0.00028319407299193244
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": -2.089142725480997e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.24910212696788, "distance-from-start": 0.0, "deviation-center-line": 0.8948982095947005, "driven_lanedir_consec": -2.089142725480997e-06}, "zigzag-000-ego1": {"driven_any": 3.7682219008410875e-13, "survival_time": 59.99999999999873, "driven_lanedir": -0.00028319407299193244, "in-drivable-lane": 0.0, "deviation-heading": 30.71290207135603, "distance-from-start": 3.1401849173675503e-16, "deviation-center-line": 2.1284930215107223, "driven_lanedir_consec": -0.00028319407299193244}, "zigzag-000-ego2": {"driven_any": 0.0, "survival_time": 59.99999999999873, "driven_lanedir": 2.477000171641208e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.481570234459818, "distance-from-start": 0.0, "deviation-center-line": 2.9467746047984105, "driven_lanedir_consec": 2.477000171641208e-06}, "zigzag-000-ego3": {"driven_any": 1.0986160316453499e-12, "survival_time": 59.99999999999873, "driven_lanedir": 4.4323372971888375e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.91427271673436, "distance-from-start": 9.155133597044477e-16, "deviation-center-line": 0.33773656276319197, "driven_lanedir_consec": 4.4323372971888375e-06}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible