Submission 1694

Submission

1694

Competing

yes

Challenge

aido-LFP-full-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:18:58+00:00

Last status update

2022-11-28 17:50:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16713 sim-1of4: 16710 sim-2of4: 16698 sim-3of4: 16711

User label

minimal-agent-full

Admin priority

Blessing

n/a

User priority

16713

Click the images to see detailed statistics about the episode.

autolab-000

16711

Click the images to see detailed statistics about the episode.

zigzag-000

16710

Click the images to see detailed statistics about the episode.

loop-000

16698

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16713

sim-0of4

success

yes

2022-11-28 17:43:39+00:00

2022-11-28 17:47:43+00:00

0:04:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	25.200000000000223
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	1.3557424143249113
deviation-center-line_median	2.2764052687353016

other stats

deviation-center-line_max	2.2764052687353016
deviation-center-line_mean	2.2764052687353016
deviation-center-line_min	2.2764052687353016
deviation-heading_max	2.9201829757406066
deviation-heading_mean	2.9201829757406066
deviation-heading_median	2.9201829757406066
deviation-heading_min	2.9201829757406066
distance-from-start_max	1.1340032910142968
distance-from-start_mean	1.1340032910142968
distance-from-start_median	1.1340032910142968
distance-from-start_min	1.1340032910142968
driven_any_max	1.4165963270662665
driven_any_mean	1.4165963270662665
driven_any_median	1.4165963270662665
driven_any_min	1.4165963270662665
driven_lanedir_consec_max	1.3557424143249113
driven_lanedir_consec_mean	1.3557424143249113
driven_lanedir_consec_min	1.3557424143249113
driven_lanedir_max	1.3557424143249113
driven_lanedir_mean	1.3557424143249113
driven_lanedir_median	1.3557424143249113
driven_lanedir_min	1.3557424143249113
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.4165963270662665, "survival_time": 25.200000000000223, "driven_lanedir": 1.3557424143249113, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9201829757406066, "distance-from-start": 1.1340032910142968, "deviation-center-line": 2.2764052687353016, "driven_lanedir_consec": 1.3557424143249113}}
simulation-passed	1
survival_time_max	25.200000000000223
survival_time_mean	25.200000000000223
survival_time_min	25.200000000000223

No reset possible

16711

sim-3of4

success

yes

2022-11-28 17:43:12+00:00

2022-11-28 17:50:18+00:00

0:07:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	48.599999999999376
in-drivable-lane_median	3.099999999999902
driven_lanedir_consec_median	2.1822085786120473
deviation-center-line_median	4.281969506383752

other stats

deviation-center-line_max	4.281969506383752
deviation-center-line_mean	4.281969506383752
deviation-center-line_min	4.281969506383752
deviation-heading_max	8.956926170181262
deviation-heading_mean	8.956926170181262
deviation-heading_median	8.956926170181262
deviation-heading_min	8.956926170181262
distance-from-start_max	1.84932503046977
distance-from-start_mean	1.84932503046977
distance-from-start_median	1.84932503046977
distance-from-start_min	1.84932503046977
driven_any_max	2.760582128240964
driven_any_mean	2.760582128240964
driven_any_median	2.760582128240964
driven_any_min	2.760582128240964
driven_lanedir_consec_max	2.1822085786120473
driven_lanedir_consec_mean	2.1822085786120473
driven_lanedir_consec_min	2.1822085786120473
driven_lanedir_max	2.5502818256429407
driven_lanedir_mean	2.5502818256429407
driven_lanedir_median	2.5502818256429407
driven_lanedir_min	2.5502818256429407
in-drivable-lane_max	3.099999999999902
in-drivable-lane_mean	3.099999999999902
in-drivable-lane_min	3.099999999999902
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.760582128240964, "survival_time": 48.599999999999376, "driven_lanedir": 2.5502818256429407, "in-drivable-lane": 3.099999999999902, "deviation-heading": 8.956926170181262, "distance-from-start": 1.84932503046977, "deviation-center-line": 4.281969506383752, "driven_lanedir_consec": 2.1822085786120473}}
simulation-passed	1
survival_time_max	48.599999999999376
survival_time_mean	48.599999999999376
survival_time_min	48.599999999999376

No reset possible

16710

sim-1of4

success

yes

2022-11-28 17:43:09+00:00

2022-11-28 17:45:49+00:00

0:02:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.09999999999998
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.41885674395418215
deviation-center-line_median	0.2592734099538108

other stats

deviation-center-line_max	0.2592734099538108
deviation-center-line_mean	0.2592734099538108
deviation-center-line_min	0.2592734099538108
deviation-heading_max	0.7151194489559713
deviation-heading_mean	0.7151194489559713
deviation-heading_median	0.7151194489559713
deviation-heading_min	0.7151194489559713
distance-from-start_max	0.4199960454985642
distance-from-start_mean	0.4199960454985642
distance-from-start_median	0.4199960454985642
distance-from-start_min	0.4199960454985642
driven_any_max	0.42359927688869903
driven_any_mean	0.42359927688869903
driven_any_median	0.42359927688869903
driven_any_min	0.42359927688869903
driven_lanedir_consec_max	0.41885674395418215
driven_lanedir_consec_mean	0.41885674395418215
driven_lanedir_consec_min	0.41885674395418215
driven_lanedir_max	0.41885674395418215
driven_lanedir_mean	0.41885674395418215
driven_lanedir_median	0.41885674395418215
driven_lanedir_min	0.41885674395418215
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.42359927688869903, "survival_time": 8.09999999999998, "driven_lanedir": 0.41885674395418215, "in-drivable-lane": 0.0, "deviation-heading": 0.7151194489559713, "distance-from-start": 0.4199960454985642, "deviation-center-line": 0.2592734099538108, "driven_lanedir_consec": 0.41885674395418215}}
simulation-passed	1
survival_time_max	8.09999999999998
survival_time_mean	8.09999999999998
survival_time_min	8.09999999999998

No reset possible

16698

sim-2of4

success

yes

2022-11-28 17:35:08+00:00

2022-11-28 17:40:56+00:00

0:05:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.4203998040440715
deviation-center-line_median	4.904463356399461

other stats

deviation-center-line_max	4.904463356399461
deviation-center-line_mean	4.904463356399461
deviation-center-line_min	4.904463356399461
deviation-heading_max	7.745124858723169
deviation-heading_mean	7.745124858723169
deviation-heading_median	7.745124858723169
deviation-heading_min	7.745124858723169
distance-from-start_max	1.2059816832534165
distance-from-start_mean	1.2059816832534165
distance-from-start_median	1.2059816832534165
distance-from-start_min	1.2059816832534165
driven_any_max	3.485084016236962
driven_any_mean	3.485084016236962
driven_any_median	3.485084016236962
driven_any_min	3.485084016236962
driven_lanedir_consec_max	1.4203998040440715
driven_lanedir_consec_mean	1.4203998040440715
driven_lanedir_consec_min	1.4203998040440715
driven_lanedir_max	3.2905050472289954
driven_lanedir_mean	3.2905050472289954
driven_lanedir_median	3.2905050472289954
driven_lanedir_min	3.2905050472289954
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.485084016236962, "survival_time": 59.99999999999873, "driven_lanedir": 3.2905050472289954, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.745124858723169, "distance-from-start": 1.2059816832534165, "deviation-center-line": 4.904463356399461, "driven_lanedir_consec": 1.4203998040440715}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible