Submission 719

Submission

719

Competing

user retired

Challenge

aido-LFVI_multi-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 21:18:18+00:00

Last status update

2022-11-16 15:59:54+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 8043 sim-1of4: 8045 sim-2of4: 8042 sim-3of4: 8044

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

8045

Click the images to see detailed statistics about the episode.

4way-000

8044

Click the images to see detailed statistics about the episode.

udem-000

8043

Click the images to see detailed statistics about the episode.

udem-001

8042

Click the images to see detailed statistics about the episode.

4way-001

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

8045

sim-1of4

success

2022-11-16 15:46:04+00:00

2022-11-16 15:59:49+00:00

0:13:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.0000000000000142
driven_lanedir_consec_median	2.7045958973197015
deviation-center-line_median	5.298353292431088

other stats

deviation-center-line_max	6.741542300686712
deviation-center-line_mean	5.280946894701026
deviation-center-line_min	3.7855386932552193
deviation-heading_max	13.312014280055324
deviation-heading_mean	6.591214969235705
deviation-heading_median	4.957876570489715
deviation-heading_min	3.137092455908064
distance-from-start_max	2.2873183361381155
distance-from-start_mean	1.7377713006693771
distance-from-start_median	1.905362800144457
distance-from-start_min	0.8530412662504799
driven_any_max	3.57958718010339
driven_any_mean	2.867838687646344
driven_any_median	2.9195898553414805
driven_any_min	2.0525878597990252
driven_lanedir_consec_max	3.3844906156720147
driven_lanedir_consec_mean	2.3919791818370477
driven_lanedir_consec_min	0.7742343170367727
driven_lanedir_max	3.5625572321117733
driven_lanedir_mean	2.7900154870496285
driven_lanedir_median	2.8384078504828008
driven_lanedir_min	1.920689015121139
in-drivable-lane_max	2.499999999999858
in-drivable-lane_mean	1.1249999999999716
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 2.2595978756974024, "survival_time": 59.99999999999873, "driven_lanedir": 2.1178590437296885, "in-drivable-lane": 2.499999999999858, "deviation-heading": 13.312014280055324, "distance-from-start": 1.7409270942727335, "deviation-center-line": 6.213697824046337, "driven_lanedir_consec": 2.073604539862879}, "4way-000-ego1": {"driven_any": 3.579581834985559, "survival_time": 59.99999999999873, "driven_lanedir": 3.5625572321117733, "in-drivable-lane": 0.0, "deviation-heading": 3.137092455908064, "distance-from-start": 2.06979850601618, "deviation-center-line": 3.7855386932552193, "driven_lanedir_consec": 3.3355872547765237}, "4way-000-ego2": {"driven_any": 3.57958718010339, "survival_time": 59.99999999999873, "driven_lanedir": 3.5589566572359135, "in-drivable-lane": 0.0, "deviation-heading": 4.261232646697791, "distance-from-start": 2.2873183361381155, "deviation-center-line": 4.383008760815839, "driven_lanedir_consec": 3.3844906156720147}, "4way-000-ego3": {"driven_any": 2.0525878597990252, "survival_time": 59.99999999999873, "driven_lanedir": 1.920689015121139, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.6545204942816385, "distance-from-start": 0.8530412662504799, "deviation-center-line": 6.741542300686712, "driven_lanedir_consec": 0.7742343170367727}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8044

sim-3of4

success

2022-11-16 15:43:09+00:00

2022-11-16 15:56:29+00:00

0:13:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.5500000000000078
driven_lanedir_consec_median	2.7186618821686923
deviation-center-line_median	4.599769298147975

other stats

deviation-center-line_max	7.514921710376692
deviation-center-line_mean	5.023920136084776
deviation-center-line_min	3.3812202376664593
deviation-heading_max	7.270406498280179
deviation-heading_mean	4.904293631585505
deviation-heading_median	4.713467910010004
deviation-heading_min	2.919832208041831
distance-from-start_max	2.224084223042804
distance-from-start_mean	1.8277566264905991
distance-from-start_median	1.825049095332756
distance-from-start_min	1.4368440922540808
driven_any_max	3.5795916194569286
driven_any_mean	3.00359070653802
driven_any_median	3.1970874397946445
driven_any_min	2.040596327105861
driven_lanedir_consec_max	3.5171199875420855
driven_lanedir_consec_mean	2.578416985684145
driven_lanedir_consec_min	1.3592241908571088
driven_lanedir_max	3.5592469839738214
driven_lanedir_mean	2.937504779196014
driven_lanedir_median	3.1055599953646267
driven_lanedir_min	1.9796521420809796
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	0.775000000000011
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 2.040596327105861, "survival_time": 59.99999999999873, "driven_lanedir": 1.9796521420809796, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919832208041831, "distance-from-start": 1.5472498854443102, "deviation-center-line": 7.514921710376692, "driven_lanedir_consec": 1.9796521420809796}, "udem-000-ego1": {"driven_any": 3.579587032303195, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592469839738214, "in-drivable-lane": 0.0, "deviation-heading": 3.7635173122449697, "distance-from-start": 2.224084223042804, "deviation-center-line": 3.3812202376664593, "driven_lanedir_consec": 3.457671622256405}, "udem-000-ego2": {"driven_any": 3.5795916194569286, "survival_time": 59.99999999999873, "driven_lanedir": 3.5287230592682937, "in-drivable-lane": 0.0, "deviation-heading": 7.270406498280179, "distance-from-start": 2.1028483052212015, "deviation-center-line": 3.716804560413257, "driven_lanedir_consec": 3.5171199875420855}, "udem-000-ego3": {"driven_any": 2.814587847286094, "survival_time": 59.99999999999873, "driven_lanedir": 2.68239693146096, "in-drivable-lane": 2.0000000000000284, "deviation-heading": 5.663418507775038, "distance-from-start": 1.4368440922540808, "deviation-center-line": 5.482734035882693, "driven_lanedir_consec": 1.3592241908571088}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8043

sim-0of4

success

2022-11-16 15:41:48+00:00

2022-11-16 15:55:39+00:00

0:13:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.5500000000000078
driven_lanedir_consec_median	3.1375524778834607
deviation-center-line_median	5.303403086224235

other stats

deviation-center-line_max	5.768512347371966
deviation-center-line_mean	5.317250833390732
deviation-center-line_min	4.8936848137424915
deviation-heading_max	7.241657133375519
deviation-heading_mean	4.871041154266794
deviation-heading_median	4.326444810614462
deviation-heading_min	3.589617862462733
distance-from-start_max	2.8752332419047746
distance-from-start_mean	2.17955975213295
distance-from-start_median	2.1288718958965607
distance-from-start_min	1.5852619748339034
driven_any_max	3.5465916471183334
driven_any_mean	3.217718907586951
driven_any_median	3.215844330234755
driven_any_min	2.892595322759963
driven_lanedir_consec_max	3.4469814271226227
driven_lanedir_consec_mean	3.1459203695222624
driven_lanedir_consec_min	2.861595095199505
driven_lanedir_max	3.4469814271226227
driven_lanedir_mean	3.15308968915101
driven_lanedir_median	3.146203724167278
driven_lanedir_min	2.8729698811468616
in-drivable-lane_max	2.349999999999945
in-drivable-lane_mean	0.86249999999999
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 2.922595524241184, "survival_time": 59.99999999999873, "driven_lanedir": 2.905499495168337, "in-drivable-lane": 0.0, "deviation-heading": 3.589617862462733, "distance-from-start": 1.5852619748339034, "deviation-center-line": 5.092329072977215, "driven_lanedir_consec": 2.8881970671965047}, "udem-001-ego1": {"driven_any": 2.892595322759963, "survival_time": 59.99999999999873, "driven_lanedir": 2.8729698811468616, "in-drivable-lane": 0.0, "deviation-heading": 3.950485200055712, "distance-from-start": 1.5897417388787718, "deviation-center-line": 4.8936848137424915, "driven_lanedir_consec": 2.861595095199505}, "udem-001-ego2": {"driven_any": 3.5090931362283255, "survival_time": 59.99999999999873, "driven_lanedir": 3.386907953166219, "in-drivable-lane": 2.349999999999945, "deviation-heading": 4.702404421173213, "distance-from-start": 2.6680020529143493, "deviation-center-line": 5.768512347371966, "driven_lanedir_consec": 3.3869078885704167}, "udem-001-ego3": {"driven_any": 3.5465916471183334, "survival_time": 59.99999999999873, "driven_lanedir": 3.4469814271226227, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 7.241657133375519, "distance-from-start": 2.8752332419047746, "deviation-center-line": 5.5144770994712555, "driven_lanedir_consec": 3.4469814271226227}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8042

sim-2of4

success

2022-11-16 15:41:45+00:00

2022-11-16 15:55:33+00:00

0:13:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.0999999999999377
driven_lanedir_consec_median	2.9739039028570327
deviation-center-line_median	3.987567693216043

other stats

deviation-center-line_max	6.355354617390863
deviation-center-line_mean	4.250566787221852
deviation-center-line_min	2.67177714506446
deviation-heading_max	6.378578140906584
deviation-heading_mean	3.851864326637447
deviation-heading_median	3.299904356446799
deviation-heading_min	2.429070452749606
distance-from-start_max	2.622846621511338
distance-from-start_mean	1.9359200828092535
distance-from-start_median	2.127382276630859
distance-from-start_min	0.8660691564639582
driven_any_max	3.5795837364261445
driven_any_mean	3.0268033484995422
driven_any_median	3.137096506981436
driven_any_min	2.2534366436091524
driven_lanedir_consec_max	3.483685068871533
driven_lanedir_consec_mean	2.566865763583437
driven_lanedir_consec_min	0.8359701797481495
driven_lanedir_max	3.560636596432562
driven_lanedir_mean	2.955289769471091
driven_lanedir_median	3.0771837142917815
driven_lanedir_min	2.1061550528682385
in-drivable-lane_max	2.400000000000034
in-drivable-lane_mean	1.1499999999999773
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 2.7275969188330973, "survival_time": 59.99999999999873, "driven_lanedir": 2.67068235971203, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.429070452749606, "distance-from-start": 2.261936693036538, "deviation-center-line": 4.511110206804874, "driven_lanedir_consec": 2.6706820218658365}, "4way-001-ego1": {"driven_any": 3.5795837364261445, "survival_time": 59.99999999999873, "driven_lanedir": 3.560636596432562, "in-drivable-lane": 0.0, "deviation-heading": 3.343516238791276, "distance-from-start": 1.992827860225181, "deviation-center-line": 2.67177714506446, "driven_lanedir_consec": 3.2771257838482284}, "4way-001-ego2": {"driven_any": 3.546596095129775, "survival_time": 59.99999999999873, "driven_lanedir": 3.483685068871533, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 3.256292474102322, "distance-from-start": 2.622846621511338, "deviation-center-line": 3.4640251796272117, "driven_lanedir_consec": 3.483685068871533}, "4way-001-ego3": {"driven_any": 2.2534366436091524, "survival_time": 59.99999999999873, "driven_lanedir": 2.1061550528682385, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.378578140906584, "distance-from-start": 0.8660691564639582, "deviation-center-line": 6.355354617390863, "driven_lanedir_consec": 0.8359701797481495}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

6406

sim-1of4

success

2021-11-02 19:44:00+00:00

2021-11-02 19:52:59+00:00

0:08:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6383

sim-0of4

success

2021-11-02 19:31:40+00:00

2021-11-02 19:40:07+00:00

0:08:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6382

sim-2of4

success

2021-11-02 19:31:37+00:00

2021-11-02 19:39:57+00:00

0:08:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6376

sim-1of4

success

2021-11-02 19:28:15+00:00

2021-11-02 19:46:26+00:00

0:18:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6374

sim-2of4

success

2021-11-02 19:27:25+00:00

2021-11-02 19:42:55+00:00

0:15:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6373

sim-0of4

success

2021-11-02 19:27:21+00:00

2021-11-02 19:42:49+00:00

0:15:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6371

sim-3of4

success

2021-11-02 19:26:51+00:00

2021-11-02 19:35:09+00:00

0:08:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5503

sim-2of4

success

2021-10-31 22:07:45+00:00

2021-10-31 22:16:15+00:00

0:08:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5502

sim-0of4

success

2021-10-31 22:06:47+00:00

2021-10-31 22:21:44+00:00

0:14:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5501

sim-3of4

success

2021-10-31 22:05:40+00:00

2021-10-31 22:14:16+00:00

0:08:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5500

sim-1of4

success

2021-10-31 22:05:37+00:00

2021-10-31 22:21:06+00:00

0:15:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible