Submission 1710

Submission

1710

Competing

yes

Challenge

aido-LFVI_multi-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:19:02+00:00

Last status update

2022-11-28 02:27:01+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16608 sim-1of4: 16609 sim-2of4: 16611 sim-3of4: 16610

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

16611

Click the images to see detailed statistics about the episode.

4way-000

16610

Click the images to see detailed statistics about the episode.

4way-001

16609

Click the images to see detailed statistics about the episode.

udem-000

16608

Click the images to see detailed statistics about the episode.

udem-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16611

sim-2of4

success

yes

2022-11-28 02:16:55+00:00

2022-11-28 02:26:32+00:00

0:09:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.4156597876014327
deviation-center-line_median	5.989789523960853

other stats

deviation-center-line_max	8.495537949245412
deviation-center-line_mean	5.971732905101129
deviation-center-line_min	3.411814623237397
deviation-heading_max	5.897113234379067
deviation-heading_mean	4.048666897035051
deviation-heading_median	3.883494575102228
deviation-heading_min	2.53056520355668
distance-from-start_max	2.619089336031859
distance-from-start_mean	2.081728511655291
distance-from-start_median	2.273437348983144
distance-from-start_min	1.1609500126230166
driven_any_max	3.5795929797204047
driven_any_mean	3.0144689618920215
driven_any_median	3.5518420920250877
driven_any_min	1.3745986837975066
driven_lanedir_consec_max	3.4641594614086646
driven_lanedir_consec_mean	2.914869629053038
driven_lanedir_consec_min	1.3639994796006216
driven_lanedir_max	3.558362293690531
driven_lanedir_mean	2.9724232090689076
driven_lanedir_median	3.483665531492239
driven_lanedir_min	1.3639994796006216
in-drivable-lane_max	1.8499999999998948
in-drivable-lane_mean	0.4624999999999737
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.5795929797204047, "survival_time": 59.99999999999873, "driven_lanedir": 3.5411070899715265, "in-drivable-lane": 0.0, "deviation-heading": 5.897113234379067, "distance-from-start": 2.263048461522456, "deviation-center-line": 5.473740300006772, "driven_lanedir_consec": 3.4641594614086646}, "4way-000-ego1": {"driven_any": 3.524094913434593, "survival_time": 59.99999999999873, "driven_lanedir": 3.4262239730129513, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 3.513531876713755, "distance-from-start": 2.619089336031859, "deviation-center-line": 6.505838747914936, "driven_lanedir_consec": 3.4262237769992145}, "4way-000-ego2": {"driven_any": 3.579589270615582, "survival_time": 59.99999999999873, "driven_lanedir": 3.558362293690531, "in-drivable-lane": 0.0, "deviation-heading": 4.2534572734907, "distance-from-start": 2.2838262364438315, "deviation-center-line": 3.411814623237397, "driven_lanedir_consec": 3.4050957982036514}, "4way-000-ego3": {"driven_any": 1.3745986837975066, "survival_time": 59.99999999999873, "driven_lanedir": 1.3639994796006216, "in-drivable-lane": 0.0, "deviation-heading": 2.53056520355668, "distance-from-start": 1.1609500126230166, "deviation-center-line": 8.495537949245412, "driven_lanedir_consec": 1.3639994796006216}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16610

sim-3of4

success

yes

2022-11-28 02:16:54+00:00

2022-11-28 02:26:46+00:00

0:09:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.0889200570209905
deviation-center-line_median	4.314589046654948

other stats

deviation-center-line_max	4.8936832240285515
deviation-center-line_mean	4.21123266117369
deviation-center-line_min	3.322069327356314
deviation-heading_max	4.486523530569267
deviation-heading_mean	3.521671102618294
deviation-heading_median	3.585810169469168
deviation-heading_min	2.4285405409655727
distance-from-start_max	2.3451607383802098
distance-from-start_mean	2.0486952679802566
distance-from-start_median	2.129939218686506
distance-from-start_min	1.5897418961678045
driven_any_max	3.5795869614824305
driven_any_mean	3.25109025299247
driven_any_median	3.2660893638644968
driven_any_min	2.8925953227584573
driven_lanedir_consec_max	3.397941501351981
driven_lanedir_consec_mean	3.109352247171395
driven_lanedir_consec_min	2.8616273732916166
driven_lanedir_max	3.5621601978351585
driven_lanedir_mean	3.221959634688333
driven_lanedir_median	3.226336335661105
driven_lanedir_min	2.873005669595961
in-drivable-lane_max	1.0999999999999377
in-drivable-lane_mean	0.27499999999998437
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 2.9525969188333514, "survival_time": 59.99999999999873, "driven_lanedir": 2.895716604572407, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 2.4285405409655727, "distance-from-start": 2.3451607383802098, "deviation-center-line": 4.511140920492081, "driven_lanedir_consec": 2.895716415698084}, "4way-001-ego1": {"driven_any": 2.8925953227584573, "survival_time": 59.99999999999873, "driven_lanedir": 2.873005669595961, "in-drivable-lane": 0.0, "deviation-heading": 3.9504849161101903, "distance-from-start": 1.5897418961678045, "deviation-center-line": 4.8936832240285515, "driven_lanedir_consec": 2.8616273732916166}, "4way-001-ego2": {"driven_any": 3.5795869614824305, "survival_time": 59.99999999999873, "driven_lanedir": 3.556956066749803, "in-drivable-lane": 0.0, "deviation-heading": 4.486523530569267, "distance-from-start": 2.2859218093052247, "deviation-center-line": 4.1180371728178145, "driven_lanedir_consec": 3.397941501351981}, "4way-001-ego3": {"driven_any": 3.579581808895642, "survival_time": 59.99999999999873, "driven_lanedir": 3.5621601978351585, "in-drivable-lane": 0.0, "deviation-heading": 3.221135422828146, "distance-from-start": 1.9739566280677876, "deviation-center-line": 3.322069327356314, "driven_lanedir_consec": 3.282123698343897}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16609

sim-1of4

success

yes

2022-11-28 02:12:14+00:00

2022-11-28 02:22:00+00:00

0:09:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.522558677891614
deviation-center-line_median	5.123208250925155

other stats

deviation-center-line_max	7.953308842217784
deviation-center-line_mean	5.026103289778249
deviation-center-line_min	1.904687815044904
deviation-heading_max	7.817092400173712
deviation-heading_mean	5.15630723293663
deviation-heading_median	4.732874626105395
deviation-heading_min	3.3423872793620153
distance-from-start_max	2.224084223392078
distance-from-start_mean	1.372418883130667
distance-from-start_median	1.2029346346602598
distance-from-start_min	0.8597220398100703
driven_any_max	3.579587032303966
driven_any_mean	2.260716204012659
driven_any_median	1.9288422979916977
driven_any_min	1.605593187763276
driven_lanedir_consec_max	3.4576714425164017
driven_lanedir_consec_mean	1.8357601162686237
driven_lanedir_consec_min	0.8402516667748646
driven_lanedir_max	3.5592470379137566
driven_lanedir_mean	2.213681704953217
driven_lanedir_median	1.8578137794091545
driven_lanedir_min	1.5798522230808028
in-drivable-lane_max	2.050000000000029
in-drivable-lane_mean	0.5125000000000073
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.6055966761902978, "survival_time": 59.99999999999873, "driven_lanedir": 1.5798522230808028, "in-drivable-lane": 0.0, "deviation-heading": 3.3423872793620153, "distance-from-start": 1.2287147051666274, "deviation-center-line": 7.953308842217784, "driven_lanedir_consec": 1.5798522230808028}, "udem-000-ego1": {"driven_any": 3.579587032303966, "survival_time": 59.99999999999873, "driven_lanedir": 3.5592470379137566, "in-drivable-lane": 0.0, "deviation-heading": 3.7635172998949176, "distance-from-start": 2.224084223392078, "deviation-center-line": 3.3812202063089525, "driven_lanedir_consec": 3.4576714425164017}, "udem-000-ego2": {"driven_any": 2.252087919793097, "survival_time": 59.99999999999873, "driven_lanedir": 2.1195031205111157, "in-drivable-lane": 2.050000000000029, "deviation-heading": 5.702231952315873, "distance-from-start": 0.8597220398100703, "deviation-center-line": 6.865196295541358, "driven_lanedir_consec": 0.8402516667748646}, "udem-000-ego3": {"driven_any": 1.605593187763276, "survival_time": 59.99999999999873, "driven_lanedir": 1.5961244383071926, "in-drivable-lane": 0.0, "deviation-heading": 7.817092400173712, "distance-from-start": 1.1771545641538923, "deviation-center-line": 1.904687815044904, "driven_lanedir_consec": 1.465265132702425}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16608

sim-0of4

success

yes

2022-11-28 02:09:07+00:00

2022-11-28 02:18:35+00:00

0:09:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.200000000000017
driven_lanedir_consec_median	2.4146675176310586
deviation-center-line_median	3.947705796799454

other stats

deviation-center-line_max	6.091229568413222
deviation-center-line_mean	4.214852861011506
deviation-center-line_min	2.872770282033897
deviation-heading_max	6.386481527905395
deviation-heading_mean	5.35354556440471
deviation-heading_median	5.451360814369008
deviation-heading_min	4.1249791009754295
distance-from-start_max	2.281674511474288
distance-from-start_mean	1.714053337572477
distance-from-start_median	1.836882099225881
distance-from-start_min	0.900774640363858
driven_any_max	3.579588827869872
driven_any_mean	3.2555873758340863
driven_any_median	3.5015869259609413
driven_any_min	2.4395868235445906
driven_lanedir_consec_max	3.4224970151785294
driven_lanedir_consec_mean	2.2942753407245777
driven_lanedir_consec_min	0.9252693124576647
driven_lanedir_max	3.5575561401701146
driven_lanedir_mean	3.1699347353913017
driven_lanedir_median	3.415152633778211
driven_lanedir_min	2.2918775338386688
in-drivable-lane_max	2.5000000000000355
in-drivable-lane_mean	1.2250000000000174
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 2.4395868235445906, "survival_time": 59.99999999999873, "driven_lanedir": 2.2918775338386688, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 6.080254254951424, "distance-from-start": 0.900774640363858, "deviation-center-line": 6.091229568413222, "driven_lanedir_consec": 0.9252693124576647}, "udem-001-ego1": {"driven_any": 3.5795872366067147, "survival_time": 59.99999999999873, "driven_lanedir": 3.5575561401701146, "in-drivable-lane": 0.0, "deviation-heading": 4.1249791009754295, "distance-from-start": 2.227888326915521, "deviation-center-line": 2.872770282033897, "driven_lanedir_consec": 3.4083694793883828}, "udem-001-ego2": {"driven_any": 3.579588827869872, "survival_time": 59.99999999999873, "driven_lanedir": 3.554406946632496, "in-drivable-lane": 0.0, "deviation-heading": 4.822467373786592, "distance-from-start": 2.281674511474288, "deviation-center-line": 2.9756165082921022, "driven_lanedir_consec": 3.4224970151785294}, "udem-001-ego3": {"driven_any": 3.4235866153151684, "survival_time": 59.99999999999873, "driven_lanedir": 3.2758983209239267, "in-drivable-lane": 2.400000000000034, "deviation-heading": 6.386481527905395, "distance-from-start": 1.4458758715362408, "deviation-center-line": 4.919795085306806, "driven_lanedir_consec": 1.420965555873734}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible