Submission 1753

Submission

1753

Competing

yes

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:19:10+00:00

Last status update

2022-11-28 00:26:30+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16476 sim-1of4: 16472 sim-2of4: 16473 sim-3of4: 16475

User label

template-pytorch

Admin priority

Blessing

n/a

User priority

16476

Click the images to see detailed statistics about the episode.

autolab-000

16475

Click the images to see detailed statistics about the episode.

zigzag-000

16473

Click the images to see detailed statistics about the episode.

loop2-000

16472

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16476

sim-0of4

success

yes

2022-11-27 23:55:44+00:00

2022-11-28 00:26:23+00:00

0:30:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	43.42499999999911
driven_lanedir_consec_median	0.5329662773753729
deviation-center-line_median	1.289606294527613

other stats

deviation-center-line_max	2.458618445772097
deviation-center-line_mean	1.309315092387905
deviation-center-line_min	0.1994293347242971
deviation-heading_max	23.15109788534859
deviation-heading_mean	13.621365393368052
deviation-heading_median	14.42748594530118
deviation-heading_min	2.4793917975212554
distance-from-start_max	0.908308966854482
distance-from-start_mean	0.4467080024359332
distance-from-start_median	0.3404434638976214
distance-from-start_min	0.1976361150940075
driven_any_max	11.587725061790676
driven_any_mean	4.673083235637529
driven_any_median	3.166278776056378
driven_any_min	0.7720503286466892
driven_lanedir_consec_max	0.5820263299321946
driven_lanedir_consec_mean	0.4758380001621667
driven_lanedir_consec_min	0.25539311596572656
driven_lanedir_max	1.1473964487700212
driven_lanedir_mean	0.6405209969434489
driven_lanedir_median	0.5796472115190238
driven_lanedir_min	0.25539311596572656
in-drivable-lane_max	56.999999999998735
in-drivable-lane_mean	43.59999999999908
in-drivable-lane_min	30.54999999999936
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.7720503286466892, "survival_time": 59.99999999999873, "driven_lanedir": 0.25539311596572656, "in-drivable-lane": 56.999999999998735, "deviation-heading": 2.4793917975212554, "distance-from-start": 0.1976361150940075, "deviation-center-line": 0.1994293347242971, "driven_lanedir_consec": 0.25539311596572656}, "autolab-000-ego1": {"driven_any": 11.587725061790676, "survival_time": 59.99999999999873, "driven_lanedir": 0.6186309103397714, "in-drivable-lane": 51.649999999998855, "deviation-heading": 9.073121661940274, "distance-from-start": 0.908308966854482, "deviation-center-line": 0.8469322511130046, "driven_lanedir_consec": 0.5820263299321946}, "autolab-000-ego2": {"driven_any": 2.321392518792206, "survival_time": 59.99999999999873, "driven_lanedir": 0.5406635126982762, "in-drivable-lane": 30.54999999999936, "deviation-heading": 23.15109788534859, "distance-from-start": 0.38899122152804794, "deviation-center-line": 1.7322803379422216, "driven_lanedir_consec": 0.5406635126982762}, "autolab-000-ego3": {"driven_any": 4.01116503332055, "survival_time": 59.99999999999873, "driven_lanedir": 1.1473964487700212, "in-drivable-lane": 35.19999999999936, "deviation-heading": 19.781850228662083, "distance-from-start": 0.2918957062671949, "deviation-center-line": 2.458618445772097, "driven_lanedir_consec": 0.5252690420524697}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16475

sim-3of4

success

yes

2022-11-27 23:54:14+00:00

2022-11-28 00:17:04+00:00

0:22:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	53.84999999999869
driven_lanedir_consec_median	0.6030597951057937
deviation-center-line_median	0.5047970465577761

other stats

deviation-center-line_max	2.158498977245296
deviation-center-line_mean	0.8048552757130962
deviation-center-line_min	0.05132803249153678
deviation-heading_max	17.500999226441266
deviation-heading_mean	6.9841028943877035
deviation-heading_median	4.866716275743437
deviation-heading_min	0.7019797996226742
distance-from-start_max	1.1818868170589532
distance-from-start_mean	0.6065073733961259
distance-from-start_median	0.528504195356901
distance-from-start_min	0.18713428581174865
driven_any_max	5.667788956765779
driven_any_mean	2.9896604336414487
driven_any_median	3.039851957061191
driven_any_min	0.21114886367763405
driven_lanedir_consec_max	1.2769794928445606
driven_lanedir_consec_mean	0.6356813404008703
driven_lanedir_consec_min	0.05962627854733338
driven_lanedir_max	1.2779952483803283
driven_lanedir_mean	0.6996774336160099
driven_lanedir_median	0.7305441037681888
driven_lanedir_min	0.05962627854733338
in-drivable-lane_max	58.99999999999873
in-drivable-lane_mean	51.01249999999881
in-drivable-lane_min	37.3499999999991
per-episodes	details {"zigzag-000-ego0": {"driven_any": 0.21114886367763405, "survival_time": 59.99999999999873, "driven_lanedir": 0.05962627854733338, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.9025466656325424, "distance-from-start": 0.18713428581174865, "deviation-center-line": 0.05132803249153678, "driven_lanedir_consec": 0.05962627854733338}, "zigzag-000-ego1": {"driven_any": 5.667788956765779, "survival_time": 59.99999999999873, "driven_lanedir": 1.128798787392474, "in-drivable-lane": 49.59999999999864, "deviation-heading": 8.830885885854332, "distance-from-start": 1.1818868170589532, "deviation-center-line": 0.922515562410636, "driven_lanedir_consec": 0.8738301700676838}, "zigzag-000-ego2": {"driven_any": 0.6944588310144657, "survival_time": 59.99999999999873, "driven_lanedir": 0.33228942014390345, "in-drivable-lane": 58.09999999999873, "deviation-heading": 0.7019797996226742, "distance-from-start": 0.38561762542356653, "deviation-center-line": 0.08707853070491636, "driven_lanedir_consec": 0.33228942014390345}, "zigzag-000-ego3": {"driven_any": 5.3852450831079155, "survival_time": 59.99999999999873, "driven_lanedir": 1.2779952483803283, "in-drivable-lane": 37.3499999999991, "deviation-heading": 17.500999226441266, "distance-from-start": 0.6713907652902353, "deviation-center-line": 2.158498977245296, "driven_lanedir_consec": 1.2769794928445606}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16473

sim-2of4

success

yes

2022-11-27 23:53:44+00:00

2022-11-28 00:07:01+00:00

0:13:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	37.84999999999917
driven_lanedir_consec_median	1.3762361510311725
deviation-center-line_median	1.8205624711389827

other stats

deviation-center-line_max	1.973064862863822
deviation-center-line_mean	1.8205624711389827
deviation-center-line_min	1.6680600794141438
deviation-heading_max	20.702420070250856
deviation-heading_mean	18.621047753290753
deviation-heading_median	18.621047753290753
deviation-heading_min	16.53967543633065
distance-from-start_max	0.8448827929496168
distance-from-start_mean	0.6750369650826796
distance-from-start_median	0.6750369650826796
distance-from-start_min	0.5051911372157425
driven_any_max	9.245219449146989
driven_any_mean	8.182596266133014
driven_any_median	8.182596266133014
driven_any_min	7.119973083119043
driven_lanedir_consec_max	1.4993746970046178
driven_lanedir_consec_mean	1.3762361510311725
driven_lanedir_consec_min	1.2530976050577267
driven_lanedir_max	1.7053755754744249
driven_lanedir_mean	1.6865103475684171
driven_lanedir_median	1.6865103475684171
driven_lanedir_min	1.66764511966241
in-drivable-lane_max	41.04999999999902
in-drivable-lane_mean	37.84999999999917
in-drivable-lane_min	34.64999999999932
per-episodes	details {"loop2-000-ego0": {"driven_any": 7.119973083119043, "survival_time": 59.99999999999873, "driven_lanedir": 1.7053755754744249, "in-drivable-lane": 34.64999999999932, "deviation-heading": 20.702420070250856, "distance-from-start": 0.8448827929496168, "deviation-center-line": 1.6680600794141438, "driven_lanedir_consec": 1.2530976050577267}, "loop2-000-ego1": {"driven_any": 9.245219449146989, "survival_time": 59.99999999999873, "driven_lanedir": 1.66764511966241, "in-drivable-lane": 41.04999999999902, "deviation-heading": 16.53967543633065, "distance-from-start": 0.5051911372157425, "deviation-center-line": 1.973064862863822, "driven_lanedir_consec": 1.4993746970046178}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16472

sim-1of4

success

yes

2022-11-27 23:53:44+00:00

2022-11-28 00:20:17+00:00

0:26:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	54.2249999999987
driven_lanedir_consec_median	0.3053281893062856
deviation-center-line_median	0.5833203374448451

other stats

deviation-center-line_max	1.046541693404034
deviation-center-line_mean	0.6029077032362445
deviation-center-line_min	0.19844844465125416
deviation-heading_max	12.050504548220994
deviation-heading_mean	5.876284719758338
deviation-heading_median	5.084688243255883
deviation-heading_min	1.285257844300597
distance-from-start_max	1.2570244316015116
distance-from-start_mean	0.9264781001751844
distance-from-start_median	0.9151802800017148
distance-from-start_min	0.6185274090957956
driven_any_max	12.930780982328082
driven_any_mean	8.053519647393623
driven_any_median	7.995416417071243
driven_any_min	3.292464773103923
driven_lanedir_consec_max	1.0173813169393
driven_lanedir_consec_mean	0.4664860626318458
driven_lanedir_consec_min	0.2379065549755119
driven_lanedir_max	1.1185401924107965
driven_lanedir_mean	0.4917757814997199
driven_lanedir_median	0.3053281893062856
driven_lanedir_min	0.2379065549755119
in-drivable-lane_max	57.59999999999873
in-drivable-lane_mean	53.57499999999875
in-drivable-lane_min	48.249999999998906
per-episodes	details {"loop-000-ego0": {"driven_any": 12.930780982328082, "survival_time": 59.99999999999873, "driven_lanedir": 1.1185401924107965, "in-drivable-lane": 48.249999999998906, "deviation-heading": 12.050504548220994, "distance-from-start": 1.2570244316015116, "deviation-center-line": 1.046541693404034, "driven_lanedir_consec": 1.0173813169393}, "loop-000-ego1": {"driven_any": 3.292464773103923, "survival_time": 59.99999999999873, "driven_lanedir": 0.2379065549755119, "in-drivable-lane": 53.3499999999987, "deviation-heading": 4.855841736500814, "distance-from-start": 0.6605505669628424, "deviation-center-line": 0.7344782160864097, "driven_lanedir_consec": 0.2379065549755119}, "loop-000-ego2": {"driven_any": 5.447717796478859, "survival_time": 59.99999999999873, "driven_lanedir": 0.35754590689344695, "in-drivable-lane": 55.099999999998694, "deviation-heading": 5.313534750010952, "distance-from-start": 0.6185274090957956, "deviation-center-line": 0.4321624588032806, "driven_lanedir_consec": 0.35754590689344695}, "loop-000-ego3": {"driven_any": 10.543115037663627, "survival_time": 59.99999999999873, "driven_lanedir": 0.25311047171912415, "in-drivable-lane": 57.59999999999873, "deviation-heading": 1.285257844300597, "distance-from-start": 1.1698099930405872, "deviation-center-line": 0.19844844465125416, "driven_lanedir_consec": 0.25311047171912415}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible