Submission 1272

Submission

1272

Competing

user retired

Challenge

aido-LFV_multi-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-23 18:36:22+00:00

Last status update

2022-11-24 23:37:21+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 15153 sim-1of4: 15152 sim-2of4: 15151 sim-3of4: 15154

User label

template-random

Admin priority

Blessing

n/a

User priority

15154

Click the images to see detailed statistics about the episode.

zigzag-000

15153

Click the images to see detailed statistics about the episode.

autolab-000

15152

Click the images to see detailed statistics about the episode.

loop-000

15151

Click the images to see detailed statistics about the episode.

loop2-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

15154

sim-3of4

success

2022-11-24 23:17:43+00:00

2022-11-24 23:30:44+00:00

0:13:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	32.250000000000306
in-drivable-lane_median	28.075000000000298
driven_lanedir_consec_median	0.1610207737330219
deviation-center-line_median	0.29879847452961933

other stats

deviation-center-line_max	0.7438965564413397
deviation-center-line_mean	0.3444866849816528
deviation-center-line_min	0.03645323442603294
deviation-heading_max	5.151628362375439
deviation-heading_mean	3.250612996537796
deviation-heading_median	3.3709673175115276
deviation-heading_min	1.1088889887526905
distance-from-start_max	0.9340577697896384
distance-from-start_mean	0.6918300925811118
distance-from-start_median	0.6561491304294165
distance-from-start_min	0.5209643396759762
driven_any_max	7.865751162007197
driven_any_mean	4.149754186300885
driven_any_median	4.093549808670279
driven_any_min	0.5461659658557834
driven_lanedir_consec_max	0.34342719852355597
driven_lanedir_consec_mean	0.1843559383324774
driven_lanedir_consec_min	0.07195500734030984
driven_lanedir_max	0.34342719852355597
driven_lanedir_mean	0.17519082439080594
driven_lanedir_median	0.142690545849679
driven_lanedir_min	0.07195500734030984
in-drivable-lane_max	30.600000000000307
in-drivable-lane_mean	27.887500000000298
in-drivable-lane_min	24.80000000000028
per-episodes	details {"zigzag-000-ego0": {"driven_any": 2.557376740490916, "survival_time": 32.250000000000306, "driven_lanedir": 0.34342719852355597, "in-drivable-lane": 27.45000000000031, "deviation-heading": 4.085690366921237, "distance-from-start": 0.576509903181454, "deviation-center-line": 0.3481403947764579, "driven_lanedir_consec": 0.34342719852355597}, "zigzag-000-ego1": {"driven_any": 5.629722876849642, "survival_time": 32.250000000000306, "driven_lanedir": 0.19038935166124735, "in-drivable-lane": 24.80000000000028, "deviation-heading": 5.151628362375439, "distance-from-start": 0.7357883576773788, "deviation-center-line": 0.7438965564413397, "driven_lanedir_consec": 0.21133294232177}, "zigzag-000-ego2": {"driven_any": 7.865751162007197, "survival_time": 32.250000000000306, "driven_lanedir": 0.09499174003811064, "in-drivable-lane": 28.70000000000028, "deviation-heading": 2.6562442681018186, "distance-from-start": 0.9340577697896384, "deviation-center-line": 0.24945655428278077, "driven_lanedir_consec": 0.11070860514427378}, "zigzag-000-ego3": {"driven_any": 0.5461659658557834, "survival_time": 32.250000000000306, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 30.600000000000307, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed	1
survival_time_max	32.250000000000306
survival_time_mean	32.250000000000306
survival_time_min	32.250000000000306

No reset possible

15153

sim-0of4

success

2022-11-24 23:16:49+00:00

2022-11-24 23:37:02+00:00

0:20:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	54.674999999998704
driven_lanedir_consec_median	0.12251247869641724
deviation-center-line_median	0.4433920965103467

other stats

deviation-center-line_max	1.2038527288241243
deviation-center-line_mean	0.5423174087533363
deviation-center-line_min	0.07863271316852748
deviation-heading_max	14.288552729590728
deviation-heading_mean	5.627247694260051
deviation-heading_median	3.416903566880354
deviation-heading_min	1.38663091368877
distance-from-start_max	1.4108418329398955
distance-from-start_mean	0.8799981600642298
distance-from-start_median	0.7992095848737366
distance-from-start_min	0.5107316375695505
driven_any_max	15.326310847370582
driven_any_mean	7.171771192512803
driven_any_median	6.412570219301883
driven_any_min	0.5356334840768605
driven_lanedir_consec_max	0.4413235258740946
driven_lanedir_consec_mean	0.1898162935783138
driven_lanedir_consec_min	0.07291669104632614
driven_lanedir_max	0.4413235258740946
driven_lanedir_mean	0.1804353170531879
driven_lanedir_median	0.1104128284063164
driven_lanedir_min	0.05959208552602435
in-drivable-lane_max	57.749999999998735
in-drivable-lane_mean	52.93749999999879
in-drivable-lane_min	44.649999999999025
per-episodes	details {"autolab-000-ego0": {"driven_any": 0.5356334840768605, "survival_time": 59.99999999999873, "driven_lanedir": 0.4413235258740946, "in-drivable-lane": 57.749999999998735, "deviation-heading": 1.38663091368877, "distance-from-start": 0.5107316375695505, "deviation-center-line": 0.07863271316852748, "driven_lanedir_consec": 0.4413235258740946}, "autolab-000-ego1": {"driven_any": 15.326310847370582, "survival_time": 59.99999999999873, "driven_lanedir": 0.05959208552602435, "in-drivable-lane": 44.649999999999025, "deviation-heading": 14.288552729590728, "distance-from-start": 1.4108418329398955, "deviation-center-line": 1.2038527288241243, "driven_lanedir_consec": 0.07291669104632614}, "autolab-000-ego2": {"driven_any": 7.342290201921084, "survival_time": 59.99999999999873, "driven_lanedir": 0.1334588763696649, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.0294981006515846, "distance-from-start": 0.8626308120701035, "deviation-center-line": 0.4429996774431571, "driven_lanedir_consec": 0.14670729988336562}, "autolab-000-ego3": {"driven_any": 5.482850236682682, "survival_time": 59.99999999999873, "driven_lanedir": 0.08736678044296786, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109123, "distance-from-start": 0.7357883576773698, "deviation-center-line": 0.44378451557753634, "driven_lanedir_consec": 0.09831765750946886}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

15152

sim-1of4

success

2022-11-24 23:14:14+00:00

2022-11-24 23:33:01+00:00

0:18:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.64999999999875
in-drivable-lane_median	52.39999999999873
driven_lanedir_consec_median	0.20841941457351276
deviation-center-line_median	0.6235918393283303

other stats

deviation-center-line_max	3.9618906351925345
deviation-center-line_mean	1.3480922472158894
deviation-center-line_min	0.18329467501436195
deviation-heading_max	29.06091202107619
deviation-heading_mean	10.086526110865954
deviation-heading_median	4.852439390352202
deviation-heading_min	1.5803136416832215
distance-from-start_max	1.390232809724702
distance-from-start_mean	0.8610879612709739
distance-from-start_median	0.7658648678412762
distance-from-start_min	0.5223892996766412
driven_any_max	14.859731274916312
driven_any_mean	6.788261723046844
driven_any_median	5.402007576921902
driven_any_min	1.4893004634272606
driven_lanedir_consec_max	0.4727232702196713
driven_lanedir_consec_mean	0.24835079061387844
driven_lanedir_consec_min	0.10384106308881692
driven_lanedir_max	0.4727232702196713
driven_lanedir_mean	0.2405349726449092
driven_lanedir_median	0.19278777863557428
driven_lanedir_min	0.10384106308881692
in-drivable-lane_max	57.149999999998755
in-drivable-lane_mean	41.13749999999905
in-drivable-lane_min	2.599999999999994
per-episodes	details {"loop-000-ego0": {"driven_any": 14.859731274916312, "survival_time": 59.64999999999875, "driven_lanedir": 0.2521152682910448, "in-drivable-lane": 50.49999999999872, "deviation-heading": 6.675380463416964, "distance-from-start": 1.390232809724702, "deviation-center-line": 0.8041846674982114, "driven_lanedir_consec": 0.2701303550718044}, "loop-000-ego1": {"driven_any": 1.4893004634272606, "survival_time": 59.64999999999875, "driven_lanedir": 0.4727232702196713, "in-drivable-lane": 2.599999999999994, "deviation-heading": 29.06091202107619, "distance-from-start": 0.5223892996766412, "deviation-center-line": 3.9618906351925345, "driven_lanedir_consec": 0.4727232702196713}, "loop-000-ego2": {"driven_any": 9.314714690416322, "survival_time": 59.64999999999875, "driven_lanedir": 0.13346028898010376, "in-drivable-lane": 54.29999999999873, "deviation-heading": 3.0294983172874397, "distance-from-start": 1.0093404360059108, "deviation-center-line": 0.4429990111584493, "driven_lanedir_consec": 0.14670847407522114}, "loop-000-ego3": {"driven_any": 1.4893004634274822, "survival_time": 59.64999999999875, "driven_lanedir": 0.10384106308881692, "in-drivable-lane": 57.149999999998755, "deviation-heading": 1.5803136416832215, "distance-from-start": 0.5223892996766415, "deviation-center-line": 0.18329467501436195, "driven_lanedir_consec": 0.10384106308881692}}
simulation-passed	1
survival_time_max	59.64999999999875
survival_time_mean	59.64999999999875
survival_time_min	59.64999999999875

No reset possible

15151

sim-2of4

success

2022-11-24 23:13:18+00:00

2022-11-24 23:21:26+00:00

0:08:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	45.099999999999575
in-drivable-lane_median	37.09999999999956
driven_lanedir_consec_median	0.23705557260553295
deviation-center-line_median	0.6463758558852182

other stats

deviation-center-line_max	0.7555292890833561
deviation-center-line_mean	0.6463758558852182
deviation-center-line_min	0.5372224226870801
deviation-heading_max	5.523299123594233
deviation-heading_mean	5.0377292657796975
deviation-heading_median	5.0377292657796975
deviation-heading_min	4.552159407965162
distance-from-start_max	1.0442247976691843
distance-from-start_mean	0.9534278048696496
distance-from-start_median	0.9534278048696496
distance-from-start_min	0.8626308120701148
driven_any_max	11.376062002465083
driven_any_mean	9.15341861992026
driven_any_median	9.15341861992026
driven_any_min	6.9307752373754345
driven_lanedir_consec_max	0.26764947507969805
driven_lanedir_consec_mean	0.23705557260553295
driven_lanedir_consec_min	0.20646167013136785
driven_lanedir_max	0.2496387990426845
driven_lanedir_mean	0.2213862628967403
driven_lanedir_median	0.2213862628967403
driven_lanedir_min	0.1931337267507961
in-drivable-lane_max	37.649999999999565
in-drivable-lane_mean	37.09999999999956
in-drivable-lane_min	36.54999999999956
per-episodes	details {"loop2-000-ego0": {"driven_any": 11.376062002465083, "survival_time": 45.099999999999575, "driven_lanedir": 0.2496387990426845, "in-drivable-lane": 36.54999999999956, "deviation-heading": 5.523299123594233, "distance-from-start": 1.0442247976691843, "deviation-center-line": 0.7555292890833561, "driven_lanedir_consec": 0.26764947507969805}, "loop2-000-ego1": {"driven_any": 6.9307752373754345, "survival_time": 45.099999999999575, "driven_lanedir": 0.1931337267507961, "in-drivable-lane": 37.649999999999565, "deviation-heading": 4.552159407965162, "distance-from-start": 0.8626308120701148, "deviation-center-line": 0.5372224226870801, "driven_lanedir_consec": 0.20646167013136785}}
simulation-passed	1
survival_time_max	45.099999999999575
survival_time_mean	45.099999999999575
survival_time_min	45.099999999999575

No reset possible

14199

sim-0of4

success

2022-11-23 18:49:44+00:00

2022-11-23 19:09:58+00:00

0:20:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14198

sim-1of4

success

2022-11-23 18:46:42+00:00

2022-11-23 19:05:11+00:00

0:18:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14197

sim-3of4

success

2022-11-23 18:44:50+00:00

2022-11-23 18:57:27+00:00

0:12:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14196

sim-2of4

success

2022-11-23 18:44:48+00:00

2022-11-23 18:53:27+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible