Submission 476

Submission

476

Competing

user retired

Challenge

aido-LFV_multi-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-23 16:32:40+00:00

Last status update

2021-10-31 20:21:35+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 5264 sim-1of4: 5263 sim-2of4: 5265 sim-3of4: 5266

User label

baseline-simple-yield

Admin priority

Blessing

n/a

User priority

5266

Click the images to see detailed statistics about the episode.

loop-000

5265

Click the images to see detailed statistics about the episode.

autolab-000

5264

Click the images to see detailed statistics about the episode.

loop2-000

5263

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

5266

277

success

yes

2021-10-31 20:08:16+00:00

2021-10-31 20:21:32+00:00

0:13:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.2997115977139024
deviation-center-line_median	0.7102992560340381

other stats

deviation-center-line_max	2.946747690455274
deviation-center-line_mean	1.168748031457989
deviation-center-line_min	0.30764592330860624
deviation-heading_max	14.481564596168331
deviation-heading_mean	8.039177481167094
deviation-heading_median	7.686717046394336
deviation-heading_min	2.3017112357113687
distance-from-start_max	3.239587633242515
distance-from-start_mean	1.3346417592161202
distance-from-start_median	1.0494897018109823
distance-from-start_min	4.47545209131181e-16
driven_any_max	5.589553224793548
driven_any_mean	2.0497427799675396
driven_any_median	1.3047089475380371
driven_any_min	5.370542509574138e-13
driven_lanedir_consec_max	5.578035038291493
driven_lanedir_consec_mean	2.0443645584298245
driven_lanedir_consec_min	0.0
driven_lanedir_max	5.578035038291493
driven_lanedir_mean	2.0443645584298245
driven_lanedir_median	1.2997115977139024
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 1.949436335934168, "survival_time": 59.99999999999873, "driven_lanedir": 1.9417601078206976, "in-drivable-lane": 0.0, "deviation-heading": 6.68429585586628, "distance-from-start": 1.4698170780742057, "deviation-center-line": 0.39698652397553214, "driven_lanedir_consec": 1.9417601078206976}, "loop-000-ego1": {"driven_any": 5.589553224793548, "survival_time": 59.99999999999873, "driven_lanedir": 5.578035038291493, "in-drivable-lane": 0.0, "deviation-heading": 2.3017112357113687, "distance-from-start": 3.239587633242515, "deviation-center-line": 0.30764592330860624, "driven_lanedir_consec": 5.578035038291493}, "loop-000-ego2": {"driven_any": 5.370542509574138e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 14.481564596168331, "distance-from-start": 4.47545209131181e-16, "deviation-center-line": 2.946747690455274, "driven_lanedir_consec": 0.0}, "loop-000-ego3": {"driven_any": 0.6599815591419063, "survival_time": 59.99999999999873, "driven_lanedir": 0.6576630876071072, "in-drivable-lane": 0.0, "deviation-heading": 8.689138236922393, "distance-from-start": 0.6291623255477591, "deviation-center-line": 1.023611988092544, "driven_lanedir_consec": 0.6576630876071072}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

5265

276

success

yes

2021-10-31 20:06:53+00:00

2021-10-31 20:21:31+00:00

0:14:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.078943578476682
deviation-center-line_median	0.34937555248795704

other stats

deviation-center-line_max	0.4453013966502106
deviation-center-line_mean	0.34459405260834863
deviation-center-line_min	0.2343237088072699
deviation-heading_max	3.294617642961078
deviation-heading_mean	2.6966382735265686
deviation-heading_median	2.770831695408246
deviation-heading_min	1.950272060328704
distance-from-start_max	3.578212152351508
distance-from-start_mean	2.8609238538897164
distance-from-start_median	2.9419610298050016
distance-from-start_min	1.9815612035973544
driven_any_max	5.258572885402073
driven_any_mean	4.934656260120086
driven_any_median	5.091445394889831
driven_any_min	4.2971613652986065
driven_lanedir_consec_max	5.243055634820162
driven_lanedir_consec_mean	4.9216866387479685
driven_lanedir_consec_min	4.285803763218347
driven_lanedir_max	5.243055634820162
driven_lanedir_mean	4.9216866387479685
driven_lanedir_median	5.078943578476682
driven_lanedir_min	4.285803763218347
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 4.2971613652986065, "survival_time": 59.99999999999873, "driven_lanedir": 4.285803763218347, "in-drivable-lane": 0.0, "deviation-heading": 2.265904794738107, "distance-from-start": 1.9815612035973544, "deviation-center-line": 0.263965617987532, "driven_lanedir_consec": 4.285803763218347}, "autolab-000-ego1": {"driven_any": 5.060296099556881, "survival_time": 59.99999999999873, "driven_lanedir": 5.048082839567761, "in-drivable-lane": 0.0, "deviation-heading": 1.950272060328704, "distance-from-start": 2.5358273509842837, "deviation-center-line": 0.2343237088072699, "driven_lanedir_consec": 5.048082839567761}, "autolab-000-ego2": {"driven_any": 5.258572885402073, "survival_time": 59.99999999999873, "driven_lanedir": 5.243055634820162, "in-drivable-lane": 0.0, "deviation-heading": 3.294617642961078, "distance-from-start": 3.578212152351508, "deviation-center-line": 0.4453013966502106, "driven_lanedir_consec": 5.243055634820162}, "autolab-000-ego3": {"driven_any": 5.122594690222782, "survival_time": 59.99999999999873, "driven_lanedir": 5.109804317385604, "in-drivable-lane": 0.0, "deviation-heading": 3.275758596078385, "distance-from-start": 3.3480947086257196, "deviation-center-line": 0.43478548698838215, "driven_lanedir_consec": 5.109804317385604}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

5264

274

success

yes

2021-10-31 20:05:29+00:00

2021-10-31 20:09:28+00:00

0:03:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.381330906743559
deviation-center-line_median	0.3759399942892944

other stats

deviation-center-line_max	0.4050492367024026
deviation-center-line_mean	0.3759399942892944
deviation-center-line_min	0.346830751876186
deviation-heading_max	3.1141410438173027
deviation-heading_mean	3.1134951286938968
deviation-heading_median	3.1134951286938968
deviation-heading_min	3.1128492135704913
distance-from-start_max	1.5440903882735502
distance-from-start_mean	1.3058755968972466
distance-from-start_median	1.3058755968972466
distance-from-start_min	1.0676608055209431
driven_any_max	5.64000698925217
driven_any_mean	5.394808261278103
driven_any_median	5.394808261278103
driven_any_min	5.149609533304037
driven_lanedir_consec_max	5.624383264436496
driven_lanedir_consec_mean	5.381330906743559
driven_lanedir_consec_min	5.138278549050622
driven_lanedir_max	5.624383264436496
driven_lanedir_mean	5.381330906743559
driven_lanedir_median	5.381330906743559
driven_lanedir_min	5.138278549050622
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop2-000-ego0": {"driven_any": 5.64000698925217, "survival_time": 59.99999999999873, "driven_lanedir": 5.624383264436496, "in-drivable-lane": 0.0, "deviation-heading": 3.1128492135704913, "distance-from-start": 1.0676608055209431, "deviation-center-line": 0.4050492367024026, "driven_lanedir_consec": 5.624383264436496}, "loop2-000-ego1": {"driven_any": 5.149609533304037, "survival_time": 59.99999999999873, "driven_lanedir": 5.138278549050622, "in-drivable-lane": 0.0, "deviation-heading": 3.1141410438173027, "distance-from-start": 1.5440903882735502, "deviation-center-line": 0.346830751876186, "driven_lanedir_consec": 5.138278549050622}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

5263

275

success

yes

2021-10-31 20:05:00+00:00

2021-10-31 20:13:57+00:00

0:08:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.742328706004615
deviation-center-line_median	0.33945456663980716

other stats

deviation-center-line_max	0.3908949944505377
deviation-center-line_mean	0.32135416680458384
deviation-center-line_min	0.2156125394881833
deviation-heading_max	3.7646465736418224
deviation-heading_mean	2.8850148728120875
deviation-heading_median	2.9961830476481808
deviation-heading_min	1.783046822310164
distance-from-start_max	3.522061458900184
distance-from-start_mean	2.7436402553448476
distance-from-start_median	2.7369885705970955
distance-from-start_min	1.978522421285015
driven_any_max	5.190284455707655
driven_any_mean	4.751674865015388
driven_any_median	4.75306747748424
driven_any_min	4.310280049385415
driven_lanedir_consec_max	5.178025139788938
driven_lanedir_consec_mean	4.740809849192896
driven_lanedir_consec_min	4.300556844973417
driven_lanedir_max	5.178025139788938
driven_lanedir_mean	4.740809849192896
driven_lanedir_median	4.742328706004615
driven_lanedir_min	4.300556844973417
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"autolab-000-ego0": {"driven_any": 4.310280049385415, "survival_time": 59.99999999999873, "driven_lanedir": 4.300556844973417, "in-drivable-lane": 0.0, "deviation-heading": 3.7646465736418224, "distance-from-start": 1.978522421285015, "deviation-center-line": 0.3085743240153483, "driven_lanedir_consec": 4.300556844973417}, "autolab-000-ego1": {"driven_any": 4.439412618608211, "survival_time": 59.99999999999873, "driven_lanedir": 4.428719111024556, "in-drivable-lane": 0.0, "deviation-heading": 1.783046822310164, "distance-from-start": 2.152738956720156, "deviation-center-line": 0.2156125394881833, "driven_lanedir_consec": 4.428719111024556}, "autolab-000-ego2": {"driven_any": 5.190284455707655, "survival_time": 59.99999999999873, "driven_lanedir": 5.178025139788938, "in-drivable-lane": 0.0, "deviation-heading": 3.020096037621849, "distance-from-start": 3.522061458900184, "deviation-center-line": 0.3908949944505377, "driven_lanedir_consec": 5.178025139788938}, "autolab-000-ego3": {"driven_any": 5.066722336360269, "survival_time": 59.99999999999873, "driven_lanedir": 5.055938300984675, "in-drivable-lane": 0.0, "deviation-heading": 2.972270057674513, "distance-from-start": 3.3212381844740353, "deviation-center-line": 0.3703348092642661, "driven_lanedir_consec": 5.055938300984675}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

4311

267

success

yes

2021-10-23 17:33:54+00:00

2021-10-23 17:42:13+00:00

0:08:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4310

268

success

yes

2021-10-23 17:33:50+00:00

2021-10-23 17:43:33+00:00

0:09:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4309

266

success

yes

2021-10-23 17:33:24+00:00

2021-10-23 17:41:09+00:00

0:07:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4308

265

success

yes

2021-10-23 17:33:04+00:00

2021-10-23 17:37:06+00:00

0:04:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible