Submission 1680

Submission

1680

Competing

yes

Challenge

aido-LFVI_multi-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:18:54+00:00

Last status update

2022-11-28 18:33:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16762 sim-1of4: 16765 sim-2of4: 16767 sim-3of4: 16764

User label

baseline-simple-yield

Admin priority

Blessing

n/a

User priority

16767

Click the images to see detailed statistics about the episode.

4way-000

16765

Click the images to see detailed statistics about the episode.

udem-000

16764

Click the images to see detailed statistics about the episode.

4way-001

16762

Click the images to see detailed statistics about the episode.

udem-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16767

sim-2of4

success

yes

2022-11-28 18:21:18+00:00

2022-11-28 18:33:30+00:00

0:12:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	5.496299828477744
deviation-center-line_median	0.17183898904941014

other stats

deviation-center-line_max	0.21132079357626976
deviation-center-line_mean	0.1743653873253979
deviation-center-line_min	0.1424627776265016
deviation-heading_max	1.5868854715733702
deviation-heading_mean	1.4512616339961206
deviation-heading_median	1.4728924991747463
deviation-heading_min	1.2723760660616197
distance-from-start_max	3.152836469048969
distance-from-start_mean	2.690530320315596
distance-from-start_median	2.641239810973879
distance-from-start_min	2.3268051902656572
driven_any_max	5.831435519999375
driven_any_mean	5.567123575605065
driven_any_median	5.707730195058858
driven_any_min	5.021598392303173
driven_lanedir_consec_max	5.704845460644086
driven_lanedir_consec_mean	5.327153206008904
driven_lanedir_consec_min	4.611167706436042
driven_lanedir_max	5.8223962690688085
driven_lanedir_mean	5.560890784650249
driven_lanedir_median	5.703499571898595
driven_lanedir_min	5.014167725734996
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 5.021598392303173, "survival_time": 59.99999999999873, "driven_lanedir": 5.014167725734996, "in-drivable-lane": 0.0, "deviation-heading": 1.5868854715733702, "distance-from-start": 2.339170523946391, "deviation-center-line": 0.1827495883978732, "driven_lanedir_consec": 4.611167706436042}, "4way-000-ego1": {"driven_any": 5.831435519999375, "survival_time": 59.99999999999873, "driven_lanedir": 5.8223962690688085, "in-drivable-lane": 0.0, "deviation-heading": 1.537638141336496, "distance-from-start": 3.152836469048969, "deviation-center-line": 0.21132079357626976, "driven_lanedir_consec": 5.584035348945523}, "4way-000-ego2": {"driven_any": 5.707095572773834, "survival_time": 59.99999999999873, "driven_lanedir": 5.702153535639253, "in-drivable-lane": 0.0, "deviation-heading": 1.408146857012997, "distance-from-start": 2.3268051902656572, "deviation-center-line": 0.16092838970094706, "driven_lanedir_consec": 5.408564308009964}, "4way-000-ego3": {"driven_any": 5.708364817343881, "survival_time": 59.99999999999873, "driven_lanedir": 5.704845608157938, "in-drivable-lane": 0.0, "deviation-heading": 1.2723760660616197, "distance-from-start": 2.943309098001367, "deviation-center-line": 0.1424627776265016, "driven_lanedir_consec": 5.704845460644086}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16765

sim-1of4

success

yes

2022-11-28 18:21:16+00:00

2022-11-28 18:32:34+00:00

0:11:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.35641596777958673
deviation-center-line_median	0.5955312146522322

other stats

deviation-center-line_max	2.128491974247639
deviation-center-line_mean	0.9139675952717752
deviation-center-line_min	0.33631597753499803
deviation-heading_max	30.712966764077652
deviation-heading_mean	12.7034688538512
deviation-heading_median	8.860215367203583
deviation-heading_min	2.3804779169199795
distance-from-start_max	2.866773837264375
distance-from-start_mean	0.8802267381267181
distance-from-start_median	0.3270665576212487
distance-from-start_min	2.2887833992611187e-16
driven_any_max	4.95910239753371
driven_any_mean	1.4197330129653098
driven_any_median	0.3599148271636274
driven_any_min	2.746540079113375e-13
driven_lanedir_consec_max	4.9492867887322785
driven_lanedir_consec_mean	1.415529681072863
driven_lanedir_consec_min	0.0
driven_lanedir_max	4.9492867887322785
driven_lanedir_mean	1.415529681072863
driven_lanedir_median	0.35641596777958673
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 0.7198296543267219, "survival_time": 59.99999999999873, "driven_lanedir": 0.7128319355591735, "in-drivable-lane": 0.0, "deviation-heading": 3.8060895796891416, "distance-from-start": 0.654133115242497, "deviation-center-line": 0.8533318010395783, "driven_lanedir_consec": 0.7128319355591735}, "udem-000-ego1": {"driven_any": 2.746540079113375e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 30.712966764077652, "distance-from-start": 2.2887833992611187e-16, "deviation-center-line": 2.128491974247639, "driven_lanedir_consec": 0.0}, "udem-000-ego2": {"driven_any": 4.95910239753371, "survival_time": 59.99999999999873, "driven_lanedir": 4.9492867887322785, "in-drivable-lane": 0.0, "deviation-heading": 2.3804779169199795, "distance-from-start": 2.866773837264375, "deviation-center-line": 0.33631597753499803, "driven_lanedir_consec": 4.9492867887322785}, "udem-000-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 13.914341154718024, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 0.33773062826488615, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16764

sim-3of4

success

yes

2022-11-28 18:21:15+00:00

2022-11-28 18:33:08+00:00

0:11:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.87044918682097
deviation-center-line_median	0.1629208044133267

other stats

deviation-center-line_max	3.4506790593202896
deviation-center-line_mean	0.975722942917009
deviation-center-line_min	0.12637110352109293
deviation-heading_max	26.9052448670844
deviation-heading_mean	7.787954995168265
deviation-heading_median	1.622296803656659
deviation-heading_min	1.001981506275341
distance-from-start_max	3.1388446632722284
distance-from-start_mean	1.8800227125863065
distance-from-start_median	2.190623093536498
distance-from-start_min	4.440892098500626e-16
driven_any_max	5.732211587504052
driven_any_mean	3.9710285465457744
driven_any_median	5.075951299339257
driven_any_min	5.329070518200751e-13
driven_lanedir_consec_max	5.726105869591416
driven_lanedir_consec_mean	3.866751060808339
driven_lanedir_consec_min	0.0
driven_lanedir_max	5.72610611271169
driven_lanedir_mean	3.9673328096636857
driven_lanedir_median	5.071612562971525
driven_lanedir_min	0.0
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 4.62060007041619, "survival_time": 59.99999999999873, "driven_lanedir": 4.618548386263603, "in-drivable-lane": 0.0, "deviation-heading": 1.001981506275341, "distance-from-start": 3.1388446632722284, "deviation-center-line": 0.12637110352109293, "driven_lanedir_consec": 4.61854797027584}, "4way-001-ego1": {"driven_any": 5.732211587504052, "survival_time": 59.99999999999873, "driven_lanedir": 5.72610611271169, "in-drivable-lane": 0.0, "deviation-heading": 1.7047057639689014, "distance-from-start": 2.052047610153934, "deviation-center-line": 0.17436950864269551, "driven_lanedir_consec": 5.726105869591416}, "4way-001-ego2": {"driven_any": 5.531302528262324, "survival_time": 59.99999999999873, "driven_lanedir": 5.524676739679447, "in-drivable-lane": 0.0, "deviation-heading": 1.5398878433444168, "distance-from-start": 2.329198576919062, "deviation-center-line": 0.1514721001839579, "driven_lanedir_consec": 5.122350403366101}, "4way-001-ego3": {"driven_any": 5.329070518200751e-13, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 26.9052448670844, "distance-from-start": 4.440892098500626e-16, "deviation-center-line": 3.4506790593202896, "driven_lanedir_consec": 0.0}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16762

sim-0of4

success

yes

2022-11-28 18:21:15+00:00

2022-11-28 18:33:13+00:00

0:11:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.304249926437537
deviation-center-line_median	0.1825026183725989

other stats

deviation-center-line_max	0.34104251013325637
deviation-center-line_mean	0.20912268674780385
deviation-center-line_min	0.13044300011276103
deviation-heading_max	2.994295582077131
deviation-heading_mean	2.5147400523068573
deviation-heading_median	2.5090088664494945
deviation-heading_min	2.0466468942513076
distance-from-start_max	3.0928237060834363
distance-from-start_mean	2.645965341319192
distance-from-start_median	2.580815039187992
distance-from-start_min	2.329407580817348
driven_any_max	5.8241864351349815
driven_any_mean	4.627603360938423
driven_any_median	4.714304114852396
driven_any_min	3.25761877891392
driven_lanedir_consec_max	5.808142217564284
driven_lanedir_consec_mean	4.417823696659784
driven_lanedir_consec_min	3.254652716199778
driven_lanedir_max	5.808142217564284
driven_lanedir_mean	4.6194454357816355
driven_lanedir_median	4.70749340468124
driven_lanedir_min	3.254652716199778
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 3.25761877891392, "survival_time": 59.99999999999873, "driven_lanedir": 3.254652716199778, "in-drivable-lane": 0.0, "deviation-heading": 2.4432266696129785, "distance-from-start": 2.7016200695021144, "deviation-center-line": 0.1633304587519851, "driven_lanedir_consec": 3.254652716199778}, "udem-001-ego1": {"driven_any": 4.275772003750879, "survival_time": 59.99999999999873, "driven_lanedir": 4.270214821719897, "in-drivable-lane": 0.0, "deviation-heading": 2.994295582077131, "distance-from-start": 3.0928237060834363, "deviation-center-line": 0.13044300011276103, "driven_lanedir_consec": 3.867286559394435}, "udem-001-ego2": {"driven_any": 5.152836225953913, "survival_time": 59.99999999999873, "driven_lanedir": 5.144771987642583, "in-drivable-lane": 0.0, "deviation-heading": 2.0466468942513076, "distance-from-start": 2.329407580817348, "deviation-center-line": 0.20167477799321273, "driven_lanedir_consec": 4.741213293480639}, "udem-001-ego3": {"driven_any": 5.8241864351349815, "survival_time": 59.99999999999873, "driven_lanedir": 5.808142217564284, "in-drivable-lane": 0.0, "deviation-heading": 2.5747910632860105, "distance-from-start": 2.460010008873869, "deviation-center-line": 0.34104251013325637, "driven_lanedir_consec": 5.808142217564284}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible