Submission 1681

Submission

1681

Competing

yes

Challenge

aido-LFVI-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:18:54+00:00

Last status update

2022-11-28 18:31:20+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16758 sim-1of4: 16759 sim-2of4: 16760 sim-3of4: 16761

User label

baseline-simple-yield

Admin priority

Blessing

n/a

User priority

16761

Click the images to see detailed statistics about the episode.

4way-001

16760

Click the images to see detailed statistics about the episode.

4way-000

16759

Click the images to see detailed statistics about the episode.

udem-000

16758

Click the images to see detailed statistics about the episode.

udem-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16761

sim-3of4

success

yes

2022-11-28 18:18:44+00:00

2022-11-28 18:30:42+00:00

0:11:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	57.84999999999885
in-drivable-lane_median	0.0
driven_lanedir_consec_median	4.884807237005287
deviation-center-line_median	0.15072920516156368

other stats

deviation-center-line_max	0.15072920516156368
deviation-center-line_mean	0.15072920516156368
deviation-center-line_min	0.15072920516156368
deviation-heading_max	1.1475940808640654
deviation-heading_mean	1.1475940808640654
deviation-heading_median	1.1475940808640654
deviation-heading_min	1.1475940808640654
distance-from-start_max	2.6948612403356473
distance-from-start_mean	2.6948612403356473
distance-from-start_median	2.6948612403356473
distance-from-start_min	2.6948612403356473
driven_any_max	5.697171922964183
driven_any_mean	5.697171922964183
driven_any_median	5.697171922964183
driven_any_min	5.697171922964183
driven_lanedir_consec_max	4.884807237005287
driven_lanedir_consec_mean	4.884807237005287
driven_lanedir_consec_min	4.884807237005287
driven_lanedir_max	5.693381869716076
driven_lanedir_mean	5.693381869716076
driven_lanedir_median	5.693381869716076
driven_lanedir_min	5.693381869716076
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-001-ego0": {"driven_any": 5.697171922964183, "survival_time": 57.84999999999885, "driven_lanedir": 5.693381869716076, "in-drivable-lane": 0.0, "deviation-heading": 1.1475940808640654, "distance-from-start": 2.6948612403356473, "deviation-center-line": 0.15072920516156368, "driven_lanedir_consec": 4.884807237005287}}
simulation-passed	1
survival_time_max	57.84999999999885
survival_time_mean	57.84999999999885
survival_time_min	57.84999999999885

No reset possible

16760

sim-2of4

success

yes

2022-11-28 18:18:42+00:00

2022-11-28 18:31:11+00:00

0:12:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	6.0817422473064955
deviation-center-line_median	0.25576965235048754

other stats

deviation-center-line_max	0.25576965235048754
deviation-center-line_mean	0.25576965235048754
deviation-center-line_min	0.25576965235048754
deviation-heading_max	1.94582432309865
deviation-heading_mean	1.94582432309865
deviation-heading_median	1.94582432309865
deviation-heading_min	1.94582432309865
distance-from-start_max	2.49941447398169
distance-from-start_mean	2.49941447398169
distance-from-start_median	2.49941447398169
distance-from-start_min	2.49941447398169
driven_any_max	6.0939946438635975
driven_any_mean	6.0939946438635975
driven_any_median	6.0939946438635975
driven_any_min	6.0939946438635975
driven_lanedir_consec_max	6.0817422473064955
driven_lanedir_consec_mean	6.0817422473064955
driven_lanedir_consec_min	6.0817422473064955
driven_lanedir_max	6.081742517685205
driven_lanedir_mean	6.081742517685205
driven_lanedir_median	6.081742517685205
driven_lanedir_min	6.081742517685205
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 6.0939946438635975, "survival_time": 59.99999999999873, "driven_lanedir": 6.081742517685205, "in-drivable-lane": 0.0, "deviation-heading": 1.94582432309865, "distance-from-start": 2.49941447398169, "deviation-center-line": 0.25576965235048754, "driven_lanedir_consec": 6.0817422473064955}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16759

sim-1of4

success

yes

2022-11-28 18:18:16+00:00

2022-11-28 18:29:11+00:00

0:10:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.3318472576969511
deviation-center-line_median	0.6648693526614008

other stats

deviation-center-line_max	0.6648693526614008
deviation-center-line_mean	0.6648693526614008
deviation-center-line_min	0.6648693526614008
deviation-heading_max	4.49371507747449
deviation-heading_mean	4.49371507747449
deviation-heading_median	4.49371507747449
deviation-heading_min	4.49371507747449
distance-from-start_max	1.4319552848600958
distance-from-start_mean	1.4319552848600958
distance-from-start_median	1.4319552848600958
distance-from-start_min	1.4319552848600958
driven_any_max	1.8616750012145875
driven_any_mean	1.8616750012145875
driven_any_median	1.8616750012145875
driven_any_min	1.8616750012145875
driven_lanedir_consec_max	1.3318472576969511
driven_lanedir_consec_mean	1.3318472576969511
driven_lanedir_consec_min	1.3318472576969511
driven_lanedir_max	1.8544941763277367
driven_lanedir_mean	1.8544941763277367
driven_lanedir_median	1.8544941763277367
driven_lanedir_min	1.8544941763277367
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 1.8616750012145875, "survival_time": 59.99999999999873, "driven_lanedir": 1.8544941763277367, "in-drivable-lane": 0.0, "deviation-heading": 4.49371507747449, "distance-from-start": 1.4319552848600958, "deviation-center-line": 0.6648693526614008, "driven_lanedir_consec": 1.3318472576969511}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

16758

sim-0of4

success

yes

2022-11-28 18:18:13+00:00

2022-11-28 18:28:56+00:00

0:10:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.4477076357371352
deviation-center-line_median	0.0719572483263306

other stats

deviation-center-line_max	0.0719572483263306
deviation-center-line_mean	0.0719572483263306
deviation-center-line_min	0.0719572483263306
deviation-heading_max	1.9197947517405864
deviation-heading_mean	1.9197947517405864
deviation-heading_median	1.9197947517405864
deviation-heading_min	1.9197947517405864
distance-from-start_max	0.4476854412517205
distance-from-start_mean	0.4476854412517205
distance-from-start_median	0.4476854412517205
distance-from-start_min	0.4476854412517205
driven_any_max	0.4483014753438006
driven_any_mean	0.4483014753438006
driven_any_median	0.4483014753438006
driven_any_min	0.4483014753438006
driven_lanedir_consec_max	0.4477076357371352
driven_lanedir_consec_mean	0.4477076357371352
driven_lanedir_consec_min	0.4477076357371352
driven_lanedir_max	0.4477076357371352
driven_lanedir_mean	0.4477076357371352
driven_lanedir_median	0.4477076357371352
driven_lanedir_min	0.4477076357371352
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-001-ego0": {"driven_any": 0.4483014753438006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4477076357371352, "in-drivable-lane": 0.0, "deviation-heading": 1.9197947517405864, "distance-from-start": 0.4476854412517205, "deviation-center-line": 0.0719572483263306, "driven_lanedir_consec": 0.4477076357371352}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible