Submission 469

Submission

469

Competing

user retired

Challenge

aido-LFV-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-23 16:31:41+00:00

Last status update

2021-10-31 20:51:01+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 5328 sim-1of4: 5330 sim-2of4: 5329 sim-3of4: 5327

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

5330

Click the images to see detailed statistics about the episode.

zigzag-000

5329

Click the images to see detailed statistics about the episode.

loop-000

5328

Click the images to see detailed statistics about the episode.

loop2-000

5327

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

5330

sim-1of4

success

2021-10-31 20:43:16+00:00

2021-10-31 20:47:41+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	21.600000000000172
in-drivable-lane_median	1.0000000000000142
driven_lanedir_consec_median	1.0990342557165476
deviation-center-line_median	1.8289586167929932

other stats

deviation-center-line_max	1.8289586167929932
deviation-center-line_mean	1.8289586167929932
deviation-center-line_min	1.8289586167929932
deviation-heading_max	5.113647296201556
deviation-heading_mean	5.113647296201556
deviation-heading_median	5.113647296201556
deviation-heading_min	5.113647296201556
distance-from-start_max	1.0166726694408923
distance-from-start_mean	1.0166726694408923
distance-from-start_median	1.0166726694408923
distance-from-start_min	1.0166726694408923
driven_any_max	1.2035907327948363
driven_any_mean	1.2035907327948363
driven_any_median	1.2035907327948363
driven_any_min	1.2035907327948363
driven_lanedir_consec_max	1.0990342557165476
driven_lanedir_consec_mean	1.0990342557165476
driven_lanedir_consec_min	1.0990342557165476
driven_lanedir_max	1.0990342557165476
driven_lanedir_mean	1.0990342557165476
driven_lanedir_median	1.0990342557165476
driven_lanedir_min	1.0990342557165476
in-drivable-lane_max	1.0000000000000142
in-drivable-lane_mean	1.0000000000000142
in-drivable-lane_min	1.0000000000000142
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.2035907327948363, "survival_time": 21.600000000000172, "driven_lanedir": 1.0990342557165476, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296201556, "distance-from-start": 1.0166726694408923, "deviation-center-line": 1.8289586167929932, "driven_lanedir_consec": 1.0990342557165476}}
simulation-passed	1
survival_time_max	21.600000000000172
survival_time_mean	21.600000000000172
survival_time_min	21.600000000000172

No reset possible

5329

sim-2of4

success

2021-10-31 20:43:15+00:00

2021-10-31 20:50:56+00:00

0:07:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	3.48568324399197
deviation-center-line_median	7.514954227940093

other stats

deviation-center-line_max	7.514954227940093
deviation-center-line_mean	7.514954227940093
deviation-center-line_min	7.514954227940093
deviation-heading_max	2.9198322000428
deviation-heading_mean	2.9198322000428
deviation-heading_median	2.9198322000428
deviation-heading_min	2.9198322000428
distance-from-start_max	2.8766441683061994
distance-from-start_mean	2.8766441683061994
distance-from-start_median	2.8766441683061994
distance-from-start_min	2.8766441683061994
driven_any_max	3.5465963271061254
driven_any_mean	3.5465963271061254
driven_any_median	3.5465963271061254
driven_any_min	3.5465963271061254
driven_lanedir_consec_max	3.48568324399197
driven_lanedir_consec_mean	3.48568324399197
driven_lanedir_consec_min	3.48568324399197
driven_lanedir_max	3.48568324399197
driven_lanedir_mean	3.48568324399197
driven_lanedir_median	3.48568324399197
driven_lanedir_min	3.48568324399197
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"loop-000-ego0": {"driven_any": 3.5465963271061254, "survival_time": 59.99999999999873, "driven_lanedir": 3.48568324399197, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.9198322000428, "distance-from-start": 2.8766441683061994, "deviation-center-line": 7.514954227940093, "driven_lanedir_consec": 3.48568324399197}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

5328

sim-0of4

success

2021-10-31 20:43:11+00:00

2021-10-31 20:48:13+00:00

0:05:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.099999999999845
driven_lanedir_consec_median	3.2655265789104
deviation-center-line_median	7.114511199103643

other stats

deviation-center-line_max	7.114511199103643
deviation-center-line_mean	7.114511199103643
deviation-center-line_min	7.114511199103643
deviation-heading_max	5.702635580930089
deviation-heading_mean	5.702635580930089
deviation-heading_median	5.702635580930089
deviation-heading_min	5.702635580930089
distance-from-start_max	1.6303678440695035
distance-from-start_mean	1.6303678440695035
distance-from-start_median	1.6303678440695035
distance-from-start_min	1.6303678440695035
driven_any_max	3.466336917289666
driven_any_mean	3.466336917289666
driven_any_median	3.466336917289666
driven_any_min	3.466336917289666
driven_lanedir_consec_max	3.2655265789104
driven_lanedir_consec_mean	3.2655265789104
driven_lanedir_consec_min	3.2655265789104
driven_lanedir_max	3.2655265789104
driven_lanedir_mean	3.2655265789104
driven_lanedir_median	3.2655265789104
driven_lanedir_min	3.2655265789104
in-drivable-lane_max	4.099999999999845
in-drivable-lane_mean	4.099999999999845
in-drivable-lane_min	4.099999999999845
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.466336917289666, "survival_time": 59.99999999999873, "driven_lanedir": 3.2655265789104, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635580930089, "distance-from-start": 1.6303678440695035, "deviation-center-line": 7.114511199103643, "driven_lanedir_consec": 3.2655265789104}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

5327

sim-3of4

success

2021-10-31 20:42:45+00:00

2021-10-31 20:45:48+00:00

0:03:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	21.600000000000172
in-drivable-lane_median	1.0000000000000142
driven_lanedir_consec_median	1.0990342557162571
deviation-center-line_median	1.828958616792992

other stats

deviation-center-line_max	1.828958616792992
deviation-center-line_mean	1.828958616792992
deviation-center-line_min	1.828958616792992
deviation-heading_max	5.113647296201552
deviation-heading_mean	5.113647296201552
deviation-heading_median	5.113647296201552
deviation-heading_min	5.113647296201552
distance-from-start_max	1.0166726694408912
distance-from-start_mean	1.0166726694408912
distance-from-start_median	1.0166726694408912
distance-from-start_min	1.0166726694408912
driven_any_max	1.203590732794828
driven_any_mean	1.203590732794828
driven_any_median	1.203590732794828
driven_any_min	1.203590732794828
driven_lanedir_consec_max	1.0990342557162571
driven_lanedir_consec_mean	1.0990342557162571
driven_lanedir_consec_min	1.0990342557162571
driven_lanedir_max	1.0990342557162571
driven_lanedir_mean	1.0990342557162571
driven_lanedir_median	1.0990342557162571
driven_lanedir_min	1.0990342557162571
in-drivable-lane_max	1.0000000000000142
in-drivable-lane_mean	1.0000000000000142
in-drivable-lane_min	1.0000000000000142
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.203590732794828, "survival_time": 21.600000000000172, "driven_lanedir": 1.0990342557162571, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296201552, "distance-from-start": 1.0166726694408912, "deviation-center-line": 1.828958616792992, "driven_lanedir_consec": 1.0990342557162571}}
simulation-passed	1
survival_time_max	21.600000000000172
survival_time_mean	21.600000000000172
survival_time_min	21.600000000000172

No reset possible

4344

sim-3of4

success

2021-10-23 18:03:28+00:00

2021-10-23 18:06:33+00:00

0:03:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4343

sim-2of4

success

2021-10-23 18:02:59+00:00

2021-10-23 18:10:40+00:00

0:07:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4342

sim-1of4

success

2021-10-23 18:01:59+00:00

2021-10-23 18:11:51+00:00

0:09:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4340

sim-0of4

success

2021-10-23 17:58:23+00:00

2021-10-23 18:04:00+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible