Submission 728

Submission

728

Competing

user retired

Challenge

aido-LFV-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 21:18:18+00:00

Last status update

2022-11-16 14:49:04+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 8006 sim-1of4: 8009 sim-2of4: 8007 sim-3of4: 8008

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

8009

Click the images to see detailed statistics about the episode.

loop2-000

8008

Click the images to see detailed statistics about the episode.

autolab-000

8007

Click the images to see detailed statistics about the episode.

loop-000

8006

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

8009

sim-1of4

success

2022-11-16 14:34:42+00:00

2022-11-16 14:42:45+00:00

0:08:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.099999999999845
driven_lanedir_consec_median	3.265526431777138
deviation-center-line_median	7.114511178777169

other stats

deviation-center-line_max	7.114511178777169
deviation-center-line_mean	7.114511178777169
deviation-center-line_min	7.114511178777169
deviation-heading_max	5.70263556757215
deviation-heading_mean	5.70263556757215
deviation-heading_median	5.70263556757215
deviation-heading_min	5.70263556757215
distance-from-start_max	1.630367843991089
distance-from-start_mean	1.630367843991089
distance-from-start_median	1.630367843991089
distance-from-start_min	1.630367843991089
driven_any_max	3.4663369172894383
driven_any_mean	3.4663369172894383
driven_any_median	3.4663369172894383
driven_any_min	3.4663369172894383
driven_lanedir_consec_max	3.265526431777138
driven_lanedir_consec_mean	3.265526431777138
driven_lanedir_consec_min	3.265526431777138
driven_lanedir_max	3.265526431777138
driven_lanedir_mean	3.265526431777138
driven_lanedir_median	3.265526431777138
driven_lanedir_min	3.265526431777138
in-drivable-lane_max	4.099999999999845
in-drivable-lane_mean	4.099999999999845
in-drivable-lane_min	4.099999999999845
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4663369172894383, "survival_time": 59.99999999999873, "driven_lanedir": 3.265526431777138, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.70263556757215, "distance-from-start": 1.630367843991089, "deviation-center-line": 7.114511178777169, "driven_lanedir_consec": 3.265526431777138}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8008

sim-3of4

success

2022-11-16 14:31:40+00:00

2022-11-16 14:48:46+00:00

0:17:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	3.4856553667756276
deviation-center-line_median	7.514935459300193

other stats

deviation-center-line_max	7.514935459300193
deviation-center-line_mean	7.514935459300193
deviation-center-line_min	7.514935459300193
deviation-heading_max	2.919831925964245
deviation-heading_mean	2.919831925964245
deviation-heading_median	2.919831925964245
deviation-heading_min	2.919831925964245
distance-from-start_max	2.8766441843859063
distance-from-start_mean	2.8766441843859063
distance-from-start_median	2.8766441843859063
distance-from-start_min	2.8766441843859063
driven_any_max	3.5465963271066645
driven_any_mean	3.5465963271066645
driven_any_median	3.5465963271066645
driven_any_min	3.5465963271066645
driven_lanedir_consec_max	3.4856553667756276
driven_lanedir_consec_mean	3.4856553667756276
driven_lanedir_consec_min	3.4856553667756276
driven_lanedir_max	3.4856553667756276
driven_lanedir_mean	3.4856553667756276
driven_lanedir_median	3.4856553667756276
driven_lanedir_min	3.4856553667756276
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.5465963271066645, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856553667756276, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919831925964245, "distance-from-start": 2.8766441843859063, "deviation-center-line": 7.514935459300193, "driven_lanedir_consec": 3.4856553667756276}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8007

sim-2of4

success

2022-11-16 14:31:40+00:00

2022-11-16 14:44:35+00:00

0:12:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	3.4856832599244276
deviation-center-line_median	7.5149542302072865

other stats

deviation-center-line_max	7.5149542302072865
deviation-center-line_mean	7.5149542302072865
deviation-center-line_min	7.5149542302072865
deviation-heading_max	2.919832203938026
deviation-heading_mean	2.919832203938026
deviation-heading_median	2.919832203938026
deviation-heading_min	2.919832203938026
distance-from-start_max	2.876644168365493
distance-from-start_mean	2.876644168365493
distance-from-start_median	2.876644168365493
distance-from-start_min	2.876644168365493
driven_any_max	3.5465963271060996
driven_any_mean	3.5465963271060996
driven_any_median	3.5465963271060996
driven_any_min	3.5465963271060996
driven_lanedir_consec_max	3.4856832599244276
driven_lanedir_consec_mean	3.4856832599244276
driven_lanedir_consec_min	3.4856832599244276
driven_lanedir_max	3.4856832599244276
driven_lanedir_mean	3.4856832599244276
driven_lanedir_median	3.4856832599244276
driven_lanedir_min	3.4856832599244276
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"loop-000-ego0": {"driven_any": 3.5465963271060996, "survival_time": 59.99999999999873, "driven_lanedir": 3.4856832599244276, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.919832203938026, "distance-from-start": 2.876644168365493, "deviation-center-line": 7.5149542302072865, "driven_lanedir_consec": 3.4856832599244276}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8006

sim-0of4

success

2022-11-16 14:27:04+00:00

2022-11-16 14:31:28+00:00

0:04:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	21.600000000000172
in-drivable-lane_median	1.0000000000000142
driven_lanedir_consec_median	1.099034250610479
deviation-center-line_median	1.828958616897794

other stats

deviation-center-line_max	1.828958616897794
deviation-center-line_mean	1.828958616897794
deviation-center-line_min	1.828958616897794
deviation-heading_max	5.113647296393216
deviation-heading_mean	5.113647296393216
deviation-heading_median	5.113647296393216
deviation-heading_min	5.113647296393216
distance-from-start_max	1.0166726694302697
distance-from-start_mean	1.0166726694302697
distance-from-start_median	1.0166726694302697
distance-from-start_min	1.0166726694302697
driven_any_max	1.203590732794792
driven_any_mean	1.203590732794792
driven_any_median	1.203590732794792
driven_any_min	1.203590732794792
driven_lanedir_consec_max	1.099034250610479
driven_lanedir_consec_mean	1.099034250610479
driven_lanedir_consec_min	1.099034250610479
driven_lanedir_max	1.099034250610479
driven_lanedir_mean	1.099034250610479
driven_lanedir_median	1.099034250610479
driven_lanedir_min	1.099034250610479
in-drivable-lane_max	1.0000000000000142
in-drivable-lane_mean	1.0000000000000142
in-drivable-lane_min	1.0000000000000142
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.203590732794792, "survival_time": 21.600000000000172, "driven_lanedir": 1.099034250610479, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 5.113647296393216, "distance-from-start": 1.0166726694302697, "deviation-center-line": 1.828958616897794, "driven_lanedir_consec": 1.099034250610479}}
simulation-passed	1
survival_time_max	21.600000000000172
survival_time_mean	21.600000000000172
survival_time_min	21.600000000000172

No reset possible

6312

sim-3of4

success

2021-11-02 18:27:52+00:00

2021-11-02 18:41:15+00:00

0:13:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6309

sim-1of4

success

2021-11-02 18:25:11+00:00

2021-11-02 18:29:17+00:00

0:04:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6308

sim-2of4

success

2021-11-02 18:25:11+00:00

2021-11-02 18:42:02+00:00

0:16:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6307

sim-0of4

success

2021-11-02 18:23:44+00:00

2021-11-02 18:31:05+00:00

0:07:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5466

sim-0of4

success

2021-10-31 21:39:10+00:00

2021-10-31 21:44:02+00:00

0:04:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5465

sim-2of4

success

2021-10-31 21:38:24+00:00

2021-10-31 21:46:12+00:00

0:07:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5464

sim-3of4

success

2021-10-31 21:37:54+00:00

2021-10-31 21:51:04+00:00

0:13:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5462

sim-1of4

success

2021-10-31 21:37:23+00:00

2021-10-31 21:47:04+00:00

0:09:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible