Submission 720

Submission

720

Competing

user retired

Challenge

aido-LFVI-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 21:18:18+00:00

Last status update

2022-11-16 15:51:27+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 8040 sim-1of4: 8039 sim-2of4: 8041 sim-3of4: 8038

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

8041

Click the images to see detailed statistics about the episode.

4way-001

8040

Click the images to see detailed statistics about the episode.

udem-001

8039

Click the images to see detailed statistics about the episode.

4way-000

8038

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

8041

sim-2of4

success

2022-11-16 15:36:27+00:00

2022-11-16 15:51:21+00:00

0:14:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.2000000000000313
driven_lanedir_consec_median	3.071963528587166
deviation-center-line_median	2.512752254009333

other stats

deviation-center-line_max	2.512752254009333
deviation-center-line_mean	2.512752254009333
deviation-center-line_min	2.512752254009333
deviation-heading_max	5.806435104216709
deviation-heading_mean	5.806435104216709
deviation-heading_median	5.806435104216709
deviation-heading_min	5.806435104216709
distance-from-start_max	2.5580188445183163
distance-from-start_mean	2.5580188445183163
distance-from-start_median	2.5580188445183163
distance-from-start_min	2.5580188445183163
driven_any_max	3.5135741911347673
driven_any_mean	3.5135741911347673
driven_any_median	3.5135741911347673
driven_any_min	3.5135741911347673
driven_lanedir_consec_max	3.071963528587166
driven_lanedir_consec_mean	3.071963528587166
driven_lanedir_consec_min	3.071963528587166
driven_lanedir_max	3.377198685996822
driven_lanedir_mean	3.377198685996822
driven_lanedir_median	3.377198685996822
driven_lanedir_min	3.377198685996822
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	2.2000000000000313
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"4way-001-ego0": {"driven_any": 3.5135741911347673, "survival_time": 59.99999999999873, "driven_lanedir": 3.377198685996822, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 5.806435104216709, "distance-from-start": 2.5580188445183163, "deviation-center-line": 2.512752254009333, "driven_lanedir_consec": 3.071963528587166}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8040

sim-0of4

success

2022-11-16 15:34:22+00:00

2022-11-16 15:42:57+00:00

0:08:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	31.30000000000031
in-drivable-lane_median	1.1000000000000156
driven_lanedir_consec_median	1.7255277651917984
deviation-center-line_median	2.855857075585254

other stats

deviation-center-line_max	2.855857075585254
deviation-center-line_mean	2.855857075585254
deviation-center-line_min	2.855857075585254
deviation-heading_max	2.4300668759857205
deviation-heading_mean	2.4300668759857205
deviation-heading_median	2.4300668759857205
deviation-heading_min	2.4300668759857205
distance-from-start_max	1.3663011503930929
distance-from-start_mean	1.3663011503930929
distance-from-start_median	1.3663011503930929
distance-from-start_min	1.3663011503930929
driven_any_max	1.7825969147102707
driven_any_mean	1.7825969147102707
driven_any_median	1.7825969147102707
driven_any_min	1.7825969147102707
driven_lanedir_consec_max	1.7255277651917984
driven_lanedir_consec_mean	1.7255277651917984
driven_lanedir_consec_min	1.7255277651917984
driven_lanedir_max	1.7255277651917984
driven_lanedir_mean	1.7255277651917984
driven_lanedir_median	1.7255277651917984
driven_lanedir_min	1.7255277651917984
in-drivable-lane_max	1.1000000000000156
in-drivable-lane_mean	1.1000000000000156
in-drivable-lane_min	1.1000000000000156
per-episodes	details {"udem-001-ego0": {"driven_any": 1.7825969147102707, "survival_time": 31.30000000000031, "driven_lanedir": 1.7255277651917984, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 2.4300668759857205, "distance-from-start": 1.3663011503930929, "deviation-center-line": 2.855857075585254, "driven_lanedir_consec": 1.7255277651917984}}
simulation-passed	1
survival_time_max	31.30000000000031
survival_time_mean	31.30000000000031
survival_time_min	31.30000000000031

No reset possible

8039

sim-1of4

success

2022-11-16 15:31:14+00:00

2022-11-16 15:45:35+00:00

0:14:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	0.0
driven_lanedir_consec_median	3.435232767289212
deviation-center-line_median	3.4976585842984904

other stats

deviation-center-line_max	3.4976585842984904
deviation-center-line_mean	3.4976585842984904
deviation-center-line_min	3.4976585842984904
deviation-heading_max	4.543459809891797
deviation-heading_mean	4.543459809891797
deviation-heading_median	4.543459809891797
deviation-heading_min	4.543459809891797
distance-from-start_max	2.277929298199526
distance-from-start_mean	2.277929298199526
distance-from-start_median	2.277929298199526
distance-from-start_min	2.277929298199526
driven_any_max	3.5795887836182776
driven_any_mean	3.5795887836182776
driven_any_median	3.5795887836182776
driven_any_min	3.5795887836182776
driven_lanedir_consec_max	3.435232767289212
driven_lanedir_consec_mean	3.435232767289212
driven_lanedir_consec_min	3.435232767289212
driven_lanedir_max	3.5560705438843097
driven_lanedir_mean	3.5560705438843097
driven_lanedir_median	3.5560705438843097
driven_lanedir_min	3.5560705438843097
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 3.5795887836182776, "survival_time": 59.99999999999873, "driven_lanedir": 3.5560705438843097, "in-drivable-lane": 0.0, "deviation-heading": 4.543459809891797, "distance-from-start": 2.277929298199526, "deviation-center-line": 3.4976585842984904, "driven_lanedir_consec": 3.435232767289212}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8038

sim-3of4

success

2022-11-16 15:30:26+00:00

2022-11-16 15:34:16+00:00

0:03:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.449999999999985
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.43985657000294776
deviation-center-line_median	0.2725613901708909

other stats

deviation-center-line_max	0.2725613901708909
deviation-center-line_mean	0.2725613901708909
deviation-center-line_min	0.2725613901708909
deviation-heading_max	0.7151184294493078
deviation-heading_mean	0.7151184294493078
deviation-heading_median	0.7151184294493078
deviation-heading_min	0.7151184294493078
distance-from-start_max	0.44094173644874646
distance-from-start_mean	0.44094173644874646
distance-from-start_median	0.44094173644874646
distance-from-start_min	0.44094173644874646
driven_any_max	0.44459927688866696
driven_any_mean	0.44459927688866696
driven_any_median	0.44459927688866696
driven_any_min	0.44459927688866696
driven_lanedir_consec_max	0.43985657000294776
driven_lanedir_consec_mean	0.43985657000294776
driven_lanedir_consec_min	0.43985657000294776
driven_lanedir_max	0.43985657000294776
driven_lanedir_mean	0.43985657000294776
driven_lanedir_median	0.43985657000294776
driven_lanedir_min	0.43985657000294776
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem-000-ego0": {"driven_any": 0.44459927688866696, "survival_time": 8.449999999999985, "driven_lanedir": 0.43985657000294776, "in-drivable-lane": 0.0, "deviation-heading": 0.7151184294493078, "distance-from-start": 0.44094173644874646, "deviation-center-line": 0.2725613901708909, "driven_lanedir_consec": 0.43985657000294776}}
simulation-passed	1
survival_time_max	8.449999999999985
survival_time_mean	8.449999999999985
survival_time_min	8.449999999999985

No reset possible

6397

sim-1of4

success

2021-11-02 19:40:27+00:00

2021-11-02 19:43:40+00:00

0:03:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6390

sim-1of4

timeout

2021-11-02 19:38:56+00:00

2021-11-02 19:39:44+00:00

0:00:48

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6381

sim-2of4

success

2021-11-02 19:30:51+00:00

2021-11-02 19:39:47+00:00

0:08:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6380

sim-1of4

success

2021-11-02 19:28:54+00:00

2021-11-02 19:43:58+00:00

0:15:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6372

sim-2of4

success

2021-11-02 19:26:52+00:00

2021-11-02 19:35:58+00:00

0:09:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6370

sim-0of4

success

2021-11-02 19:26:02+00:00

2021-11-02 19:31:28+00:00

0:05:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6369

sim-3of4

success

2021-11-02 19:25:15+00:00

2021-11-02 19:28:27+00:00

0:03:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6368

sim-1of4

success

2021-11-02 19:24:53+00:00

2021-11-02 19:39:37+00:00

0:14:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5499

sim-3of4

success

2021-10-31 22:04:10+00:00

2021-10-31 22:13:08+00:00

0:08:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5498

sim-0of4

success

2021-10-31 22:04:08+00:00

2021-10-31 22:19:32+00:00

0:15:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5497

sim-1of4

success

2021-10-31 22:04:06+00:00

2021-10-31 22:07:20+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5496

sim-2of4

success

2021-10-31 22:03:10+00:00

2021-10-31 22:12:12+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible