Submission 722

Submission

722

Competing

user retired

Challenge

aido-LFP-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 21:18:18+00:00

Last status update

2022-11-16 15:30:23+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 8031 sim-1of4: 8033 sim-2of4: 8029 sim-3of4: 8032

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

8033

Click the images to see detailed statistics about the episode.

loop2-000

8032

Click the images to see detailed statistics about the episode.

autolab-000

8031

Click the images to see detailed statistics about the episode.

zigzag-000

8029

Click the images to see detailed statistics about the episode.

loop-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

8033

sim-1of4

success

2022-11-16 15:22:57+00:00

2022-11-16 15:28:58+00:00

0:06:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.4204196916535985
deviation-center-line_median	4.903600866459574

other stats

deviation-center-line_max	4.903600866459574
deviation-center-line_mean	4.903600866459574
deviation-center-line_min	4.903600866459574
deviation-heading_max	7.744574577220404
deviation-heading_mean	7.744574577220404
deviation-heading_median	7.744574577220404
deviation-heading_min	7.744574577220404
distance-from-start_max	1.2060007984779362
distance-from-start_mean	1.2060007984779362
distance-from-start_median	1.2060007984779362
distance-from-start_min	1.2060007984779362
driven_any_max	3.4850840176965243
driven_any_mean	3.4850840176965243
driven_any_median	3.4850840176965243
driven_any_min	3.4850840176965243
driven_lanedir_consec_max	1.4204196916535985
driven_lanedir_consec_mean	1.4204196916535985
driven_lanedir_consec_min	1.4204196916535985
driven_lanedir_max	3.290507623068698
driven_lanedir_mean	3.290507623068698
driven_lanedir_median	3.290507623068698
driven_lanedir_min	3.290507623068698
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4850840176965243, "survival_time": 59.99999999999873, "driven_lanedir": 3.290507623068698, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.744574577220404, "distance-from-start": 1.2060007984779362, "deviation-center-line": 4.903600866459574, "driven_lanedir_consec": 1.4204196916535985}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8032

sim-3of4

success

2022-11-16 15:22:22+00:00

2022-11-16 15:30:06+00:00

0:07:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	54.99999999999901
in-drivable-lane_median	3.1499999999999666
driven_lanedir_consec_median	1.4204531654839432
deviation-center-line_median	4.299642743198505

other stats

deviation-center-line_max	4.299642743198505
deviation-center-line_mean	4.299642743198505
deviation-center-line_min	4.299642743198505
deviation-heading_max	7.7378823871569
deviation-heading_mean	7.7378823871569
deviation-heading_median	7.7378823871569
deviation-heading_min	7.7378823871569
distance-from-start_max	1.2060007909381567
distance-from-start_mean	1.2060007909381567
distance-from-start_median	1.2060007909381567
distance-from-start_min	1.2060007909381567
driven_any_max	3.1430848844497508
driven_any_mean	3.1430848844497508
driven_any_median	3.1430848844497508
driven_any_min	3.1430848844497508
driven_lanedir_consec_max	1.4204531654839432
driven_lanedir_consec_mean	1.4204531654839432
driven_lanedir_consec_min	1.4204531654839432
driven_lanedir_max	2.9486966801724956
driven_lanedir_mean	2.9486966801724956
driven_lanedir_median	2.9486966801724956
driven_lanedir_min	2.9486966801724956
in-drivable-lane_max	3.1499999999999666
in-drivable-lane_mean	3.1499999999999666
in-drivable-lane_min	3.1499999999999666
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.1430848844497508, "survival_time": 54.99999999999901, "driven_lanedir": 2.9486966801724956, "in-drivable-lane": 3.1499999999999666, "deviation-heading": 7.7378823871569, "distance-from-start": 1.2060007909381567, "deviation-center-line": 4.299642743198505, "driven_lanedir_consec": 1.4204531654839432}}
simulation-passed	1
survival_time_max	54.99999999999901
survival_time_mean	54.99999999999901
survival_time_min	54.99999999999901

No reset possible

8031

sim-0of4

success

2022-11-16 15:21:45+00:00

2022-11-16 15:29:57+00:00

0:08:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	58.999999999998785
in-drivable-lane_median	5.099999999999877
driven_lanedir_consec_median	2.892079268568325
deviation-center-line_median	5.68067401244577

other stats

deviation-center-line_max	5.68067401244577
deviation-center-line_mean	5.68067401244577
deviation-center-line_min	5.68067401244577
deviation-heading_max	11.303441083989476
deviation-heading_mean	11.303441083989476
deviation-heading_median	11.303441083989476
deviation-heading_min	11.303441083989476
distance-from-start_max	2.5229792435170997
distance-from-start_mean	2.5229792435170997
distance-from-start_median	2.5229792435170997
distance-from-start_min	2.5229792435170997
driven_any_max	3.3245754522162305
driven_any_mean	3.3245754522162305
driven_any_median	3.3245754522162305
driven_any_min	3.3245754522162305
driven_lanedir_consec_max	2.892079268568325
driven_lanedir_consec_mean	2.892079268568325
driven_lanedir_consec_min	2.892079268568325
driven_lanedir_max	2.9981420962757213
driven_lanedir_mean	2.9981420962757213
driven_lanedir_median	2.9981420962757213
driven_lanedir_min	2.9981420962757213
in-drivable-lane_max	5.099999999999877
in-drivable-lane_mean	5.099999999999877
in-drivable-lane_min	5.099999999999877
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.3245754522162305, "survival_time": 58.999999999998785, "driven_lanedir": 2.9981420962757213, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.303441083989476, "distance-from-start": 2.5229792435170997, "deviation-center-line": 5.68067401244577, "driven_lanedir_consec": 2.892079268568325}}
simulation-passed	1
survival_time_max	58.999999999998785
survival_time_mean	58.999999999998785
survival_time_min	58.999999999998785

No reset possible

8029

sim-2of4

success

2022-11-16 15:19:00+00:00

2022-11-16 15:21:14+00:00

0:02:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	8.399999999999984
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.43685686215365394
deviation-center-line_median	0.2706641555037605

other stats

deviation-center-line_max	0.2706641555037605
deviation-center-line_mean	0.2706641555037605
deviation-center-line_min	0.2706641555037605
deviation-heading_max	0.7151185427551809
deviation-heading_mean	0.7151185427551809
deviation-heading_median	0.7151185427551809
deviation-heading_min	0.7151185427551809
distance-from-start_max	0.4379491769922931
distance-from-start_mean	0.4379491769922931
distance-from-start_median	0.4379491769922931
distance-from-start_min	0.4379491769922931
driven_any_max	0.4415992768886728
driven_any_mean	0.4415992768886728
driven_any_median	0.4415992768886728
driven_any_min	0.4415992768886728
driven_lanedir_consec_max	0.43685686215365394
driven_lanedir_consec_mean	0.43685686215365394
driven_lanedir_consec_min	0.43685686215365394
driven_lanedir_max	0.43685686215365394
driven_lanedir_mean	0.43685686215365394
driven_lanedir_median	0.43685686215365394
driven_lanedir_min	0.43685686215365394
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"loop-000-ego0": {"driven_any": 0.4415992768886728, "survival_time": 8.399999999999984, "driven_lanedir": 0.43685686215365394, "in-drivable-lane": 0.0, "deviation-heading": 0.7151185427551809, "distance-from-start": 0.4379491769922931, "deviation-center-line": 0.2706641555037605, "driven_lanedir_consec": 0.43685686215365394}}
simulation-passed	1
survival_time_max	8.399999999999984
survival_time_mean	8.399999999999984
survival_time_min	8.399999999999984

No reset possible

6363

sim-3of4

success

2021-11-02 19:22:17+00:00

2021-11-02 19:24:33+00:00

0:02:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6362

sim-0of4

success

2021-11-02 19:22:12+00:00

2021-11-02 19:25:48+00:00

0:03:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6361

sim-1of4

success

2021-11-02 19:20:14+00:00

2021-11-02 19:24:19+00:00

0:04:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6360

sim-2of4

success

2021-11-02 19:19:49+00:00

2021-11-02 19:26:54+00:00

0:07:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5493

sim-1of4

success

2021-10-31 22:01:05+00:00

2021-10-31 22:05:20+00:00

0:04:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5490

sim-1of4

host-error

2021-10-31 21:59:40+00:00

2021-10-31 22:00:04+00:00

0:00:24

Error while running [...]

Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5489

sim-2of4

success

2021-10-31 21:59:18+00:00

2021-10-31 22:00:42+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5488

sim-3of4

success

2021-10-31 21:58:52+00:00

2021-10-31 22:03:33+00:00

0:04:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5487

sim-0of4

success

2021-10-31 21:58:36+00:00

2021-10-31 22:02:01+00:00

0:03:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible