Submission 717

Submission

717

Competing

user retired

Challenge

aido-LF-state-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 21:18:18+00:00

Last status update

2022-11-16 16:07:18+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 8050 sim-1of4: 8051 sim-2of4: 8052 sim-3of4: 8053

User label

minimal-agent-state

Admin priority

Blessing

n/a

User priority

8053

Click the images to see detailed statistics about the episode.

autolab-000

8052

Click the images to see detailed statistics about the episode.

loop-000

8051

Click the images to see detailed statistics about the episode.

loop2-000

8050

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

8053

sim-3of4

success

2022-11-16 16:00:30+00:00

2022-11-16 16:07:14+00:00

0:06:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	3.449999999999882
driven_lanedir_consec_median	3.2733415499402216
deviation-center-line_median	5.928861946292094

other stats

deviation-center-line_max	5.928861946292094
deviation-center-line_mean	5.928861946292094
deviation-center-line_min	5.928861946292094
deviation-heading_max	8.566643949098404
deviation-heading_mean	8.566643949098404
deviation-heading_median	8.566643949098404
deviation-heading_min	8.566643949098404
distance-from-start_max	2.0613975346450584
distance-from-start_mean	2.0613975346450584
distance-from-start_median	2.0613975346450584
distance-from-start_min	2.0613975346450584
driven_any_max	3.476087222739478
driven_any_mean	3.476087222739478
driven_any_median	3.476087222739478
driven_any_min	3.476087222739478
driven_lanedir_consec_max	3.2733415499402216
driven_lanedir_consec_mean	3.2733415499402216
driven_lanedir_consec_min	3.2733415499402216
driven_lanedir_max	3.2733415499402216
driven_lanedir_mean	3.2733415499402216
driven_lanedir_median	3.2733415499402216
driven_lanedir_min	3.2733415499402216
in-drivable-lane_max	3.449999999999882
in-drivable-lane_mean	3.449999999999882
in-drivable-lane_min	3.449999999999882
per-episodes	details {"autolab-000-ego0": {"driven_any": 3.476087222739478, "survival_time": 59.99999999999873, "driven_lanedir": 3.2733415499402216, "in-drivable-lane": 3.449999999999882, "deviation-heading": 8.566643949098404, "distance-from-start": 2.0613975346450584, "deviation-center-line": 5.928861946292094, "driven_lanedir_consec": 3.2733415499402216}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8052

sim-2of4

success

2022-11-16 16:00:01+00:00

2022-11-16 16:05:54+00:00

0:05:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	2.0499999999998835
driven_lanedir_consec_median	2.590344626764449
deviation-center-line_median	4.845050203327669

other stats

deviation-center-line_max	4.845050203327669
deviation-center-line_mean	4.845050203327669
deviation-center-line_min	4.845050203327669
deviation-heading_max	5.268596965891924
deviation-heading_mean	5.268596965891924
deviation-heading_median	5.268596965891924
deviation-heading_min	5.268596965891924
distance-from-start_max	2.0328181008705815
distance-from-start_mean	2.0328181008705815
distance-from-start_median	2.0328181008705815
distance-from-start_min	2.0328181008705815
driven_any_max	3.5180872153629963
driven_any_mean	3.5180872153629963
driven_any_median	3.5180872153629963
driven_any_min	3.5180872153629963
driven_lanedir_consec_max	2.590344626764449
driven_lanedir_consec_mean	2.590344626764449
driven_lanedir_consec_min	2.590344626764449
driven_lanedir_max	3.3813728203313413
driven_lanedir_mean	3.3813728203313413
driven_lanedir_median	3.3813728203313413
driven_lanedir_min	3.3813728203313413
in-drivable-lane_max	2.0499999999998835
in-drivable-lane_mean	2.0499999999998835
in-drivable-lane_min	2.0499999999998835
per-episodes	details {"loop-000-ego0": {"driven_any": 3.5180872153629963, "survival_time": 59.99999999999873, "driven_lanedir": 3.3813728203313413, "in-drivable-lane": 2.0499999999998835, "deviation-heading": 5.268596965891924, "distance-from-start": 2.0328181008705815, "deviation-center-line": 4.845050203327669, "driven_lanedir_consec": 2.590344626764449}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8051

sim-1of4

success

2022-11-16 15:58:07+00:00

2022-11-16 16:03:59+00:00

0:05:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	4.099999999999845
driven_lanedir_consec_median	3.265534945442065
deviation-center-line_median	7.114511298462666

other stats

deviation-center-line_max	7.114511298462666
deviation-center-line_mean	7.114511298462666
deviation-center-line_min	7.114511298462666
deviation-heading_max	5.702635614477716
deviation-heading_mean	5.702635614477716
deviation-heading_median	5.702635614477716
deviation-heading_min	5.702635614477716
distance-from-start_max	1.6303678378962243
distance-from-start_mean	1.6303678378962243
distance-from-start_median	1.6303678378962243
distance-from-start_min	1.6303678378962243
driven_any_max	3.4663369172893987
driven_any_mean	3.4663369172893987
driven_any_median	3.4663369172893987
driven_any_min	3.4663369172893987
driven_lanedir_consec_max	3.265534945442065
driven_lanedir_consec_mean	3.265534945442065
driven_lanedir_consec_min	3.265534945442065
driven_lanedir_max	3.265534945442065
driven_lanedir_mean	3.265534945442065
driven_lanedir_median	3.265534945442065
driven_lanedir_min	3.265534945442065
in-drivable-lane_max	4.099999999999845
in-drivable-lane_mean	4.099999999999845
in-drivable-lane_min	4.099999999999845
per-episodes	details {"loop2-000-ego0": {"driven_any": 3.4663369172893987, "survival_time": 59.99999999999873, "driven_lanedir": 3.265534945442065, "in-drivable-lane": 4.099999999999845, "deviation-heading": 5.702635614477716, "distance-from-start": 1.6303678378962243, "deviation-center-line": 7.114511298462666, "driven_lanedir_consec": 3.265534945442065}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

8050

sim-0of4

success

2022-11-16 15:56:41+00:00

2022-11-16 16:03:28+00:00

0:06:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	59.99999999999873
in-drivable-lane_median	5.099999999999877
driven_lanedir_consec_median	2.892079268568325
deviation-center-line_median	5.68028894694067

other stats

deviation-center-line_max	5.68028894694067
deviation-center-line_mean	5.68028894694067
deviation-center-line_min	5.68028894694067
deviation-heading_max	11.490175069101426
deviation-heading_mean	11.490175069101426
deviation-heading_median	11.490175069101426
deviation-heading_min	11.490175069101426
distance-from-start_max	2.5229792435170997
distance-from-start_mean	2.5229792435170997
distance-from-start_median	2.5229792435170997
distance-from-start_min	2.5229792435170997
driven_any_max	3.4265750684856733
driven_any_mean	3.4265750684856733
driven_any_median	3.4265750684856733
driven_any_min	3.4265750684856733
driven_lanedir_consec_max	2.892079268568325
driven_lanedir_consec_mean	2.892079268568325
driven_lanedir_consec_min	2.892079268568325
driven_lanedir_max	3.0978304042211517
driven_lanedir_mean	3.0978304042211517
driven_lanedir_median	3.0978304042211517
driven_lanedir_min	3.0978304042211517
in-drivable-lane_max	5.099999999999877
in-drivable-lane_mean	5.099999999999877
in-drivable-lane_min	5.099999999999877
per-episodes	details {"zigzag-000-ego0": {"driven_any": 3.4265750684856733, "survival_time": 59.99999999999873, "driven_lanedir": 3.0978304042211517, "in-drivable-lane": 5.099999999999877, "deviation-heading": 11.490175069101426, "distance-from-start": 2.5229792435170997, "deviation-center-line": 5.68028894694067, "driven_lanedir_consec": 2.892079268568325}}
simulation-passed	1
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

6388

sim-1of4

success

2021-11-02 19:37:33+00:00

2021-11-02 19:41:33+00:00

0:04:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6384

sim-0of4

success

2021-11-02 19:31:59+00:00

2021-11-02 19:35:19+00:00

0:03:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6379

sim-3of4

success

2021-11-02 19:28:18+00:00

2021-11-02 19:38:21+00:00

0:10:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6378

sim-2of4

success

2021-11-02 19:28:17+00:00

2021-11-02 19:39:00+00:00

0:10:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6377

sim-0of4

success

2021-11-02 19:28:15+00:00

2021-11-02 19:38:16+00:00

0:10:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6375

sim-1of4

success

2021-11-02 19:28:14+00:00

2021-11-02 19:39:10+00:00

0:10:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5513

sim-3of4

success

2021-10-31 22:14:31+00:00

2021-10-31 22:18:31+00:00

0:04:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5510

sim-2of4

success

2021-10-31 22:14:13+00:00

2021-10-31 22:21:27+00:00

0:07:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5509

sim-1of4

success

2021-10-31 22:13:41+00:00

2021-10-31 22:21:12+00:00

0:07:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5508

sim-0of4

success

2021-10-31 22:13:37+00:00

2021-10-31 22:17:03+00:00

0:03:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible