Submission 1726

Submission

1726

Competing

yes

Challenge

aido-LF-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:19:06+00:00

Last status update

2022-11-28 01:14:58+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16548 sim-1of4: 16550 sim-2of4: 16551 sim-3of4: 16549

User label

minimal-agent

Admin priority

Blessing

n/a

User priority

16551

Click the images to see detailed statistics about the episode.

loop2-000

16550

Click the images to see detailed statistics about the episode.

loop-000

16549

Click the images to see detailed statistics about the episode.

zigzag-000

16548

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16551

sim-2of4

success

yes

2022-11-28 01:13:00+00:00

2022-11-28 01:14:36+00:00

0:01:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.19694617160956465
survival_time_median	10.450000000000014
deviation-center-line_median	0.1253907294304808
in-drivable-lane_median	8.700000000000014

other stats

deviation-center-line_max	0.1253907294304808
deviation-center-line_mean	0.1253907294304808
deviation-center-line_min	0.1253907294304808
deviation-heading_max	0.9520924629376074
deviation-heading_mean	0.9520924629376074
deviation-heading_median	0.9520924629376074
deviation-heading_min	0.9520924629376074
distance-from-start_max	1.5508236376562086
distance-from-start_mean	1.5508236376562086
distance-from-start_median	1.5508236376562086
distance-from-start_min	1.5508236376562086
driven_any_max	1.5511368313112877
driven_any_mean	1.5511368313112877
driven_any_median	1.5511368313112877
driven_any_min	1.5511368313112877
driven_lanedir_consec_max	0.19694617160956465
driven_lanedir_consec_mean	0.19694617160956465
driven_lanedir_consec_min	0.19694617160956465
driven_lanedir_max	0.19694617160956465
driven_lanedir_mean	0.19694617160956465
driven_lanedir_median	0.19694617160956465
driven_lanedir_min	0.19694617160956465
in-drivable-lane_max	8.700000000000014
in-drivable-lane_mean	8.700000000000014
in-drivable-lane_min	8.700000000000014
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.5511368313112877, "survival_time": 10.450000000000014, "driven_lanedir": 0.19694617160956465, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376074, "distance-from-start": 1.5508236376562086, "deviation-center-line": 0.1253907294304808, "driven_lanedir_consec": 0.19694617160956465}}
simulation-passed	1
survival_time_max	10.450000000000014
survival_time_mean	10.450000000000014
survival_time_min	10.450000000000014

No reset possible

16550

sim-1of4

success

yes

2022-11-28 01:12:59+00:00

2022-11-28 01:14:38+00:00

0:01:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1969489134232345
survival_time_median	10.450000000000014
deviation-center-line_median	0.1253905781126274
in-drivable-lane_median	8.700000000000014

other stats

deviation-center-line_max	0.1253905781126274
deviation-center-line_mean	0.1253905781126274
deviation-center-line_min	0.1253905781126274
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	1.5508236376562057
distance-from-start_mean	1.5508236376562057
distance-from-start_median	1.5508236376562057
distance-from-start_min	1.5508236376562057
driven_any_max	1.5511368313112754
driven_any_mean	1.5511368313112754
driven_any_median	1.5511368313112754
driven_any_min	1.5511368313112754
driven_lanedir_consec_max	0.1969489134232345
driven_lanedir_consec_mean	0.1969489134232345
driven_lanedir_consec_min	0.1969489134232345
driven_lanedir_max	0.1969489134232345
driven_lanedir_mean	0.1969489134232345
driven_lanedir_median	0.1969489134232345
driven_lanedir_min	0.1969489134232345
in-drivable-lane_max	8.700000000000014
in-drivable-lane_mean	8.700000000000014
in-drivable-lane_min	8.700000000000014
per-episodes	details {"loop-000-ego0": {"driven_any": 1.5511368313112754, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969489134232345, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.5508236376562057, "deviation-center-line": 0.1253905781126274, "driven_lanedir_consec": 0.1969489134232345}}
simulation-passed	1
survival_time_max	10.450000000000014
survival_time_mean	10.450000000000014
survival_time_min	10.450000000000014

No reset possible

16549

sim-3of4

success

yes

2022-11-28 01:12:57+00:00

2022-11-28 01:14:47+00:00

0:01:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31872576909325967
survival_time_median	12.40000000000004
deviation-center-line_median	0.2634611971893196
in-drivable-lane_median	9.150000000000045

other stats

deviation-center-line_max	0.2634611971893196
deviation-center-line_mean	0.2634611971893196
deviation-center-line_min	0.2634611971893196
deviation-heading_max	2.539741615834614
deviation-heading_mean	2.539741615834614
deviation-heading_median	2.539741615834614
deviation-heading_min	2.539741615834614
distance-from-start_max	1.8751243016635968
distance-from-start_mean	1.8751243016635968
distance-from-start_median	1.8751243016635968
distance-from-start_min	1.8751243016635968
driven_any_max	1.875978020012028
driven_any_mean	1.875978020012028
driven_any_median	1.875978020012028
driven_any_min	1.875978020012028
driven_lanedir_consec_max	0.31872576909325967
driven_lanedir_consec_mean	0.31872576909325967
driven_lanedir_consec_min	0.31872576909325967
driven_lanedir_max	0.31872576909325967
driven_lanedir_mean	0.31872576909325967
driven_lanedir_median	0.31872576909325967
driven_lanedir_min	0.31872576909325967
in-drivable-lane_max	9.150000000000045
in-drivable-lane_mean	9.150000000000045
in-drivable-lane_min	9.150000000000045
per-episodes	details {"zigzag-000-ego0": {"driven_any": 1.875978020012028, "survival_time": 12.40000000000004, "driven_lanedir": 0.31872576909325967, "in-drivable-lane": 9.150000000000045, "deviation-heading": 2.539741615834614, "distance-from-start": 1.8751243016635968, "deviation-center-line": 0.2634611971893196, "driven_lanedir_consec": 0.31872576909325967}}
simulation-passed	1
survival_time_max	12.40000000000004
survival_time_mean	12.40000000000004
survival_time_min	12.40000000000004

No reset possible

16548

sim-0of4

success

yes

2022-11-28 01:11:48+00:00

2022-11-28 01:13:30+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1969462908187456
survival_time_median	10.450000000000014
deviation-center-line_median	0.12539072943048185
in-drivable-lane_median	8.700000000000014

other stats

deviation-center-line_max	0.12539072943048185
deviation-center-line_mean	0.12539072943048185
deviation-center-line_min	0.12539072943048185
deviation-heading_max	0.9520924629376072
deviation-heading_mean	0.9520924629376072
deviation-heading_median	0.9520924629376072
deviation-heading_min	0.9520924629376072
distance-from-start_max	1.550823637656203
distance-from-start_mean	1.550823637656203
distance-from-start_median	1.550823637656203
distance-from-start_min	1.550823637656203
driven_any_max	1.5511368313112863
driven_any_mean	1.5511368313112863
driven_any_median	1.5511368313112863
driven_any_min	1.5511368313112863
driven_lanedir_consec_max	0.1969462908187456
driven_lanedir_consec_mean	0.1969462908187456
driven_lanedir_consec_min	0.1969462908187456
driven_lanedir_max	0.1969462908187456
driven_lanedir_mean	0.1969462908187456
driven_lanedir_median	0.1969462908187456
driven_lanedir_min	0.1969462908187456
in-drivable-lane_max	8.700000000000014
in-drivable-lane_mean	8.700000000000014
in-drivable-lane_min	8.700000000000014
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.5511368313112863, "survival_time": 10.450000000000014, "driven_lanedir": 0.1969462908187456, "in-drivable-lane": 8.700000000000014, "deviation-heading": 0.9520924629376072, "distance-from-start": 1.550823637656203, "deviation-center-line": 0.12539072943048185, "driven_lanedir_consec": 0.1969462908187456}}
simulation-passed	1
survival_time_max	10.450000000000014
survival_time_mean	10.450000000000014
survival_time_min	10.450000000000014

No reset possible