Submission 1659

Submission

1659

Competing

yes

Challenge

aido-LFP-sim-validation

User

Bea Baselines 🐤

Date submitted

2022-11-27 20:18:50+00:00

Last status update

2022-11-28 19:07:18+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sim-0of4: 16817 sim-1of4: 16818 sim-2of4: 16819 sim-3of4: 16820

User label

baseline-duckietown

Admin priority

Blessing

n/a

User priority

16820

Click the images to see detailed statistics about the episode.

zigzag-000

16819

Click the images to see detailed statistics about the episode.

loop2-000

16818

Click the images to see detailed statistics about the episode.

loop-000

16817

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges

Job ID

step

status

up to date

date started

date completed

duration

message

16820

sim-3of4

success

yes

2022-11-28 19:01:29+00:00

2022-11-28 19:07:06+00:00

0:05:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	38.19999999999997
in-drivable-lane_median	3.450000000000035
driven_lanedir_consec_median	2.954166851959711
deviation-center-line_median	2.6594588441515024

other stats

deviation-center-line_max	2.6594588441515024
deviation-center-line_mean	2.6594588441515024
deviation-center-line_min	2.6594588441515024
deviation-heading_max	10.13976566165057
deviation-heading_mean	10.13976566165057
deviation-heading_median	10.13976566165057
deviation-heading_min	10.13976566165057
distance-from-start_max	2.2180839512434787
distance-from-start_mean	2.2180839512434787
distance-from-start_median	2.2180839512434787
distance-from-start_min	2.2180839512434787
driven_any_max	4.926796333194103
driven_any_mean	4.926796333194103
driven_any_median	4.926796333194103
driven_any_min	4.926796333194103
driven_lanedir_consec_max	2.954166851959711
driven_lanedir_consec_mean	2.954166851959711
driven_lanedir_consec_min	2.954166851959711
driven_lanedir_max	4.086709715800125
driven_lanedir_mean	4.086709715800125
driven_lanedir_median	4.086709715800125
driven_lanedir_min	4.086709715800125
in-drivable-lane_max	3.450000000000035
in-drivable-lane_mean	3.450000000000035
in-drivable-lane_min	3.450000000000035
per-episodes	details {"zigzag-000-ego0": {"driven_any": 4.926796333194103, "survival_time": 38.19999999999997, "driven_lanedir": 4.086709715800125, "in-drivable-lane": 3.450000000000035, "deviation-heading": 10.13976566165057, "distance-from-start": 2.2180839512434787, "deviation-center-line": 2.6594588441515024, "driven_lanedir_consec": 2.954166851959711}}
simulation-passed	1
survival_time_max	38.19999999999997
survival_time_mean	38.19999999999997
survival_time_min	38.19999999999997

No reset possible

16819

sim-2of4

success

yes

2022-11-28 19:01:29+00:00

2022-11-28 19:03:53+00:00

0:02:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	9.299999999999995
in-drivable-lane_median	2.1000000000000147
driven_lanedir_consec_median	0.862787926971639
deviation-center-line_median	0.26187930037806706

other stats

deviation-center-line_max	0.26187930037806706
deviation-center-line_mean	0.26187930037806706
deviation-center-line_min	0.26187930037806706
deviation-heading_max	1.4589397629719076
deviation-heading_mean	1.4589397629719076
deviation-heading_median	1.4589397629719076
deviation-heading_min	1.4589397629719076
distance-from-start_max	0.7840818000130989
distance-from-start_mean	0.7840818000130989
distance-from-start_median	0.7840818000130989
distance-from-start_min	0.7840818000130989
driven_any_max	1.0834018058914796
driven_any_mean	1.0834018058914796
driven_any_median	1.0834018058914796
driven_any_min	1.0834018058914796
driven_lanedir_consec_max	0.862787926971639
driven_lanedir_consec_mean	0.862787926971639
driven_lanedir_consec_min	0.862787926971639
driven_lanedir_max	0.862787926971639
driven_lanedir_mean	0.862787926971639
driven_lanedir_median	0.862787926971639
driven_lanedir_min	0.862787926971639
in-drivable-lane_max	2.1000000000000147
in-drivable-lane_mean	2.1000000000000147
in-drivable-lane_min	2.1000000000000147
per-episodes	details {"loop2-000-ego0": {"driven_any": 1.0834018058914796, "survival_time": 9.299999999999995, "driven_lanedir": 0.862787926971639, "in-drivable-lane": 2.1000000000000147, "deviation-heading": 1.4589397629719076, "distance-from-start": 0.7840818000130989, "deviation-center-line": 0.26187930037806706, "driven_lanedir_consec": 0.862787926971639}}
simulation-passed	1
survival_time_max	9.299999999999995
survival_time_mean	9.299999999999995
survival_time_min	9.299999999999995

No reset possible

16818

sim-1of4

success

yes

2022-11-28 19:01:28+00:00

2022-11-28 19:05:28+00:00

0:04:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	29.80000000000029
in-drivable-lane_median	0.9999999999999976
driven_lanedir_consec_median	3.521615492692299
deviation-center-line_median	2.6036507154536497

other stats

deviation-center-line_max	2.6036507154536497
deviation-center-line_mean	2.6036507154536497
deviation-center-line_min	2.6036507154536497
deviation-heading_max	5.904872263386404
deviation-heading_mean	5.904872263386404
deviation-heading_median	5.904872263386404
deviation-heading_min	5.904872263386404
distance-from-start_max	2.011743621108002
distance-from-start_mean	2.011743621108002
distance-from-start_median	2.011743621108002
distance-from-start_min	2.011743621108002
driven_any_max	3.8052016795805614
driven_any_mean	3.8052016795805614
driven_any_median	3.8052016795805614
driven_any_min	3.8052016795805614
driven_lanedir_consec_max	3.521615492692299
driven_lanedir_consec_mean	3.521615492692299
driven_lanedir_consec_min	3.521615492692299
driven_lanedir_max	3.521615492692299
driven_lanedir_mean	3.521615492692299
driven_lanedir_median	3.521615492692299
driven_lanedir_min	3.521615492692299
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.9999999999999976
in-drivable-lane_min	0.9999999999999976
per-episodes	details {"loop-000-ego0": {"driven_any": 3.8052016795805614, "survival_time": 29.80000000000029, "driven_lanedir": 3.521615492692299, "in-drivable-lane": 0.9999999999999976, "deviation-heading": 5.904872263386404, "distance-from-start": 2.011743621108002, "deviation-center-line": 2.6036507154536497, "driven_lanedir_consec": 3.521615492692299}}
simulation-passed	1
survival_time_max	29.80000000000029
survival_time_mean	29.80000000000029
survival_time_min	29.80000000000029

No reset possible

16817

sim-0of4

success

yes

2022-11-28 18:58:37+00:00

2022-11-28 19:01:03+00:00

0:02:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.450000000000028
in-drivable-lane_median	0.9000000000000039
driven_lanedir_consec_median	1.212607488054101
deviation-center-line_median	0.59567667517759

other stats

deviation-center-line_max	0.59567667517759
deviation-center-line_mean	0.59567667517759
deviation-center-line_min	0.59567667517759
deviation-heading_max	2.2927680187792574
deviation-heading_mean	2.2927680187792574
deviation-heading_median	2.2927680187792574
deviation-heading_min	2.2927680187792574
distance-from-start_max	1.166525006811424
distance-from-start_mean	1.166525006811424
distance-from-start_median	1.166525006811424
distance-from-start_min	1.166525006811424
driven_any_max	1.3755123265727172
driven_any_mean	1.3755123265727172
driven_any_median	1.3755123265727172
driven_any_min	1.3755123265727172
driven_lanedir_consec_max	1.212607488054101
driven_lanedir_consec_mean	1.212607488054101
driven_lanedir_consec_min	1.212607488054101
driven_lanedir_max	1.212607488054101
driven_lanedir_mean	1.212607488054101
driven_lanedir_median	1.212607488054101
driven_lanedir_min	1.212607488054101
in-drivable-lane_max	0.9000000000000039
in-drivable-lane_mean	0.9000000000000039
in-drivable-lane_min	0.9000000000000039
per-episodes	details {"autolab-000-ego0": {"driven_any": 1.3755123265727172, "survival_time": 11.450000000000028, "driven_lanedir": 1.212607488054101, "in-drivable-lane": 0.9000000000000039, "deviation-heading": 2.2927680187792574, "distance-from-start": 1.166525006811424, "deviation-center-line": 0.59567667517759, "driven_lanedir_consec": 1.212607488054101}}
simulation-passed	1
survival_time_max	11.450000000000028
survival_time_mean	11.450000000000028
survival_time_min	11.450000000000028

No reset possible