Submission 539

Submission

539

Competing

yes

Challenge

aido-LFI-sim-testing

User

Bea Baselines 🐤

Date submitted

2021-10-23 16:42:07+00:00

Last status update

2022-11-29 13:29:42+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💔

Jobs

sim-0of4: 17064 sim-1of4: 17067 sim-2of4: 17068 sim-3of4: 17066

User label

baseline-dagger-pytorch

Admin priority

Blessing

n/a

User priority

17067

Click the images to see detailed statistics about the episode.

udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

17068

sim-2of4

success

yes

2022-11-29 13:22:26+00:00

2022-11-29 13:23:55+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17067

sim-1of4

success

yes

2022-11-29 13:21:43+00:00

2022-11-29 13:29:08+00:00

0:07:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	31.20000000000031
in-drivable-lane_median	0.7499999999999973
driven_lanedir_consec_median	4.829726783576551
deviation-center-line_median	1.8680732120759147

other stats

deviation-center-line_max	1.8680732120759147
deviation-center-line_mean	1.8680732120759147
deviation-center-line_min	1.8680732120759147
deviation-heading_max	9.213467062751567
deviation-heading_mean	9.213467062751567
deviation-heading_median	9.213467062751567
deviation-heading_min	9.213467062751567
distance-from-start_max	2.9107788765001237
distance-from-start_mean	2.9107788765001237
distance-from-start_median	2.9107788765001237
distance-from-start_min	2.9107788765001237
driven_any_max	5.264732605160545
driven_any_mean	5.264732605160545
driven_any_median	5.264732605160545
driven_any_min	5.264732605160545
driven_lanedir_consec_max	4.829726783576551
driven_lanedir_consec_mean	4.829726783576551
driven_lanedir_consec_min	4.829726783576551
driven_lanedir_max	4.841538225151944
driven_lanedir_mean	4.841538225151944
driven_lanedir_median	4.841538225151944
driven_lanedir_min	4.841538225151944
in-drivable-lane_max	0.7499999999999973
in-drivable-lane_mean	0.7499999999999973
in-drivable-lane_min	0.7499999999999973
per-episodes	details {"udem1-000-ego0": {"driven_any": 5.264732605160545, "survival_time": 31.20000000000031, "driven_lanedir": 4.841538225151944, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 9.213467062751567, "distance-from-start": 2.9107788765001237, "deviation-center-line": 1.8680732120759147, "driven_lanedir_consec": 4.829726783576551}}
simulation-passed	1
survival_time_max	31.20000000000031
survival_time_mean	31.20000000000031
survival_time_min	31.20000000000031

No reset possible

17066

sim-3of4

success

yes

2022-11-29 13:21:38+00:00

2022-11-29 13:23:10+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

17064

sim-0of4

failed

yes

2022-11-29 13:21:11+00:00

2022-11-29 13:22:40+00:00

0:01:29

The container "solut [...]

The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

15930

sim-2of4

success

2022-11-25 13:15:21+00:00

2022-11-25 13:17:38+00:00

0:02:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

15928

sim-3of4

success

2022-11-25 13:13:21+00:00

2022-11-25 13:15:12+00:00

0:01:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

15927

sim-0of4

success

2022-11-25 13:11:04+00:00

2022-11-25 13:13:06+00:00

0:02:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

15926

sim-1of4

success

2022-11-25 13:09:40+00:00

2022-11-25 13:17:33+00:00

0:07:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14855

sim-3of4

success

2022-11-24 07:52:22+00:00

2022-11-24 07:53:51+00:00

0:01:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14854

sim-2of4

success

2022-11-24 07:51:16+00:00

2022-11-24 07:53:10+00:00

0:01:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14853

sim-1of4

success

2022-11-24 07:51:16+00:00

2022-11-24 07:55:01+00:00

0:03:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14852

sim-0of4

success

2022-11-24 07:50:18+00:00

2022-11-24 07:57:07+00:00

0:06:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13720

sim-1of4

error

2022-11-23 00:38:12+00:00

2022-11-23 00:39:37+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13718

sim-0of4

error

2022-11-23 00:37:20+00:00

2022-11-23 00:38:45+00:00

0:01:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13717

sim-3of4

success

2022-11-23 00:37:17+00:00

2022-11-23 00:38:48+00:00

0:01:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13716

sim-2of4

success

2022-11-23 00:36:55+00:00

2022-11-23 00:38:25+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12363

sim-0of4

success

2022-11-19 03:02:17+00:00

2022-11-19 03:04:04+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12361

sim-1of4

success

2022-11-19 03:01:24+00:00

2022-11-19 03:05:13+00:00

0:03:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12360

sim-2of4

success

2022-11-19 03:01:23+00:00

2022-11-19 03:03:21+00:00

0:01:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12358

sim-3of4

success

2022-11-19 02:58:09+00:00

2022-11-19 03:01:08+00:00

0:02:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7290

sim-0of4

success

2021-11-03 06:39:42+00:00

2021-11-03 06:42:26+00:00

0:02:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7289

sim-3of4

success

2021-11-03 06:39:26+00:00

2021-11-03 06:40:56+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7286

sim-2of4

success

2021-11-03 06:39:00+00:00

2021-11-03 06:40:32+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7284

sim-1of4

success

2021-11-03 06:38:21+00:00

2021-11-03 06:40:11+00:00

0:01:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6080

sim-2of4

success

2021-11-01 03:28:32+00:00

2021-11-01 03:30:05+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6079

sim-1of4

success

2021-11-01 03:28:13+00:00

2021-11-01 03:29:59+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6078

sim-0of4

success

2021-11-01 03:27:53+00:00

2021-11-01 03:32:41+00:00

0:04:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6077

sim-3of4

success

2021-11-01 03:26:46+00:00

2021-11-01 03:28:19+00:00

0:01:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4473

sim-2of4

success

2021-10-23 19:26:49+00:00

2021-10-23 19:28:31+00:00

0:01:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4472

sim-3of4

success

2021-10-23 19:26:45+00:00

2021-10-23 19:28:15+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4470

sim-1of4

success

2021-10-23 19:26:23+00:00

2021-10-23 19:28:12+00:00

0:01:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

4468

sim-0of4

success

2021-10-23 19:26:04+00:00

2021-10-23 19:29:01+00:00

0:02:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible