Submission 797

Submission

797

Competing

yes

Challenge

aido-hello-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-03 15:00:14+00:00

Last status update

2022-11-29 13:18:28+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 17046

User label

challenge-aido_LF-template-ros:daffy-staging:9c5ebcaaac3c2c24fe955f2dfc9f86ef7741bb3d

Admin priority

Blessing

n/a

User priority

17046

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

17046

sanity-check

success

yes

2022-11-29 13:16:14+00:00

2022-11-29 13:18:05+00:00

0:01:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.04976153604225919
deviation-center-line_median	0.006527887863951426

other stats

deviation-center-line_max	0.006527887863951426
deviation-center-line_mean	0.006527887863951426
deviation-center-line_min	0.006527887863951426
deviation-heading_max	0.2703592668848383
deviation-heading_mean	0.2703592668848383
deviation-heading_median	0.2703592668848383
deviation-heading_min	0.2703592668848383
distance-from-start_max	0.05808520229604176
distance-from-start_mean	0.05808520229604176
distance-from-start_median	0.05808520229604176
distance-from-start_min	0.05808520229604176
driven_any_max	0.05808658971291994
driven_any_mean	0.05808658971291994
driven_any_median	0.05808658971291994
driven_any_min	0.05808658971291994
driven_lanedir_consec_max	0.04976153604225919
driven_lanedir_consec_mean	0.04976153604225919
driven_lanedir_consec_min	0.04976153604225919
driven_lanedir_max	0.04976153604225919
driven_lanedir_mean	0.04976153604225919
driven_lanedir_median	0.04976153604225919
driven_lanedir_min	0.04976153604225919
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.05808658971291994, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04976153604225919, "in-drivable-lane": 0.0, "deviation-heading": 0.2703592668848383, "distance-from-start": 0.05808520229604176, "deviation-center-line": 0.006527887863951426, "driven_lanedir_consec": 0.04976153604225919}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

15907

sanity-check

success

2022-11-25 13:00:01+00:00

2022-11-25 13:01:10+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14824

sanity-check

success

2022-11-24 07:36:07+00:00

2022-11-24 07:37:21+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13379

sanity-check

error

2022-11-22 22:49:17+00:00

2022-11-22 22:50:13+00:00

0:00:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11792

sanity-check

success

2022-11-17 22:47:17+00:00

2022-11-17 22:50:15+00:00

0:02:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10044

sanity-check

host-error

2022-11-16 21:56:46+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10041

sanity-check

host-error

2022-11-16 21:56:29+00:00

2022-11-16 21:56:30+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10037

sanity-check

host-error

2022-11-16 21:56:09+00:00

2022-11-16 21:56:10+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10028

sanity-check

host-error

2022-11-16 21:55:46+00:00

2022-11-16 21:55:47+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10022

sanity-check

host-error

2022-11-16 21:55:28+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

8994

sanity-check

host-error

2022-11-16 20:47:14+00:00

2022-11-16 20:47:15+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

8984

sanity-check

host-error

2022-11-16 20:46:00+00:00

2022-11-16 20:46:01+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7469

sanity-check

success

2021-11-03 15:07:00+00:00

2021-11-03 15:08:04+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7468

sanity-check

success

2021-11-03 15:03:57+00:00

2021-11-03 15:07:48+00:00

0:03:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7467

sanity-check

success

2021-11-03 15:03:25+00:00

2021-11-03 15:07:51+00:00

0:04:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7466

sanity-check

success

2021-11-03 15:02:55+00:00

2021-11-03 15:06:36+00:00

0:03:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible