Submission 764

Submission

764

Competing

yes

Challenge

aido-hello-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-10-31 23:10:09+00:00

Last status update

2022-11-29 13:20:28+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 17052

User label

challenge-aido_LF-baseline-duckietown:daffy:d0c3b9f200e160334a96bdb0f91745327be57194

Admin priority

Blessing

n/a

User priority

17052

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

17052

sanity-check

success

yes

2022-11-29 13:18:25+00:00

2022-11-29 13:20:18+00:00

0:01:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.01321925883757702
deviation-center-line_median	0.006547555220619863

other stats

deviation-center-line_max	0.006547555220619863
deviation-center-line_mean	0.006547555220619863
deviation-center-line_min	0.006547555220619863
deviation-heading_max	0.26438221729272254
deviation-heading_mean	0.26438221729272254
deviation-heading_median	0.26438221729272254
deviation-heading_min	0.26438221729272254
distance-from-start_max	0.015079702740142396
distance-from-start_mean	0.015079702740142396
distance-from-start_median	0.015079702740142396
distance-from-start_min	0.015079702740142396
driven_any_max	0.0150845296061755
driven_any_mean	0.0150845296061755
driven_any_median	0.0150845296061755
driven_any_min	0.0150845296061755
driven_lanedir_consec_max	0.01321925883757702
driven_lanedir_consec_mean	0.01321925883757702
driven_lanedir_consec_min	0.01321925883757702
driven_lanedir_max	0.01321925883757702
driven_lanedir_mean	0.01321925883757702
driven_lanedir_median	0.01321925883757702
driven_lanedir_min	0.01321925883757702
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.0150845296061755, "survival_time": 0.49999999999999994, "driven_lanedir": 0.01321925883757702, "in-drivable-lane": 0.0, "deviation-heading": 0.26438221729272254, "distance-from-start": 0.015079702740142396, "deviation-center-line": 0.006547555220619863, "driven_lanedir_consec": 0.01321925883757702}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

15915

sanity-check

success

2022-11-25 13:01:52+00:00

2022-11-25 13:03:01+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14831

sanity-check

success

2022-11-24 07:39:02+00:00

2022-11-24 07:40:24+00:00

0:01:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13438

sanity-check

error

2022-11-22 23:08:35+00:00

2022-11-22 23:09:35+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11927

sanity-check

success

2022-11-18 20:53:29+00:00

2022-11-18 20:55:17+00:00

0:01:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10057

sanity-check

host-error

2022-11-16 21:57:27+00:00

2022-11-16 21:57:28+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10052

sanity-check

host-error

2022-11-16 21:57:08+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10045

sanity-check

host-error

2022-11-16 21:56:47+00:00

2022-11-16 21:56:48+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10042

sanity-check

host-error

2022-11-16 21:56:29+00:00

2022-11-16 21:56:30+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10035

sanity-check

host-error

2022-11-16 21:56:07+00:00

2022-11-16 21:56:08+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

9000

sanity-check

host-error

2022-11-16 20:47:48+00:00

2022-11-16 20:47:49+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

8988

sanity-check

host-error

2022-11-16 20:46:29+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

6252

sanity-check

success

2021-11-02 17:59:53+00:00

2021-11-02 18:03:05+00:00

0:03:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5635

sanity-check

success

2021-10-31 23:44:09+00:00

2021-10-31 23:47:06+00:00

0:02:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible