Submission 803

Submission

803

Competing

yes

Challenge

aido-hello-sim-validation

User

Bea Baselines 🐤

Date submitted

2021-11-06 20:05:50+00:00

Last status update

2022-11-29 13:18:28+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 17045

User label

challenge-aido_LF-template-ros:daffy-staging:3b1546b6959e8affea32711104eb83074ec984ea

Admin priority

Blessing

n/a

User priority

17045

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

17045

sanity-check

success

yes

2022-11-29 13:16:13+00:00

2022-11-29 13:18:18+00:00

0:02:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	0.05305156472117312
deviation-center-line_median	0.006408563471858657

other stats

deviation-center-line_max	0.006408563471858657
deviation-center-line_mean	0.006408563471858657
deviation-center-line_min	0.006408563471858657
deviation-heading_max	0.26053979126284427
deviation-heading_mean	0.26053979126284427
deviation-heading_median	0.26053979126284427
deviation-heading_min	0.26053979126284427
distance-from-start_max	0.06060612435746503
distance-from-start_mean	0.06060612435746503
distance-from-start_median	0.06060612435746503
distance-from-start_min	0.06060612435746503
driven_any_max	0.06061019352416028
driven_any_mean	0.06061019352416028
driven_any_median	0.06061019352416028
driven_any_min	0.06061019352416028
driven_lanedir_consec_max	0.05305156472117312
driven_lanedir_consec_mean	0.05305156472117312
driven_lanedir_consec_min	0.05305156472117312
driven_lanedir_max	0.05305156472117312
driven_lanedir_mean	0.05305156472117312
driven_lanedir_median	0.05305156472117312
driven_lanedir_min	0.05305156472117312
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 0.06061019352416028, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05305156472117312, "in-drivable-lane": 0.0, "deviation-heading": 0.26053979126284427, "distance-from-start": 0.06060612435746503, "deviation-center-line": 0.006408563471858657, "driven_lanedir_consec": 0.05305156472117312}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

15905

sanity-check

success

2022-11-25 12:58:52+00:00

2022-11-25 13:00:02+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

14815

sanity-check

success

2022-11-24 07:32:06+00:00

2022-11-24 07:33:13+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

13370

sanity-check

error

2022-11-22 22:46:44+00:00

2022-11-22 22:47:43+00:00

0:00:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12666

sanity-check

error

2022-11-22 18:52:03+00:00

2022-11-22 18:53:42+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11781

sanity-check

success

2022-11-17 22:43:40+00:00

2022-11-17 22:45:25+00:00

0:01:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10040

sanity-check

host-error

2022-11-16 21:56:27+00:00

2022-11-16 21:56:28+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10034

sanity-check

host-error

2022-11-16 21:56:06+00:00

2022-11-16 21:56:07+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10033

sanity-check

host-error

2022-11-16 21:55:50+00:00

2022-11-16 21:55:51+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10021

sanity-check

host-error

2022-11-16 21:55:27+00:00

2022-11-16 21:55:28+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

10015

sanity-check

host-error

2022-11-16 21:55:06+00:00

2022-11-16 21:55:07+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

8991

sanity-check

host-error

2022-11-16 20:46:52+00:00

2022-11-16 20:46:53+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

8978

sanity-check

host-error

2022-11-16 20:45:39+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 840, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7484

sanity-check

success

2021-11-06 20:07:48+00:00

2021-11-06 20:11:18+00:00

0:03:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible