Submission 599

Submission

599

Competing

admin aborted

Challenge

aido-hello-sim-validation

User

Liam Paull

Date submitted

2021-10-30 13:50:58+00:00

Last status update

2022-11-24 07:42:12+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

sanity-check: 14836

User label

template-random

Admin priority

Blessing

n/a

User priority

14836

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

14836

sanity-check

success

2022-11-24 07:40:53+00:00

2022-11-24 07:42:00+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	0.49999999999999994
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.1920928955078125e-06
deviation-center-line_median	0.007457559042937448

other stats

deviation-center-line_max	0.007457559042937448
deviation-center-line_mean	0.007457559042937448
deviation-center-line_min	0.007457559042937448
deviation-heading_max	0.1966171946901932
deviation-heading_mean	0.1966171946901932
deviation-heading_median	0.1966171946901932
deviation-heading_min	0.1966171946901932
distance-from-start_max	6.280369834735102e-16
distance-from-start_mean	6.280369834735102e-16
distance-from-start_median	6.280369834735102e-16
distance-from-start_min	6.280369834735102e-16
driven_any_max	4.1538810900383696e-15
driven_any_mean	4.1538810900383696e-15
driven_any_median	4.1538810900383696e-15
driven_any_min	4.1538810900383696e-15
driven_lanedir_consec_max	1.1920928955078125e-06
driven_lanedir_consec_mean	1.1920928955078125e-06
driven_lanedir_consec_min	1.1920928955078125e-06
driven_lanedir_max	1.1920928955078125e-06
driven_lanedir_mean	1.1920928955078125e-06
driven_lanedir_median	1.1920928955078125e-06
driven_lanedir_min	1.1920928955078125e-06
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"scenarios-ego0": {"driven_any": 4.1538810900383696e-15, "survival_time": 0.49999999999999994, "driven_lanedir": 1.1920928955078125e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 6.280369834735102e-16, "deviation-center-line": 0.007457559042937448, "driven_lanedir_consec": 1.1920928955078125e-06}}
simulation-passed	1
survival_time_max	0.49999999999999994
survival_time_mean	0.49999999999999994
survival_time_min	0.49999999999999994

No reset possible

13701

sanity-check

error

2022-11-23 00:33:09+00:00

2022-11-23 00:34:06+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 540, in run_episode
    dynamics=robot_conf.dynamics,
AttributeError: 'ScenarioRobotSpec' object has no attribute 'dynamics'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

12338

sanity-check

success

2022-11-19 02:38:30+00:00

2022-11-19 02:39:46+00:00

0:01:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11201

sanity-check

host-error

2022-11-16 23:19:01+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11199

sanity-check

host-error

2022-11-16 23:18:47+00:00

2022-11-16 23:18:48+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11193

sanity-check

host-error

2022-11-16 23:18:29+00:00

2022-11-16 23:18:30+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11173

sanity-check

host-error

2022-11-16 23:17:15+00:00

2022-11-16 23:17:16+00:00

0:00:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

11167

sanity-check

host-error

2022-11-16 23:16:46+00:00

0:00:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 841, in get_cr
    mkdirs_thread_safe(wd)
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 16, in mkdirs_thread_safe
    mkdirs_thread_safe(cast(DirPath, head))
  File "/usr/local/lib/python3.8/dist-packages/zuper_commons/fs/zc_mkdirs.py", line 18, in mkdirs_thread_safe
    os.mkdir(dst, 0o777)
OSError: [Errno 28] No space left on device: '/tmp/ubuntu/aido-hello-sim-validation'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

7208

sanity-check

success

2021-11-03 06:14:13+00:00

2021-11-03 06:15:40+00:00

0:01:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5215

sanity-check

success

2021-10-31 19:37:51+00:00

2021-10-31 19:42:39+00:00

0:04:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

5189

sanity-check

success

2021-10-30 13:51:24+00:00

2021-10-30 13:54:38+00:00

0:03:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible