Duckietown Challenges Home Challenges Submissions

Evaluator 55

ID55
evaluatorArchimede-stage-04
owneruser1000001
machineArchimede-stage
processArchimede-stage-04
version6.2.42
first heard
last heard
statusinactive
# evaluating
# success1 7920
# timeout1 7926
# failed1 7924
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors39%
RAM total (MB)376.6 GB
RAM free (MB)246.3 GB
Disk (MB)74209.1 GB
Disk available (MB)63577.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7926658Bea Baselines 🐤template-pytorchaido-LF-sim-testingsim-0of4timeoutnoArchimede-stage-04----No reset possible
7924672Bea Baselines 🐤template-tensorflowaido-LF-sim-testingsim-3of4failednoArchimede-stage-040:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7920715Bea Baselines 🐤template-randomaido-LF-sim-testingsim-3of4successnoArchimede-stage-040:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05434655109498099
survival_time_median27.600000000000257
deviation-center-line_median0.6346585919510964
in-drivable-lane_median20.050000000000185


other stats
deviation-center-line_max0.6346585919510964
deviation-center-line_mean0.6346585919510964
deviation-center-line_min0.6346585919510964
deviation-heading_max5.904235246936342
deviation-heading_mean5.904235246936342
deviation-heading_median5.904235246936342
deviation-heading_min5.904235246936342
distance-from-start_max0.7960980578554611
distance-from-start_mean0.7960980578554611
distance-from-start_median0.7960980578554611
distance-from-start_min0.7960980578554611
driven_any_max6.5764984329581075
driven_any_mean6.5764984329581075
driven_any_median6.5764984329581075
driven_any_min6.5764984329581075
driven_lanedir_consec_max0.05434655109498099
driven_lanedir_consec_mean0.05434655109498099
driven_lanedir_consec_min0.05434655109498099
driven_lanedir_max0.057693250829968346
driven_lanedir_mean0.057693250829968346
driven_lanedir_median0.057693250829968346
driven_lanedir_min0.057693250829968346
in-drivable-lane_max20.050000000000185
in-drivable-lane_mean20.050000000000185
in-drivable-lane_min20.050000000000185
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.5764984329581075, "survival_time": 27.600000000000257, "driven_lanedir": 0.057693250829968346, "in-drivable-lane": 20.050000000000185, "deviation-heading": 5.904235246936342, "distance-from-start": 0.7960980578554611, "deviation-center-line": 0.6346585919510964, "driven_lanedir_consec": 0.05434655109498099}}
simulation-passed1
survival_time_max27.600000000000257
survival_time_mean27.600000000000257
survival_time_min27.600000000000257
No reset possible