Evaluator 54

ID	54
evaluator	`Archimede-stage-01`
owner	user1000001
machine	Archimede-stage
process	Archimede-stage-01
version	6.2.42
first heard	2022-11-16 13:05:25+00:00
last heard	2022-11-16 13:19:05+00:00
status	inactive
# evaluating
# success	1 `7922`
# timeout	1 `7927`
# failed	1 `7919`
# error
# aborted
# host-error
arm	0
x86_64	1
Mac	0
gpu available	1
Number of processors	40
Processor frequency (MHz)	2.1 GHz
Free % of processors	36%
RAM total (MB)	376.6 GB
RAM free (MB)	243.1 GB
Disk (MB)	74209.1 GB
Disk available (MB)	63576.9 GB
Docker Hub
P1	1
P2
Cloud simulations	1
PI Camera	0
# Duckiebots	0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, ETH_small_intersect
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

7927

658

Bea Baselines 🐤

template-pytorch

aido-LF-sim-testing

sim-1of4

timeout

Archimede-stage-01

2022-11-16 13:16:30+00:00

No reset possible

7922

715

Bea Baselines 🐤

template-random

aido-LF-sim-testing

sim-1of4

success

Archimede-stage-01

2022-11-16 13:08:23+00:00

2022-11-16 13:16:04+00:00

0:07:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.01242626914621503
survival_time_median	51.799999999999194
deviation-center-line_median	0.5849700317999195
in-drivable-lane_median	45.549999999999145

other stats

deviation-center-line_max	0.5849700317999195
deviation-center-line_mean	0.5849700317999195
deviation-center-line_min	0.5849700317999195
deviation-heading_max	4.775258870776771
deviation-heading_mean	4.775258870776771
deviation-heading_median	4.775258870776771
deviation-heading_min	4.775258870776771
distance-from-start_max	1.2120262829171748
distance-from-start_mean	1.2120262829171748
distance-from-start_median	1.2120262829171748
distance-from-start_min	1.2120262829171748
driven_any_max	12.878703808370847
driven_any_mean	12.878703808370847
driven_any_median	12.878703808370847
driven_any_min	12.878703808370847
driven_lanedir_consec_max	0.01242626914621503
driven_lanedir_consec_mean	0.01242626914621503
driven_lanedir_consec_min	0.01242626914621503
driven_lanedir_max	0.015772611253357494
driven_lanedir_mean	0.015772611253357494
driven_lanedir_median	0.015772611253357494
driven_lanedir_min	0.015772611253357494
in-drivable-lane_max	45.549999999999145
in-drivable-lane_mean	45.549999999999145
in-drivable-lane_min	45.549999999999145
per-episodes	details {"loop2-000-ego0": {"driven_any": 12.878703808370847, "survival_time": 51.799999999999194, "driven_lanedir": 0.015772611253357494, "in-drivable-lane": 45.549999999999145, "deviation-heading": 4.775258870776771, "distance-from-start": 1.2120262829171748, "deviation-center-line": 0.5849700317999195, "driven_lanedir_consec": 0.01242626914621503}}
simulation-passed	1
survival_time_max	51.799999999999194
survival_time_mean	51.799999999999194
survival_time_min	51.799999999999194

No reset possible

7919

672

Bea Baselines 🐤

template-tensorflow

aido-LF-sim-testing

sim-1of4

failed

Archimede-stage-01

2022-11-16 13:05:31+00:00

2022-11-16 13:08:09+00:00

0:02:38

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible